2025-12-04 11:53:07.397626 | Job console starting... 2025-12-04 11:53:07.614759 | Updating repositories 2025-12-04 11:53:08.320463 | Preparing job workspace 2025-12-04 11:53:15.173276 | Running Ansible setup... 2025-12-04 11:53:18.835057 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-04 11:53:19.350226 | 2025-12-04 11:53:19.350327 | PLAY [localhost] 2025-12-04 11:53:19.358263 | 2025-12-04 11:53:19.358327 | TASK [Gathering Facts] 2025-12-04 11:53:20.143076 | localhost | ok 2025-12-04 11:53:20.155439 | 2025-12-04 11:53:20.155515 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-12-04 11:53:20.466347 | localhost -> localhost | changed 2025-12-04 11:53:20.471678 | 2025-12-04 11:53:20.471751 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-12-04 11:53:21.144963 | localhost -> localhost | changed 2025-12-04 11:53:21.153140 | 2025-12-04 11:53:21.153209 | TASK [Setup log path fact] 2025-12-04 11:53:21.170585 | localhost | ok 2025-12-04 11:53:21.181419 | 2025-12-04 11:53:21.181484 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-04 11:53:21.208293 | localhost | ok 2025-12-04 11:53:21.217565 | 2025-12-04 11:53:21.217703 | TASK [emit-job-header : Print job information] 2025-12-04 11:53:21.246518 | # Job Information 2025-12-04 11:53:21.246637 | Ansible Version: 2.15.12 2025-12-04 11:53:21.246698 | Job: cifmw-molecule-reproducer 2025-12-04 11:53:21.246725 | Pipeline: github-check 2025-12-04 11:53:21.246747 | Executor: ibm-bm3-ze.softwarefactory-project.io 2025-12-04 11:53:21.246767 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3530 2025-12-04 11:53:21.246788 | Log URL (when completed): https://logserver.rdoproject.org/0eb/rdoproject.org/0eb1bc396fbe48c99260d746275559ee/ 2025-12-04 11:53:21.246807 | Event ID: a7ce0b40-d107-11f0-8a70-855dc4781684 2025-12-04 11:53:21.250068 | 2025-12-04 11:53:21.250127 | LOOP [emit-job-header : Print node information] 2025-12-04 11:53:21.332882 | localhost | ok: 2025-12-04 11:53:21.333110 | localhost | # Node Information 2025-12-04 11:53:21.333141 | localhost | Inventory Hostname: controller 2025-12-04 11:53:21.333165 | localhost | Hostname: np0005545553 2025-12-04 11:53:21.333184 | localhost | Username: zuul 2025-12-04 11:53:21.333203 | localhost | Distro: CentOS 9 2025-12-04 11:53:21.333220 | localhost | Provider: ibm-bm3-nodepool 2025-12-04 11:53:21.333236 | localhost | Region: regionOne 2025-12-04 11:53:21.333253 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-12-04 11:53:21.333271 | localhost | Product Name: OpenStack Compute 2025-12-04 11:53:21.333287 | localhost | Interface IP: 192.168.25.58 2025-12-04 11:53:21.351843 | 2025-12-04 11:53:21.351922 | PLAY [all] 2025-12-04 11:53:21.357584 | 2025-12-04 11:53:21.357641 | TASK [Gather network facts] 2025-12-04 11:53:21.815645 | controller | ok 2025-12-04 11:53:21.829498 | 2025-12-04 11:53:21.829568 | TASK [include_role : start-zuul-console] 2025-12-04 11:53:21.847765 | controller | ok 2025-12-04 11:53:21.857936 | 2025-12-04 11:53:21.857993 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-12-04 11:53:22.239154 | controller | ok 2025-12-04 11:53:22.255471 | 2025-12-04 11:53:22.255542 | TASK [include_role : add-build-sshkey] 2025-12-04 11:53:22.272559 | controller | ok 2025-12-04 11:53:22.284735 | 2025-12-04 11:53:22.284801 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-12-04 11:53:22.481481 | controller -> localhost | ok 2025-12-04 11:53:22.493055 | 2025-12-04 11:53:22.493123 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-12-04 11:53:22.511410 | controller | ok 2025-12-04 11:53:22.523017 | controller | included: /var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-12-04 11:53:22.528129 | 2025-12-04 11:53:22.528189 | TASK [add-build-sshkey : Create Temp SSH key] 2025-12-04 11:53:23.131925 | controller -> localhost | Generating public/private rsa key pair. 2025-12-04 11:53:23.132107 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/0eb1bc396fbe48c99260d746275559ee_id_rsa. 2025-12-04 11:53:23.132139 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/0eb1bc396fbe48c99260d746275559ee_id_rsa.pub. 2025-12-04 11:53:23.132161 | controller -> localhost | The key fingerprint is: 2025-12-04 11:53:23.132180 | controller -> localhost | SHA256:TTKAPrq4wRALVJZFSpvuwYocHCC516qy0qGGjI7r3/Q zuul-build-sshkey 2025-12-04 11:53:23.132199 | controller -> localhost | The key's randomart image is: 2025-12-04 11:53:23.132217 | controller -> localhost | +---[RSA 3072]----+ 2025-12-04 11:53:23.132234 | controller -> localhost | |oo.+++. | 2025-12-04 11:53:23.132253 | controller -> localhost | |= o.= . | 2025-12-04 11:53:23.132272 | controller -> localhost | |oo * o . | 2025-12-04 11:53:23.132291 | controller -> localhost | |+o= + = | 2025-12-04 11:53:23.132309 | controller -> localhost | |o+ * . S . | 2025-12-04 11:53:23.132326 | controller -> localhost | |= B . | 2025-12-04 11:53:23.132343 | controller -> localhost | |*O + . | 2025-12-04 11:53:23.132361 | controller -> localhost | |X+o o . | 2025-12-04 11:53:23.132378 | controller -> localhost | |@*.. . E | 2025-12-04 11:53:23.132397 | controller -> localhost | +----[SHA256]-----+ 2025-12-04 11:53:23.132437 | controller -> localhost | ok: Runtime: 0:00:00.291010 2025-12-04 11:53:23.137874 | 2025-12-04 11:53:23.137938 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-12-04 11:53:23.155445 | controller | ok 2025-12-04 11:53:23.164240 | controller | included: /var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-12-04 11:53:23.171696 | 2025-12-04 11:53:23.171755 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-12-04 11:53:23.185814 | controller | skipping: Conditional result was False 2025-12-04 11:53:23.191847 | 2025-12-04 11:53:23.191921 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-12-04 11:53:23.675369 | controller | changed 2025-12-04 11:53:23.680151 | 2025-12-04 11:53:23.680213 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-12-04 11:53:23.962494 | controller | ok 2025-12-04 11:53:23.967358 | 2025-12-04 11:53:23.967434 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-12-04 11:53:25.236767 | controller | changed 2025-12-04 11:53:25.241922 | 2025-12-04 11:53:25.241988 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-12-04 11:53:26.447077 | controller | changed 2025-12-04 11:53:26.451759 | 2025-12-04 11:53:26.451828 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-12-04 11:53:26.465160 | controller | skipping: Conditional result was False 2025-12-04 11:53:26.470496 | 2025-12-04 11:53:26.470558 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-12-04 11:53:26.767677 | controller -> localhost | changed 2025-12-04 11:53:26.776345 | 2025-12-04 11:53:26.776412 | TASK [add-build-sshkey : Add back temp key] 2025-12-04 11:53:27.002515 | controller -> localhost | Identity added: /var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/0eb1bc396fbe48c99260d746275559ee_id_rsa (zuul-build-sshkey) 2025-12-04 11:53:27.002705 | controller -> localhost | ok: Runtime: 0:00:00.006162 2025-12-04 11:53:27.007963 | 2025-12-04 11:53:27.008018 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-12-04 11:53:27.361490 | controller | ok 2025-12-04 11:53:27.365623 | 2025-12-04 11:53:27.365698 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-12-04 11:53:27.389270 | controller | skipping: Conditional result was False 2025-12-04 11:53:27.397952 | 2025-12-04 11:53:27.398031 | TASK [include_role : validate-host] 2025-12-04 11:53:27.414863 | controller | ok 2025-12-04 11:53:27.432622 | 2025-12-04 11:53:27.432865 | TASK [validate-host : Define zuul_info_dir fact] 2025-12-04 11:53:27.461467 | controller | ok 2025-12-04 11:53:27.465888 | 2025-12-04 11:53:27.465953 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-12-04 11:53:27.663020 | controller -> localhost | ok 2025-12-04 11:53:27.668288 | 2025-12-04 11:53:27.668348 | TASK [validate-host : Collect information about the host] 2025-12-04 11:53:28.404260 | controller | ok 2025-12-04 11:53:28.411816 | 2025-12-04 11:53:28.411877 | TASK [validate-host : Sanitize hostname] 2025-12-04 11:53:28.450560 | controller | ok 2025-12-04 11:53:28.455174 | 2025-12-04 11:53:28.455237 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-12-04 11:53:28.802890 | controller -> localhost | changed 2025-12-04 11:53:28.808043 | 2025-12-04 11:53:28.808125 | TASK [validate-host : Collect information about zuul worker] 2025-12-04 11:53:29.205137 | controller | ok 2025-12-04 11:53:29.209683 | 2025-12-04 11:53:29.209750 | TASK [validate-host : Write out all zuul information for each host] 2025-12-04 11:53:29.608978 | controller -> localhost | changed 2025-12-04 11:53:29.617904 | 2025-12-04 11:53:29.617969 | TASK [include_role : prepare-workspace-openshift] 2025-12-04 11:53:29.636697 | controller | skipping: Conditional result was False 2025-12-04 11:53:29.641163 | 2025-12-04 11:53:29.641222 | TASK [include_role : remove-zuul-sshkey] 2025-12-04 11:53:29.654104 | controller | skipping: Conditional result was False 2025-12-04 11:53:29.658601 | 2025-12-04 11:53:29.658685 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-12-04 11:53:29.937617 | controller | ok: "logs" 2025-12-04 11:53:29.937862 | controller | ok: All items complete 2025-12-04 11:53:29.937890 | 2025-12-04 11:53:30.180832 | controller | ok: "artifacts" 2025-12-04 11:53:30.433160 | controller | ok: "docs" 2025-12-04 11:53:30.439722 | 2025-12-04 11:53:30.439790 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-12-04 11:53:30.724921 | controller | changed: "logs" 2025-12-04 11:53:30.992615 | controller | changed: "artifacts" 2025-12-04 11:53:31.240344 | controller | changed: "docs" 2025-12-04 11:53:31.263559 | 2025-12-04 11:53:31.263631 | PLAY RECAP 2025-12-04 11:53:31.263694 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-04 11:53:31.263724 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-04 11:53:31.263744 | 2025-12-04 11:53:31.332110 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-04 11:53:31.332899 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-04 11:53:31.839433 | 2025-12-04 11:53:31.839543 | PLAY [all] 2025-12-04 11:53:31.859284 | 2025-12-04 11:53:31.859355 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-04 11:53:31.908134 | controller | ok 2025-12-04 11:53:31.912837 | 2025-12-04 11:53:31.912912 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-04 11:53:32.336061 | controller | changed 2025-12-04 11:53:32.341356 | 2025-12-04 11:53:32.341427 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-04 11:53:33.735952 | controller | changed 2025-12-04 11:53:33.745453 | 2025-12-04 11:53:33.745522 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-12-04 11:53:34.199205 | controller | changed: 2025-12-04 11:53:34.199366 | controller | { 2025-12-04 11:53:34.199399 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-12-04 11:53:34.199430 | controller | } 2025-12-04 11:53:34.523582 | controller | changed: 2025-12-04 11:53:34.523693 | controller | { 2025-12-04 11:53:34.523727 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-12-04 11:53:34.523750 | controller | } 2025-12-04 11:53:34.817011 | controller | changed: 2025-12-04 11:53:34.817109 | controller | { 2025-12-04 11:53:34.817140 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-12-04 11:53:34.817164 | controller | } 2025-12-04 11:53:35.145702 | controller | changed: 2025-12-04 11:53:35.145803 | controller | { 2025-12-04 11:53:35.145831 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-12-04 11:53:35.145851 | controller | } 2025-12-04 11:53:35.446298 | controller | changed: 2025-12-04 11:53:35.446403 | controller | { 2025-12-04 11:53:35.446430 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-12-04 11:53:35.446449 | controller | } 2025-12-04 11:53:35.746535 | controller | changed: 2025-12-04 11:53:35.746618 | controller | { 2025-12-04 11:53:35.746716 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-12-04 11:53:35.746839 | controller | } 2025-12-04 11:53:36.066558 | controller | changed: 2025-12-04 11:53:36.066628 | controller | { 2025-12-04 11:53:36.066676 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-12-04 11:53:36.066702 | controller | } 2025-12-04 11:53:36.375688 | controller | changed: 2025-12-04 11:53:36.375759 | controller | { 2025-12-04 11:53:36.375786 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-12-04 11:53:36.375807 | controller | } 2025-12-04 11:53:36.676348 | controller | changed: 2025-12-04 11:53:36.676427 | controller | { 2025-12-04 11:53:36.676454 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-12-04 11:53:36.676474 | controller | } 2025-12-04 11:53:36.987085 | controller | changed: 2025-12-04 11:53:36.987159 | controller | { 2025-12-04 11:53:36.987186 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-12-04 11:53:36.987207 | controller | } 2025-12-04 11:53:37.285967 | controller | changed: 2025-12-04 11:53:37.286076 | controller | { 2025-12-04 11:53:37.286103 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-12-04 11:53:37.286124 | controller | } 2025-12-04 11:53:37.577685 | controller | changed: 2025-12-04 11:53:37.577795 | controller | { 2025-12-04 11:53:37.577823 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-12-04 11:53:37.577844 | controller | } 2025-12-04 11:53:37.885060 | controller | changed: 2025-12-04 11:53:37.885142 | controller | { 2025-12-04 11:53:37.885169 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-12-04 11:53:37.885189 | controller | } 2025-12-04 11:53:38.200870 | controller | changed: 2025-12-04 11:53:38.200936 | controller | { 2025-12-04 11:53:38.200963 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-12-04 11:53:38.200983 | controller | } 2025-12-04 11:53:38.509807 | controller | changed: 2025-12-04 11:53:38.509889 | controller | { 2025-12-04 11:53:38.509915 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-12-04 11:53:38.509936 | controller | } 2025-12-04 11:53:38.821697 | controller | changed: 2025-12-04 11:53:38.821751 | controller | { 2025-12-04 11:53:38.821774 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-12-04 11:53:38.821792 | controller | } 2025-12-04 11:53:39.128569 | controller | changed: 2025-12-04 11:53:39.129270 | controller | { 2025-12-04 11:53:39.129306 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-12-04 11:53:39.129337 | controller | } 2025-12-04 11:53:39.461265 | controller | changed: 2025-12-04 11:53:39.461351 | controller | { 2025-12-04 11:53:39.461379 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-12-04 11:53:39.461408 | controller | } 2025-12-04 11:53:39.781863 | controller | changed: 2025-12-04 11:53:39.781934 | controller | { 2025-12-04 11:53:39.781962 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-12-04 11:53:39.781982 | controller | } 2025-12-04 11:53:40.092503 | controller | changed: 2025-12-04 11:53:40.092695 | controller | { 2025-12-04 11:53:40.092731 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-12-04 11:53:40.092762 | controller | } 2025-12-04 11:53:40.399210 | controller | changed: 2025-12-04 11:53:40.399307 | controller | { 2025-12-04 11:53:40.399333 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-12-04 11:53:40.399353 | controller | } 2025-12-04 11:53:40.707850 | controller | changed: 2025-12-04 11:53:40.707937 | controller | { 2025-12-04 11:53:40.707963 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-12-04 11:53:40.707984 | controller | } 2025-12-04 11:53:41.014459 | controller | changed: 2025-12-04 11:53:41.014685 | controller | { 2025-12-04 11:53:41.014722 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-12-04 11:53:41.014745 | controller | } 2025-12-04 11:53:41.338768 | controller | changed: 2025-12-04 11:53:41.338856 | controller | { 2025-12-04 11:53:41.338881 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-12-04 11:53:41.338899 | controller | } 2025-12-04 11:53:41.684248 | controller | changed: 2025-12-04 11:53:41.684410 | controller | { 2025-12-04 11:53:41.684445 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-12-04 11:53:41.684465 | controller | } 2025-12-04 11:53:42.039193 | controller | changed: 2025-12-04 11:53:42.039270 | controller | { 2025-12-04 11:53:42.039303 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-12-04 11:53:42.039324 | controller | } 2025-12-04 11:53:42.059772 | 2025-12-04 11:53:42.060320 | TASK [Set timezone to UTC] 2025-12-04 11:53:42.658806 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-12-04 11:53:42.663409 | 2025-12-04 11:53:42.663472 | TASK [Create nodepool directory] 2025-12-04 11:53:42.967317 | controller | changed 2025-12-04 11:53:42.972495 | 2025-12-04 11:53:42.972557 | TASK [Create nodepool sub_nodes file] 2025-12-04 11:53:44.087792 | controller | changed 2025-12-04 11:53:44.093384 | 2025-12-04 11:53:44.093452 | TASK [Create nodepool sub_nodes_private file] 2025-12-04 11:53:45.188494 | controller | changed 2025-12-04 11:53:45.193354 | 2025-12-04 11:53:45.193417 | LOOP [Populate nodepool sub_nodes file] 2025-12-04 11:53:45.222870 | 2025-12-04 11:53:45.223022 | LOOP [Populate nodepool sub_nodes_private file] 2025-12-04 11:53:45.251537 | 2025-12-04 11:53:45.251682 | TASK [Create nodepool primary file] 2025-12-04 11:53:45.274925 | controller | skipping: Conditional result was False 2025-12-04 11:53:45.279996 | 2025-12-04 11:53:45.280075 | TASK [Create nodepool node_private for this node] 2025-12-04 11:53:46.433324 | controller | changed 2025-12-04 11:53:46.438532 | 2025-12-04 11:53:46.438590 | LOOP [Copy ssh keys to nodepool directory] 2025-12-04 11:53:46.828504 | controller | ok: Item: id_rsa Runtime: 0:00:00.006803 2025-12-04 11:53:46.828801 | 2025-12-04 11:53:47.073610 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.006305 2025-12-04 11:53:47.079624 | 2025-12-04 11:53:47.079752 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-12-04 11:53:48.195805 | controller | changed 2025-12-04 11:53:48.200396 | 2025-12-04 11:53:48.200455 | TASK [Validate sudoers config after edits] 2025-12-04 11:53:48.499427 | controller | /etc/sudoers: parsed OK 2025-12-04 11:53:48.499518 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-12-04 11:53:48.499599 | controller | /etc/sudoers.d/zuul: parsed OK 2025-12-04 11:53:48.499608 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-12-04 11:53:48.725761 | controller | ok: Runtime: 0:00:00.006915 2025-12-04 11:53:48.730627 | 2025-12-04 11:53:48.730705 | TASK [Show the environment passed in to job shell scripts] 2025-12-04 11:53:49.011846 | controller | SHELL=/bin/bash 2025-12-04 11:53:49.011904 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-12-04 11:53:49.011915 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-12-04 11:53:49.011924 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/30/3530/a7492ca0acb620f234cb0bc8de40d0f153f7acae 2025-12-04 11:53:49.011931 | controller | PWD=/home/zuul 2025-12-04 11:53:49.011936 | controller | ZUUL_PIPELINE=github-check 2025-12-04 11:53:49.011943 | controller | LOGNAME=zuul 2025-12-04 11:53:49.011960 | controller | XDG_SESSION_TYPE=tty 2025-12-04 11:53:49.011967 | controller | _=/usr/bin/env 2025-12-04 11:53:49.011978 | controller | MOTD_SHOWN=pam 2025-12-04 11:53:49.011990 | controller | HOME=/home/zuul 2025-12-04 11:53:49.012049 | controller | LANG=en_US.UTF-8 2025-12-04 11:53:49.012059 | controller | SSH_CONNECTION=192.168.25.12 55772 192.168.25.58 22 2025-12-04 11:53:49.012066 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-12-04 11:53:49.012076 | controller | ZUUL_CHANGE_IDS=3530,a7492ca0acb620f234cb0bc8de40d0f153f7acae 2025-12-04 11:53:49.012082 | controller | WORKSPACE=/home/zuul/workspace 2025-12-04 11:53:49.012088 | controller | XDG_SESSION_CLASS=user 2025-12-04 11:53:49.012094 | controller | SELINUX_ROLE_REQUESTED= 2025-12-04 11:53:49.012099 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-12-04 11:53:49.012105 | controller | USER=zuul 2025-12-04 11:53:49.012111 | controller | ZUUL_VOTING=True 2025-12-04 11:53:49.012125 | controller | BUILD_TIMEOUT=5400000 2025-12-04 11:53:49.012131 | controller | SELINUX_USE_CURRENT_RANGE= 2025-12-04 11:53:49.012137 | controller | SHLVL=1 2025-12-04 11:53:49.012143 | controller | ZUUL_PATCHSET=a7492ca0acb620f234cb0bc8de40d0f153f7acae 2025-12-04 11:53:49.012148 | controller | XDG_SESSION_ID=1 2025-12-04 11:53:49.012154 | controller | ZUUL_BRANCH=main 2025-12-04 11:53:49.012159 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-12-04 11:53:49.012165 | controller | SSH_CLIENT=192.168.25.12 55772 22 2025-12-04 11:53:49.012171 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-12-04 11:53:49.012176 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-12-04 11:53:49.012182 | controller | which_declare=declare -f 2025-12-04 11:53:49.012189 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-12-04 11:53:49.012195 | controller | SELINUX_LEVEL_REQUESTED= 2025-12-04 11:53:49.012201 | controller | ZUUL_CHANGE=3530 2025-12-04 11:53:49.012206 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-12-04 11:53:49.012212 | controller | ZUUL_UUID=0eb1bc396fbe48c99260d746275559ee 2025-12-04 11:53:49.012217 | controller | BASH_FUNC_which%%=() { ( alias; 2025-12-04 11:53:49.012223 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-12-04 11:53:49.012228 | controller | } 2025-12-04 11:53:49.255619 | controller | ok: Runtime: 0:00:00.007992 2025-12-04 11:53:49.260675 | 2025-12-04 11:53:49.260736 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-12-04 11:53:49.274240 | controller | skipping: Conditional result was False 2025-12-04 11:53:49.279128 | 2025-12-04 11:53:49.279190 | TASK [Symlink /home/zuul-worker/workspace] 2025-12-04 11:53:49.829023 | controller | skipping: Conditional result was False 2025-12-04 11:53:49.834568 | 2025-12-04 11:53:49.834633 | TASK [Ensure legacy workspace directory] 2025-12-04 11:53:50.126768 | controller | changed 2025-12-04 11:53:50.144356 | 2025-12-04 11:53:50.144409 | PLAY RECAP 2025-12-04 11:53:50.144451 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-04 11:53:50.144473 | 2025-12-04 11:53:50.210342 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-04 11:53:50.211094 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-04 11:53:50.685620 | 2025-12-04 11:53:50.685730 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-12-04 11:53:50.706791 | 2025-12-04 11:53:50.706908 | TASK [Create zuul-output directory] 2025-12-04 11:53:51.102111 | controller | changed 2025-12-04 11:53:51.107017 | 2025-12-04 11:53:51.107101 | TASK [Slurp Zuul inventory test] 2025-12-04 11:53:51.363599 | controller -> localhost | ok 2025-12-04 11:53:51.369750 | 2025-12-04 11:53:51.369816 | TASK [Save zuul inventory] 2025-12-04 11:53:52.686241 | controller | changed 2025-12-04 11:53:52.691881 | 2025-12-04 11:53:52.691948 | TASK [Save zuul vars without the change_message] 2025-12-04 11:53:53.816002 | controller | changed 2025-12-04 11:53:53.834461 | 2025-12-04 11:53:53.834512 | PLAY RECAP 2025-12-04 11:53:53.834554 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-04 11:53:53.834577 | 2025-12-04 11:53:53.895268 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-04 11:53:53.895939 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-04 11:53:54.404074 | 2025-12-04 11:53:54.404172 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-12-04 11:53:54.424097 | 2025-12-04 11:53:54.424167 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-12-04 11:53:54.442270 | controller | ok 2025-12-04 11:53:54.458557 | 2025-12-04 11:53:54.458636 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-04 11:53:54.482380 | controller | skipping: Conditional result was False 2025-12-04 11:53:54.487973 | 2025-12-04 11:53:54.488051 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-04 11:53:54.882105 | controller | ok 2025-12-04 11:53:54.887535 | 2025-12-04 11:53:54.887604 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-04 11:53:55.931108 | controller | ok 2025-12-04 11:53:55.940314 | 2025-12-04 11:53:55.940378 | TASK [Prepare workspace] 2025-12-04 11:53:55.958578 | controller | ok 2025-12-04 11:53:55.974983 | 2025-12-04 11:53:55.975065 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-12-04 11:53:56.348219 | controller | ok 2025-12-04 11:53:56.354075 | 2025-12-04 11:53:56.354142 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-12-04 11:53:58.903669 | controller | Output suppressed because no_log was given 2025-12-04 11:53:58.912450 | 2025-12-04 11:53:58.912515 | LOOP [Create zuul-output directory] 2025-12-04 11:53:59.174477 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-12-04 11:53:59.411478 | controller | ok: "/home/zuul/zuul-output/logs" 2025-12-04 11:53:59.420435 | 2025-12-04 11:53:59.420522 | TASK [Install required packages] 2025-12-04 11:54:30.037341 | controller | ok: Nothing to do 2025-12-04 11:54:30.042083 | 2025-12-04 11:54:30.042144 | TASK [Install venv] 2025-12-04 11:55:31.650338 | controller | changed 2025-12-04 11:55:31.676409 | 2025-12-04 11:55:31.676482 | PLAY RECAP 2025-12-04 11:55:31.676525 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-04 11:55:31.676548 | 2025-12-04 11:55:31.746276 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-04 11:55:31.747073 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-04 11:55:32.254271 | 2025-12-04 11:55:32.254367 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-12-04 11:55:32.274344 | 2025-12-04 11:55:32.274413 | TASK [Gather required facts] 2025-12-04 11:55:32.840913 | controller | ok 2025-12-04 11:55:32.846483 | 2025-12-04 11:55:32.846556 | TASK [Load environment var if instructed to] 2025-12-04 11:55:32.870341 | controller | skipping: Conditional result was False 2025-12-04 11:55:32.875711 | 2025-12-04 11:55:32.875777 | TASK [Ensure group_vars dir exists] 2025-12-04 11:55:33.259287 | controller | ok 2025-12-04 11:55:33.264322 | 2025-12-04 11:55:33.264389 | TASK [Print related variables] 2025-12-04 11:55:33.292714 | controller | ok: 2025-12-04 11:55:33.292823 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2025-12-04 11:55:33.292851 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2025-12-04 11:55:33.297464 | 2025-12-04 11:55:33.297529 | TASK [Run molecule] 2025-12-04 11:55:34.302623 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-12-04 11:55:34.569783 | controller | INFO Performing prerun with role_name_check=0... 2025-12-04 11:55:51.728824 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.729218 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.729691 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.730148 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.730629 | controller | WARNING Another version of 'cifmw.general' 1.0.0+a7492ca0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+a7492ca0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.731084 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.731549 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.731998 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.732667 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.733139 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.733580 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.734017 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.734464 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.734909 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.735360 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 11:55:51.745545 | controller | INFO Running crc_layout > prepare 2025-12-04 11:55:52.445745 | controller | 2025-12-04 11:55:52.445828 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 11:55:52.445944 | controller | 2025-12-04 11:55:52.445959 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-04 11:55:52.446053 | controller | Thursday 04 December 2025 11:55:52 +0000 (0:00:00.019) 0:00:00.019 ***** 2025-12-04 11:55:53.341469 | controller | ok: [instance] 2025-12-04 11:55:53.341515 | controller | 2025-12-04 11:55:53.341640 | controller | TASK [Create custom basedir] *************************************************** 2025-12-04 11:55:53.341746 | controller | Thursday 04 December 2025 11:55:53 +0000 (0:00:00.896) 0:00:00.915 ***** 2025-12-04 11:55:53.675868 | controller | changed: [instance] 2025-12-04 11:55:53.675920 | controller | 2025-12-04 11:55:53.676007 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-12-04 11:55:53.676107 | controller | Thursday 04 December 2025 11:55:53 +0000 (0:00:00.334) 0:00:01.250 ***** 2025-12-04 11:55:53.695192 | controller | skipping: [instance] 2025-12-04 11:55:53.695281 | controller | 2025-12-04 11:55:53.695418 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-12-04 11:55:53.695543 | controller | Thursday 04 December 2025 11:55:53 +0000 (0:00:00.019) 0:00:01.270 ***** 2025-12-04 11:55:53.738411 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-12-04 11:55:53.738584 | controller | 2025-12-04 11:55:53.738595 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-12-04 11:55:53.738680 | controller | Thursday 04 December 2025 11:55:53 +0000 (0:00:00.043) 0:00:01.313 ***** 2025-12-04 11:55:54.054833 | controller | ok: [instance] 2025-12-04 11:55:54.054879 | controller | 2025-12-04 11:55:54.055002 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-12-04 11:55:54.055106 | controller | Thursday 04 December 2025 11:55:54 +0000 (0:00:00.316) 0:00:01.629 ***** 2025-12-04 11:55:54.284109 | controller | ok: [instance] 2025-12-04 11:55:54.284160 | controller | 2025-12-04 11:55:54.284296 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-12-04 11:55:54.284452 | controller | Thursday 04 December 2025 11:55:54 +0000 (0:00:00.229) 0:00:01.858 ***** 2025-12-04 11:55:55.015695 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-12-04 11:55:55.015739 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-12-04 11:55:55.016061 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-12-04 11:55:55.016151 | controller | 2025-12-04 11:55:55.016263 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-12-04 11:55:55.016392 | controller | Thursday 04 December 2025 11:55:55 +0000 (0:00:00.731) 0:00:02.589 ***** 2025-12-04 11:55:55.076900 | controller | 2025-12-04 11:55:55.077020 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-04 11:55:55.077137 | controller | Thursday 04 December 2025 11:55:55 +0000 (0:00:00.061) 0:00:02.651 ***** 2025-12-04 11:55:55.636767 | controller | changed: [instance] => (item=tmp) 2025-12-04 11:55:55.636841 | controller | changed: [instance] => (item=artifacts/repositories) 2025-12-04 11:55:55.636934 | controller | changed: [instance] => (item=venv/repo_setup) 2025-12-04 11:55:55.637024 | controller | 2025-12-04 11:55:55.637125 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-04 11:55:55.637211 | controller | Thursday 04 December 2025 11:55:55 +0000 (0:00:00.559) 0:00:03.211 ***** 2025-12-04 11:55:56.504035 | controller | ok: [instance] 2025-12-04 11:55:56.504138 | controller | 2025-12-04 11:55:56.504315 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-04 11:55:56.504379 | controller | Thursday 04 December 2025 11:55:56 +0000 (0:00:00.866) 0:00:04.078 ***** 2025-12-04 11:55:57.587039 | controller | changed: [instance] 2025-12-04 11:56:05.393722 | controller | 2025-12-04 11:56:05.393767 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-04 11:56:05.393776 | controller | Thursday 04 December 2025 11:55:57 +0000 (0:00:01.082) 0:00:05.160 ***** 2025-12-04 11:56:05.393786 | controller | changed: [instance] 2025-12-04 11:56:06.120393 | controller | 2025-12-04 11:56:06.120434 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-04 11:56:06.120445 | controller | Thursday 04 December 2025 11:56:05 +0000 (0:00:07.806) 0:00:12.967 ***** 2025-12-04 11:56:06.120459 | controller | changed: [instance] 2025-12-04 11:56:06.144360 | controller | 2025-12-04 11:56:06.144405 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-04 11:56:06.144416 | controller | Thursday 04 December 2025 11:56:06 +0000 (0:00:00.726) 0:00:13.694 ***** 2025-12-04 11:56:06.144429 | controller | skipping: [instance] 2025-12-04 11:56:06.144462 | controller | 2025-12-04 11:56:06.144473 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-04 11:56:06.144610 | controller | Thursday 04 December 2025 11:56:06 +0000 (0:00:00.024) 0:00:13.718 ***** 2025-12-04 11:56:06.960635 | controller | changed: [instance] 2025-12-04 11:56:06.998358 | controller | 2025-12-04 11:56:06.998392 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-04 11:56:06.998401 | controller | Thursday 04 December 2025 11:56:06 +0000 (0:00:00.815) 0:00:14.534 ***** 2025-12-04 11:56:06.998412 | controller | skipping: [instance] 2025-12-04 11:56:06.998730 | controller | 2025-12-04 11:56:06.998753 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-04 11:56:07.035783 | controller | Thursday 04 December 2025 11:56:06 +0000 (0:00:00.038) 0:00:14.572 ***** 2025-12-04 11:56:07.035808 | controller | skipping: [instance] 2025-12-04 11:56:07.074383 | controller | 2025-12-04 11:56:07.074422 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-04 11:56:07.074433 | controller | Thursday 04 December 2025 11:56:07 +0000 (0:00:00.037) 0:00:14.610 ***** 2025-12-04 11:56:07.074447 | controller | skipping: [instance] 2025-12-04 11:56:07.635736 | controller | 2025-12-04 11:56:07.635769 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-04 11:56:07.635777 | controller | Thursday 04 December 2025 11:56:07 +0000 (0:00:00.038) 0:00:14.648 ***** 2025-12-04 11:56:07.635787 | controller | changed: [instance] 2025-12-04 11:56:08.102159 | controller | 2025-12-04 11:56:08.102188 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-04 11:56:08.102196 | controller | Thursday 04 December 2025 11:56:07 +0000 (0:00:00.560) 0:00:15.209 ***** 2025-12-04 11:56:08.102206 | controller | changed: [instance] 2025-12-04 11:56:08.141452 | controller | 2025-12-04 11:56:08.141494 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-04 11:56:08.141506 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.466) 0:00:15.676 ***** 2025-12-04 11:56:08.141520 | controller | skipping: [instance] 2025-12-04 11:56:08.195416 | controller | 2025-12-04 11:56:08.195445 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-04 11:56:08.195454 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.039) 0:00:15.715 ***** 2025-12-04 11:56:08.195471 | controller | skipping: [instance] 2025-12-04 11:56:08.195504 | controller | 2025-12-04 11:56:08.195699 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-04 11:56:08.234758 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.053) 0:00:15.769 ***** 2025-12-04 11:56:08.234781 | controller | skipping: [instance] 2025-12-04 11:56:08.283960 | controller | 2025-12-04 11:56:08.283979 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-04 11:56:08.283987 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.039) 0:00:15.809 ***** 2025-12-04 11:56:08.283996 | controller | ok: [instance] 2025-12-04 11:56:08.321838 | controller | 2025-12-04 11:56:08.321856 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-04 11:56:08.321863 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.049) 0:00:15.858 ***** 2025-12-04 11:56:08.321879 | controller | skipping: [instance] 2025-12-04 11:56:08.354715 | controller | 2025-12-04 11:56:08.354733 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-04 11:56:08.354740 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.037) 0:00:15.896 ***** 2025-12-04 11:56:08.354749 | controller | skipping: [instance] 2025-12-04 11:56:08.385982 | controller | 2025-12-04 11:56:08.386002 | controller | TASK [Download the RPM] ******************************************************** 2025-12-04 11:56:08.386009 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.032) 0:00:15.929 ***** 2025-12-04 11:56:08.386018 | controller | skipping: [instance] 2025-12-04 11:56:08.423051 | controller | 2025-12-04 11:56:08.423073 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-04 11:56:08.423082 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.031) 0:00:15.960 ***** 2025-12-04 11:56:08.423093 | controller | skipping: [instance] 2025-12-04 11:56:08.423296 | controller | 2025-12-04 11:56:08.423493 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-04 11:56:08.423668 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.037) 0:00:15.997 ***** 2025-12-04 11:56:08.460825 | controller | skipping: [instance] 2025-12-04 11:56:08.461013 | controller | 2025-12-04 11:56:08.461154 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-04 11:56:08.461311 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.037) 0:00:16.035 ***** 2025-12-04 11:56:08.514352 | controller | skipping: [instance] 2025-12-04 11:56:08.514528 | controller | 2025-12-04 11:56:08.514699 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-04 11:56:08.514858 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.053) 0:00:16.089 ***** 2025-12-04 11:56:08.544099 | controller | skipping: [instance] 2025-12-04 11:56:08.544317 | controller | 2025-12-04 11:56:08.544521 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-04 11:56:08.544697 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.029) 0:00:16.118 ***** 2025-12-04 11:56:08.756055 | controller | ok: [instance] 2025-12-04 11:56:08.979245 | controller | 2025-12-04 11:56:08.979266 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-04 11:56:08.979293 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.211) 0:00:16.330 ***** 2025-12-04 11:56:08.979306 | controller | changed: [instance] 2025-12-04 11:56:09.217915 | controller | 2025-12-04 11:56:09.217939 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-04 11:56:09.217949 | controller | Thursday 04 December 2025 11:56:08 +0000 (0:00:00.223) 0:00:16.553 ***** 2025-12-04 11:56:09.217959 | controller | changed: [instance] 2025-12-04 11:56:09.241457 | controller | 2025-12-04 11:56:09.241499 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-04 11:56:09.241509 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.238) 0:00:16.792 ***** 2025-12-04 11:56:09.241523 | controller | skipping: [instance] 2025-12-04 11:56:09.241557 | controller | 2025-12-04 11:56:09.241566 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-04 11:56:09.241686 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.024) 0:00:16.816 ***** 2025-12-04 11:56:09.265051 | controller | skipping: [instance] 2025-12-04 11:56:09.289159 | controller | 2025-12-04 11:56:09.289180 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-04 11:56:09.289189 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.023) 0:00:16.839 ***** 2025-12-04 11:56:09.289210 | controller | skipping: [instance] 2025-12-04 11:56:09.312265 | controller | 2025-12-04 11:56:09.312319 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-04 11:56:09.312329 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.024) 0:00:16.863 ***** 2025-12-04 11:56:09.312340 | controller | skipping: [instance] 2025-12-04 11:56:09.335404 | controller | 2025-12-04 11:56:09.335443 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-04 11:56:09.335460 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.023) 0:00:16.886 ***** 2025-12-04 11:56:09.335472 | controller | skipping: [instance] 2025-12-04 11:56:09.359392 | controller | 2025-12-04 11:56:09.359426 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-04 11:56:09.359435 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.023) 0:00:16.909 ***** 2025-12-04 11:56:09.359447 | controller | skipping: [instance] 2025-12-04 11:56:09.359543 | controller | 2025-12-04 11:56:09.359707 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-04 11:56:09.359840 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.024) 0:00:16.934 ***** 2025-12-04 11:56:09.377934 | controller | skipping: [instance] 2025-12-04 11:56:09.378099 | controller | 2025-12-04 11:56:09.378257 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-04 11:56:09.378437 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.018) 0:00:16.952 ***** 2025-12-04 11:56:09.410907 | controller | skipping: [instance] 2025-12-04 11:56:09.411073 | controller | 2025-12-04 11:56:09.411223 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-04 11:56:09.411403 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.032) 0:00:16.985 ***** 2025-12-04 11:56:09.433641 | controller | skipping: [instance] 2025-12-04 11:56:09.433791 | controller | 2025-12-04 11:56:09.433951 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-04 11:56:09.434074 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.022) 0:00:17.008 ***** 2025-12-04 11:56:09.457938 | controller | skipping: [instance] 2025-12-04 11:56:09.486999 | controller | 2025-12-04 11:56:09.487017 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-12-04 11:56:09.487026 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.023) 0:00:17.032 ***** 2025-12-04 11:56:09.487037 | controller | skipping: [instance] 2025-12-04 11:56:09.487164 | controller | 2025-12-04 11:56:09.487349 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-12-04 11:56:09.487508 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.029) 0:00:17.061 ***** 2025-12-04 11:56:09.517929 | controller | skipping: [instance] 2025-12-04 11:56:09.518102 | controller | 2025-12-04 11:56:09.518228 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-12-04 11:56:09.518372 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.030) 0:00:17.092 ***** 2025-12-04 11:56:09.549700 | controller | skipping: [instance] 2025-12-04 11:56:09.549863 | controller | 2025-12-04 11:56:09.550045 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-12-04 11:56:09.550177 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.031) 0:00:17.124 ***** 2025-12-04 11:56:09.581259 | controller | skipping: [instance] 2025-12-04 11:56:09.581458 | controller | 2025-12-04 11:56:09.581620 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-12-04 11:56:09.581771 | controller | Thursday 04 December 2025 11:56:09 +0000 (0:00:00.031) 0:00:17.156 ***** 2025-12-04 11:56:56.739417 | controller | ok: [instance] 2025-12-04 11:56:56.739508 | controller | 2025-12-04 11:56:56.739543 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-12-04 11:56:56.739556 | controller | Thursday 04 December 2025 11:56:56 +0000 (0:00:47.155) 0:01:04.311 ***** 2025-12-04 11:56:58.068066 | controller | ok: [instance] 2025-12-04 11:56:58.105466 | controller | 2025-12-04 11:56:58.105517 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-12-04 11:56:58.105527 | controller | Thursday 04 December 2025 11:56:58 +0000 (0:00:01.330) 0:01:05.642 ***** 2025-12-04 11:56:58.105541 | controller | skipping: [instance] 2025-12-04 11:56:58.156456 | controller | 2025-12-04 11:56:58.156504 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-04 11:56:58.156514 | controller | Thursday 04 December 2025 11:56:58 +0000 (0:00:00.037) 0:01:05.679 ***** 2025-12-04 11:56:58.156527 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-12-04 11:56:58.182440 | controller | 2025-12-04 11:56:58.182468 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-04 11:56:58.182478 | controller | Thursday 04 December 2025 11:56:58 +0000 (0:00:00.050) 0:01:05.730 ***** 2025-12-04 11:56:58.182489 | controller | ok: [instance] => 2025-12-04 11:56:58.183467 | controller | cifmw_ci_setup_packages: 2025-12-04 11:56:58.183529 | controller | - bash-completion 2025-12-04 11:56:58.183544 | controller | - ca-certificates 2025-12-04 11:57:01.467310 | controller | - git-core 2025-12-04 11:57:01.467351 | controller | - make 2025-12-04 11:57:01.467358 | controller | - tar 2025-12-04 11:57:01.467364 | controller | - tmux 2025-12-04 11:57:01.467370 | controller | - python3-pip 2025-12-04 11:57:01.467375 | controller | 2025-12-04 11:57:01.467381 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-04 11:57:01.467393 | controller | Thursday 04 December 2025 11:56:58 +0000 (0:00:00.026) 0:01:05.757 ***** 2025-12-04 11:57:01.467404 | controller | changed: [instance] 2025-12-04 11:57:02.102904 | controller | 2025-12-04 11:57:02.102942 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-04 11:57:02.102950 | controller | Thursday 04 December 2025 11:57:01 +0000 (0:00:03.284) 0:01:09.041 ***** 2025-12-04 11:57:02.102960 | controller | ok: [instance] 2025-12-04 11:57:02.336255 | controller | 2025-12-04 11:57:02.336309 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-04 11:57:02.336318 | controller | Thursday 04 December 2025 11:57:02 +0000 (0:00:00.635) 0:01:09.676 ***** 2025-12-04 11:57:02.336329 | controller | changed: [instance] 2025-12-04 11:57:08.470476 | controller | 2025-12-04 11:57:08.470513 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-04 11:57:08.470521 | controller | Thursday 04 December 2025 11:57:02 +0000 (0:00:00.233) 0:01:09.910 ***** 2025-12-04 11:57:08.470532 | controller | changed: [instance] 2025-12-04 11:57:08.509546 | controller | 2025-12-04 11:57:08.509632 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-04 11:57:08.509643 | controller | Thursday 04 December 2025 11:57:08 +0000 (0:00:06.134) 0:01:16.044 ***** 2025-12-04 11:57:08.509659 | controller | ok: [instance] 2025-12-04 11:57:08.787084 | controller | 2025-12-04 11:57:08.787130 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-04 11:57:08.787140 | controller | Thursday 04 December 2025 11:57:08 +0000 (0:00:00.039) 0:01:16.083 ***** 2025-12-04 11:57:08.787167 | controller | changed: [instance] 2025-12-04 11:57:09.083364 | controller | 2025-12-04 11:57:09.083407 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-04 11:57:09.083415 | controller | Thursday 04 December 2025 11:57:08 +0000 (0:00:00.277) 0:01:16.361 ***** 2025-12-04 11:57:09.083425 | controller | changed: [instance] 2025-12-04 11:57:09.102112 | controller | 2025-12-04 11:57:09.102130 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-04 11:57:09.102137 | controller | Thursday 04 December 2025 11:57:09 +0000 (0:00:00.296) 0:01:16.657 ***** 2025-12-04 11:57:09.102156 | controller | skipping: [instance] 2025-12-04 11:57:09.120941 | controller | 2025-12-04 11:57:09.120962 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-04 11:57:09.120969 | controller | Thursday 04 December 2025 11:57:09 +0000 (0:00:00.019) 0:01:16.676 ***** 2025-12-04 11:57:09.120978 | controller | skipping: [instance] 2025-12-04 11:57:09.146502 | controller | 2025-12-04 11:57:09.146544 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-04 11:57:09.146556 | controller | Thursday 04 December 2025 11:57:09 +0000 (0:00:00.018) 0:01:16.695 ***** 2025-12-04 11:57:09.146570 | controller | skipping: [instance] 2025-12-04 11:57:09.171889 | controller | 2025-12-04 11:57:09.171917 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-04 11:57:09.171927 | controller | Thursday 04 December 2025 11:57:09 +0000 (0:00:00.025) 0:01:16.720 ***** 2025-12-04 11:57:09.171939 | controller | skipping: [instance] 2025-12-04 11:57:09.196433 | controller | 2025-12-04 11:57:09.196469 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-04 11:57:09.196495 | controller | Thursday 04 December 2025 11:57:09 +0000 (0:00:00.025) 0:01:16.746 ***** 2025-12-04 11:57:09.196512 | controller | skipping: [instance] 2025-12-04 11:57:09.224890 | controller | 2025-12-04 11:57:09.224916 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-04 11:57:09.224926 | controller | Thursday 04 December 2025 11:57:09 +0000 (0:00:00.024) 0:01:16.770 ***** 2025-12-04 11:57:09.224937 | controller | skipping: [instance] 2025-12-04 11:57:10.316477 | controller | 2025-12-04 11:57:10.316528 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-04 11:57:10.316542 | controller | Thursday 04 December 2025 11:57:09 +0000 (0:00:00.028) 0:01:16.799 ***** 2025-12-04 11:57:10.316560 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-12-04 11:57:10.316637 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-12-04 11:57:10.316675 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-12-04 11:57:10.316683 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-12-04 11:57:10.316689 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-12-04 11:57:10.316695 | controller | 2025-12-04 11:57:10.316705 | controller | TASK [Create secret file] ****************************************************** 2025-12-04 11:57:10.689617 | controller | Thursday 04 December 2025 11:57:10 +0000 (0:00:01.091) 0:01:17.890 ***** 2025-12-04 11:57:10.689670 | controller | changed: [instance] 2025-12-04 11:57:10.689707 | controller | 2025-12-04 11:57:10.689722 | controller | PLAY RECAP ********************************************************************* 2025-12-04 11:57:10.689729 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-12-04 11:57:10.689737 | controller | 2025-12-04 11:57:10.689743 | controller | Thursday 04 December 2025 11:57:10 +0000 (0:00:00.372) 0:01:18.262 ***** 2025-12-04 11:57:10.689756 | controller | =============================================================================== 2025-12-04 11:57:10.689763 | controller | test_deps : Install selinux python libs -------------------------------- 47.16s 2025-12-04 11:57:10.689770 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.81s 2025-12-04 11:57:10.689776 | controller | ci_setup : Install openshift client ------------------------------------- 6.13s 2025-12-04 11:57:10.689785 | controller | ci_setup : Install needed packages -------------------------------------- 3.28s 2025-12-04 11:57:10.689812 | controller | test_deps : Install python yaml libs ------------------------------------ 1.33s 2025-12-04 11:57:10.691383 | controller | ci_setup : Manage directories ------------------------------------------- 1.09s 2025-12-04 11:57:10.798403 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.08s 2025-12-04 11:57:10.798448 | controller | Gathering Facts --------------------------------------------------------- 0.90s 2025-12-04 11:57:10.798456 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.87s 2025-12-04 11:57:10.798461 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.82s 2025-12-04 11:57:10.798467 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.73s 2025-12-04 11:57:10.798472 | controller | repo_setup : Install repo-setup package --------------------------------- 0.73s 2025-12-04 11:57:10.798478 | controller | ci_setup : Gather version of openshift client --------------------------- 0.64s 2025-12-04 11:57:10.798483 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.56s 2025-12-04 11:57:10.798488 | controller | repo_setup : Ensure directories are present ----------------------------- 0.56s 2025-12-04 11:57:10.798493 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.47s 2025-12-04 11:57:10.798499 | controller | Create secret file ------------------------------------------------------ 0.37s 2025-12-04 11:57:10.798504 | controller | Create custom basedir --------------------------------------------------- 0.33s 2025-12-04 11:57:10.798509 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.32s 2025-12-04 11:57:10.798520 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.30s 2025-12-04 11:57:10.798531 | controller | INFO Running crc_layout > converge 2025-12-04 11:57:11.382697 | controller | 2025-12-04 11:57:11.382911 | controller | PLAY [Converge] **************************************************************** 2025-12-04 11:57:11.383041 | controller | 2025-12-04 11:57:11.383182 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-04 11:57:11.383338 | controller | Thursday 04 December 2025 11:57:11 +0000 (0:00:00.025) 0:00:00.025 ***** 2025-12-04 11:57:12.236386 | controller | ok: [instance] 2025-12-04 11:57:12.260113 | controller | 2025-12-04 11:57:12.260137 | controller | TASK [Load networking definition from scenario file] *************************** 2025-12-04 11:57:12.260147 | controller | Thursday 04 December 2025 11:57:12 +0000 (0:00:00.853) 0:00:00.879 ***** 2025-12-04 11:57:12.260158 | controller | ok: [instance] 2025-12-04 11:57:13.805934 | controller | 2025-12-04 11:57:13.805975 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-04 11:57:13.805983 | controller | Thursday 04 December 2025 11:57:12 +0000 (0:00:00.024) 0:00:00.903 ***** 2025-12-04 11:57:13.805994 | controller | changed: [instance] 2025-12-04 11:57:13.833880 | controller | 2025-12-04 11:57:13.833897 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-04 11:57:13.833904 | controller | Thursday 04 December 2025 11:57:13 +0000 (0:00:01.545) 0:00:02.448 ***** 2025-12-04 11:57:13.833912 | controller | ok: [instance] 2025-12-04 11:57:13.856428 | controller | 2025-12-04 11:57:13.856461 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-12-04 11:57:13.856484 | controller | Thursday 04 December 2025 11:57:13 +0000 (0:00:00.028) 0:00:02.476 ***** 2025-12-04 11:57:13.856501 | controller | skipping: [instance] 2025-12-04 11:57:13.856813 | controller | 2025-12-04 11:57:13.856846 | controller | TASK [Build final libvirt layout] ********************************************** 2025-12-04 11:57:13.907108 | controller | Thursday 04 December 2025 11:57:13 +0000 (0:00:00.022) 0:00:02.499 ***** 2025-12-04 11:57:13.907129 | controller | 2025-12-04 11:57:13.989157 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-12-04 11:57:13.989188 | controller | Thursday 04 December 2025 11:57:13 +0000 (0:00:00.050) 0:00:02.550 ***** 2025-12-04 11:57:13.989200 | controller | ok: [instance] 2025-12-04 11:57:14.050299 | controller | 2025-12-04 11:57:14.050318 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-12-04 11:57:14.050326 | controller | Thursday 04 December 2025 11:57:13 +0000 (0:00:00.081) 0:00:02.631 ***** 2025-12-04 11:57:14.050335 | controller | skipping: [instance] 2025-12-04 11:57:14.077626 | controller | 2025-12-04 11:57:14.077649 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-12-04 11:57:14.077658 | controller | Thursday 04 December 2025 11:57:14 +0000 (0:00:00.061) 0:00:02.693 ***** 2025-12-04 11:57:14.077668 | controller | ok: [instance] 2025-12-04 11:57:14.077845 | controller | 2025-12-04 11:57:14.078038 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-12-04 11:57:14.078225 | controller | Thursday 04 December 2025 11:57:14 +0000 (0:00:00.027) 0:00:02.721 ***** 2025-12-04 11:57:14.101697 | controller | ok: [instance] => changed=false 2025-12-04 11:57:14.101894 | controller | msg: All assertions passed 2025-12-04 11:57:14.102071 | controller | 2025-12-04 11:57:14.102261 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-12-04 11:57:14.102449 | controller | Thursday 04 December 2025 11:57:14 +0000 (0:00:00.024) 0:00:02.745 ***** 2025-12-04 11:57:14.144334 | controller | ok: [instance] 2025-12-04 11:57:14.144524 | controller | 2025-12-04 11:57:14.144671 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-12-04 11:57:14.144809 | controller | Thursday 04 December 2025 11:57:14 +0000 (0:00:00.042) 0:00:02.787 ***** 2025-12-04 11:57:14.598390 | controller | ok: [instance] => (item=artifacts) 2025-12-04 11:57:14.598445 | controller | ok: [instance] => (item=logs) 2025-12-04 11:57:14.598454 | controller | 2025-12-04 11:57:14.598462 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-12-04 11:57:14.598554 | controller | Thursday 04 December 2025 11:57:14 +0000 (0:00:00.453) 0:00:03.241 ***** 2025-12-04 11:57:14.677448 | controller | 2025-12-04 11:57:14.677503 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-12-04 11:57:14.677516 | controller | Thursday 04 December 2025 11:57:14 +0000 (0:00:00.079) 0:00:03.320 ***** 2025-12-04 11:57:14.875269 | controller | ok: [instance] 2025-12-04 11:57:15.170462 | controller | 2025-12-04 11:57:15.170512 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-12-04 11:57:15.170522 | controller | Thursday 04 December 2025 11:57:14 +0000 (0:00:00.197) 0:00:03.518 ***** 2025-12-04 11:57:15.170536 | controller | changed: [instance] 2025-12-04 11:57:15.468827 | controller | 2025-12-04 11:57:15.468864 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-12-04 11:57:15.468872 | controller | Thursday 04 December 2025 11:57:15 +0000 (0:00:00.295) 0:00:03.813 ***** 2025-12-04 11:57:15.468883 | controller | ok: [instance] 2025-12-04 11:57:15.500193 | controller | 2025-12-04 11:57:15.500224 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-12-04 11:57:15.500233 | controller | Thursday 04 December 2025 11:57:15 +0000 (0:00:00.298) 0:00:04.111 ***** 2025-12-04 11:57:15.500243 | controller | skipping: [instance] 2025-12-04 11:57:15.517961 | controller | 2025-12-04 11:57:15.517984 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-12-04 11:57:15.517993 | controller | Thursday 04 December 2025 11:57:15 +0000 (0:00:00.031) 0:00:04.143 ***** 2025-12-04 11:57:15.518004 | controller | skipping: [instance] 2025-12-04 11:57:15.537408 | controller | 2025-12-04 11:57:15.537448 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-12-04 11:57:15.537458 | controller | Thursday 04 December 2025 11:57:15 +0000 (0:00:00.017) 0:00:04.161 ***** 2025-12-04 11:57:15.537471 | controller | ok: [instance] 2025-12-04 11:57:15.537505 | controller | 2025-12-04 11:57:15.537886 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-12-04 11:57:15.565330 | controller | Thursday 04 December 2025 11:57:15 +0000 (0:00:00.019) 0:00:04.180 ***** 2025-12-04 11:57:15.565353 | controller | skipping: [instance] 2025-12-04 11:57:25.635336 | controller | 2025-12-04 11:57:25.635381 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-12-04 11:57:25.635397 | controller | Thursday 04 December 2025 11:57:15 +0000 (0:00:00.027) 0:00:04.208 ***** 2025-12-04 11:57:25.635410 | controller | changed: [instance] 2025-12-04 11:57:25.635552 | controller | 2025-12-04 11:57:25.635561 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-12-04 11:57:25.635569 | controller | Thursday 04 December 2025 11:57:25 +0000 (0:00:10.069) 0:00:14.278 ***** 2025-12-04 11:57:25.868254 | controller | changed: [instance] 2025-12-04 11:57:26.389037 | controller | 2025-12-04 11:57:26.389071 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-12-04 11:57:26.389079 | controller | Thursday 04 December 2025 11:57:25 +0000 (0:00:00.232) 0:00:14.510 ***** 2025-12-04 11:57:26.389090 | controller | changed: [instance] 2025-12-04 11:57:26.389127 | controller | 2025-12-04 11:57:26.389335 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-12-04 11:57:27.003923 | controller | Thursday 04 December 2025 11:57:26 +0000 (0:00:00.521) 0:00:15.032 ***** 2025-12-04 11:57:27.003971 | controller | changed: [instance] 2025-12-04 11:57:27.217231 | controller | 2025-12-04 11:57:27.217269 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-12-04 11:57:27.217290 | controller | Thursday 04 December 2025 11:57:27 +0000 (0:00:00.614) 0:00:15.646 ***** 2025-12-04 11:57:27.217304 | controller | ok: [instance] 2025-12-04 11:57:27.889934 | controller | 2025-12-04 11:57:27.890074 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-12-04 11:57:27.890083 | controller | Thursday 04 December 2025 11:57:27 +0000 (0:00:00.213) 0:00:15.860 ***** 2025-12-04 11:57:27.890095 | controller | ok: [instance] 2025-12-04 11:57:28.786376 | controller | 2025-12-04 11:57:28.786415 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-12-04 11:57:28.786431 | controller | Thursday 04 December 2025 11:57:27 +0000 (0:00:00.672) 0:00:16.532 ***** 2025-12-04 11:57:28.786442 | controller | changed: [instance] 2025-12-04 11:57:28.873489 | controller | 2025-12-04 11:57:28.873546 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-12-04 11:57:28.873557 | controller | Thursday 04 December 2025 11:57:28 +0000 (0:00:00.896) 0:00:17.428 ***** 2025-12-04 11:57:28.873571 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-12-04 11:57:28.873606 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-12-04 11:57:28.873614 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-12-04 11:57:28.873621 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-12-04 11:57:28.873628 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-12-04 11:57:28.873636 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-12-04 11:57:28.873643 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-12-04 11:57:28.873653 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-12-04 11:57:28.873680 | controller | 2025-12-04 11:57:28.873690 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-12-04 11:57:28.873828 | controller | Thursday 04 December 2025 11:57:28 +0000 (0:00:00.086) 0:00:17.515 ***** 2025-12-04 11:57:29.211391 | controller | ok: [instance] 2025-12-04 11:57:29.211431 | controller | 2025-12-04 11:57:29.211439 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-12-04 11:57:29.211448 | controller | Thursday 04 December 2025 11:57:29 +0000 (0:00:00.338) 0:00:17.854 ***** 2025-12-04 11:57:29.533175 | controller | ok: [instance] 2025-12-04 11:57:29.856397 | controller | 2025-12-04 11:57:29.856447 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-12-04 11:57:29.856457 | controller | Thursday 04 December 2025 11:57:29 +0000 (0:00:00.321) 0:00:18.176 ***** 2025-12-04 11:57:29.856471 | controller | ok: [instance] 2025-12-04 11:57:30.179988 | controller | 2025-12-04 11:57:30.180024 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-12-04 11:57:30.180033 | controller | Thursday 04 December 2025 11:57:29 +0000 (0:00:00.323) 0:00:18.499 ***** 2025-12-04 11:57:30.180043 | controller | ok: [instance] 2025-12-04 11:57:30.506378 | controller | 2025-12-04 11:57:30.506414 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-12-04 11:57:30.506422 | controller | Thursday 04 December 2025 11:57:30 +0000 (0:00:00.323) 0:00:18.822 ***** 2025-12-04 11:57:30.506434 | controller | ok: [instance] 2025-12-04 11:57:30.506440 | controller | 2025-12-04 11:57:30.506445 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-12-04 11:57:30.506453 | controller | Thursday 04 December 2025 11:57:30 +0000 (0:00:00.326) 0:00:19.149 ***** 2025-12-04 11:57:30.834062 | controller | ok: [instance] 2025-12-04 11:57:31.155048 | controller | 2025-12-04 11:57:31.155074 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-12-04 11:57:31.155082 | controller | Thursday 04 December 2025 11:57:30 +0000 (0:00:00.327) 0:00:19.476 ***** 2025-12-04 11:57:31.155091 | controller | ok: [instance] 2025-12-04 11:57:31.475865 | controller | 2025-12-04 11:57:31.475888 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-12-04 11:57:31.475895 | controller | Thursday 04 December 2025 11:57:31 +0000 (0:00:00.321) 0:00:19.798 ***** 2025-12-04 11:57:31.475927 | controller | ok: [instance] 2025-12-04 11:57:31.805045 | controller | 2025-12-04 11:57:31.805081 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-12-04 11:57:31.805089 | controller | Thursday 04 December 2025 11:57:31 +0000 (0:00:00.320) 0:00:20.118 ***** 2025-12-04 11:57:31.805099 | controller | ok: [instance] 2025-12-04 11:57:32.129926 | controller | 2025-12-04 11:57:32.129963 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-12-04 11:57:32.129973 | controller | Thursday 04 December 2025 11:57:31 +0000 (0:00:00.328) 0:00:20.447 ***** 2025-12-04 11:57:32.129985 | controller | ok: [instance] 2025-12-04 11:57:32.130174 | controller | 2025-12-04 11:57:32.130397 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-12-04 11:57:32.130580 | controller | Thursday 04 December 2025 11:57:32 +0000 (0:00:00.325) 0:00:20.773 ***** 2025-12-04 11:57:32.447580 | controller | ok: [instance] 2025-12-04 11:57:32.447784 | controller | 2025-12-04 11:57:32.447961 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-12-04 11:57:32.448134 | controller | Thursday 04 December 2025 11:57:32 +0000 (0:00:00.317) 0:00:21.090 ***** 2025-12-04 11:57:32.765824 | controller | ok: [instance] 2025-12-04 11:57:32.765999 | controller | 2025-12-04 11:57:32.766156 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-12-04 11:57:32.766330 | controller | Thursday 04 December 2025 11:57:32 +0000 (0:00:00.318) 0:00:21.409 ***** 2025-12-04 11:57:33.083057 | controller | ok: [instance] 2025-12-04 11:57:33.083239 | controller | 2025-12-04 11:57:33.083424 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-12-04 11:57:33.083569 | controller | Thursday 04 December 2025 11:57:33 +0000 (0:00:00.317) 0:00:21.726 ***** 2025-12-04 11:57:33.398734 | controller | ok: [instance] 2025-12-04 11:57:33.398954 | controller | 2025-12-04 11:57:33.399108 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-12-04 11:57:33.399249 | controller | Thursday 04 December 2025 11:57:33 +0000 (0:00:00.315) 0:00:22.041 ***** 2025-12-04 11:57:33.715747 | controller | ok: [instance] 2025-12-04 11:57:33.715918 | controller | 2025-12-04 11:57:33.716064 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-12-04 11:57:33.716203 | controller | Thursday 04 December 2025 11:57:33 +0000 (0:00:00.317) 0:00:22.358 ***** 2025-12-04 11:57:34.031624 | controller | ok: [instance] 2025-12-04 11:57:34.031880 | controller | 2025-12-04 11:57:34.032142 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-12-04 11:57:34.032348 | controller | Thursday 04 December 2025 11:57:34 +0000 (0:00:00.315) 0:00:22.674 ***** 2025-12-04 11:57:34.348607 | controller | ok: [instance] 2025-12-04 11:57:34.667183 | controller | 2025-12-04 11:57:34.667224 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-12-04 11:57:34.667234 | controller | Thursday 04 December 2025 11:57:34 +0000 (0:00:00.316) 0:00:22.991 ***** 2025-12-04 11:57:34.667247 | controller | ok: [instance] 2025-12-04 11:57:34.991057 | controller | 2025-12-04 11:57:34.991085 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-12-04 11:57:34.991093 | controller | Thursday 04 December 2025 11:57:34 +0000 (0:00:00.318) 0:00:23.309 ***** 2025-12-04 11:57:34.991103 | controller | ok: [instance] 2025-12-04 11:57:35.337299 | controller | 2025-12-04 11:57:35.337367 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-12-04 11:57:35.337376 | controller | Thursday 04 December 2025 11:57:34 +0000 (0:00:00.324) 0:00:23.634 ***** 2025-12-04 11:57:35.337389 | controller | ok: [instance] 2025-12-04 11:57:35.711073 | controller | 2025-12-04 11:57:35.711125 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-12-04 11:57:35.711132 | controller | Thursday 04 December 2025 11:57:35 +0000 (0:00:00.344) 0:00:23.978 ***** 2025-12-04 11:57:35.711144 | controller | ok: [instance] 2025-12-04 11:57:36.052829 | controller | 2025-12-04 11:57:36.052876 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-12-04 11:57:36.052883 | controller | Thursday 04 December 2025 11:57:35 +0000 (0:00:00.374) 0:00:24.353 ***** 2025-12-04 11:57:36.052904 | controller | ok: [instance] 2025-12-04 11:57:36.405152 | controller | 2025-12-04 11:57:36.405209 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-12-04 11:57:36.405218 | controller | Thursday 04 December 2025 11:57:36 +0000 (0:00:00.341) 0:00:24.695 ***** 2025-12-04 11:57:36.405229 | controller | ok: [instance] 2025-12-04 11:57:36.772576 | controller | 2025-12-04 11:57:36.772616 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-12-04 11:57:36.772632 | controller | Thursday 04 December 2025 11:57:36 +0000 (0:00:00.352) 0:00:25.047 ***** 2025-12-04 11:57:36.772644 | controller | ok: [instance] 2025-12-04 11:57:36.801104 | controller | 2025-12-04 11:57:36.801141 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-12-04 11:57:36.801149 | controller | Thursday 04 December 2025 11:57:36 +0000 (0:00:00.367) 0:00:25.415 ***** 2025-12-04 11:57:36.801160 | controller | skipping: [instance] 2025-12-04 11:57:37.104512 | controller | 2025-12-04 11:57:37.104567 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-12-04 11:57:37.104577 | controller | Thursday 04 December 2025 11:57:36 +0000 (0:00:00.028) 0:00:25.443 ***** 2025-12-04 11:57:37.104593 | controller | ok: [instance] 2025-12-04 11:57:37.507149 | controller | 2025-12-04 11:57:37.507194 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-12-04 11:57:37.507202 | controller | Thursday 04 December 2025 11:57:37 +0000 (0:00:00.303) 0:00:25.747 ***** 2025-12-04 11:57:37.507212 | controller | ok: [instance] 2025-12-04 11:57:37.817434 | controller | 2025-12-04 11:57:37.817472 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-12-04 11:57:37.817479 | controller | Thursday 04 December 2025 11:57:37 +0000 (0:00:00.402) 0:00:26.149 ***** 2025-12-04 11:57:37.817489 | controller | changed: [instance] 2025-12-04 11:57:38.099228 | controller | 2025-12-04 11:57:38.099254 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-12-04 11:57:38.099263 | controller | Thursday 04 December 2025 11:57:37 +0000 (0:00:00.310) 0:00:26.460 ***** 2025-12-04 11:57:38.099304 | controller | [WARNING]: Reset is not implemented for this connection 2025-12-04 11:57:38.109502 | controller | changed: [instance] 2025-12-04 11:57:38.109542 | controller | 2025-12-04 11:57:38.109552 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-12-04 11:57:38.109561 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.276) 0:00:26.736 ***** 2025-12-04 11:57:38.109568 | controller | 2025-12-04 11:57:38.109576 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-12-04 11:57:38.109586 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.015) 0:00:26.752 ***** 2025-12-04 11:57:38.192847 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-12-04 11:57:38.245485 | controller | 2025-12-04 11:57:38.245545 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-12-04 11:57:38.245557 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.083) 0:00:26.835 ***** 2025-12-04 11:57:38.245575 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-12-04 11:57:38.297596 | controller | 2025-12-04 11:57:38.297619 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 11:57:38.297629 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.052) 0:00:26.888 ***** 2025-12-04 11:57:38.297640 | controller | ok: [instance] => (item=compute) 2025-12-04 11:57:38.297686 | controller | ok: [instance] => (item=controller) 2025-12-04 11:57:38.297694 | controller | ok: [instance] => (item=crc) 2025-12-04 11:57:38.297703 | controller | 2025-12-04 11:57:38.297734 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 11:57:38.297904 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.051) 0:00:26.940 ***** 2025-12-04 11:57:38.342442 | controller | ok: [instance] 2025-12-04 11:57:38.342529 | controller | 2025-12-04 11:57:38.342554 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 11:57:38.342574 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.045) 0:00:26.985 ***** 2025-12-04 11:57:38.391055 | controller | ok: [instance] => changed=false 2025-12-04 11:57:38.437643 | controller | msg: All assertions passed 2025-12-04 11:57:38.437663 | controller | 2025-12-04 11:57:38.437671 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-12-04 11:57:38.437677 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.048) 0:00:27.034 ***** 2025-12-04 11:57:38.437686 | controller | 2025-12-04 11:57:38.437840 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-12-04 11:57:38.437986 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.046) 0:00:27.081 ***** 2025-12-04 11:57:38.515747 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-12-04 11:57:38.515917 | controller | ok: [instance] => (item={}) 2025-12-04 11:57:38.516053 | controller | 2025-12-04 11:57:38.516193 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-12-04 11:57:38.516369 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.078) 0:00:27.159 ***** 2025-12-04 11:57:38.538251 | controller | skipping: [instance] 2025-12-04 11:57:38.538486 | controller | 2025-12-04 11:57:38.538664 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-12-04 11:57:38.538818 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.022) 0:00:27.181 ***** 2025-12-04 11:57:38.783411 | controller | ok: [instance] 2025-12-04 11:57:38.783456 | controller | 2025-12-04 11:57:38.783464 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-12-04 11:57:38.783473 | controller | Thursday 04 December 2025 11:57:38 +0000 (0:00:00.244) 0:00:27.426 ***** 2025-12-04 11:57:39.177751 | controller | changed: [instance] 2025-12-04 11:57:40.013169 | controller | 2025-12-04 11:57:40.013246 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-12-04 11:57:40.013262 | controller | Thursday 04 December 2025 11:57:39 +0000 (0:00:00.394) 0:00:27.820 ***** 2025-12-04 11:57:40.013315 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-12-04 11:57:40.044459 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-12-04 11:57:40.044490 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-12-04 11:57:40.044503 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-12-04 11:57:40.044512 | controller | 2025-12-04 11:57:40.044521 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-12-04 11:57:40.044530 | controller | Thursday 04 December 2025 11:57:40 +0000 (0:00:00.834) 0:00:28.654 ***** 2025-12-04 11:57:40.044544 | controller | skipping: [instance] 2025-12-04 11:57:40.044591 | controller | 2025-12-04 11:57:40.044604 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-12-04 11:57:40.044710 | controller | Thursday 04 December 2025 11:57:40 +0000 (0:00:00.032) 0:00:28.687 ***** 2025-12-04 11:57:40.457018 | controller | changed: [instance] 2025-12-04 11:57:40.951721 | controller | 2025-12-04 11:57:40.951774 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-12-04 11:57:40.951783 | controller | Thursday 04 December 2025 11:57:40 +0000 (0:00:00.403) 0:00:29.090 ***** 2025-12-04 11:57:40.951789 | controller | 2025-12-04 11:57:40.951794 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-04 11:57:40.951799 | controller | Thursday 04 December 2025 11:57:40 +0000 (0:00:00.008) 0:00:29.099 ***** 2025-12-04 11:57:40.951822 | controller | changed: [instance] 2025-12-04 11:57:40.951853 | controller | 2025-12-04 11:57:40.952047 | controller | TASK [Ensure no default networks exists] *************************************** 2025-12-04 11:57:40.952107 | controller | Thursday 04 December 2025 11:57:40 +0000 (0:00:00.494) 0:00:29.594 ***** 2025-12-04 11:57:41.037458 | controller | 2025-12-04 11:57:42.335482 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-12-04 11:57:42.335525 | controller | Thursday 04 December 2025 11:57:41 +0000 (0:00:00.085) 0:00:29.680 ***** 2025-12-04 11:57:42.335540 | controller | ok: [instance] 2025-12-04 11:57:42.592055 | controller | 2025-12-04 11:57:42.592103 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-12-04 11:57:42.592113 | controller | Thursday 04 December 2025 11:57:42 +0000 (0:00:01.297) 0:00:30.977 ***** 2025-12-04 11:57:42.592128 | controller | ok: [instance] 2025-12-04 11:57:43.147294 | controller | 2025-12-04 11:57:43.147337 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-12-04 11:57:43.147345 | controller | Thursday 04 December 2025 11:57:42 +0000 (0:00:00.256) 0:00:31.234 ***** 2025-12-04 11:57:43.147356 | controller | ok: [instance] 2025-12-04 11:57:43.410941 | controller | 2025-12-04 11:57:43.410979 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-12-04 11:57:43.410988 | controller | Thursday 04 December 2025 11:57:43 +0000 (0:00:00.555) 0:00:31.789 ***** 2025-12-04 11:57:43.410999 | controller | ok: [instance] 2025-12-04 11:57:44.666033 | controller | 2025-12-04 11:57:44.666067 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-12-04 11:57:44.666075 | controller | Thursday 04 December 2025 11:57:43 +0000 (0:00:00.263) 0:00:32.053 ***** 2025-12-04 11:57:44.666085 | controller | ok: [instance] 2025-12-04 11:57:44.981859 | controller | 2025-12-04 11:57:44.981896 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-12-04 11:57:44.981904 | controller | Thursday 04 December 2025 11:57:44 +0000 (0:00:01.255) 0:00:33.308 ***** 2025-12-04 11:57:44.981916 | controller | ok: [instance] 2025-12-04 11:57:45.315320 | controller | 2025-12-04 11:57:45.315364 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-12-04 11:57:45.315372 | controller | Thursday 04 December 2025 11:57:44 +0000 (0:00:00.315) 0:00:33.624 ***** 2025-12-04 11:57:45.315404 | controller | changed: [instance] 2025-12-04 11:57:45.648182 | controller | 2025-12-04 11:57:45.648231 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-12-04 11:57:45.648239 | controller | Thursday 04 December 2025 11:57:45 +0000 (0:00:00.333) 0:00:33.957 ***** 2025-12-04 11:57:45.648250 | controller | changed: [instance] 2025-12-04 11:57:47.281073 | controller | 2025-12-04 11:57:47.281116 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-12-04 11:57:47.281124 | controller | Thursday 04 December 2025 11:57:45 +0000 (0:00:00.333) 0:00:34.290 ***** 2025-12-04 11:57:47.281134 | controller | changed: [instance] => (item=arptables) 2025-12-04 11:57:47.614019 | controller | changed: [instance] => (item=iptables) 2025-12-04 11:57:47.614057 | controller | changed: [instance] => (item=ip6tables) 2025-12-04 11:57:47.614064 | controller | 2025-12-04 11:57:47.614071 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-12-04 11:57:47.614077 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:01.632) 0:00:35.923 ***** 2025-12-04 11:57:47.614086 | controller | ok: [instance] 2025-12-04 11:57:47.711486 | controller | 2025-12-04 11:57:47.711541 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-12-04 11:57:47.711551 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:00.333) 0:00:36.256 ***** 2025-12-04 11:57:47.711566 | controller | ok: [instance] 2025-12-04 11:57:47.755987 | controller | 2025-12-04 11:57:47.756030 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-12-04 11:57:47.756041 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:00.097) 0:00:36.354 ***** 2025-12-04 11:57:47.756055 | controller | 2025-12-04 11:57:47.783301 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-12-04 11:57:47.783348 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:00.044) 0:00:36.399 ***** 2025-12-04 11:57:47.783359 | controller | skipping: [instance] 2025-12-04 11:57:47.809077 | controller | 2025-12-04 11:57:47.809106 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-12-04 11:57:47.809119 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:00.026) 0:00:36.425 ***** 2025-12-04 11:57:47.809133 | controller | skipping: [instance] 2025-12-04 11:57:47.834455 | controller | 2025-12-04 11:57:47.834485 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 11:57:47.834497 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:00.026) 0:00:36.451 ***** 2025-12-04 11:57:47.834512 | controller | skipping: [instance] 2025-12-04 11:57:47.834762 | controller | 2025-12-04 11:57:47.834997 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-12-04 11:57:47.835222 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:00.025) 0:00:36.477 ***** 2025-12-04 11:57:47.866622 | controller | skipping: [instance] 2025-12-04 11:57:47.866802 | controller | 2025-12-04 11:57:47.866963 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-12-04 11:57:47.867116 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:00.032) 0:00:36.509 ***** 2025-12-04 11:57:47.909247 | controller | ok: [instance] 2025-12-04 11:57:47.909462 | controller | 2025-12-04 11:57:47.909616 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-12-04 11:57:47.909745 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:00.042) 0:00:36.552 ***** 2025-12-04 11:57:47.946441 | controller | skipping: [instance] 2025-12-04 11:57:47.946666 | controller | 2025-12-04 11:57:47.946833 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-12-04 11:57:47.946974 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:00.036) 0:00:36.589 ***** 2025-12-04 11:57:47.972816 | controller | skipping: [instance] 2025-12-04 11:57:47.972984 | controller | 2025-12-04 11:57:47.973150 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-12-04 11:57:47.973347 | controller | Thursday 04 December 2025 11:57:47 +0000 (0:00:00.026) 0:00:36.616 ***** 2025-12-04 11:57:48.031769 | controller | ok: [instance] 2025-12-04 11:57:48.031955 | controller | 2025-12-04 11:57:48.032140 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-12-04 11:57:48.032342 | controller | Thursday 04 December 2025 11:57:48 +0000 (0:00:00.058) 0:00:36.675 ***** 2025-12-04 11:57:48.057527 | controller | skipping: [instance] 2025-12-04 11:57:48.057709 | controller | 2025-12-04 11:57:48.057862 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-12-04 11:57:48.057998 | controller | Thursday 04 December 2025 11:57:48 +0000 (0:00:00.025) 0:00:36.700 ***** 2025-12-04 11:57:48.107783 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-12-04 11:57:48.107967 | controller | 2025-12-04 11:57:48.108116 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-04 11:57:48.108262 | controller | Thursday 04 December 2025 11:57:48 +0000 (0:00:00.050) 0:00:36.751 ***** 2025-12-04 11:57:48.441522 | controller | ok: [instance -> localhost] 2025-12-04 11:57:48.441594 | controller | 2025-12-04 11:57:48.441606 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-12-04 11:57:48.441638 | controller | Thursday 04 December 2025 11:57:48 +0000 (0:00:00.333) 0:00:37.084 ***** 2025-12-04 11:57:56.399253 | controller | changed: [instance -> localhost] 2025-12-04 11:57:56.622729 | controller | 2025-12-04 11:57:56.622771 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-04 11:57:56.622780 | controller | Thursday 04 December 2025 11:57:56 +0000 (0:00:07.957) 0:00:45.041 ***** 2025-12-04 11:57:56.622790 | controller | changed: [instance] 2025-12-04 11:57:57.000023 | controller | 2025-12-04 11:57:57.000068 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-12-04 11:57:57.000077 | controller | Thursday 04 December 2025 11:57:56 +0000 (0:00:00.223) 0:00:45.265 ***** 2025-12-04 11:57:57.000097 | controller | changed: [instance] 2025-12-04 11:57:58.698415 | controller | 2025-12-04 11:57:58.698454 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-12-04 11:57:58.698461 | controller | Thursday 04 December 2025 11:57:56 +0000 (0:00:00.377) 0:00:45.642 ***** 2025-12-04 11:57:58.698471 | controller | changed: [instance -> localhost] 2025-12-04 11:57:59.073422 | controller | 2025-12-04 11:57:59.073480 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-12-04 11:57:59.073505 | controller | Thursday 04 December 2025 11:57:58 +0000 (0:00:01.698) 0:00:47.340 ***** 2025-12-04 11:57:59.073522 | controller | changed: [instance] 2025-12-04 11:57:59.110322 | controller | 2025-12-04 11:57:59.110386 | controller | TASK [reproducer : Select right domain] **************************************** 2025-12-04 11:57:59.110397 | controller | Thursday 04 December 2025 11:57:59 +0000 (0:00:00.375) 0:00:47.716 ***** 2025-12-04 11:57:59.110411 | controller | ok: [instance] 2025-12-04 11:57:59.228388 | controller | 2025-12-04 11:57:59.228413 | controller | TASK [Create the virtual networks] ********************************************* 2025-12-04 11:57:59.228423 | controller | Thursday 04 December 2025 11:57:59 +0000 (0:00:00.037) 0:00:47.753 ***** 2025-12-04 11:57:59.228434 | controller | 2025-12-04 11:57:59.252435 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-12-04 11:57:59.252498 | controller | Thursday 04 December 2025 11:57:59 +0000 (0:00:00.118) 0:00:47.871 ***** 2025-12-04 11:57:59.252517 | controller | ok: [instance] 2025-12-04 11:57:59.252651 | controller | 2025-12-04 11:57:59.252682 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-12-04 11:57:59.455214 | controller | Thursday 04 December 2025 11:57:59 +0000 (0:00:00.023) 0:00:47.895 ***** 2025-12-04 11:57:59.455257 | controller | ok: [instance] 2025-12-04 11:57:59.488515 | controller | 2025-12-04 11:57:59.488560 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-12-04 11:57:59.488571 | controller | Thursday 04 December 2025 11:57:59 +0000 (0:00:00.202) 0:00:48.097 ***** 2025-12-04 11:57:59.488585 | controller | skipping: [instance] 2025-12-04 11:57:59.524416 | controller | 2025-12-04 11:57:59.524431 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-12-04 11:57:59.524438 | controller | Thursday 04 December 2025 11:57:59 +0000 (0:00:00.033) 0:00:48.131 ***** 2025-12-04 11:57:59.524448 | controller | skipping: [instance] 2025-12-04 11:57:59.524795 | controller | 2025-12-04 11:57:59.524819 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-12-04 11:57:59.524830 | controller | Thursday 04 December 2025 11:57:59 +0000 (0:00:00.036) 0:00:48.167 ***** 2025-12-04 11:57:59.588571 | controller | ok: [instance] 2025-12-04 11:57:59.724222 | controller | 2025-12-04 11:57:59.724240 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-12-04 11:57:59.724246 | controller | Thursday 04 December 2025 11:57:59 +0000 (0:00:00.063) 0:00:48.230 ***** 2025-12-04 11:57:59.724255 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 11:57:59.761303 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 11:57:59.761320 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 11:57:59.761327 | controller | 2025-12-04 11:57:59.761333 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-12-04 11:57:59.761338 | controller | Thursday 04 December 2025 11:57:59 +0000 (0:00:00.135) 0:00:48.366 ***** 2025-12-04 11:57:59.761346 | controller | skipping: [instance] 2025-12-04 11:57:59.761496 | controller | 2025-12-04 11:57:59.761633 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-12-04 11:57:59.761758 | controller | Thursday 04 December 2025 11:57:59 +0000 (0:00:00.038) 0:00:48.404 ***** 2025-12-04 11:58:00.129815 | controller | changed: [instance] 2025-12-04 11:58:00.254452 | controller | 2025-12-04 11:58:00.254518 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-12-04 11:58:00.254527 | controller | Thursday 04 December 2025 11:58:00 +0000 (0:00:00.367) 0:00:48.772 ***** 2025-12-04 11:58:00.254550 | controller | changed: [instance] => (item=Adding compute-0 to computes) 2025-12-04 11:58:00.254569 | controller | changed: [instance] => (item=Adding controller-0 to controllers) 2025-12-04 11:58:00.254575 | controller | changed: [instance] => (item=Adding crc-0 to ocps) 2025-12-04 11:58:00.254581 | controller | 2025-12-04 11:58:00.254595 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-04 11:58:00.254612 | controller | Thursday 04 December 2025 11:58:00 +0000 (0:00:00.124) 0:00:48.897 ***** 2025-12-04 11:58:00.287773 | controller | skipping: [instance] 2025-12-04 11:58:00.287840 | controller | 2025-12-04 11:58:00.287968 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 11:58:00.288071 | controller | Thursday 04 December 2025 11:58:00 +0000 (0:00:00.033) 0:00:48.931 ***** 2025-12-04 11:58:00.320619 | controller | skipping: [instance] 2025-12-04 11:58:00.320768 | controller | 2025-12-04 11:58:00.320811 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-04 11:58:00.320937 | controller | Thursday 04 December 2025 11:58:00 +0000 (0:00:00.032) 0:00:48.964 ***** 2025-12-04 11:58:00.351146 | controller | skipping: [instance] 2025-12-04 11:58:00.351199 | controller | 2025-12-04 11:58:00.351386 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-04 11:58:00.351472 | controller | Thursday 04 December 2025 11:58:00 +0000 (0:00:00.030) 0:00:48.994 ***** 2025-12-04 11:58:00.385534 | controller | skipping: [instance] 2025-12-04 11:58:00.385630 | controller | 2025-12-04 11:58:00.385648 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-04 11:58:00.385733 | controller | Thursday 04 December 2025 11:58:00 +0000 (0:00:00.034) 0:00:49.028 ***** 2025-12-04 11:58:00.409519 | controller | ok: [instance] 2025-12-04 11:58:00.497035 | controller | 2025-12-04 11:58:00.497065 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-04 11:58:00.497075 | controller | Thursday 04 December 2025 11:58:00 +0000 (0:00:00.023) 0:00:49.052 ***** 2025-12-04 11:58:00.497090 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-04 11:58:00.518804 | controller | 2025-12-04 11:58:00.518824 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-04 11:58:00.518831 | controller | Thursday 04 December 2025 11:58:00 +0000 (0:00:00.087) 0:00:49.139 ***** 2025-12-04 11:58:00.518840 | controller | skipping: [instance] 2025-12-04 11:58:00.758907 | controller | 2025-12-04 11:58:00.758952 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-04 11:58:00.758962 | controller | Thursday 04 December 2025 11:58:00 +0000 (0:00:00.021) 0:00:49.161 ***** 2025-12-04 11:58:00.758973 | controller | changed: [instance] 2025-12-04 11:58:01.184110 | controller | 2025-12-04 11:58:01.184137 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-04 11:58:01.184145 | controller | Thursday 04 December 2025 11:58:00 +0000 (0:00:00.239) 0:00:49.401 ***** 2025-12-04 11:58:01.184155 | controller | changed: [instance] 2025-12-04 11:58:01.252597 | controller | 2025-12-04 11:58:01.252662 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-04 11:58:01.252676 | controller | Thursday 04 December 2025 11:58:01 +0000 (0:00:00.425) 0:00:49.827 ***** 2025-12-04 11:58:01.252695 | controller | ok: [instance] 2025-12-04 11:58:01.252726 | controller | 2025-12-04 11:58:01.252740 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-04 11:58:01.290380 | controller | Thursday 04 December 2025 11:58:01 +0000 (0:00:00.068) 0:00:49.895 ***** 2025-12-04 11:58:01.290400 | controller | ok: [instance] 2025-12-04 11:58:01.290480 | controller | 2025-12-04 11:58:01.290604 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-04 11:58:01.290710 | controller | Thursday 04 December 2025 11:58:01 +0000 (0:00:00.038) 0:00:49.933 ***** 2025-12-04 11:58:01.715555 | controller | changed: [instance] 2025-12-04 11:58:01.715615 | controller | 2025-12-04 11:58:01.715697 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-12-04 11:58:01.715829 | controller | Thursday 04 December 2025 11:58:01 +0000 (0:00:00.425) 0:00:50.358 ***** 2025-12-04 11:58:01.842037 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-12-04 11:58:01.901879 | controller | 2025-12-04 11:58:01.901902 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-12-04 11:58:01.901911 | controller | Thursday 04 December 2025 11:58:01 +0000 (0:00:00.126) 0:00:50.484 ***** 2025-12-04 11:58:01.901922 | controller | ok: [instance] => (item=public) 2025-12-04 11:58:02.403941 | controller | ok: [instance] => (item=osp_trunk) 2025-12-04 11:58:02.403991 | controller | 2025-12-04 11:58:02.404000 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-12-04 11:58:02.404021 | controller | Thursday 04 December 2025 11:58:01 +0000 (0:00:00.059) 0:00:50.544 ***** 2025-12-04 11:58:02.404032 | controller | changed: [instance] => (item=cifmw-public) 2025-12-04 11:58:03.088392 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:58:03.088437 | controller | 2025-12-04 11:58:03.088445 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-12-04 11:58:03.088451 | controller | Thursday 04 December 2025 11:58:02 +0000 (0:00:00.501) 0:00:51.046 ***** 2025-12-04 11:58:03.088461 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 11:58:03.579665 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:58:03.579706 | controller | 2025-12-04 11:58:03.579714 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-12-04 11:58:03.579720 | controller | Thursday 04 December 2025 11:58:03 +0000 (0:00:00.684) 0:00:51.730 ***** 2025-12-04 11:58:03.579730 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 11:58:04.046051 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:58:04.046092 | controller | 2025-12-04 11:58:04.046104 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-12-04 11:58:04.046112 | controller | Thursday 04 December 2025 11:58:03 +0000 (0:00:00.491) 0:00:52.222 ***** 2025-12-04 11:58:04.046130 | controller | changed: [instance] => (item=cifmw-public) 2025-12-04 11:58:04.104116 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:58:04.104142 | controller | 2025-12-04 11:58:04.104152 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-12-04 11:58:04.104160 | controller | Thursday 04 December 2025 11:58:04 +0000 (0:00:00.466) 0:00:52.688 ***** 2025-12-04 11:58:04.104172 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-12-04 11:58:04.304968 | controller | 2025-12-04 11:58:04.305025 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-12-04 11:58:04.305036 | controller | Thursday 04 December 2025 11:58:04 +0000 (0:00:00.058) 0:00:52.747 ***** 2025-12-04 11:58:04.305052 | controller | ok: [instance] 2025-12-04 11:58:04.740952 | controller | 2025-12-04 11:58:04.741004 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-12-04 11:58:04.741013 | controller | Thursday 04 December 2025 11:58:04 +0000 (0:00:00.200) 0:00:52.947 ***** 2025-12-04 11:58:04.741025 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 11:58:04.815478 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:58:04.815551 | controller | 2025-12-04 11:58:04.815563 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-12-04 11:58:04.815573 | controller | Thursday 04 December 2025 11:58:04 +0000 (0:00:00.435) 0:00:53.383 ***** 2025-12-04 11:58:04.815589 | controller | 2025-12-04 11:58:04.858153 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-04 11:58:04.858194 | controller | Thursday 04 December 2025 11:58:04 +0000 (0:00:00.074) 0:00:53.458 ***** 2025-12-04 11:58:04.858209 | controller | skipping: [instance] 2025-12-04 11:58:06.218670 | controller | 2025-12-04 11:58:06.218718 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-12-04 11:58:06.218726 | controller | Thursday 04 December 2025 11:58:04 +0000 (0:00:00.042) 0:00:53.501 ***** 2025-12-04 11:58:06.218736 | controller | ok: [instance] 2025-12-04 11:58:06.442480 | controller | 2025-12-04 11:58:06.442549 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-04 11:58:06.442561 | controller | Thursday 04 December 2025 11:58:06 +0000 (0:00:01.359) 0:00:54.861 ***** 2025-12-04 11:58:06.442577 | controller | ok: [instance] 2025-12-04 11:58:06.833473 | controller | 2025-12-04 11:58:06.833529 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-12-04 11:58:06.833549 | controller | Thursday 04 December 2025 11:58:06 +0000 (0:00:00.224) 0:00:55.085 ***** 2025-12-04 11:58:06.833564 | controller | changed: [instance] 2025-12-04 11:58:08.579467 | controller | 2025-12-04 11:58:08.579530 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-12-04 11:58:08.579541 | controller | Thursday 04 December 2025 11:58:06 +0000 (0:00:00.391) 0:00:55.476 ***** 2025-12-04 11:58:08.579566 | controller | changed: [instance] 2025-12-04 11:58:08.579606 | controller | 2025-12-04 11:58:08.579717 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-12-04 11:58:08.579762 | controller | Thursday 04 December 2025 11:58:08 +0000 (0:00:01.745) 0:00:57.222 ***** 2025-12-04 11:58:08.976525 | controller | changed: [instance] 2025-12-04 11:58:09.017499 | controller | 2025-12-04 11:58:09.017566 | controller | TASK [Create extra network configuration] ************************************** 2025-12-04 11:58:09.017577 | controller | Thursday 04 December 2025 11:58:08 +0000 (0:00:00.396) 0:00:57.618 ***** 2025-12-04 11:58:09.017592 | controller | skipping: [instance] 2025-12-04 11:58:09.054210 | controller | 2025-12-04 11:58:09.054261 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-12-04 11:58:09.054298 | controller | Thursday 04 December 2025 11:58:09 +0000 (0:00:00.041) 0:00:57.660 ***** 2025-12-04 11:58:09.054328 | controller | skipping: [instance] 2025-12-04 11:58:09.574939 | controller | 2025-12-04 11:58:09.575005 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-12-04 11:58:09.575027 | controller | Thursday 04 December 2025 11:58:09 +0000 (0:00:00.036) 0:00:57.697 ***** 2025-12-04 11:58:09.575040 | controller | ok: [instance] 2025-12-04 11:58:09.729486 | controller | 2025-12-04 11:58:09.729540 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-12-04 11:58:09.729550 | controller | Thursday 04 December 2025 11:58:09 +0000 (0:00:00.518) 0:00:58.215 ***** 2025-12-04 11:58:09.729576 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 11:58:11.107005 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:58:11.107063 | controller | 2025-12-04 11:58:11.107072 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-12-04 11:58:11.107079 | controller | Thursday 04 December 2025 11:58:09 +0000 (0:00:00.156) 0:00:58.371 ***** 2025-12-04 11:58:11.107090 | controller | ok: [instance] 2025-12-04 11:58:14.988248 | controller | 2025-12-04 11:58:14.988316 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-12-04 11:58:14.988325 | controller | Thursday 04 December 2025 11:58:11 +0000 (0:00:01.376) 0:00:59.748 ***** 2025-12-04 11:58:14.988337 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-12-04 11:58:15.227893 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-12-04 11:58:15.227931 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-12-04 11:58:15.227939 | controller | 2025-12-04 11:58:15.227946 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-12-04 11:58:15.227952 | controller | Thursday 04 December 2025 11:58:14 +0000 (0:00:03.881) 0:01:03.630 ***** 2025-12-04 11:58:15.227963 | controller | changed: [instance] 2025-12-04 11:58:15.617464 | controller | 2025-12-04 11:58:15.617530 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-12-04 11:58:15.617539 | controller | Thursday 04 December 2025 11:58:15 +0000 (0:00:00.240) 0:01:03.870 ***** 2025-12-04 11:58:15.617552 | controller | changed: [instance] 2025-12-04 11:58:16.035936 | controller | 2025-12-04 11:58:16.035988 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-12-04 11:58:16.035997 | controller | Thursday 04 December 2025 11:58:15 +0000 (0:00:00.389) 0:01:04.260 ***** 2025-12-04 11:58:16.036009 | controller | changed: [instance] 2025-12-04 11:58:16.069237 | controller | 2025-12-04 11:58:16.069264 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-12-04 11:58:16.069296 | controller | Thursday 04 December 2025 11:58:16 +0000 (0:00:00.418) 0:01:04.678 ***** 2025-12-04 11:58:16.069310 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-12-04 11:58:16.481423 | controller | 2025-12-04 11:58:16.481482 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-12-04 11:58:16.481493 | controller | Thursday 04 December 2025 11:58:16 +0000 (0:00:00.033) 0:01:04.712 ***** 2025-12-04 11:58:16.481508 | controller | changed: [instance] 2025-12-04 11:58:16.503485 | controller | 2025-12-04 11:58:16.503541 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-12-04 11:58:16.503553 | controller | Thursday 04 December 2025 11:58:16 +0000 (0:00:00.411) 0:01:05.124 ***** 2025-12-04 11:58:16.503568 | controller | skipping: [instance] 2025-12-04 11:58:16.539971 | controller | 2025-12-04 11:58:16.540003 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-12-04 11:58:16.540012 | controller | Thursday 04 December 2025 11:58:16 +0000 (0:00:00.022) 0:01:05.146 ***** 2025-12-04 11:58:16.540023 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-12-04 11:58:16.950089 | controller | 2025-12-04 11:58:16.950121 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-12-04 11:58:16.950130 | controller | Thursday 04 December 2025 11:58:16 +0000 (0:00:00.036) 0:01:05.182 ***** 2025-12-04 11:58:16.950140 | controller | changed: [instance] 2025-12-04 11:58:16.972471 | controller | 2025-12-04 11:58:16.972538 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-12-04 11:58:16.972550 | controller | Thursday 04 December 2025 11:58:16 +0000 (0:00:00.410) 0:01:05.592 ***** 2025-12-04 11:58:16.972565 | controller | skipping: [instance] 2025-12-04 11:58:16.972601 | controller | 2025-12-04 11:58:16.972624 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-12-04 11:58:16.972689 | controller | Thursday 04 December 2025 11:58:16 +0000 (0:00:00.022) 0:01:05.615 ***** 2025-12-04 11:58:17.192483 | controller | ok: [instance] => (item=127.0.0.2) 2025-12-04 11:58:17.192571 | controller | 2025-12-04 11:58:17.192968 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-12-04 11:58:17.918453 | controller | Thursday 04 December 2025 11:58:17 +0000 (0:00:00.219) 0:01:05.835 ***** 2025-12-04 11:58:17.918513 | controller | changed: [instance] 2025-12-04 11:58:17.939414 | controller | 2025-12-04 11:58:17.939460 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-12-04 11:58:17.939481 | controller | Thursday 04 December 2025 11:58:17 +0000 (0:00:00.725) 0:01:06.561 ***** 2025-12-04 11:58:17.939496 | controller | skipping: [instance] 2025-12-04 11:58:17.939530 | controller | 2025-12-04 11:58:17.939674 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-12-04 11:58:17.939697 | controller | Thursday 04 December 2025 11:58:17 +0000 (0:00:00.021) 0:01:06.582 ***** 2025-12-04 11:58:17.959073 | controller | skipping: [instance] 2025-12-04 11:58:17.988355 | controller | 2025-12-04 11:58:17.988372 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-12-04 11:58:17.988379 | controller | Thursday 04 December 2025 11:58:17 +0000 (0:00:00.019) 0:01:06.602 ***** 2025-12-04 11:58:17.988389 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-04 11:58:17.988415 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-12-04 11:58:17.988423 | controller | skipping: [instance] 2025-12-04 11:58:17.988431 | controller | 2025-12-04 11:58:17.988600 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-12-04 11:58:18.112923 | controller | Thursday 04 December 2025 11:58:17 +0000 (0:00:00.029) 0:01:06.631 ***** 2025-12-04 11:58:18.112957 | controller | 2025-12-04 11:58:18.147390 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-04 11:58:18.147422 | controller | Thursday 04 December 2025 11:58:18 +0000 (0:00:00.124) 0:01:06.755 ***** 2025-12-04 11:58:18.147436 | controller | ok: [instance] => changed=false 2025-12-04 11:58:18.187884 | controller | msg: All assertions passed 2025-12-04 11:58:18.187909 | controller | 2025-12-04 11:58:18.187918 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-04 11:58:18.187926 | controller | Thursday 04 December 2025 11:58:18 +0000 (0:00:00.034) 0:01:06.790 ***** 2025-12-04 11:58:18.187936 | controller | ok: [instance] => changed=false 2025-12-04 11:58:18.188117 | controller | msg: All assertions passed 2025-12-04 11:58:18.188304 | controller | 2025-12-04 11:58:18.188492 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-04 11:58:18.188678 | controller | Thursday 04 December 2025 11:58:18 +0000 (0:00:00.040) 0:01:06.831 ***** 2025-12-04 11:58:18.648473 | controller | changed: [instance] 2025-12-04 11:58:18.648528 | controller | 2025-12-04 11:58:18.648542 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-04 11:58:18.669859 | controller | Thursday 04 December 2025 11:58:18 +0000 (0:00:00.459) 0:01:07.290 ***** 2025-12-04 11:58:18.669885 | controller | skipping: [instance] 2025-12-04 11:58:18.696765 | controller | 2025-12-04 11:58:18.696783 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-04 11:58:18.696791 | controller | Thursday 04 December 2025 11:58:18 +0000 (0:00:00.021) 0:01:07.312 ***** 2025-12-04 11:58:18.696799 | controller | skipping: [instance] 2025-12-04 11:58:18.728997 | controller | 2025-12-04 11:58:18.729015 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-04 11:58:18.729023 | controller | Thursday 04 December 2025 11:58:18 +0000 (0:00:00.026) 0:01:07.339 ***** 2025-12-04 11:58:18.729037 | controller | ok: [instance] => changed=false 2025-12-04 11:58:18.769321 | controller | msg: All assertions passed 2025-12-04 11:58:18.769344 | controller | 2025-12-04 11:58:18.769354 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-04 11:58:18.769361 | controller | Thursday 04 December 2025 11:58:18 +0000 (0:00:00.032) 0:01:07.371 ***** 2025-12-04 11:58:18.769372 | controller | ok: [instance] => changed=false 2025-12-04 11:58:19.226107 | controller | msg: All assertions passed 2025-12-04 11:58:19.226151 | controller | 2025-12-04 11:58:19.226160 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-04 11:58:19.226167 | controller | Thursday 04 December 2025 11:58:18 +0000 (0:00:00.040) 0:01:07.412 ***** 2025-12-04 11:58:19.226179 | controller | changed: [instance] 2025-12-04 11:58:19.248382 | controller | 2025-12-04 11:58:19.248406 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-04 11:58:19.248415 | controller | Thursday 04 December 2025 11:58:19 +0000 (0:00:00.456) 0:01:07.868 ***** 2025-12-04 11:58:19.248426 | controller | skipping: [instance] 2025-12-04 11:58:19.248456 | controller | 2025-12-04 11:58:19.248713 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-04 11:58:19.275948 | controller | Thursday 04 December 2025 11:58:19 +0000 (0:00:00.022) 0:01:07.891 ***** 2025-12-04 11:58:19.275967 | controller | skipping: [instance] 2025-12-04 11:58:19.309388 | controller | 2025-12-04 11:58:19.309411 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2025-12-04 11:58:19.309419 | controller | Thursday 04 December 2025 11:58:19 +0000 (0:00:00.027) 0:01:07.919 ***** 2025-12-04 11:58:19.309428 | controller | skipping: [instance] 2025-12-04 11:58:19.842645 | controller | 2025-12-04 11:58:19.842693 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-12-04 11:58:19.842703 | controller | Thursday 04 December 2025 11:58:19 +0000 (0:00:00.033) 0:01:07.952 ***** 2025-12-04 11:58:19.842724 | controller | changed: [instance] => (item=cifmw-public) 2025-12-04 11:58:19.843011 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:58:19.884066 | controller | 2025-12-04 11:58:19.884095 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-04 11:58:19.884103 | controller | Thursday 04 December 2025 11:58:19 +0000 (0:00:00.532) 0:01:08.485 ***** 2025-12-04 11:58:19.884115 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-12-04 11:58:20.237045 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-12-04 11:58:20.237098 | controller | 2025-12-04 11:58:20.237108 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-04 11:58:20.237116 | controller | Thursday 04 December 2025 11:58:19 +0000 (0:00:00.041) 0:01:08.526 ***** 2025-12-04 11:58:20.237128 | controller | ok: [instance] 2025-12-04 11:58:20.282997 | controller | 2025-12-04 11:58:20.283014 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-04 11:58:20.283021 | controller | Thursday 04 December 2025 11:58:20 +0000 (0:00:00.353) 0:01:08.879 ***** 2025-12-04 11:58:20.283030 | controller | ok: [instance] 2025-12-04 11:58:20.513210 | controller | 2025-12-04 11:58:20.513235 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-04 11:58:20.513244 | controller | Thursday 04 December 2025 11:58:20 +0000 (0:00:00.046) 0:01:08.926 ***** 2025-12-04 11:58:20.513256 | controller | ok: [instance] 2025-12-04 11:58:20.557629 | controller | 2025-12-04 11:58:20.557694 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-04 11:58:20.557705 | controller | Thursday 04 December 2025 11:58:20 +0000 (0:00:00.229) 0:01:09.155 ***** 2025-12-04 11:58:20.557721 | controller | ok: [instance] 2025-12-04 11:58:20.942123 | controller | 2025-12-04 11:58:20.942181 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-12-04 11:58:20.942191 | controller | Thursday 04 December 2025 11:58:20 +0000 (0:00:00.044) 0:01:09.200 ***** 2025-12-04 11:58:20.942208 | controller | changed: [instance] 2025-12-04 11:58:21.318699 | controller | 2025-12-04 11:58:21.318737 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-12-04 11:58:21.318745 | controller | Thursday 04 December 2025 11:58:20 +0000 (0:00:00.384) 0:01:09.584 ***** 2025-12-04 11:58:21.318755 | controller | changed: [instance] 2025-12-04 11:58:21.695723 | controller | 2025-12-04 11:58:21.695764 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-12-04 11:58:21.695772 | controller | Thursday 04 December 2025 11:58:21 +0000 (0:00:00.377) 0:01:09.961 ***** 2025-12-04 11:58:21.695785 | controller | changed: [instance] 2025-12-04 11:58:21.854987 | controller | 2025-12-04 11:58:21.855006 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-12-04 11:58:21.855013 | controller | Thursday 04 December 2025 11:58:21 +0000 (0:00:00.376) 0:01:10.338 ***** 2025-12-04 11:58:21.855021 | controller | ok: [instance] 2025-12-04 11:58:22.224794 | controller | 2025-12-04 11:58:22.224845 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-12-04 11:58:22.224855 | controller | Thursday 04 December 2025 11:58:21 +0000 (0:00:00.159) 0:01:10.498 ***** 2025-12-04 11:58:22.224867 | controller | changed: [instance] 2025-12-04 11:58:22.254265 | controller | 2025-12-04 11:58:22.254302 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-04 11:58:22.254309 | controller | Thursday 04 December 2025 11:58:22 +0000 (0:00:00.369) 0:01:10.867 ***** 2025-12-04 11:58:22.254317 | controller | skipping: [instance] 2025-12-04 11:58:22.281719 | controller | 2025-12-04 11:58:22.281738 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 11:58:22.281745 | controller | Thursday 04 December 2025 11:58:22 +0000 (0:00:00.030) 0:01:10.897 ***** 2025-12-04 11:58:22.281753 | controller | skipping: [instance] 2025-12-04 11:58:22.307974 | controller | 2025-12-04 11:58:22.307995 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-04 11:58:22.308004 | controller | Thursday 04 December 2025 11:58:22 +0000 (0:00:00.027) 0:01:10.924 ***** 2025-12-04 11:58:22.308014 | controller | skipping: [instance] 2025-12-04 11:58:22.342513 | controller | 2025-12-04 11:58:22.342585 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-04 11:58:22.342601 | controller | Thursday 04 December 2025 11:58:22 +0000 (0:00:00.026) 0:01:10.951 ***** 2025-12-04 11:58:22.342623 | controller | skipping: [instance] 2025-12-04 11:58:22.365821 | controller | 2025-12-04 11:58:22.365853 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-04 11:58:22.365864 | controller | Thursday 04 December 2025 11:58:22 +0000 (0:00:00.034) 0:01:10.985 ***** 2025-12-04 11:58:22.365876 | controller | ok: [instance] 2025-12-04 11:58:22.456342 | controller | 2025-12-04 11:58:22.456362 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-04 11:58:22.456378 | controller | Thursday 04 December 2025 11:58:22 +0000 (0:00:00.023) 0:01:11.008 ***** 2025-12-04 11:58:22.456390 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-04 11:58:22.477738 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-04 11:58:22.477774 | controller | 2025-12-04 11:58:22.477787 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-04 11:58:22.477796 | controller | Thursday 04 December 2025 11:58:22 +0000 (0:00:00.090) 0:01:11.099 ***** 2025-12-04 11:58:22.477810 | controller | skipping: [instance] 2025-12-04 11:58:22.478042 | controller | 2025-12-04 11:58:22.478316 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-04 11:58:22.478484 | controller | Thursday 04 December 2025 11:58:22 +0000 (0:00:00.021) 0:01:11.121 ***** 2025-12-04 11:58:22.709938 | controller | ok: [instance] 2025-12-04 11:58:23.159476 | controller | 2025-12-04 11:58:23.159518 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-04 11:58:23.159527 | controller | Thursday 04 December 2025 11:58:22 +0000 (0:00:00.231) 0:01:11.352 ***** 2025-12-04 11:58:23.159537 | controller | changed: [instance] 2025-12-04 11:58:23.228478 | controller | 2025-12-04 11:58:23.228531 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-04 11:58:23.228542 | controller | Thursday 04 December 2025 11:58:23 +0000 (0:00:00.449) 0:01:11.801 ***** 2025-12-04 11:58:23.228556 | controller | ok: [instance] 2025-12-04 11:58:23.266230 | controller | 2025-12-04 11:58:23.266268 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-04 11:58:23.266307 | controller | Thursday 04 December 2025 11:58:23 +0000 (0:00:00.069) 0:01:11.871 ***** 2025-12-04 11:58:23.266320 | controller | ok: [instance] 2025-12-04 11:58:23.719442 | controller | 2025-12-04 11:58:23.719483 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-04 11:58:23.719491 | controller | Thursday 04 December 2025 11:58:23 +0000 (0:00:00.037) 0:01:11.909 ***** 2025-12-04 11:58:23.719504 | controller | changed: [instance] 2025-12-04 11:58:23.752499 | controller | 2025-12-04 11:58:23.752559 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-12-04 11:58:23.752574 | controller | Thursday 04 December 2025 11:58:23 +0000 (0:00:00.452) 0:01:12.361 ***** 2025-12-04 11:58:23.752595 | controller | ok: [instance] 2025-12-04 11:58:23.775413 | controller | 2025-12-04 11:58:23.775442 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-12-04 11:58:23.775451 | controller | Thursday 04 December 2025 11:58:23 +0000 (0:00:00.033) 0:01:12.395 ***** 2025-12-04 11:58:23.775463 | controller | ok: [instance] 2025-12-04 11:58:23.797461 | controller | 2025-12-04 11:58:23.797500 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-12-04 11:58:23.797514 | controller | Thursday 04 December 2025 11:58:23 +0000 (0:00:00.022) 0:01:12.418 ***** 2025-12-04 11:58:23.797531 | controller | ok: [instance] 2025-12-04 11:58:23.797588 | controller | 2025-12-04 11:58:23.797602 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-12-04 11:58:23.797790 | controller | Thursday 04 December 2025 11:58:23 +0000 (0:00:00.022) 0:01:12.440 ***** 2025-12-04 11:58:23.872439 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-12-04 11:58:23.872500 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-12-04 11:58:23.872511 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-12-04 11:58:23.872518 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-12-04 11:58:23.872525 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-12-04 11:58:23.872532 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-12-04 11:58:23.872542 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-12-04 11:58:23.872837 | controller | 2025-12-04 11:58:24.022479 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 11:58:24.022529 | controller | Thursday 04 December 2025 11:58:23 +0000 (0:00:00.074) 0:01:12.515 ***** 2025-12-04 11:58:24.022550 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-12-04 11:58:24.105518 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-12-04 11:58:24.105567 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-12-04 11:58:24.105577 | controller | 2025-12-04 11:58:24.105585 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 11:58:24.105593 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.149) 0:01:12.665 ***** 2025-12-04 11:58:24.105608 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-12-04 11:58:24.188465 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-12-04 11:58:24.188515 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-12-04 11:58:24.188529 | controller | skipping: [instance] 2025-12-04 11:58:24.188539 | controller | 2025-12-04 11:58:24.188549 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 11:58:24.188560 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.083) 0:01:12.748 ***** 2025-12-04 11:58:24.188579 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-12-04 11:58:24.282429 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-12-04 11:58:24.282458 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-12-04 11:58:24.282468 | controller | skipping: [instance] 2025-12-04 11:58:24.282475 | controller | 2025-12-04 11:58:24.282482 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 11:58:24.282489 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.082) 0:01:12.831 ***** 2025-12-04 11:58:24.282501 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-12-04 11:58:24.282953 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-12-04 11:58:24.282986 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-12-04 11:58:24.372487 | controller | skipping: [instance] 2025-12-04 11:58:24.372529 | controller | 2025-12-04 11:58:24.372545 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 11:58:24.372556 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.094) 0:01:12.925 ***** 2025-12-04 11:58:24.372586 | controller | skipping: [instance] => (item=compute-0 - external) 2025-12-04 11:58:24.460962 | controller | skipping: [instance] => (item=controller-0 - external) 2025-12-04 11:58:24.461014 | controller | skipping: [instance] => (item=crc-0 - external) 2025-12-04 11:58:24.461029 | controller | skipping: [instance] 2025-12-04 11:58:24.461039 | controller | 2025-12-04 11:58:24.461049 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 11:58:24.461060 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.089) 0:01:13.015 ***** 2025-12-04 11:58:24.461077 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-12-04 11:58:24.461157 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-12-04 11:58:24.461177 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-12-04 11:58:24.461295 | controller | skipping: [instance] 2025-12-04 11:58:24.461385 | controller | 2025-12-04 11:58:24.461515 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 11:58:24.461605 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.089) 0:01:13.104 ***** 2025-12-04 11:58:24.606392 | controller | ok: [instance] => (item=compute-0 - public) 2025-12-04 11:58:24.606556 | controller | ok: [instance] => (item=controller-0 - public) 2025-12-04 11:58:24.606694 | controller | ok: [instance] => (item=crc-0 - public) 2025-12-04 11:58:24.606806 | controller | 2025-12-04 11:58:24.606962 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-12-04 11:58:24.607055 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.145) 0:01:13.249 ***** 2025-12-04 11:58:24.715369 | controller | 2025-12-04 11:58:24.715473 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-12-04 11:58:24.715617 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.108) 0:01:13.358 ***** 2025-12-04 11:58:24.763946 | controller | ok: [instance] 2025-12-04 11:58:24.764121 | controller | 2025-12-04 11:58:24.764364 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-12-04 11:58:24.764601 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.048) 0:01:13.407 ***** 2025-12-04 11:58:24.864902 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:2a:3b:cc', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-04 11:58:24.864992 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:22:1a:9a', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-04 11:58:24.865115 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:fc:b1:08', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-04 11:58:24.865237 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:9f:fc:b1', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-04 11:58:24.865377 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a5:cd:1f', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-04 11:58:24.865496 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:42:57:23', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-04 11:58:24.865588 | controller | 2025-12-04 11:58:24.865714 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-12-04 11:58:24.865806 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.101) 0:01:13.508 ***** 2025-12-04 11:58:24.920415 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-12-04 11:58:24.920530 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-12-04 11:58:24.920645 | controller | 2025-12-04 11:58:24.920791 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-04 11:58:24.920908 | controller | Thursday 04 December 2025 11:58:24 +0000 (0:00:00.055) 0:01:13.563 ***** 2025-12-04 11:58:25.118258 | controller | ok: [instance] 2025-12-04 11:58:25.150480 | controller | 2025-12-04 11:58:25.150535 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-04 11:58:25.150551 | controller | Thursday 04 December 2025 11:58:25 +0000 (0:00:00.197) 0:01:13.761 ***** 2025-12-04 11:58:25.150564 | controller | ok: [instance] 2025-12-04 11:58:25.150601 | controller | 2025-12-04 11:58:25.150686 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-04 11:58:25.150715 | controller | Thursday 04 December 2025 11:58:25 +0000 (0:00:00.032) 0:01:13.793 ***** 2025-12-04 11:58:25.336245 | controller | ok: [instance] 2025-12-04 11:58:25.363507 | controller | 2025-12-04 11:58:25.363608 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-04 11:58:25.363619 | controller | Thursday 04 December 2025 11:58:25 +0000 (0:00:00.185) 0:01:13.979 ***** 2025-12-04 11:58:25.363644 | controller | ok: [instance] 2025-12-04 11:58:25.386977 | controller | 2025-12-04 11:58:25.387002 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-12-04 11:58:25.387011 | controller | Thursday 04 December 2025 11:58:25 +0000 (0:00:00.027) 0:01:14.006 ***** 2025-12-04 11:58:25.387021 | controller | ok: [instance] 2025-12-04 11:58:25.614260 | controller | 2025-12-04 11:58:25.614304 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-12-04 11:58:25.614314 | controller | Thursday 04 December 2025 11:58:25 +0000 (0:00:00.023) 0:01:14.030 ***** 2025-12-04 11:58:25.614325 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:2a:3b:cc', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-04 11:58:25.665025 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:22:1a:9a', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-04 11:58:25.665050 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:fc:b1:08', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-04 11:58:25.665060 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:9f:fc:b1', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-04 11:58:25.665067 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a5:cd:1f', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-04 11:58:25.665075 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:42:57:23', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-04 11:58:25.665082 | controller | 2025-12-04 11:58:25.665088 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-12-04 11:58:25.665094 | controller | Thursday 04 December 2025 11:58:25 +0000 (0:00:00.226) 0:01:14.256 ***** 2025-12-04 11:58:25.665102 | controller | ok: [instance] 2025-12-04 11:58:27.902437 | controller | 2025-12-04 11:58:27.902482 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-12-04 11:58:27.902491 | controller | Thursday 04 December 2025 11:58:25 +0000 (0:00:00.051) 0:01:14.307 ***** 2025-12-04 11:58:27.902505 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:2a:3b:cc', 'entry': 'set:compute,52:54:00:2a:3b:cc,192.168.140.100,compute-0', 'state': 'present'}) 2025-12-04 11:58:27.929379 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:22:1a:9a', 'entry': 'set:controller,52:54:01:22:1a:9a,192.168.140.9,controller-0', 'state': 'present'}) 2025-12-04 11:58:27.929402 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:fc:b1:08', 'entry': 'set:ocp,52:54:02:fc:b1:08,192.168.140.10,crc-0', 'state': 'present'}) 2025-12-04 11:58:27.929411 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:9f:fc:b1', 'entry': 'set:compute,52:54:00:9f:fc:b1,192.168.101.100,compute-0', 'state': 'present'}) 2025-12-04 11:58:27.929417 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:a5:cd:1f', 'entry': 'set:controller,52:54:01:a5:cd:1f,192.168.101.9,controller-0', 'state': 'present'}) 2025-12-04 11:58:27.929423 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:42:57:23', 'entry': 'set:ocp,52:54:02:42:57:23,192.168.101.10,crc-0', 'state': 'present'}) 2025-12-04 11:58:27.929436 | controller | 2025-12-04 11:58:27.929443 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-12-04 11:58:27.929449 | controller | Thursday 04 December 2025 11:58:27 +0000 (0:00:02.236) 0:01:16.544 ***** 2025-12-04 11:58:27.929459 | controller | skipping: [instance] 2025-12-04 11:58:27.929501 | controller | 2025-12-04 11:58:27.929509 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-12-04 11:58:27.929530 | controller | Thursday 04 December 2025 11:58:27 +0000 (0:00:00.028) 0:01:16.572 ***** 2025-12-04 11:58:28.145034 | controller | ok: [instance] => (item=compute-0) 2025-12-04 11:58:28.269205 | controller | ok: [instance] => (item=controller-0) 2025-12-04 11:58:28.269229 | controller | ok: [instance] => (item=crc-0) 2025-12-04 11:58:28.269239 | controller | 2025-12-04 11:58:28.269247 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-12-04 11:58:28.269254 | controller | Thursday 04 December 2025 11:58:28 +0000 (0:00:00.215) 0:01:16.787 ***** 2025-12-04 11:58:28.269264 | controller | 2025-12-04 11:58:28.322440 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-04 11:58:28.322480 | controller | Thursday 04 December 2025 11:58:28 +0000 (0:00:00.124) 0:01:16.912 ***** 2025-12-04 11:58:28.322500 | controller | ok: [instance] 2025-12-04 11:58:28.519437 | controller | 2025-12-04 11:58:28.519477 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 11:58:28.519487 | controller | Thursday 04 December 2025 11:58:28 +0000 (0:00:00.052) 0:01:16.965 ***** 2025-12-04 11:58:28.519501 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 11:58:28.519536 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 11:58:28.519547 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-04 11:58:28.519709 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-04 11:58:28.519886 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-04 11:58:28.520004 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-04 11:58:28.520182 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-04 11:58:28.520286 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 11:58:28.520445 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 11:58:28.520554 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-04 11:58:28.520678 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 11:58:28.520794 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 11:58:28.520907 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-04 11:58:28.521018 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-04 11:58:28.521130 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-04 11:58:28.521242 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-04 11:58:28.521365 | controller | 2025-12-04 11:58:28.521483 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 11:58:28.521593 | controller | Thursday 04 December 2025 11:58:28 +0000 (0:00:00.197) 0:01:17.162 ***** 2025-12-04 11:58:32.193478 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 11:58:32.193565 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 11:58:32.193577 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-04 11:58:32.193587 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-04 11:58:32.193598 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-04 11:58:32.193630 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-04 11:58:32.194942 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-04 11:58:32.226453 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 11:58:32.226506 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 11:58:32.226516 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-04 11:58:32.226524 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 11:58:32.226531 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 11:58:32.226539 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-04 11:58:32.226546 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-04 11:58:32.226553 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-04 11:58:32.226560 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-04 11:58:32.226567 | controller | 2025-12-04 11:58:32.226574 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2025-12-04 11:58:32.226582 | controller | Thursday 04 December 2025 11:58:32 +0000 (0:00:03.673) 0:01:20.835 ***** 2025-12-04 11:58:32.226595 | controller | ok: [instance] 2025-12-04 11:58:32.282518 | controller | 2025-12-04 11:58:32.282587 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2025-12-04 11:58:32.282603 | controller | Thursday 04 December 2025 11:58:32 +0000 (0:00:00.033) 0:01:20.869 ***** 2025-12-04 11:58:32.282621 | controller | skipping: [instance] => (item=compute) 2025-12-04 11:58:32.282699 | controller | skipping: [instance] => (item=controller) 2025-12-04 11:58:32.282712 | controller | skipping: [instance] => (item=crc) 2025-12-04 11:58:32.282732 | controller | skipping: [instance] 2025-12-04 11:58:32.282746 | controller | 2025-12-04 11:58:32.282836 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2025-12-04 11:58:32.282869 | controller | Thursday 04 December 2025 11:58:32 +0000 (0:00:00.056) 0:01:20.925 ***** 2025-12-04 11:58:32.324427 | controller | skipping: [instance] 2025-12-04 11:58:32.324457 | controller | 2025-12-04 11:58:32.324468 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-12-04 11:58:32.324589 | controller | Thursday 04 December 2025 11:58:32 +0000 (0:00:00.042) 0:01:20.967 ***** 2025-12-04 11:58:32.770291 | controller | changed: [instance] 2025-12-04 11:58:33.679411 | controller | 2025-12-04 11:58:33.679467 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-12-04 11:58:33.679479 | controller | Thursday 04 December 2025 11:58:32 +0000 (0:00:00.434) 0:01:21.401 ***** 2025-12-04 11:58:33.679485 | controller | 2025-12-04 11:58:33.679491 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-04 11:58:33.679497 | controller | Thursday 04 December 2025 11:58:32 +0000 (0:00:00.010) 0:01:21.411 ***** 2025-12-04 11:58:33.679509 | controller | changed: [instance] 2025-12-04 11:58:33.679542 | controller | 2025-12-04 11:58:33.679716 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-04 11:58:33.679779 | controller | Thursday 04 December 2025 11:58:33 +0000 (0:00:00.910) 0:01:22.322 ***** 2025-12-04 11:58:34.099438 | controller | changed: [instance] 2025-12-04 11:58:34.512825 | controller | 2025-12-04 11:58:34.512881 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-12-04 11:58:34.512892 | controller | Thursday 04 December 2025 11:58:34 +0000 (0:00:00.419) 0:01:22.741 ***** 2025-12-04 11:58:34.512906 | controller | changed: [instance] 2025-12-04 11:58:34.934022 | controller | 2025-12-04 11:58:34.934074 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-12-04 11:58:34.934083 | controller | Thursday 04 December 2025 11:58:34 +0000 (0:00:00.413) 0:01:23.155 ***** 2025-12-04 11:58:34.934095 | controller | changed: [instance] 2025-12-04 11:58:35.350432 | controller | 2025-12-04 11:58:35.350480 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-12-04 11:58:35.350490 | controller | Thursday 04 December 2025 11:58:34 +0000 (0:00:00.421) 0:01:23.576 ***** 2025-12-04 11:58:35.350504 | controller | changed: [instance] 2025-12-04 11:58:35.350540 | controller | 2025-12-04 11:58:35.350550 | controller | TASK [Build utility records dataset] ******************************************* 2025-12-04 11:58:35.387194 | controller | Thursday 04 December 2025 11:58:35 +0000 (0:00:00.416) 0:01:23.993 ***** 2025-12-04 11:58:35.387220 | controller | 2025-12-04 11:58:35.486142 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-04 11:58:35.486170 | controller | Thursday 04 December 2025 11:58:35 +0000 (0:00:00.037) 0:01:24.030 ***** 2025-12-04 11:58:35.486184 | controller | ok: [instance] 2025-12-04 11:58:35.635050 | controller | 2025-12-04 11:58:35.635073 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 11:58:35.635083 | controller | Thursday 04 December 2025 11:58:35 +0000 (0:00:00.098) 0:01:24.129 ***** 2025-12-04 11:58:35.635094 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-04 11:58:35.635311 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 11:58:35.635490 | controller | 2025-12-04 11:58:35.635656 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 11:58:35.635830 | controller | Thursday 04 December 2025 11:58:35 +0000 (0:00:00.149) 0:01:24.278 ***** 2025-12-04 11:58:36.174497 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-04 11:58:36.174560 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 11:58:36.174570 | controller | 2025-12-04 11:58:36.174577 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-04 11:58:36.174585 | controller | Thursday 04 December 2025 11:58:36 +0000 (0:00:00.528) 0:01:24.806 ***** 2025-12-04 11:58:36.174593 | controller | 2025-12-04 11:58:36.174628 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-04 11:58:36.174637 | controller | Thursday 04 December 2025 11:58:36 +0000 (0:00:00.010) 0:01:24.816 ***** 2025-12-04 11:58:36.741670 | controller | changed: [instance] 2025-12-04 11:58:37.140036 | controller | 2025-12-04 11:58:37.140084 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-04 11:58:37.140093 | controller | Thursday 04 December 2025 11:58:36 +0000 (0:00:00.565) 0:01:25.382 ***** 2025-12-04 11:58:37.140105 | controller | changed: [instance] 2025-12-04 11:58:37.181441 | controller | 2025-12-04 11:58:37.181477 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-12-04 11:58:37.181487 | controller | Thursday 04 December 2025 11:58:37 +0000 (0:00:00.399) 0:01:25.782 ***** 2025-12-04 11:58:37.181499 | controller | skipping: [instance] 2025-12-04 11:58:37.277911 | controller | 2025-12-04 11:58:37.277942 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-12-04 11:58:37.277950 | controller | Thursday 04 December 2025 11:58:37 +0000 (0:00:00.042) 0:01:25.824 ***** 2025-12-04 11:58:37.277960 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-12-04 11:58:37.278014 | controller | 2025-12-04 11:58:37.278167 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-12-04 11:58:37.278258 | controller | Thursday 04 December 2025 11:58:37 +0000 (0:00:00.092) 0:01:25.917 ***** 2025-12-04 11:58:37.495982 | controller | ok: [instance] 2025-12-04 11:58:37.521398 | controller | 2025-12-04 11:58:37.521424 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-12-04 11:58:37.521434 | controller | Thursday 04 December 2025 11:58:37 +0000 (0:00:00.221) 0:01:26.138 ***** 2025-12-04 11:58:37.521445 | controller | skipping: [instance] 2025-12-04 11:58:37.521477 | controller | 2025-12-04 11:58:37.521659 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-12-04 11:58:37.942001 | controller | Thursday 04 December 2025 11:58:37 +0000 (0:00:00.025) 0:01:26.164 ***** 2025-12-04 11:58:37.942050 | controller | ok: [instance] 2025-12-04 11:58:38.208933 | controller | 2025-12-04 11:58:38.208962 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-12-04 11:58:38.208971 | controller | Thursday 04 December 2025 11:58:37 +0000 (0:00:00.419) 0:01:26.584 ***** 2025-12-04 11:58:38.208982 | controller | ok: [instance] 2025-12-04 11:58:38.448395 | controller | 2025-12-04 11:58:38.448441 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-12-04 11:58:38.448450 | controller | Thursday 04 December 2025 11:58:38 +0000 (0:00:00.267) 0:01:26.851 ***** 2025-12-04 11:58:38.448460 | controller | ok: [instance] 2025-12-04 11:58:38.704417 | controller | 2025-12-04 11:58:38.704468 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-12-04 11:58:38.704478 | controller | Thursday 04 December 2025 11:58:38 +0000 (0:00:00.238) 0:01:27.090 ***** 2025-12-04 11:58:38.704490 | controller | ok: [instance] 2025-12-04 11:58:38.704513 | controller | 2025-12-04 11:58:38.704664 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-12-04 11:58:38.704720 | controller | Thursday 04 December 2025 11:58:38 +0000 (0:00:00.256) 0:01:27.347 ***** 2025-12-04 11:58:38.957143 | controller | ok: [instance] 2025-12-04 11:58:39.007245 | controller | 2025-12-04 11:58:39.007359 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 11:58:39.007382 | controller | Thursday 04 December 2025 11:58:38 +0000 (0:00:00.252) 0:01:27.599 ***** 2025-12-04 11:58:39.007415 | controller | 2025-12-04 11:58:39.007949 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-04 11:58:39.217558 | controller | Thursday 04 December 2025 11:58:38 +0000 (0:00:00.046) 0:01:27.645 ***** 2025-12-04 11:58:39.217613 | controller | ok: [instance] 2025-12-04 11:58:39.217635 | controller | 2025-12-04 11:58:39.217679 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-04 11:58:39.217851 | controller | Thursday 04 December 2025 11:58:39 +0000 (0:00:00.215) 0:01:27.860 ***** 2025-12-04 11:58:39.249064 | controller | ok: [instance] 2025-12-04 11:58:39.278329 | controller | 2025-12-04 11:58:39.278352 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-04 11:58:39.278363 | controller | Thursday 04 December 2025 11:58:39 +0000 (0:00:00.031) 0:01:27.891 ***** 2025-12-04 11:58:39.278375 | controller | skipping: [instance] 2025-12-04 11:58:39.617905 | controller | 2025-12-04 11:58:39.617928 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-12-04 11:58:39.617935 | controller | Thursday 04 December 2025 11:58:39 +0000 (0:00:00.029) 0:01:27.921 ***** 2025-12-04 11:58:39.617944 | controller | ok: [instance] 2025-12-04 11:58:39.854454 | controller | 2025-12-04 11:58:39.854522 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-12-04 11:58:39.854533 | controller | Thursday 04 December 2025 11:58:39 +0000 (0:00:00.339) 0:01:28.260 ***** 2025-12-04 11:58:39.854550 | controller | ok: [instance] 2025-12-04 11:58:39.854583 | controller | 2025-12-04 11:58:39.854593 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-12-04 11:58:39.854623 | controller | Thursday 04 December 2025 11:58:39 +0000 (0:00:00.236) 0:01:28.497 ***** 2025-12-04 11:58:40.041580 | controller | ok: [instance] 2025-12-04 11:58:40.041778 | controller | 2025-12-04 11:58:40.041816 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-12-04 11:58:40.041836 | controller | Thursday 04 December 2025 11:58:40 +0000 (0:00:00.187) 0:01:28.684 ***** 2025-12-04 11:58:40.098442 | controller | 2025-12-04 11:58:40.098566 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-04 11:58:40.098589 | controller | Thursday 04 December 2025 11:58:40 +0000 (0:00:00.056) 0:01:28.741 ***** 2025-12-04 11:58:40.142418 | controller | ok: [instance] => changed=false 2025-12-04 11:58:40.142627 | controller | msg: All assertions passed 2025-12-04 11:58:40.142646 | controller | 2025-12-04 11:58:40.142658 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-04 11:58:40.349449 | controller | Thursday 04 December 2025 11:58:40 +0000 (0:00:00.044) 0:01:28.785 ***** 2025-12-04 11:58:40.349498 | controller | ok: [instance] 2025-12-04 11:58:40.349557 | controller | 2025-12-04 11:58:40.349580 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-04 11:58:40.349591 | controller | Thursday 04 December 2025 11:58:40 +0000 (0:00:00.206) 0:01:28.992 ***** 2025-12-04 11:58:40.562361 | controller | ok: [instance] 2025-12-04 11:58:40.593047 | controller | 2025-12-04 11:58:40.593072 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-04 11:58:40.593082 | controller | Thursday 04 December 2025 11:58:40 +0000 (0:00:00.212) 0:01:29.205 ***** 2025-12-04 11:58:40.593094 | controller | ok: [instance] => changed=false 2025-12-04 11:58:40.819838 | controller | msg: All assertions passed 2025-12-04 11:58:40.819865 | controller | 2025-12-04 11:58:40.819873 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-04 11:58:40.819880 | controller | Thursday 04 December 2025 11:58:40 +0000 (0:00:00.030) 0:01:29.235 ***** 2025-12-04 11:58:40.819889 | controller | ok: [instance] 2025-12-04 11:58:41.022408 | controller | 2025-12-04 11:58:41.022461 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-04 11:58:41.022470 | controller | Thursday 04 December 2025 11:58:40 +0000 (0:00:00.226) 0:01:29.462 ***** 2025-12-04 11:58:41.022484 | controller | ok: [instance] 2025-12-04 11:58:41.022530 | controller | 2025-12-04 11:58:41.022539 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-04 11:58:41.079456 | controller | Thursday 04 December 2025 11:58:41 +0000 (0:00:00.202) 0:01:29.665 ***** 2025-12-04 11:58:41.079520 | controller | ok: [instance] 2025-12-04 11:58:41.079564 | controller | 2025-12-04 11:58:41.079667 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-12-04 11:58:41.079707 | controller | Thursday 04 December 2025 11:58:41 +0000 (0:00:00.056) 0:01:29.722 ***** 2025-12-04 11:58:41.530816 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-12-04 11:58:41.554507 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-12-04 11:58:41.554564 | controller | 2025-12-04 11:58:41.554574 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-12-04 11:58:41.554582 | controller | Thursday 04 December 2025 11:58:41 +0000 (0:00:00.450) 0:01:30.173 ***** 2025-12-04 11:58:41.554595 | controller | skipping: [instance] 2025-12-04 11:58:41.587620 | controller | 2025-12-04 11:58:41.587679 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-12-04 11:58:41.587705 | controller | Thursday 04 December 2025 11:58:41 +0000 (0:00:00.024) 0:01:30.197 ***** 2025-12-04 11:58:41.587721 | controller | skipping: [instance] 2025-12-04 11:58:41.785136 | controller | 2025-12-04 11:58:41.785171 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-12-04 11:58:41.785181 | controller | Thursday 04 December 2025 11:58:41 +0000 (0:00:00.033) 0:01:30.230 ***** 2025-12-04 11:58:41.785194 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-12-04 11:58:41.819086 | controller | 2025-12-04 11:58:41.819116 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-12-04 11:58:41.819129 | controller | Thursday 04 December 2025 11:58:41 +0000 (0:00:00.197) 0:01:30.427 ***** 2025-12-04 11:58:41.819144 | controller | skipping: [instance] 2025-12-04 11:58:42.284087 | controller | 2025-12-04 11:58:42.284152 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-12-04 11:58:42.284163 | controller | Thursday 04 December 2025 11:58:41 +0000 (0:00:00.034) 0:01:30.462 ***** 2025-12-04 11:58:42.284177 | controller | changed: [instance] 2025-12-04 11:58:42.817472 | controller | 2025-12-04 11:58:42.817524 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-12-04 11:58:42.817534 | controller | Thursday 04 December 2025 11:58:42 +0000 (0:00:00.464) 0:01:30.926 ***** 2025-12-04 11:58:42.817549 | controller | changed: [instance] 2025-12-04 11:58:42.817586 | controller | 2025-12-04 11:58:42.817596 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-12-04 11:58:42.818022 | controller | Thursday 04 December 2025 11:58:42 +0000 (0:00:00.522) 0:01:31.448 ***** 2025-12-04 11:58:43.279144 | controller | 2025-12-04 11:58:43.279183 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-04 11:58:43.279192 | controller | Thursday 04 December 2025 11:58:42 +0000 (0:00:00.010) 0:01:31.459 ***** 2025-12-04 11:58:43.279202 | controller | changed: [instance] 2025-12-04 11:58:44.167103 | controller | 2025-12-04 11:58:44.167151 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-04 11:58:44.167159 | controller | Thursday 04 December 2025 11:58:43 +0000 (0:00:00.461) 0:01:31.921 ***** 2025-12-04 11:58:44.167170 | controller | changed: [instance] 2025-12-04 11:58:44.209688 | controller | 2025-12-04 11:58:44.209718 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-12-04 11:58:44.209726 | controller | Thursday 04 December 2025 11:58:44 +0000 (0:00:00.887) 0:01:32.809 ***** 2025-12-04 11:58:44.209734 | controller | skipping: [instance] 2025-12-04 11:58:44.249132 | controller | 2025-12-04 11:58:44.249155 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-12-04 11:58:44.249163 | controller | Thursday 04 December 2025 11:58:44 +0000 (0:00:00.043) 0:01:32.852 ***** 2025-12-04 11:58:44.249172 | controller | skipping: [instance] 2025-12-04 11:58:44.883223 | controller | 2025-12-04 11:58:44.883294 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-12-04 11:58:44.883306 | controller | Thursday 04 December 2025 11:58:44 +0000 (0:00:00.039) 0:01:32.892 ***** 2025-12-04 11:58:44.883317 | controller | changed: [instance] => (item=workload) 2025-12-04 11:58:45.351118 | controller | changed: [instance] => (item=reproducer-inventory) 2025-12-04 11:58:45.351158 | controller | ok: [instance] => (item=volumes) 2025-12-04 11:58:45.351168 | controller | 2025-12-04 11:58:45.351176 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-12-04 11:58:45.351184 | controller | Thursday 04 December 2025 11:58:44 +0000 (0:00:00.633) 0:01:33.525 ***** 2025-12-04 11:58:45.351197 | controller | changed: [instance] => (item=workload) 2025-12-04 11:58:45.384352 | controller | changed: [instance] => (item=volumes) 2025-12-04 11:58:45.384389 | controller | 2025-12-04 11:58:45.384403 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-12-04 11:58:45.384413 | controller | Thursday 04 December 2025 11:58:45 +0000 (0:00:00.467) 0:01:33.993 ***** 2025-12-04 11:58:45.384429 | controller | skipping: [instance] 2025-12-04 11:58:46.543442 | controller | 2025-12-04 11:58:46.543493 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-12-04 11:58:46.543503 | controller | Thursday 04 December 2025 11:58:45 +0000 (0:00:00.033) 0:01:34.026 ***** 2025-12-04 11:58:46.543518 | controller | changed: [instance] => (item=compute) 2025-12-04 11:58:46.543553 | controller | changed: [instance] => (item=controller) 2025-12-04 11:58:46.543563 | controller | changed: [instance] => (item=crc) 2025-12-04 11:58:46.543910 | controller | 2025-12-04 11:58:46.960548 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-12-04 11:58:46.960856 | controller | Thursday 04 December 2025 11:58:46 +0000 (0:00:01.159) 0:01:35.185 ***** 2025-12-04 11:58:46.960996 | controller | changed: [instance] 2025-12-04 11:58:46.961133 | controller | 2025-12-04 11:58:46.961418 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-12-04 11:58:46.961509 | controller | Thursday 04 December 2025 11:58:46 +0000 (0:00:00.415) 0:01:35.601 ***** 2025-12-04 11:58:47.000797 | controller | skipping: [instance] 2025-12-04 11:58:47.000953 | controller | 2025-12-04 11:58:47.001099 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-12-04 11:58:47.001240 | controller | Thursday 04 December 2025 11:58:46 +0000 (0:00:00.042) 0:01:35.644 ***** 2025-12-04 11:58:47.072017 | controller | skipping: [instance] => (item=crc) 2025-12-04 11:58:47.072180 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-12-04 11:58:47.072345 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-12-04 11:58:47.072453 | controller | 2025-12-04 11:58:47.072611 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-04 11:58:47.072697 | controller | Thursday 04 December 2025 11:58:47 +0000 (0:00:00.071) 0:01:35.715 ***** 2025-12-04 11:58:47.320498 | controller | changed: [instance] 2025-12-04 11:58:47.527621 | controller | 2025-12-04 11:58:47.527666 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-04 11:58:47.527674 | controller | Thursday 04 December 2025 11:58:47 +0000 (0:00:00.247) 0:01:35.963 ***** 2025-12-04 11:58:47.527686 | controller | ok: [instance] 2025-12-04 11:59:08.808148 | controller | 2025-12-04 11:59:08.808198 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-04 11:59:08.808206 | controller | Thursday 04 December 2025 11:58:47 +0000 (0:00:00.207) 0:01:36.170 ***** 2025-12-04 11:59:08.808217 | controller | changed: [instance] 2025-12-04 11:59:09.042979 | controller | 2025-12-04 11:59:09.043013 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-04 11:59:09.043022 | controller | Thursday 04 December 2025 11:59:08 +0000 (0:00:21.280) 0:01:57.450 ***** 2025-12-04 11:59:09.043034 | controller | ok: [instance] 2025-12-04 11:59:09.091453 | controller | 2025-12-04 11:59:09.091476 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-04 11:59:09.091494 | controller | Thursday 04 December 2025 11:59:09 +0000 (0:00:00.235) 0:01:57.685 ***** 2025-12-04 11:59:09.091504 | controller | ok: [instance] => changed=false 2025-12-04 11:59:09.329821 | controller | msg: All assertions passed 2025-12-04 11:59:09.329854 | controller | 2025-12-04 11:59:09.329861 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-04 11:59:09.329868 | controller | Thursday 04 December 2025 11:59:09 +0000 (0:00:00.048) 0:01:57.733 ***** 2025-12-04 11:59:09.329879 | controller | changed: [instance] 2025-12-04 11:59:09.556675 | controller | 2025-12-04 11:59:09.556703 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-04 11:59:09.556711 | controller | Thursday 04 December 2025 11:59:09 +0000 (0:00:00.238) 0:01:57.972 ***** 2025-12-04 11:59:09.556721 | controller | ok: [instance] 2025-12-04 11:59:09.778783 | controller | 2025-12-04 11:59:09.778846 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-04 11:59:09.778856 | controller | Thursday 04 December 2025 11:59:09 +0000 (0:00:00.227) 0:01:58.199 ***** 2025-12-04 11:59:09.778869 | controller | ok: [instance] 2025-12-04 11:59:09.779022 | controller | 2025-12-04 11:59:09.779169 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-04 11:59:09.779383 | controller | Thursday 04 December 2025 11:59:09 +0000 (0:00:00.221) 0:01:58.420 ***** 2025-12-04 11:59:09.808145 | controller | skipping: [instance] 2025-12-04 11:59:09.808459 | controller | 2025-12-04 11:59:09.808627 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-04 11:59:09.808753 | controller | Thursday 04 December 2025 11:59:09 +0000 (0:00:00.030) 0:01:58.451 ***** 2025-12-04 11:59:10.033621 | controller | ok: [instance] 2025-12-04 11:59:10.033915 | controller | 2025-12-04 11:59:10.034067 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-04 11:59:10.034191 | controller | Thursday 04 December 2025 11:59:10 +0000 (0:00:00.225) 0:01:58.676 ***** 2025-12-04 11:59:10.078576 | controller | ok: [instance] => changed=false 2025-12-04 11:59:10.078889 | controller | msg: All assertions passed 2025-12-04 11:59:10.079085 | controller | 2025-12-04 11:59:10.079208 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-04 11:59:10.079356 | controller | Thursday 04 December 2025 11:59:10 +0000 (0:00:00.045) 0:01:58.721 ***** 2025-12-04 11:59:10.318024 | controller | ok: [instance] 2025-12-04 11:59:10.318307 | controller | 2025-12-04 11:59:10.318500 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-12-04 11:59:10.318693 | controller | Thursday 04 December 2025 11:59:10 +0000 (0:00:00.238) 0:01:58.960 ***** 2025-12-04 11:59:10.522683 | controller | ok: [instance] 2025-12-04 11:59:10.522897 | controller | 2025-12-04 11:59:10.523058 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-12-04 11:59:10.523203 | controller | Thursday 04 December 2025 11:59:10 +0000 (0:00:00.204) 0:01:59.165 ***** 2025-12-04 11:59:10.959490 | controller | changed: [instance] 2025-12-04 11:59:10.959578 | controller | 2025-12-04 11:59:10.959592 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-12-04 11:59:11.158745 | controller | Thursday 04 December 2025 11:59:10 +0000 (0:00:00.436) 0:01:59.602 ***** 2025-12-04 11:59:11.158817 | controller | ok: [instance] 2025-12-04 11:59:11.382699 | controller | 2025-12-04 11:59:11.382741 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-12-04 11:59:11.382749 | controller | Thursday 04 December 2025 11:59:11 +0000 (0:00:00.199) 0:01:59.801 ***** 2025-12-04 11:59:11.382783 | controller | ok: [instance] 2025-12-04 11:59:11.784399 | controller | 2025-12-04 11:59:11.784454 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-12-04 11:59:11.784463 | controller | Thursday 04 December 2025 11:59:11 +0000 (0:00:00.223) 0:02:00.025 ***** 2025-12-04 11:59:11.784479 | controller | changed: [instance] 2025-12-04 11:59:11.810380 | controller | 2025-12-04 11:59:11.810402 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-12-04 11:59:11.810412 | controller | Thursday 04 December 2025 11:59:11 +0000 (0:00:00.401) 0:02:00.426 ***** 2025-12-04 11:59:11.810430 | controller | ok: [instance] 2025-12-04 11:59:12.063163 | controller | 2025-12-04 11:59:12.063208 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-12-04 11:59:12.063217 | controller | Thursday 04 December 2025 11:59:11 +0000 (0:00:00.026) 0:02:00.453 ***** 2025-12-04 11:59:12.063229 | controller | ok: [instance] 2025-12-04 11:59:12.529229 | controller | 2025-12-04 11:59:12.529308 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-12-04 11:59:12.529323 | controller | Thursday 04 December 2025 11:59:12 +0000 (0:00:00.251) 0:02:00.705 ***** 2025-12-04 11:59:12.529335 | controller | ok: [instance] 2025-12-04 11:59:12.667179 | controller | 2025-12-04 11:59:12.667202 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-12-04 11:59:12.667209 | controller | Thursday 04 December 2025 11:59:12 +0000 (0:00:00.466) 0:02:01.171 ***** 2025-12-04 11:59:12.667219 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 11:59:12.947421 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 11:59:12.947472 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 11:59:12.947482 | controller | 2025-12-04 11:59:12.947490 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-12-04 11:59:12.947497 | controller | Thursday 04 December 2025 11:59:12 +0000 (0:00:00.137) 0:02:01.309 ***** 2025-12-04 11:59:12.947511 | controller | changed: [instance] 2025-12-04 11:59:13.201398 | controller | 2025-12-04 11:59:13.201457 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-12-04 11:59:13.201467 | controller | Thursday 04 December 2025 11:59:12 +0000 (0:00:00.280) 0:02:01.589 ***** 2025-12-04 11:59:13.201483 | controller | changed: [instance] 2025-12-04 11:59:13.522818 | controller | 2025-12-04 11:59:13.522852 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-12-04 11:59:13.522860 | controller | Thursday 04 December 2025 11:59:13 +0000 (0:00:00.254) 0:02:01.843 ***** 2025-12-04 11:59:13.522871 | controller | changed: [instance] 2025-12-04 11:59:13.560835 | controller | 2025-12-04 11:59:13.560854 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-12-04 11:59:13.560862 | controller | Thursday 04 December 2025 11:59:13 +0000 (0:00:00.321) 0:02:02.165 ***** 2025-12-04 11:59:13.560871 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-04 11:59:13.612188 | controller | 2025-12-04 11:59:13.612224 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-04 11:59:13.612237 | controller | Thursday 04 December 2025 11:59:13 +0000 (0:00:00.037) 0:02:02.203 ***** 2025-12-04 11:59:13.612253 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-04 11:59:13.862077 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-04 11:59:13.862121 | controller | 2025-12-04 11:59:13.862129 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 11:59:13.862136 | controller | Thursday 04 December 2025 11:59:13 +0000 (0:00:00.051) 0:02:02.254 ***** 2025-12-04 11:59:13.862148 | controller | ok: [instance] 2025-12-04 11:59:13.916416 | controller | 2025-12-04 11:59:13.916463 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 11:59:13.916472 | controller | Thursday 04 December 2025 11:59:13 +0000 (0:00:00.250) 0:02:02.504 ***** 2025-12-04 11:59:13.916483 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 11:59:13.916516 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:59:13.916526 | controller | 2025-12-04 11:59:13.916533 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 11:59:13.916559 | controller | Thursday 04 December 2025 11:59:13 +0000 (0:00:00.054) 0:02:02.559 ***** 2025-12-04 11:59:14.173363 | controller | ok: [instance] 2025-12-04 11:59:14.388394 | controller | 2025-12-04 11:59:14.388433 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 11:59:14.388443 | controller | Thursday 04 December 2025 11:59:14 +0000 (0:00:00.256) 0:02:02.815 ***** 2025-12-04 11:59:14.388457 | controller | ok: [instance] 2025-12-04 11:59:14.721813 | controller | 2025-12-04 11:59:14.721854 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-12-04 11:59:14.721862 | controller | Thursday 04 December 2025 11:59:14 +0000 (0:00:00.214) 0:02:03.030 ***** 2025-12-04 11:59:14.721874 | controller | changed: [instance] 2025-12-04 11:59:14.990014 | controller | 2025-12-04 11:59:14.990054 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 11:59:14.990063 | controller | Thursday 04 December 2025 11:59:14 +0000 (0:00:00.333) 0:02:03.364 ***** 2025-12-04 11:59:14.990074 | controller | ok: [instance] 2025-12-04 11:59:15.052650 | controller | 2025-12-04 11:59:15.052682 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 11:59:15.052692 | controller | Thursday 04 December 2025 11:59:14 +0000 (0:00:00.268) 0:02:03.632 ***** 2025-12-04 11:59:15.052705 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 11:59:15.052743 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:59:15.316468 | controller | 2025-12-04 11:59:15.316496 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 11:59:15.316505 | controller | Thursday 04 December 2025 11:59:15 +0000 (0:00:00.062) 0:02:03.695 ***** 2025-12-04 11:59:15.316516 | controller | ok: [instance] 2025-12-04 11:59:15.535246 | controller | 2025-12-04 11:59:15.535290 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 11:59:15.535303 | controller | Thursday 04 December 2025 11:59:15 +0000 (0:00:00.263) 0:02:03.959 ***** 2025-12-04 11:59:15.535313 | controller | ok: [instance] 2025-12-04 11:59:15.856240 | controller | 2025-12-04 11:59:15.856291 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-12-04 11:59:15.856314 | controller | Thursday 04 December 2025 11:59:15 +0000 (0:00:00.218) 0:02:04.178 ***** 2025-12-04 11:59:15.856325 | controller | changed: [instance] 2025-12-04 11:59:15.883151 | controller | 2025-12-04 11:59:15.883173 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-12-04 11:59:15.883182 | controller | Thursday 04 December 2025 11:59:15 +0000 (0:00:00.320) 0:02:04.498 ***** 2025-12-04 11:59:15.883194 | controller | skipping: [instance] 2025-12-04 11:59:15.920335 | controller | 2025-12-04 11:59:15.920351 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-12-04 11:59:15.920358 | controller | Thursday 04 December 2025 11:59:15 +0000 (0:00:00.027) 0:02:04.526 ***** 2025-12-04 11:59:15.920366 | controller | skipping: [instance] 2025-12-04 11:59:15.958470 | controller | 2025-12-04 11:59:15.958511 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-12-04 11:59:15.958521 | controller | Thursday 04 December 2025 11:59:15 +0000 (0:00:00.036) 0:02:04.563 ***** 2025-12-04 11:59:15.958535 | controller | skipping: [instance] 2025-12-04 11:59:15.993115 | controller | 2025-12-04 11:59:15.993145 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-12-04 11:59:15.993153 | controller | Thursday 04 December 2025 11:59:15 +0000 (0:00:00.038) 0:02:04.601 ***** 2025-12-04 11:59:15.993165 | controller | skipping: [instance] 2025-12-04 11:59:16.240123 | controller | 2025-12-04 11:59:16.240149 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-04 11:59:16.240156 | controller | Thursday 04 December 2025 11:59:15 +0000 (0:00:00.034) 0:02:04.636 ***** 2025-12-04 11:59:16.240166 | controller | changed: [instance] 2025-12-04 11:59:16.280881 | controller | 2025-12-04 11:59:16.280902 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-04 11:59:16.280915 | controller | Thursday 04 December 2025 11:59:16 +0000 (0:00:00.247) 0:02:04.883 ***** 2025-12-04 11:59:16.280926 | controller | ok: [instance] 2025-12-04 11:59:16.336455 | controller | 2025-12-04 11:59:16.336500 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-04 11:59:16.336511 | controller | Thursday 04 December 2025 11:59:16 +0000 (0:00:00.040) 0:02:04.923 ***** 2025-12-04 11:59:16.336525 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-04 11:59:16.336561 | controller | 2025-12-04 11:59:16.336571 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-04 11:59:16.336657 | controller | Thursday 04 December 2025 11:59:16 +0000 (0:00:00.055) 0:02:04.979 ***** 2025-12-04 11:59:16.562454 | controller | ok: [instance] 2025-12-04 11:59:16.631466 | controller | 2025-12-04 11:59:16.631514 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-04 11:59:16.631528 | controller | Thursday 04 December 2025 11:59:16 +0000 (0:00:00.224) 0:02:05.203 ***** 2025-12-04 11:59:16.631544 | controller | ok: [instance] 2025-12-04 11:59:16.681171 | controller | 2025-12-04 11:59:16.681221 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-04 11:59:16.681230 | controller | Thursday 04 December 2025 11:59:16 +0000 (0:00:00.070) 0:02:05.274 ***** 2025-12-04 11:59:16.681242 | controller | ok: [instance] 2025-12-04 11:59:16.728328 | controller | 2025-12-04 11:59:16.728469 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-04 11:59:16.728481 | controller | Thursday 04 December 2025 11:59:16 +0000 (0:00:00.049) 0:02:05.324 ***** 2025-12-04 11:59:16.728495 | controller | skipping: [instance] 2025-12-04 11:59:16.776904 | controller | 2025-12-04 11:59:16.776921 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-04 11:59:16.776928 | controller | Thursday 04 December 2025 11:59:16 +0000 (0:00:00.046) 0:02:05.370 ***** 2025-12-04 11:59:16.776936 | controller | skipping: [instance] 2025-12-04 11:59:16.840492 | controller | 2025-12-04 11:59:16.840526 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-04 11:59:16.840552 | controller | Thursday 04 December 2025 11:59:16 +0000 (0:00:00.048) 0:02:05.419 ***** 2025-12-04 11:59:16.840569 | controller | 2025-12-04 11:59:16.840614 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-04 11:59:16.840756 | controller | Thursday 04 December 2025 11:59:16 +0000 (0:00:00.063) 0:02:05.483 ***** 2025-12-04 11:59:17.268441 | controller | ok: [instance] => (item=artifacts) 2025-12-04 11:59:17.268513 | controller | ok: [instance] => (item=logs) 2025-12-04 11:59:17.268523 | controller | 2025-12-04 11:59:17.268531 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-04 11:59:17.268559 | controller | Thursday 04 December 2025 11:59:17 +0000 (0:00:00.427) 0:02:05.911 ***** 2025-12-04 11:59:18.522009 | controller | ok: [instance] 2025-12-04 11:59:18.807464 | controller | 2025-12-04 11:59:18.807514 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-04 11:59:18.807524 | controller | Thursday 04 December 2025 11:59:18 +0000 (0:00:01.253) 0:02:07.164 ***** 2025-12-04 11:59:18.807540 | controller | changed: [instance] 2025-12-04 11:59:18.807569 | controller | 2025-12-04 11:59:18.807578 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-04 11:59:18.807669 | controller | Thursday 04 December 2025 11:59:18 +0000 (0:00:00.285) 0:02:07.450 ***** 2025-12-04 11:59:19.227893 | controller | changed: [instance] 2025-12-04 11:59:19.677974 | controller | 2025-12-04 11:59:19.678018 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-04 11:59:19.678028 | controller | Thursday 04 December 2025 11:59:19 +0000 (0:00:00.419) 0:02:07.870 ***** 2025-12-04 11:59:19.678041 | controller | changed: [instance] 2025-12-04 11:59:19.732947 | controller | 2025-12-04 11:59:19.732972 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-04 11:59:19.732980 | controller | Thursday 04 December 2025 11:59:19 +0000 (0:00:00.450) 0:02:08.320 ***** 2025-12-04 11:59:19.733001 | controller | skipping: [instance] 2025-12-04 11:59:19.967455 | controller | 2025-12-04 11:59:19.967498 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-04 11:59:19.967511 | controller | Thursday 04 December 2025 11:59:19 +0000 (0:00:00.055) 0:02:08.375 ***** 2025-12-04 11:59:19.967527 | controller | ok: [instance] 2025-12-04 11:59:19.967800 | controller | 2025-12-04 11:59:19.967831 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-04 11:59:20.022207 | controller | Thursday 04 December 2025 11:59:19 +0000 (0:00:00.234) 0:02:08.610 ***** 2025-12-04 11:59:20.022229 | controller | skipping: [instance] 2025-12-04 11:59:20.297442 | controller | 2025-12-04 11:59:20.297506 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-04 11:59:20.297516 | controller | Thursday 04 December 2025 11:59:20 +0000 (0:00:00.055) 0:02:08.665 ***** 2025-12-04 11:59:20.297530 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-12-04 11:59:20.641461 | controller | changed: [instance] 2025-12-04 11:59:20.641513 | controller | 2025-12-04 11:59:20.641521 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-04 11:59:20.641529 | controller | Thursday 04 December 2025 11:59:20 +0000 (0:00:00.274) 0:02:08.939 ***** 2025-12-04 11:59:20.641547 | controller | changed: [instance] 2025-12-04 11:59:20.699957 | controller | 2025-12-04 11:59:20.699978 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-04 11:59:20.699987 | controller | Thursday 04 December 2025 11:59:20 +0000 (0:00:00.344) 0:02:09.284 ***** 2025-12-04 11:59:20.699998 | controller | skipping: [instance] 2025-12-04 11:59:20.731918 | controller | 2025-12-04 11:59:20.731940 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2025-12-04 11:59:20.731949 | controller | Thursday 04 December 2025 11:59:20 +0000 (0:00:00.058) 0:02:09.342 ***** 2025-12-04 11:59:20.731960 | controller | skipping: [instance] 2025-12-04 11:59:21.011485 | controller | 2025-12-04 11:59:21.011549 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-12-04 11:59:21.011564 | controller | Thursday 04 December 2025 11:59:20 +0000 (0:00:00.032) 0:02:09.374 ***** 2025-12-04 11:59:21.011583 | controller | changed: [instance] 2025-12-04 11:59:21.011626 | controller | 2025-12-04 11:59:21.011641 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-12-04 11:59:21.270528 | controller | Thursday 04 December 2025 11:59:21 +0000 (0:00:00.279) 0:02:09.654 ***** 2025-12-04 11:59:21.270602 | controller | changed: [instance] 2025-12-04 11:59:21.591217 | controller | 2025-12-04 11:59:21.591260 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-12-04 11:59:21.591294 | controller | Thursday 04 December 2025 11:59:21 +0000 (0:00:00.258) 0:02:09.913 ***** 2025-12-04 11:59:21.591314 | controller | changed: [instance] 2025-12-04 11:59:21.626056 | controller | 2025-12-04 11:59:21.626074 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-12-04 11:59:21.626081 | controller | Thursday 04 December 2025 11:59:21 +0000 (0:00:00.320) 0:02:10.234 ***** 2025-12-04 11:59:21.626096 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-04 11:59:21.679115 | controller | 2025-12-04 11:59:21.679135 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-04 11:59:21.679142 | controller | Thursday 04 December 2025 11:59:21 +0000 (0:00:00.034) 0:02:10.268 ***** 2025-12-04 11:59:21.679152 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-04 11:59:21.925424 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-04 11:59:21.925487 | controller | 2025-12-04 11:59:21.925496 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 11:59:21.925503 | controller | Thursday 04 December 2025 11:59:21 +0000 (0:00:00.052) 0:02:10.321 ***** 2025-12-04 11:59:21.925520 | controller | ok: [instance] 2025-12-04 11:59:21.925539 | controller | 2025-12-04 11:59:21.925544 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 11:59:21.925551 | controller | Thursday 04 December 2025 11:59:21 +0000 (0:00:00.246) 0:02:10.568 ***** 2025-12-04 11:59:21.978518 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 11:59:21.978580 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:59:21.978667 | controller | 2025-12-04 11:59:21.978767 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 11:59:21.979030 | controller | Thursday 04 December 2025 11:59:21 +0000 (0:00:00.053) 0:02:10.621 ***** 2025-12-04 11:59:22.237538 | controller | ok: [instance] 2025-12-04 11:59:22.466229 | controller | 2025-12-04 11:59:22.466310 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 11:59:22.466332 | controller | Thursday 04 December 2025 11:59:22 +0000 (0:00:00.258) 0:02:10.880 ***** 2025-12-04 11:59:22.466350 | controller | ok: [instance] 2025-12-04 11:59:22.778449 | controller | 2025-12-04 11:59:22.778524 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-12-04 11:59:22.778539 | controller | Thursday 04 December 2025 11:59:22 +0000 (0:00:00.228) 0:02:11.108 ***** 2025-12-04 11:59:22.778559 | controller | changed: [instance] 2025-12-04 11:59:22.778570 | controller | 2025-12-04 11:59:22.778583 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 11:59:23.032242 | controller | Thursday 04 December 2025 11:59:22 +0000 (0:00:00.312) 0:02:11.421 ***** 2025-12-04 11:59:23.032293 | controller | ok: [instance] 2025-12-04 11:59:23.085260 | controller | 2025-12-04 11:59:23.085308 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 11:59:23.085319 | controller | Thursday 04 December 2025 11:59:23 +0000 (0:00:00.253) 0:02:11.675 ***** 2025-12-04 11:59:23.085331 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 11:59:23.344701 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:59:23.344722 | controller | 2025-12-04 11:59:23.344728 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 11:59:23.344734 | controller | Thursday 04 December 2025 11:59:23 +0000 (0:00:00.052) 0:02:11.728 ***** 2025-12-04 11:59:23.344743 | controller | ok: [instance] 2025-12-04 11:59:23.556769 | controller | 2025-12-04 11:59:23.556787 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 11:59:23.556804 | controller | Thursday 04 December 2025 11:59:23 +0000 (0:00:00.259) 0:02:11.987 ***** 2025-12-04 11:59:23.556818 | controller | ok: [instance] 2025-12-04 11:59:23.864720 | controller | 2025-12-04 11:59:23.864743 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-12-04 11:59:23.864750 | controller | Thursday 04 December 2025 11:59:23 +0000 (0:00:00.211) 0:02:12.199 ***** 2025-12-04 11:59:23.864759 | controller | changed: [instance] 2025-12-04 11:59:23.892903 | controller | 2025-12-04 11:59:23.892926 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-12-04 11:59:23.892935 | controller | Thursday 04 December 2025 11:59:23 +0000 (0:00:00.308) 0:02:12.507 ***** 2025-12-04 11:59:23.892947 | controller | skipping: [instance] 2025-12-04 11:59:23.928428 | controller | 2025-12-04 11:59:23.928484 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-12-04 11:59:23.928497 | controller | Thursday 04 December 2025 11:59:23 +0000 (0:00:00.028) 0:02:12.535 ***** 2025-12-04 11:59:23.928513 | controller | skipping: [instance] 2025-12-04 11:59:23.962498 | controller | 2025-12-04 11:59:23.962550 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-12-04 11:59:23.962561 | controller | Thursday 04 December 2025 11:59:23 +0000 (0:00:00.035) 0:02:12.571 ***** 2025-12-04 11:59:23.962574 | controller | skipping: [instance] 2025-12-04 11:59:23.996387 | controller | 2025-12-04 11:59:23.996409 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-12-04 11:59:23.996418 | controller | Thursday 04 December 2025 11:59:23 +0000 (0:00:00.033) 0:02:12.605 ***** 2025-12-04 11:59:23.996436 | controller | skipping: [instance] 2025-12-04 11:59:24.234728 | controller | 2025-12-04 11:59:24.234761 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-04 11:59:24.234770 | controller | Thursday 04 December 2025 11:59:23 +0000 (0:00:00.033) 0:02:12.639 ***** 2025-12-04 11:59:24.234780 | controller | changed: [instance] 2025-12-04 11:59:24.278996 | controller | 2025-12-04 11:59:24.279013 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-04 11:59:24.279021 | controller | Thursday 04 December 2025 11:59:24 +0000 (0:00:00.238) 0:02:12.877 ***** 2025-12-04 11:59:24.279029 | controller | ok: [instance] 2025-12-04 11:59:24.336928 | controller | 2025-12-04 11:59:24.336963 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-04 11:59:24.336977 | controller | Thursday 04 December 2025 11:59:24 +0000 (0:00:00.043) 0:02:12.921 ***** 2025-12-04 11:59:24.336994 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-04 11:59:24.552399 | controller | 2025-12-04 11:59:24.552447 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-04 11:59:24.552457 | controller | Thursday 04 December 2025 11:59:24 +0000 (0:00:00.057) 0:02:12.979 ***** 2025-12-04 11:59:24.552470 | controller | ok: [instance] 2025-12-04 11:59:24.552502 | controller | 2025-12-04 11:59:24.552706 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-04 11:59:24.621492 | controller | Thursday 04 December 2025 11:59:24 +0000 (0:00:00.215) 0:02:13.195 ***** 2025-12-04 11:59:24.621528 | controller | ok: [instance] 2025-12-04 11:59:24.621565 | controller | 2025-12-04 11:59:24.621571 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-04 11:59:24.621578 | controller | Thursday 04 December 2025 11:59:24 +0000 (0:00:00.068) 0:02:13.264 ***** 2025-12-04 11:59:24.676937 | controller | ok: [instance] 2025-12-04 11:59:24.677173 | controller | 2025-12-04 11:59:24.677449 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-04 11:59:24.677668 | controller | Thursday 04 December 2025 11:59:24 +0000 (0:00:00.055) 0:02:13.320 ***** 2025-12-04 11:59:24.728729 | controller | skipping: [instance] 2025-12-04 11:59:24.728898 | controller | 2025-12-04 11:59:24.728988 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-04 11:59:24.729096 | controller | Thursday 04 December 2025 11:59:24 +0000 (0:00:00.051) 0:02:13.371 ***** 2025-12-04 11:59:24.778537 | controller | skipping: [instance] 2025-12-04 11:59:24.778758 | controller | 2025-12-04 11:59:24.778937 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-04 11:59:24.779036 | controller | Thursday 04 December 2025 11:59:24 +0000 (0:00:00.049) 0:02:13.421 ***** 2025-12-04 11:59:24.846197 | controller | 2025-12-04 11:59:24.846488 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-04 11:59:24.846719 | controller | Thursday 04 December 2025 11:59:24 +0000 (0:00:00.067) 0:02:13.489 ***** 2025-12-04 11:59:25.287384 | controller | ok: [instance] => (item=artifacts) 2025-12-04 11:59:25.287901 | controller | ok: [instance] => (item=logs) 2025-12-04 11:59:26.509986 | controller | 2025-12-04 11:59:26.510035 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-04 11:59:26.510051 | controller | Thursday 04 December 2025 11:59:25 +0000 (0:00:00.440) 0:02:13.930 ***** 2025-12-04 11:59:26.510064 | controller | ok: [instance] 2025-12-04 11:59:26.744664 | controller | 2025-12-04 11:59:26.744728 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-04 11:59:26.744739 | controller | Thursday 04 December 2025 11:59:26 +0000 (0:00:01.221) 0:02:15.152 ***** 2025-12-04 11:59:26.744754 | controller | changed: [instance] 2025-12-04 11:59:27.152161 | controller | 2025-12-04 11:59:27.152209 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-04 11:59:27.152224 | controller | Thursday 04 December 2025 11:59:26 +0000 (0:00:00.235) 0:02:15.387 ***** 2025-12-04 11:59:27.152241 | controller | changed: [instance] 2025-12-04 11:59:27.568102 | controller | 2025-12-04 11:59:27.568122 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-04 11:59:27.568136 | controller | Thursday 04 December 2025 11:59:27 +0000 (0:00:00.407) 0:02:15.794 ***** 2025-12-04 11:59:27.568145 | controller | changed: [instance] 2025-12-04 11:59:27.621518 | controller | 2025-12-04 11:59:27.621574 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-04 11:59:27.621585 | controller | Thursday 04 December 2025 11:59:27 +0000 (0:00:00.416) 0:02:16.211 ***** 2025-12-04 11:59:27.621600 | controller | skipping: [instance] 2025-12-04 11:59:27.854981 | controller | 2025-12-04 11:59:27.855011 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-04 11:59:27.855019 | controller | Thursday 04 December 2025 11:59:27 +0000 (0:00:00.052) 0:02:16.264 ***** 2025-12-04 11:59:27.855029 | controller | ok: [instance] 2025-12-04 11:59:27.907009 | controller | 2025-12-04 11:59:27.907025 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-04 11:59:27.907032 | controller | Thursday 04 December 2025 11:59:27 +0000 (0:00:00.233) 0:02:16.497 ***** 2025-12-04 11:59:27.907041 | controller | skipping: [instance] 2025-12-04 11:59:28.170169 | controller | 2025-12-04 11:59:28.170199 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-04 11:59:28.170209 | controller | Thursday 04 December 2025 11:59:27 +0000 (0:00:00.052) 0:02:16.549 ***** 2025-12-04 11:59:28.170223 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-12-04 11:59:28.483458 | controller | changed: [instance] 2025-12-04 11:59:28.483518 | controller | 2025-12-04 11:59:28.483528 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-04 11:59:28.483538 | controller | Thursday 04 December 2025 11:59:28 +0000 (0:00:00.263) 0:02:16.812 ***** 2025-12-04 11:59:28.483551 | controller | changed: [instance] 2025-12-04 11:59:28.483574 | controller | 2025-12-04 11:59:28.483581 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-04 11:59:28.483590 | controller | Thursday 04 December 2025 11:59:28 +0000 (0:00:00.313) 0:02:17.126 ***** 2025-12-04 11:59:28.541468 | controller | skipping: [instance] 2025-12-04 11:59:28.541523 | controller | 2025-12-04 11:59:28.541625 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2025-12-04 11:59:28.541764 | controller | Thursday 04 December 2025 11:59:28 +0000 (0:00:00.058) 0:02:17.184 ***** 2025-12-04 11:59:28.576424 | controller | skipping: [instance] 2025-12-04 11:59:28.576786 | controller | 2025-12-04 11:59:28.847436 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-12-04 11:59:28.847484 | controller | Thursday 04 December 2025 11:59:28 +0000 (0:00:00.034) 0:02:17.219 ***** 2025-12-04 11:59:28.847500 | controller | changed: [instance] 2025-12-04 11:59:28.847596 | controller | 2025-12-04 11:59:28.847622 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-12-04 11:59:28.847633 | controller | Thursday 04 December 2025 11:59:28 +0000 (0:00:00.270) 0:02:17.490 ***** 2025-12-04 11:59:29.101508 | controller | changed: [instance] 2025-12-04 11:59:29.101596 | controller | 2025-12-04 11:59:29.101612 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-12-04 11:59:29.101796 | controller | Thursday 04 December 2025 11:59:29 +0000 (0:00:00.254) 0:02:17.744 ***** 2025-12-04 11:59:29.438238 | controller | changed: [instance] 2025-12-04 11:59:29.473966 | controller | 2025-12-04 11:59:29.473986 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-12-04 11:59:29.473993 | controller | Thursday 04 December 2025 11:59:29 +0000 (0:00:00.336) 0:02:18.080 ***** 2025-12-04 11:59:29.474010 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-04 11:59:29.524486 | controller | 2025-12-04 11:59:29.524561 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-04 11:59:29.524578 | controller | Thursday 04 December 2025 11:59:29 +0000 (0:00:00.035) 0:02:18.116 ***** 2025-12-04 11:59:29.524601 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-04 11:59:29.524688 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-04 11:59:29.524704 | controller | 2025-12-04 11:59:29.789430 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 11:59:29.789496 | controller | Thursday 04 December 2025 11:59:29 +0000 (0:00:00.050) 0:02:18.167 ***** 2025-12-04 11:59:29.789515 | controller | ok: [instance] 2025-12-04 11:59:29.789578 | controller | 2025-12-04 11:59:29.789698 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 11:59:29.789728 | controller | Thursday 04 December 2025 11:59:29 +0000 (0:00:00.264) 0:02:18.432 ***** 2025-12-04 11:59:29.844413 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 11:59:29.844473 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:59:29.844485 | controller | 2025-12-04 11:59:29.844676 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 11:59:30.103159 | controller | Thursday 04 December 2025 11:59:29 +0000 (0:00:00.054) 0:02:18.487 ***** 2025-12-04 11:59:30.103185 | controller | ok: [instance] 2025-12-04 11:59:30.338772 | controller | 2025-12-04 11:59:30.338821 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 11:59:30.338831 | controller | Thursday 04 December 2025 11:59:30 +0000 (0:00:00.258) 0:02:18.746 ***** 2025-12-04 11:59:30.338842 | controller | ok: [instance] 2025-12-04 11:59:30.671182 | controller | 2025-12-04 11:59:30.671207 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-12-04 11:59:30.671215 | controller | Thursday 04 December 2025 11:59:30 +0000 (0:00:00.235) 0:02:18.981 ***** 2025-12-04 11:59:30.671224 | controller | changed: [instance] 2025-12-04 11:59:30.930498 | controller | 2025-12-04 11:59:30.930568 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 11:59:30.930581 | controller | Thursday 04 December 2025 11:59:30 +0000 (0:00:00.332) 0:02:19.313 ***** 2025-12-04 11:59:30.930598 | controller | ok: [instance] 2025-12-04 11:59:30.987413 | controller | 2025-12-04 11:59:30.987447 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 11:59:30.987455 | controller | Thursday 04 December 2025 11:59:30 +0000 (0:00:00.259) 0:02:19.573 ***** 2025-12-04 11:59:30.987468 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 11:59:30.987798 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 11:59:30.987835 | controller | 2025-12-04 11:59:31.252474 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 11:59:31.252531 | controller | Thursday 04 December 2025 11:59:30 +0000 (0:00:00.056) 0:02:19.630 ***** 2025-12-04 11:59:31.252548 | controller | ok: [instance] 2025-12-04 11:59:31.478715 | controller | 2025-12-04 11:59:31.478771 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 11:59:31.478780 | controller | Thursday 04 December 2025 11:59:31 +0000 (0:00:00.264) 0:02:19.894 ***** 2025-12-04 11:59:31.478793 | controller | ok: [instance] 2025-12-04 11:59:31.806320 | controller | 2025-12-04 11:59:31.806366 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-12-04 11:59:31.806375 | controller | Thursday 04 December 2025 11:59:31 +0000 (0:00:00.227) 0:02:20.121 ***** 2025-12-04 11:59:31.806387 | controller | changed: [instance] 2025-12-04 11:59:31.837333 | controller | 2025-12-04 11:59:31.837362 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-12-04 11:59:31.837369 | controller | Thursday 04 December 2025 11:59:31 +0000 (0:00:00.327) 0:02:20.448 ***** 2025-12-04 11:59:31.837380 | controller | skipping: [instance] 2025-12-04 11:59:31.872569 | controller | 2025-12-04 11:59:31.872637 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-12-04 11:59:31.872652 | controller | Thursday 04 December 2025 11:59:31 +0000 (0:00:00.031) 0:02:20.480 ***** 2025-12-04 11:59:31.872672 | controller | skipping: [instance] 2025-12-04 11:59:31.911464 | controller | 2025-12-04 11:59:31.911514 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-12-04 11:59:31.911529 | controller | Thursday 04 December 2025 11:59:31 +0000 (0:00:00.035) 0:02:20.515 ***** 2025-12-04 11:59:31.911542 | controller | skipping: [instance] 2025-12-04 11:59:31.945966 | controller | 2025-12-04 11:59:31.945990 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-12-04 11:59:31.945998 | controller | Thursday 04 December 2025 11:59:31 +0000 (0:00:00.038) 0:02:20.554 ***** 2025-12-04 11:59:31.946009 | controller | skipping: [instance] 2025-12-04 11:59:31.946136 | controller | 2025-12-04 11:59:31.946265 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-04 11:59:31.946454 | controller | Thursday 04 December 2025 11:59:31 +0000 (0:00:00.034) 0:02:20.589 ***** 2025-12-04 11:59:32.201350 | controller | changed: [instance] 2025-12-04 11:59:32.252971 | controller | 2025-12-04 11:59:32.252992 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-04 11:59:32.253001 | controller | Thursday 04 December 2025 11:59:32 +0000 (0:00:00.254) 0:02:20.843 ***** 2025-12-04 11:59:32.253010 | controller | ok: [instance] 2025-12-04 11:59:32.291966 | controller | 2025-12-04 11:59:32.291989 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-04 11:59:32.291997 | controller | Thursday 04 December 2025 11:59:32 +0000 (0:00:00.052) 0:02:20.896 ***** 2025-12-04 11:59:32.292006 | controller | skipping: [instance] 2025-12-04 11:59:32.330201 | controller | 2025-12-04 11:59:32.330220 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-04 11:59:32.330228 | controller | Thursday 04 December 2025 11:59:32 +0000 (0:00:00.038) 0:02:20.934 ***** 2025-12-04 11:59:32.330237 | controller | skipping: [instance] 2025-12-04 11:59:32.387375 | controller | 2025-12-04 11:59:32.387450 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-04 11:59:32.387463 | controller | Thursday 04 December 2025 11:59:32 +0000 (0:00:00.038) 0:02:20.972 ***** 2025-12-04 11:59:32.387483 | controller | skipping: [instance] 2025-12-04 11:59:32.424306 | controller | 2025-12-04 11:59:32.424334 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2025-12-04 11:59:32.424342 | controller | Thursday 04 December 2025 11:59:32 +0000 (0:00:00.057) 0:02:21.030 ***** 2025-12-04 11:59:32.424352 | controller | skipping: [instance] 2025-12-04 11:59:32.497899 | controller | 2025-12-04 11:59:32.497934 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-12-04 11:59:32.497947 | controller | Thursday 04 December 2025 11:59:32 +0000 (0:00:00.036) 0:02:21.066 ***** 2025-12-04 11:59:32.497964 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-12-04 11:59:32.498216 | controller | 2025-12-04 11:59:32.498469 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-12-04 11:59:32.498613 | controller | Thursday 04 December 2025 11:59:32 +0000 (0:00:00.074) 0:02:21.141 ***** 2025-12-04 11:59:32.776518 | controller | ok: [instance] => (item=crc) 2025-12-04 11:59:32.776567 | controller | 2025-12-04 11:59:32.776577 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-12-04 11:59:32.776589 | controller | Thursday 04 December 2025 11:59:32 +0000 (0:00:00.278) 0:02:21.419 ***** 2025-12-04 11:59:34.859146 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 11:59:35.563537 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 11:59:35.563615 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 11:59:35.563629 | controller | 2025-12-04 11:59:35.563641 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-04 11:59:35.563651 | controller | Thursday 04 December 2025 11:59:34 +0000 (0:00:02.081) 0:02:23.501 ***** 2025-12-04 11:59:35.563683 | controller | changed: [instance] 2025-12-04 11:59:36.143920 | controller | 2025-12-04 11:59:36.143962 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-04 11:59:36.143971 | controller | Thursday 04 December 2025 11:59:35 +0000 (0:00:00.704) 0:02:24.206 ***** 2025-12-04 11:59:36.143983 | controller | changed: [instance] 2025-12-04 11:59:36.748192 | controller | 2025-12-04 11:59:36.748218 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-04 11:59:36.748227 | controller | Thursday 04 December 2025 11:59:36 +0000 (0:00:00.580) 0:02:24.786 ***** 2025-12-04 11:59:36.748238 | controller | changed: [instance] 2025-12-04 11:59:37.584891 | controller | 2025-12-04 11:59:37.584929 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-12-04 11:59:37.584937 | controller | Thursday 04 December 2025 11:59:36 +0000 (0:00:00.604) 0:02:25.390 ***** 2025-12-04 11:59:37.584949 | controller | changed: [instance] => (item=compute-0.utility) 2025-12-04 12:00:00.752507 | controller | changed: [instance] => (item=controller-0.utility) 2025-12-04 12:00:00.752564 | controller | changed: [instance] => (item=crc-0.utility) 2025-12-04 12:00:00.752571 | controller | 2025-12-04 12:00:00.752577 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-12-04 12:00:00.752583 | controller | Thursday 04 December 2025 11:59:37 +0000 (0:00:00.829) 0:02:26.221 ***** 2025-12-04 12:00:00.752595 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-04 12:00:00.873316 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-12-04 12:00:00.873353 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-12-04 12:00:00.873360 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-12-04 12:00:00.873365 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-12-04 12:00:00.873370 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2025-12-04 12:00:00.873376 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j141854925438.21106', 'results_file': '/home/zuul/.ansible_async/j141854925438.21106', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-12-04 12:00:00.873396 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j924482460910.21123', 'results_file': '/home/zuul/.ansible_async/j924482460910.21123', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-12-04 12:00:00.873402 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-04 12:00:00.873407 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j171079145241.21139', 'results_file': '/home/zuul/.ansible_async/j171079145241.21139', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-12-04 12:00:00.873412 | controller | 2025-12-04 12:00:00.873418 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-12-04 12:00:00.873423 | controller | Thursday 04 December 2025 12:00:00 +0000 (0:00:23.172) 0:02:49.393 ***** 2025-12-04 12:00:00.873433 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 12:00:00.873922 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 12:00:00.899172 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 12:00:00.899191 | controller | 2025-12-04 12:00:00.899198 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 12:00:00.899203 | controller | Thursday 04 December 2025 12:00:00 +0000 (0:00:00.122) 0:02:49.516 ***** 2025-12-04 12:00:00.899230 | controller | skipping: [instance] 2025-12-04 12:00:00.937472 | controller | 2025-12-04 12:00:00.937489 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-12-04 12:00:00.937496 | controller | Thursday 04 December 2025 12:00:00 +0000 (0:00:00.026) 0:02:49.542 ***** 2025-12-04 12:00:00.937505 | controller | 2025-12-04 12:00:01.026824 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-04 12:00:01.026875 | controller | Thursday 04 December 2025 12:00:00 +0000 (0:00:00.038) 0:02:49.580 ***** 2025-12-04 12:00:01.026895 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-04 12:00:01.287716 | controller | 2025-12-04 12:00:01.287758 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-04 12:00:01.287766 | controller | Thursday 04 December 2025 12:00:01 +0000 (0:00:00.088) 0:02:49.669 ***** 2025-12-04 12:00:01.287778 | controller | changed: [instance] 2025-12-04 12:00:01.512032 | controller | 2025-12-04 12:00:01.512073 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-04 12:00:01.512082 | controller | Thursday 04 December 2025 12:00:01 +0000 (0:00:00.260) 0:02:49.930 ***** 2025-12-04 12:00:01.512094 | controller | changed: [instance] 2025-12-04 12:00:01.971028 | controller | 2025-12-04 12:00:01.971070 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-12-04 12:00:01.971079 | controller | Thursday 04 December 2025 12:00:01 +0000 (0:00:00.224) 0:02:50.154 ***** 2025-12-04 12:00:01.971090 | controller | changed: [instance] 2025-12-04 12:00:02.001025 | controller | 2025-12-04 12:00:02.001045 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-12-04 12:00:02.001052 | controller | Thursday 04 December 2025 12:00:01 +0000 (0:00:00.458) 0:02:50.613 ***** 2025-12-04 12:00:02.001061 | controller | skipping: [instance] 2025-12-04 12:00:02.032832 | controller | 2025-12-04 12:00:02.032869 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-04 12:00:02.032876 | controller | Thursday 04 December 2025 12:00:01 +0000 (0:00:00.030) 0:02:50.644 ***** 2025-12-04 12:00:02.032886 | controller | skipping: [instance] 2025-12-04 12:00:02.084758 | controller | 2025-12-04 12:00:02.084778 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-12-04 12:00:02.084785 | controller | Thursday 04 December 2025 12:00:02 +0000 (0:00:00.031) 0:02:50.675 ***** 2025-12-04 12:00:02.084794 | controller | skipping: [instance] 2025-12-04 12:00:02.130312 | controller | 2025-12-04 12:00:02.130334 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-12-04 12:00:02.130342 | controller | Thursday 04 December 2025 12:00:02 +0000 (0:00:00.052) 0:02:50.727 ***** 2025-12-04 12:00:02.130351 | controller | skipping: [instance] 2025-12-04 12:00:02.157574 | controller | 2025-12-04 12:00:02.157592 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 12:00:02.157600 | controller | Thursday 04 December 2025 12:00:02 +0000 (0:00:00.045) 0:02:50.773 ***** 2025-12-04 12:00:02.157608 | controller | skipping: [instance] 2025-12-04 12:00:02.202583 | controller | 2025-12-04 12:00:02.202601 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-12-04 12:00:02.202609 | controller | Thursday 04 December 2025 12:00:02 +0000 (0:00:00.027) 0:02:50.800 ***** 2025-12-04 12:00:02.202617 | controller | 2025-12-04 12:00:02.288359 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-04 12:00:02.288381 | controller | Thursday 04 December 2025 12:00:02 +0000 (0:00:00.045) 0:02:50.845 ***** 2025-12-04 12:00:02.288407 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-04 12:00:02.527727 | controller | 2025-12-04 12:00:02.527778 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-04 12:00:02.527787 | controller | Thursday 04 December 2025 12:00:02 +0000 (0:00:00.085) 0:02:50.931 ***** 2025-12-04 12:00:02.527798 | controller | ok: [instance] 2025-12-04 12:00:02.778561 | controller | 2025-12-04 12:00:02.778610 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-04 12:00:02.778618 | controller | Thursday 04 December 2025 12:00:02 +0000 (0:00:00.238) 0:02:51.169 ***** 2025-12-04 12:00:02.778631 | controller | ok: [instance] 2025-12-04 12:00:03.189750 | controller | 2025-12-04 12:00:03.189795 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-12-04 12:00:03.189803 | controller | Thursday 04 December 2025 12:00:02 +0000 (0:00:00.250) 0:02:51.420 ***** 2025-12-04 12:00:03.189815 | controller | changed: [instance] 2025-12-04 12:00:03.221958 | controller | 2025-12-04 12:00:03.221980 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-12-04 12:00:03.221993 | controller | Thursday 04 December 2025 12:00:03 +0000 (0:00:00.411) 0:02:51.832 ***** 2025-12-04 12:00:03.222003 | controller | skipping: [instance] 2025-12-04 12:00:03.257675 | controller | 2025-12-04 12:00:03.257694 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-04 12:00:03.257702 | controller | Thursday 04 December 2025 12:00:03 +0000 (0:00:00.032) 0:02:51.864 ***** 2025-12-04 12:00:03.257711 | controller | skipping: [instance] 2025-12-04 12:00:05.114428 | controller | 2025-12-04 12:00:05.114489 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-12-04 12:00:05.114499 | controller | Thursday 04 December 2025 12:00:03 +0000 (0:00:00.035) 0:02:51.900 ***** 2025-12-04 12:00:05.114512 | controller | changed: [instance -> controller-0.instance] 2025-12-04 12:00:06.335682 | controller | 2025-12-04 12:00:06.335745 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-12-04 12:00:06.335754 | controller | Thursday 04 December 2025 12:00:05 +0000 (0:00:01.855) 0:02:53.756 ***** 2025-12-04 12:00:06.335767 | controller | changed: [instance -> controller-0.instance] 2025-12-04 12:00:06.388048 | controller | 2025-12-04 12:00:06.388106 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 12:00:06.388115 | controller | Thursday 04 December 2025 12:00:06 +0000 (0:00:01.221) 0:02:54.977 ***** 2025-12-04 12:00:06.388128 | controller | 2025-12-04 12:00:06.624833 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-04 12:00:06.624896 | controller | Thursday 04 December 2025 12:00:06 +0000 (0:00:00.053) 0:02:55.031 ***** 2025-12-04 12:00:06.624910 | controller | ok: [instance] 2025-12-04 12:00:06.660605 | controller | 2025-12-04 12:00:06.660644 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-04 12:00:06.660652 | controller | Thursday 04 December 2025 12:00:06 +0000 (0:00:00.236) 0:02:55.267 ***** 2025-12-04 12:00:06.660663 | controller | ok: [instance] 2025-12-04 12:00:06.697624 | controller | 2025-12-04 12:00:06.697652 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-04 12:00:06.697660 | controller | Thursday 04 December 2025 12:00:06 +0000 (0:00:00.032) 0:02:55.299 ***** 2025-12-04 12:00:06.697671 | controller | skipping: [instance] 2025-12-04 12:00:06.745196 | controller | 2025-12-04 12:00:06.745213 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-12-04 12:00:06.745220 | controller | Thursday 04 December 2025 12:00:06 +0000 (0:00:00.041) 0:02:55.340 ***** 2025-12-04 12:00:06.745229 | controller | 2025-12-04 12:00:06.745375 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-04 12:00:06.745490 | controller | Thursday 04 December 2025 12:00:06 +0000 (0:00:00.047) 0:02:55.388 ***** 2025-12-04 12:00:06.841522 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-12-04 12:00:07.056817 | controller | 2025-12-04 12:00:07.056872 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-04 12:00:07.056882 | controller | Thursday 04 December 2025 12:00:06 +0000 (0:00:00.094) 0:02:55.482 ***** 2025-12-04 12:00:07.056893 | controller | ok: [instance] 2025-12-04 12:00:07.297786 | controller | 2025-12-04 12:00:07.297826 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-04 12:00:07.297834 | controller | Thursday 04 December 2025 12:00:07 +0000 (0:00:00.216) 0:02:55.699 ***** 2025-12-04 12:00:07.297857 | controller | ok: [instance] 2025-12-04 12:00:07.720147 | controller | 2025-12-04 12:00:07.720184 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-12-04 12:00:07.720192 | controller | Thursday 04 December 2025 12:00:07 +0000 (0:00:00.241) 0:02:55.940 ***** 2025-12-04 12:00:07.720203 | controller | changed: [instance] 2025-12-04 12:00:08.539722 | controller | 2025-12-04 12:00:08.539761 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-12-04 12:00:08.539770 | controller | Thursday 04 December 2025 12:00:07 +0000 (0:00:00.422) 0:02:56.362 ***** 2025-12-04 12:00:08.539789 | controller | changed: [instance] 2025-12-04 12:00:08.568567 | controller | 2025-12-04 12:00:08.568592 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-04 12:00:08.568601 | controller | Thursday 04 December 2025 12:00:08 +0000 (0:00:00.819) 0:02:57.182 ***** 2025-12-04 12:00:08.568611 | controller | skipping: [instance] 2025-12-04 12:00:08.611492 | controller | 2025-12-04 12:00:08.611513 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-12-04 12:00:08.611522 | controller | Thursday 04 December 2025 12:00:08 +0000 (0:00:00.029) 0:02:57.211 ***** 2025-12-04 12:00:08.611537 | controller | skipping: [instance] 2025-12-04 12:00:08.655891 | controller | 2025-12-04 12:00:08.655913 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-12-04 12:00:08.655921 | controller | Thursday 04 December 2025 12:00:08 +0000 (0:00:00.042) 0:02:57.254 ***** 2025-12-04 12:00:08.655932 | controller | skipping: [instance] 2025-12-04 12:00:08.706262 | controller | 2025-12-04 12:00:08.706307 | controller | TASK [Create VBMC entity] ****************************************************** 2025-12-04 12:00:08.706315 | controller | Thursday 04 December 2025 12:00:08 +0000 (0:00:00.044) 0:02:57.298 ***** 2025-12-04 12:00:08.706324 | controller | skipping: [instance] => (item=compute-0) 2025-12-04 12:00:08.966883 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 12:00:08.966922 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 12:00:08.966930 | controller | skipping: [instance] 2025-12-04 12:00:08.966937 | controller | 2025-12-04 12:00:08.966943 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-12-04 12:00:08.966949 | controller | Thursday 04 December 2025 12:00:08 +0000 (0:00:00.050) 0:02:57.349 ***** 2025-12-04 12:00:08.966960 | controller | ok: [instance] 2025-12-04 12:00:09.389400 | controller | 2025-12-04 12:00:09.389431 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-12-04 12:00:09.389440 | controller | Thursday 04 December 2025 12:00:08 +0000 (0:00:00.260) 0:02:57.609 ***** 2025-12-04 12:00:09.389451 | controller | changed: [instance] 2025-12-04 12:00:09.389588 | controller | 2025-12-04 12:00:09.389625 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-12-04 12:00:09.426768 | controller | Thursday 04 December 2025 12:00:09 +0000 (0:00:00.422) 0:02:58.032 ***** 2025-12-04 12:00:09.426799 | controller | skipping: [instance] 2025-12-04 12:00:09.468976 | controller | 2025-12-04 12:00:09.468996 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-12-04 12:00:09.469011 | controller | Thursday 04 December 2025 12:00:09 +0000 (0:00:00.037) 0:02:58.069 ***** 2025-12-04 12:00:09.469020 | controller | skipping: [instance] 2025-12-04 12:00:09.510937 | controller | 2025-12-04 12:00:09.510956 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-12-04 12:00:09.510963 | controller | Thursday 04 December 2025 12:00:09 +0000 (0:00:00.042) 0:02:58.111 ***** 2025-12-04 12:00:09.510972 | controller | skipping: [instance] 2025-12-04 12:00:10.237479 | controller | 2025-12-04 12:00:10.237537 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-12-04 12:00:10.237546 | controller | Thursday 04 December 2025 12:00:09 +0000 (0:00:00.041) 0:02:58.153 ***** 2025-12-04 12:00:10.237559 | controller | changed: [instance] 2025-12-04 12:00:10.237650 | controller | 2025-12-04 12:00:10.237706 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-12-04 12:00:10.965902 | controller | Thursday 04 December 2025 12:00:10 +0000 (0:00:00.726) 0:02:58.880 ***** 2025-12-04 12:00:10.965947 | controller | changed: [instance] 2025-12-04 12:00:11.010064 | controller | 2025-12-04 12:00:11.010088 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-12-04 12:00:11.010096 | controller | Thursday 04 December 2025 12:00:10 +0000 (0:00:00.728) 0:02:59.608 ***** 2025-12-04 12:00:11.010105 | controller | skipping: [instance] 2025-12-04 12:00:11.149344 | controller | 2025-12-04 12:00:11.149375 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-12-04 12:00:11.149383 | controller | Thursday 04 December 2025 12:00:11 +0000 (0:00:00.044) 0:02:59.652 ***** 2025-12-04 12:00:11.149393 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-12-04 12:00:11.198887 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-12-04 12:00:11.198907 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-12-04 12:00:11.198915 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-12-04 12:00:11.198921 | controller | 2025-12-04 12:00:11.199114 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-12-04 12:00:11.199120 | controller | Thursday 04 December 2025 12:00:11 +0000 (0:00:00.138) 0:02:59.791 ***** 2025-12-04 12:00:11.199129 | controller | skipping: [instance] 2025-12-04 12:00:11.243009 | controller | 2025-12-04 12:00:11.243033 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-12-04 12:00:11.243041 | controller | Thursday 04 December 2025 12:00:11 +0000 (0:00:00.049) 0:02:59.841 ***** 2025-12-04 12:00:11.243050 | controller | skipping: [instance] 2025-12-04 12:00:11.280116 | controller | 2025-12-04 12:00:11.280176 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-12-04 12:00:11.280186 | controller | Thursday 04 December 2025 12:00:11 +0000 (0:00:00.044) 0:02:59.885 ***** 2025-12-04 12:00:11.280199 | controller | skipping: [instance] 2025-12-04 12:00:11.280256 | controller | 2025-12-04 12:00:11.280320 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-12-04 12:00:11.318007 | controller | Thursday 04 December 2025 12:00:11 +0000 (0:00:00.037) 0:02:59.923 ***** 2025-12-04 12:00:11.318032 | controller | skipping: [instance] 2025-12-04 12:00:11.318060 | controller | 2025-12-04 12:00:11.318236 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-12-04 12:00:11.318307 | controller | Thursday 04 December 2025 12:00:11 +0000 (0:00:00.037) 0:02:59.961 ***** 2025-12-04 12:00:12.015881 | controller | changed: [instance] 2025-12-04 12:00:12.060849 | controller | 2025-12-04 12:00:12.060918 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-12-04 12:00:12.060928 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.697) 0:03:00.658 ***** 2025-12-04 12:00:12.060944 | controller | skipping: [instance] 2025-12-04 12:00:12.101660 | controller | 2025-12-04 12:00:12.101711 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-12-04 12:00:12.101720 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.045) 0:03:00.703 ***** 2025-12-04 12:00:12.101736 | controller | skipping: [instance] 2025-12-04 12:00:12.141467 | controller | 2025-12-04 12:00:12.141498 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-12-04 12:00:12.141506 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.040) 0:03:00.744 ***** 2025-12-04 12:00:12.141518 | controller | skipping: [instance] 2025-12-04 12:00:12.183007 | controller | 2025-12-04 12:00:12.183039 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-04 12:00:12.183047 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.040) 0:03:00.784 ***** 2025-12-04 12:00:12.183059 | controller | skipping: [instance] 2025-12-04 12:00:12.226211 | controller | 2025-12-04 12:00:12.226245 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-04 12:00:12.226254 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.041) 0:03:00.825 ***** 2025-12-04 12:00:12.226268 | controller | skipping: [instance] 2025-12-04 12:00:12.268908 | controller | 2025-12-04 12:00:12.268946 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-04 12:00:12.268954 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.042) 0:03:00.868 ***** 2025-12-04 12:00:12.268967 | controller | skipping: [instance] 2025-12-04 12:00:12.312092 | controller | 2025-12-04 12:00:12.312126 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-04 12:00:12.312135 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.042) 0:03:00.911 ***** 2025-12-04 12:00:12.312148 | controller | skipping: [instance] 2025-12-04 12:00:12.312421 | controller | 2025-12-04 12:00:12.312525 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-04 12:00:12.312546 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.043) 0:03:00.955 ***** 2025-12-04 12:00:12.359070 | controller | skipping: [instance] 2025-12-04 12:00:12.401970 | controller | 2025-12-04 12:00:12.402001 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-04 12:00:12.402010 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.046) 0:03:01.001 ***** 2025-12-04 12:00:12.402021 | controller | skipping: [instance] 2025-12-04 12:00:12.449925 | controller | 2025-12-04 12:00:12.449972 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-04 12:00:12.449982 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.043) 0:03:01.044 ***** 2025-12-04 12:00:12.449993 | controller | skipping: [instance] 2025-12-04 12:00:12.482613 | controller | 2025-12-04 12:00:12.482632 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-12-04 12:00:12.482639 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.047) 0:03:01.092 ***** 2025-12-04 12:00:12.482648 | controller | skipping: [instance] 2025-12-04 12:00:12.647817 | controller | 2025-12-04 12:00:12.647848 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-12-04 12:00:12.647865 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.032) 0:03:01.125 ***** 2025-12-04 12:00:12.647876 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-12-04 12:00:14.137398 | controller | 2025-12-04 12:00:14.137456 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-04 12:00:14.137468 | controller | Thursday 04 December 2025 12:00:12 +0000 (0:00:00.164) 0:03:01.290 ***** 2025-12-04 12:00:14.137484 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-04 12:00:14.137556 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-04 12:00:14.137575 | controller | 2025-12-04 12:00:14.137588 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-04 12:00:14.168397 | controller | Thursday 04 December 2025 12:00:14 +0000 (0:00:01.489) 0:03:02.779 ***** 2025-12-04 12:00:14.168433 | controller | skipping: [instance] 2025-12-04 12:00:14.168703 | controller | 2025-12-04 12:00:14.168765 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-04 12:00:14.885756 | controller | Thursday 04 December 2025 12:00:14 +0000 (0:00:00.031) 0:03:02.811 ***** 2025-12-04 12:00:14.885798 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:14.926696 | controller | 2025-12-04 12:00:14.926717 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-04 12:00:14.926726 | controller | Thursday 04 December 2025 12:00:14 +0000 (0:00:00.716) 0:03:03.528 ***** 2025-12-04 12:00:14.926737 | controller | skipping: [instance] 2025-12-04 12:00:14.974211 | controller | 2025-12-04 12:00:14.974232 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-04 12:00:14.974241 | controller | Thursday 04 December 2025 12:00:14 +0000 (0:00:00.041) 0:03:03.569 ***** 2025-12-04 12:00:14.974251 | controller | skipping: [instance] 2025-12-04 12:00:15.017236 | controller | 2025-12-04 12:00:15.017261 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-04 12:00:15.017293 | controller | Thursday 04 December 2025 12:00:14 +0000 (0:00:00.047) 0:03:03.616 ***** 2025-12-04 12:00:15.017310 | controller | skipping: [instance] 2025-12-04 12:00:15.064840 | controller | 2025-12-04 12:00:15.064877 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-04 12:00:15.064887 | controller | Thursday 04 December 2025 12:00:15 +0000 (0:00:00.043) 0:03:03.660 ***** 2025-12-04 12:00:15.064898 | controller | skipping: [instance] 2025-12-04 12:00:15.104115 | controller | 2025-12-04 12:00:15.104136 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-12-04 12:00:15.104145 | controller | Thursday 04 December 2025 12:00:15 +0000 (0:00:00.047) 0:03:03.707 ***** 2025-12-04 12:00:15.104155 | controller | skipping: [instance] 2025-12-04 12:00:15.142411 | controller | 2025-12-04 12:00:15.142435 | controller | TASK [reproducer : Install repos] ********************************************** 2025-12-04 12:00:15.142443 | controller | Thursday 04 December 2025 12:00:15 +0000 (0:00:00.039) 0:03:03.747 ***** 2025-12-04 12:00:15.142453 | controller | skipping: [instance] 2025-12-04 12:00:15.187455 | controller | 2025-12-04 12:00:15.187526 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-12-04 12:00:15.187539 | controller | Thursday 04 December 2025 12:00:15 +0000 (0:00:00.038) 0:03:03.785 ***** 2025-12-04 12:00:15.187558 | controller | skipping: [instance] 2025-12-04 12:00:15.228344 | controller | 2025-12-04 12:00:15.228370 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-12-04 12:00:15.228378 | controller | Thursday 04 December 2025 12:00:15 +0000 (0:00:00.045) 0:03:03.830 ***** 2025-12-04 12:00:15.228388 | controller | skipping: [instance] 2025-12-04 12:00:16.427340 | controller | 2025-12-04 12:00:16.427379 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-12-04 12:00:16.427389 | controller | Thursday 04 December 2025 12:00:15 +0000 (0:00:00.040) 0:03:03.871 ***** 2025-12-04 12:00:16.427401 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:17.596735 | controller | 2025-12-04 12:00:17.596777 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-12-04 12:00:17.596785 | controller | Thursday 04 December 2025 12:00:16 +0000 (0:00:01.197) 0:03:05.069 ***** 2025-12-04 12:00:17.596795 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:18.274308 | controller | 2025-12-04 12:00:18.274349 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-12-04 12:00:18.274358 | controller | Thursday 04 December 2025 12:00:17 +0000 (0:00:01.170) 0:03:06.239 ***** 2025-12-04 12:00:18.274368 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:19.373441 | controller | 2025-12-04 12:00:19.373474 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-12-04 12:00:19.373482 | controller | Thursday 04 December 2025 12:00:18 +0000 (0:00:00.677) 0:03:06.916 ***** 2025-12-04 12:00:19.373498 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:20.623984 | controller | 2025-12-04 12:00:20.624026 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-12-04 12:00:20.624035 | controller | Thursday 04 December 2025 12:00:19 +0000 (0:00:01.099) 0:03:08.016 ***** 2025-12-04 12:00:20.624046 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-04 12:00:21.436454 | controller | skipping: [instance] => (item=compute-0) 2025-12-04 12:00:21.436513 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 12:00:21.436521 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 12:00:21.436527 | controller | 2025-12-04 12:00:21.436533 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-12-04 12:00:21.436541 | controller | Thursday 04 December 2025 12:00:20 +0000 (0:00:01.249) 0:03:09.265 ***** 2025-12-04 12:00:21.436554 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-04 12:00:23.471519 | controller | skipping: [instance] => (item=compute-0) 2025-12-04 12:00:23.471593 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 12:00:23.471601 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 12:00:23.471608 | controller | 2025-12-04 12:00:23.471615 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-12-04 12:00:23.471622 | controller | Thursday 04 December 2025 12:00:21 +0000 (0:00:00.812) 0:03:10.078 ***** 2025-12-04 12:00:23.471644 | controller | skipping: [instance] => (item=instance) 2025-12-04 12:00:23.471668 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-12-04 12:00:23.471709 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-04 12:00:23.471718 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-12-04 12:00:23.471811 | controller | 2025-12-04 12:00:23.471909 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-12-04 12:00:23.472002 | controller | Thursday 04 December 2025 12:00:23 +0000 (0:00:02.035) 0:03:12.114 ***** 2025-12-04 12:00:24.120787 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:25.172878 | controller | 2025-12-04 12:00:25.172921 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-12-04 12:00:25.172929 | controller | Thursday 04 December 2025 12:00:24 +0000 (0:00:00.644) 0:03:12.758 ***** 2025-12-04 12:00:25.172941 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:26.217919 | controller | 2025-12-04 12:00:26.217964 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-12-04 12:00:26.217972 | controller | Thursday 04 December 2025 12:00:25 +0000 (0:00:01.056) 0:03:13.815 ***** 2025-12-04 12:00:26.217983 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:26.256020 | controller | 2025-12-04 12:00:26.256045 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-12-04 12:00:26.256054 | controller | Thursday 04 December 2025 12:00:26 +0000 (0:00:01.045) 0:03:14.860 ***** 2025-12-04 12:00:26.256066 | controller | skipping: [instance] 2025-12-04 12:00:26.882327 | controller | 2025-12-04 12:00:26.882377 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-12-04 12:00:26.882385 | controller | Thursday 04 December 2025 12:00:26 +0000 (0:00:00.038) 0:03:14.898 ***** 2025-12-04 12:00:26.882396 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:26.882644 | controller | 2025-12-04 12:00:26.882833 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-12-04 12:00:26.883038 | controller | Thursday 04 December 2025 12:00:26 +0000 (0:00:00.626) 0:03:15.525 ***** 2025-12-04 12:00:27.530332 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:27.530553 | controller | 2025-12-04 12:00:27.530711 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-12-04 12:00:27.530849 | controller | Thursday 04 December 2025 12:00:27 +0000 (0:00:00.647) 0:03:16.173 ***** 2025-12-04 12:00:27.576748 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:27.576925 | controller | 2025-12-04 12:00:27.577052 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-12-04 12:00:27.577177 | controller | Thursday 04 December 2025 12:00:27 +0000 (0:00:00.046) 0:03:16.219 ***** 2025-12-04 12:00:27.650689 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-12-04 12:00:27.650898 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-12-04 12:00:27.651038 | controller | 2025-12-04 12:00:27.651171 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-04 12:00:27.651331 | controller | Thursday 04 December 2025 12:00:27 +0000 (0:00:00.073) 0:03:16.293 ***** 2025-12-04 12:00:27.711006 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:00:27.711199 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-12-04 12:00:27.711389 | controller | 2025-12-04 12:00:27.711561 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-04 12:00:27.711731 | controller | Thursday 04 December 2025 12:00:27 +0000 (0:00:00.060) 0:03:16.354 ***** 2025-12-04 12:00:27.779204 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:00:27.779449 | controller | _secret_file: '' 2025-12-04 12:00:27.779635 | controller | 2025-12-04 12:00:27.779821 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-04 12:00:27.780042 | controller | Thursday 04 December 2025 12:00:27 +0000 (0:00:00.068) 0:03:16.422 ***** 2025-12-04 12:00:27.838375 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:00:27.838527 | controller | _secret_content: my-default-location-place 2025-12-04 12:00:27.838657 | controller | 2025-12-04 12:00:27.838800 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-04 12:00:27.838951 | controller | Thursday 04 December 2025 12:00:27 +0000 (0:00:00.059) 0:03:16.481 ***** 2025-12-04 12:00:27.893323 | controller | skipping: [instance] 2025-12-04 12:00:27.893477 | controller | 2025-12-04 12:00:27.893620 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-04 12:00:27.893762 | controller | Thursday 04 December 2025 12:00:27 +0000 (0:00:00.054) 0:03:16.536 ***** 2025-12-04 12:00:27.952018 | controller | skipping: [instance] 2025-12-04 12:00:28.010239 | controller | 2025-12-04 12:00:28.010265 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-04 12:00:28.010295 | controller | Thursday 04 December 2025 12:00:27 +0000 (0:00:00.058) 0:03:16.594 ***** 2025-12-04 12:00:28.010310 | controller | skipping: [instance] 2025-12-04 12:00:28.010778 | controller | 2025-12-04 12:00:29.088463 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-04 12:00:29.088502 | controller | Thursday 04 December 2025 12:00:28 +0000 (0:00:00.058) 0:03:16.653 ***** 2025-12-04 12:00:29.088523 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:29.148792 | controller | 2025-12-04 12:00:29.148820 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-04 12:00:29.148828 | controller | Thursday 04 December 2025 12:00:29 +0000 (0:00:01.072) 0:03:17.725 ***** 2025-12-04 12:00:29.148839 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:00:29.205425 | controller | _secret_dest: /home/zuul/ipmi-things 2025-12-04 12:00:29.205443 | controller | 2025-12-04 12:00:29.205450 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-04 12:00:29.205455 | controller | Thursday 04 December 2025 12:00:29 +0000 (0:00:00.065) 0:03:17.791 ***** 2025-12-04 12:00:29.205464 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:00:29.259729 | controller | _secret_file: /tmp/ipmi-things 2025-12-04 12:00:29.259749 | controller | 2025-12-04 12:00:29.259756 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-04 12:00:29.259765 | controller | Thursday 04 December 2025 12:00:29 +0000 (0:00:00.056) 0:03:17.848 ***** 2025-12-04 12:00:29.259774 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:00:29.319649 | controller | _secret_content: '' 2025-12-04 12:00:29.319684 | controller | 2025-12-04 12:00:29.319693 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-04 12:00:29.319701 | controller | Thursday 04 December 2025 12:00:29 +0000 (0:00:00.054) 0:03:17.902 ***** 2025-12-04 12:00:29.319711 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-12-04 12:00:29.319899 | controller | msg: All assertions passed 2025-12-04 12:00:29.320064 | controller | 2025-12-04 12:00:29.320211 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-04 12:00:29.320375 | controller | Thursday 04 December 2025 12:00:29 +0000 (0:00:00.060) 0:03:17.962 ***** 2025-12-04 12:00:29.947918 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:29.948099 | controller | 2025-12-04 12:00:29.948268 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-04 12:00:29.948449 | controller | Thursday 04 December 2025 12:00:29 +0000 (0:00:00.627) 0:03:18.590 ***** 2025-12-04 12:00:31.010519 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:31.010712 | controller | 2025-12-04 12:00:31.010857 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-04 12:00:31.011006 | controller | Thursday 04 December 2025 12:00:31 +0000 (0:00:01.062) 0:03:19.653 ***** 2025-12-04 12:00:31.067146 | controller | skipping: [instance] 2025-12-04 12:00:31.067377 | controller | 2025-12-04 12:00:31.067526 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-12-04 12:00:31.067661 | controller | Thursday 04 December 2025 12:00:31 +0000 (0:00:00.057) 0:03:19.710 ***** 2025-12-04 12:00:31.703416 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:31.703611 | controller | 2025-12-04 12:00:31.703768 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-12-04 12:00:31.703910 | controller | Thursday 04 December 2025 12:00:31 +0000 (0:00:00.635) 0:03:20.346 ***** 2025-12-04 12:00:32.355476 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:00:32.355662 | controller | 2025-12-04 12:00:32.355810 | controller | TASK [reproducer : Check package install status] ******************************* 2025-12-04 12:00:32.355968 | controller | Thursday 04 December 2025 12:00:32 +0000 (0:00:00.651) 0:03:20.998 ***** 2025-12-04 12:01:51.005107 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-12-04 12:01:51.005317 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-12-04 12:01:51.005467 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-12-04 12:01:51.005599 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-12-04 12:01:51.005728 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-12-04 12:01:51.005856 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-12-04 12:01:51.005996 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-12-04 12:01:51.006120 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-12-04 12:01:51.006245 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-12-04 12:01:51.006394 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). 2025-12-04 12:01:51.006523 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). 2025-12-04 12:01:51.006649 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (89 retries left). 2025-12-04 12:01:51.006794 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (88 retries left). 2025-12-04 12:01:51.006934 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (87 retries left). 2025-12-04 12:01:51.007067 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:01:51.007183 | controller | 2025-12-04 12:01:51.007336 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-12-04 12:01:51.007480 | controller | Thursday 04 December 2025 12:01:50 +0000 (0:01:18.643) 0:04:39.641 ***** 2025-12-04 12:01:51.776724 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:01:55.034628 | controller | 2025-12-04 12:01:55.034669 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-12-04 12:01:55.034677 | controller | Thursday 04 December 2025 12:01:51 +0000 (0:00:00.777) 0:04:40.419 ***** 2025-12-04 12:01:55.034689 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:01:55.085671 | controller | 2025-12-04 12:01:55.085698 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-12-04 12:01:55.085705 | controller | Thursday 04 December 2025 12:01:55 +0000 (0:00:03.256) 0:04:43.675 ***** 2025-12-04 12:01:55.085716 | controller | skipping: [instance] 2025-12-04 12:01:55.143758 | controller | 2025-12-04 12:01:55.143785 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-12-04 12:01:55.143793 | controller | Thursday 04 December 2025 12:01:55 +0000 (0:00:00.053) 0:04:43.728 ***** 2025-12-04 12:01:55.143803 | controller | skipping: [instance] 2025-12-04 12:01:55.890483 | controller | 2025-12-04 12:01:55.890527 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-12-04 12:01:55.890538 | controller | Thursday 04 December 2025 12:01:55 +0000 (0:00:00.058) 0:04:43.786 ***** 2025-12-04 12:01:55.890552 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:01:56.627138 | controller | 2025-12-04 12:01:56.627181 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-12-04 12:01:56.627189 | controller | Thursday 04 December 2025 12:01:55 +0000 (0:00:00.746) 0:04:44.532 ***** 2025-12-04 12:01:56.627199 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:01:56.961378 | controller | 2025-12-04 12:01:56.961419 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-12-04 12:01:56.961427 | controller | Thursday 04 December 2025 12:01:56 +0000 (0:00:00.736) 0:04:45.269 ***** 2025-12-04 12:01:56.961438 | controller | changed: [instance] 2025-12-04 12:01:57.704847 | controller | 2025-12-04 12:01:57.704883 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-12-04 12:01:57.704891 | controller | Thursday 04 December 2025 12:01:56 +0000 (0:00:00.334) 0:04:45.603 ***** 2025-12-04 12:01:57.704902 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:01:58.846180 | controller | 2025-12-04 12:01:58.846216 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-12-04 12:01:58.846224 | controller | Thursday 04 December 2025 12:01:57 +0000 (0:00:00.743) 0:04:46.347 ***** 2025-12-04 12:01:58.846235 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:01:58.893185 | controller | 2025-12-04 12:01:58.893203 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-04 12:01:58.893211 | controller | Thursday 04 December 2025 12:01:58 +0000 (0:00:01.141) 0:04:47.489 ***** 2025-12-04 12:01:58.893220 | controller | skipping: [instance] 2025-12-04 12:01:58.941064 | controller | 2025-12-04 12:01:58.941090 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-04 12:01:58.941100 | controller | Thursday 04 December 2025 12:01:58 +0000 (0:00:00.047) 0:04:47.536 ***** 2025-12-04 12:01:58.941112 | controller | skipping: [instance] 2025-12-04 12:01:58.983387 | controller | 2025-12-04 12:01:58.983406 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-04 12:01:58.983422 | controller | Thursday 04 December 2025 12:01:58 +0000 (0:00:00.047) 0:04:47.583 ***** 2025-12-04 12:01:58.983431 | controller | skipping: [instance] 2025-12-04 12:01:59.143116 | controller | 2025-12-04 12:01:59.143156 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-12-04 12:01:59.143163 | controller | Thursday 04 December 2025 12:01:58 +0000 (0:00:00.042) 0:04:47.626 ***** 2025-12-04 12:01:59.143174 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:01:59.186210 | controller | 2025-12-04 12:01:59.186233 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-12-04 12:01:59.186241 | controller | Thursday 04 December 2025 12:01:59 +0000 (0:00:00.157) 0:04:47.784 ***** 2025-12-04 12:01:59.186250 | controller | skipping: [instance] 2025-12-04 12:01:59.226371 | controller | 2025-12-04 12:01:59.226392 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-12-04 12:01:59.226400 | controller | Thursday 04 December 2025 12:01:59 +0000 (0:00:00.044) 0:04:47.829 ***** 2025-12-04 12:01:59.226410 | controller | skipping: [instance] 2025-12-04 12:01:59.266125 | controller | 2025-12-04 12:01:59.266145 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-12-04 12:01:59.266152 | controller | Thursday 04 December 2025 12:01:59 +0000 (0:00:00.040) 0:04:47.869 ***** 2025-12-04 12:01:59.266171 | controller | skipping: [instance] 2025-12-04 12:01:59.952135 | controller | 2025-12-04 12:01:59.952160 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-12-04 12:01:59.952167 | controller | Thursday 04 December 2025 12:01:59 +0000 (0:00:00.039) 0:04:47.909 ***** 2025-12-04 12:01:59.952177 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:00.058499 | controller | 2025-12-04 12:02:00.058527 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-12-04 12:02:00.058534 | controller | Thursday 04 December 2025 12:01:59 +0000 (0:00:00.685) 0:04:48.595 ***** 2025-12-04 12:02:00.058544 | controller | skipping: [instance] => (item=secret) 2025-12-04 12:02:01.171817 | controller | skipping: [instance] => (item=configmap) 2025-12-04 12:02:01.171853 | controller | skipping: [instance] => (item=pod) 2025-12-04 12:02:01.171860 | controller | skipping: [instance] => (item=service) 2025-12-04 12:02:01.171865 | controller | skipping: [instance] => (item=route) 2025-12-04 12:02:01.171871 | controller | skipping: [instance] 2025-12-04 12:02:01.171876 | controller | 2025-12-04 12:02:01.171882 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-12-04 12:02:01.171888 | controller | Thursday 04 December 2025 12:02:00 +0000 (0:00:00.106) 0:04:48.701 ***** 2025-12-04 12:02:01.171899 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:02.288292 | controller | 2025-12-04 12:02:02.288331 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-12-04 12:02:02.288340 | controller | Thursday 04 December 2025 12:02:01 +0000 (0:00:01.113) 0:04:49.814 ***** 2025-12-04 12:02:02.288352 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:02.336693 | controller | 2025-12-04 12:02:02.336711 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-12-04 12:02:02.336719 | controller | Thursday 04 December 2025 12:02:02 +0000 (0:00:01.116) 0:04:50.930 ***** 2025-12-04 12:02:02.336744 | controller | skipping: [instance] 2025-12-04 12:02:02.389637 | controller | 2025-12-04 12:02:02.389704 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-12-04 12:02:02.389714 | controller | Thursday 04 December 2025 12:02:02 +0000 (0:00:00.048) 0:04:50.979 ***** 2025-12-04 12:02:02.389729 | controller | skipping: [instance] 2025-12-04 12:02:02.470780 | controller | 2025-12-04 12:02:02.470803 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-12-04 12:02:02.470811 | controller | Thursday 04 December 2025 12:02:02 +0000 (0:00:00.052) 0:04:51.031 ***** 2025-12-04 12:02:02.470820 | controller | skipping: [instance] => (item=secret) 2025-12-04 12:02:02.514109 | controller | skipping: [instance] => (item=configmap) 2025-12-04 12:02:02.514132 | controller | skipping: [instance] => (item=service) 2025-12-04 12:02:02.514155 | controller | skipping: [instance] => (item=route) 2025-12-04 12:02:02.514163 | controller | skipping: [instance] 2025-12-04 12:02:02.514171 | controller | 2025-12-04 12:02:02.514177 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-12-04 12:02:02.514184 | controller | Thursday 04 December 2025 12:02:02 +0000 (0:00:00.081) 0:04:51.113 ***** 2025-12-04 12:02:02.514195 | controller | skipping: [instance] 2025-12-04 12:02:04.098976 | controller | 2025-12-04 12:02:04.099030 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-12-04 12:02:04.099040 | controller | Thursday 04 December 2025 12:02:02 +0000 (0:00:00.043) 0:04:51.157 ***** 2025-12-04 12:02:04.099052 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:04.099199 | controller | 2025-12-04 12:02:04.099365 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-12-04 12:02:04.099503 | controller | Thursday 04 December 2025 12:02:04 +0000 (0:00:01.584) 0:04:52.741 ***** 2025-12-04 12:02:04.979746 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:04.979930 | controller | 2025-12-04 12:02:04.980086 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-12-04 12:02:04.980218 | controller | Thursday 04 December 2025 12:02:04 +0000 (0:00:00.880) 0:04:53.621 ***** 2025-12-04 12:02:05.033222 | controller | skipping: [instance] 2025-12-04 12:02:05.033435 | controller | 2025-12-04 12:02:05.033616 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-12-04 12:02:05.033781 | controller | Thursday 04 December 2025 12:02:05 +0000 (0:00:00.054) 0:04:53.676 ***** 2025-12-04 12:02:05.081838 | controller | skipping: [instance] 2025-12-04 12:02:05.082037 | controller | 2025-12-04 12:02:05.082222 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-12-04 12:02:05.082438 | controller | Thursday 04 December 2025 12:02:05 +0000 (0:00:00.048) 0:04:53.725 ***** 2025-12-04 12:02:05.134447 | controller | skipping: [instance] 2025-12-04 12:02:05.134611 | controller | 2025-12-04 12:02:05.134770 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-12-04 12:02:05.134937 | controller | Thursday 04 December 2025 12:02:05 +0000 (0:00:00.052) 0:04:53.777 ***** 2025-12-04 12:02:16.035619 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:17.581314 | controller | 2025-12-04 12:02:17.581354 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-12-04 12:02:17.581362 | controller | Thursday 04 December 2025 12:02:16 +0000 (0:00:10.892) 0:05:04.670 ***** 2025-12-04 12:02:17.581372 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:18.837881 | controller | 2025-12-04 12:02:18.837956 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-04 12:02:18.837977 | controller | Thursday 04 December 2025 12:02:17 +0000 (0:00:01.553) 0:05:06.223 ***** 2025-12-04 12:02:18.837990 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-04 12:02:18.883567 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-04 12:02:18.883603 | controller | 2025-12-04 12:02:18.883612 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-12-04 12:02:18.883618 | controller | Thursday 04 December 2025 12:02:18 +0000 (0:00:01.255) 0:05:07.479 ***** 2025-12-04 12:02:18.883628 | controller | skipping: [instance] 2025-12-04 12:02:19.451861 | controller | 2025-12-04 12:02:19.451913 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-12-04 12:02:19.451925 | controller | Thursday 04 December 2025 12:02:18 +0000 (0:00:00.046) 0:05:07.526 ***** 2025-12-04 12:02:19.451938 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:19.500963 | controller | 2025-12-04 12:02:19.500992 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-12-04 12:02:19.501000 | controller | Thursday 04 December 2025 12:02:19 +0000 (0:00:00.567) 0:05:08.094 ***** 2025-12-04 12:02:19.501012 | controller | skipping: [instance] 2025-12-04 12:02:19.554420 | controller | 2025-12-04 12:02:19.554468 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-12-04 12:02:19.554485 | controller | Thursday 04 December 2025 12:02:19 +0000 (0:00:00.049) 0:05:08.143 ***** 2025-12-04 12:02:19.554497 | controller | skipping: [instance] 2025-12-04 12:02:19.609716 | controller | 2025-12-04 12:02:19.609744 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-04 12:02:19.609754 | controller | Thursday 04 December 2025 12:02:19 +0000 (0:00:00.053) 0:05:08.197 ***** 2025-12-04 12:02:19.609768 | controller | skipping: [instance] 2025-12-04 12:02:19.662316 | controller | 2025-12-04 12:02:19.662338 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-04 12:02:19.662345 | controller | Thursday 04 December 2025 12:02:19 +0000 (0:00:00.055) 0:05:08.252 ***** 2025-12-04 12:02:19.662356 | controller | skipping: [instance] 2025-12-04 12:02:19.812265 | controller | 2025-12-04 12:02:19.812307 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-12-04 12:02:19.812316 | controller | Thursday 04 December 2025 12:02:19 +0000 (0:00:00.052) 0:05:08.305 ***** 2025-12-04 12:02:19.812327 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': 'f57486c3-f725-4eee-affe-0cfbec81c912'}) 2025-12-04 12:02:21.011737 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '808e3b1d-c303-4531-8e28-3e30a1cdd1bd'}) 2025-12-04 12:02:21.011772 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '0e37a22b-e9d7-42b6-afee-e7c1e2671119'}) 2025-12-04 12:02:21.011781 | controller | 2025-12-04 12:02:21.011788 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-12-04 12:02:21.011795 | controller | Thursday 04 December 2025 12:02:19 +0000 (0:00:00.149) 0:05:08.454 ***** 2025-12-04 12:02:21.011806 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:21.049927 | controller | 2025-12-04 12:02:21.049957 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-12-04 12:02:21.049966 | controller | Thursday 04 December 2025 12:02:21 +0000 (0:00:01.199) 0:05:09.654 ***** 2025-12-04 12:02:21.049978 | controller | skipping: [instance] 2025-12-04 12:02:21.193496 | controller | 2025-12-04 12:02:21.193519 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-12-04 12:02:21.193526 | controller | Thursday 04 December 2025 12:02:21 +0000 (0:00:00.038) 0:05:09.692 ***** 2025-12-04 12:02:21.193535 | controller | 2025-12-04 12:02:21.250382 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-12-04 12:02:21.250403 | controller | Thursday 04 December 2025 12:02:21 +0000 (0:00:00.143) 0:05:09.836 ***** 2025-12-04 12:02:21.250414 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:21.307895 | controller | 2025-12-04 12:02:21.307931 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-04 12:02:21.307938 | controller | Thursday 04 December 2025 12:02:21 +0000 (0:00:00.056) 0:05:09.893 ***** 2025-12-04 12:02:21.307948 | controller | skipping: [instance] 2025-12-04 12:02:21.351702 | controller | 2025-12-04 12:02:21.351721 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-04 12:02:21.351728 | controller | Thursday 04 December 2025 12:02:21 +0000 (0:00:00.057) 0:05:09.950 ***** 2025-12-04 12:02:21.351736 | controller | skipping: [instance] 2025-12-04 12:02:22.834194 | controller | 2025-12-04 12:02:22.834229 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-12-04 12:02:22.834236 | controller | Thursday 04 December 2025 12:02:21 +0000 (0:00:00.043) 0:05:09.994 ***** 2025-12-04 12:02:22.834247 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:28.308956 | controller | 2025-12-04 12:02:28.308992 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-12-04 12:02:28.309000 | controller | Thursday 04 December 2025 12:02:22 +0000 (0:00:01.481) 0:05:11.476 ***** 2025-12-04 12:02:28.309015 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=f57486c3-f725-4eee-affe-0cfbec81c912) 2025-12-04 12:02:28.422291 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=808e3b1d-c303-4531-8e28-3e30a1cdd1bd) 2025-12-04 12:02:28.422320 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=0e37a22b-e9d7-42b6-afee-e7c1e2671119) 2025-12-04 12:02:28.422327 | controller | 2025-12-04 12:02:28.422333 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-12-04 12:02:28.422339 | controller | Thursday 04 December 2025 12:02:28 +0000 (0:00:05.471) 0:05:16.948 ***** 2025-12-04 12:02:28.422348 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-12-04 12:02:28.665499 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-12-04 12:02:28.665521 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-12-04 12:02:28.665528 | controller | 2025-12-04 12:02:28.665544 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-12-04 12:02:28.665550 | controller | Thursday 04 December 2025 12:02:28 +0000 (0:00:00.116) 0:05:17.064 ***** 2025-12-04 12:02:28.665560 | controller | ok: [instance -> localhost] 2025-12-04 12:02:30.759704 | controller | 2025-12-04 12:02:30.759742 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-12-04 12:02:30.759750 | controller | Thursday 04 December 2025 12:02:28 +0000 (0:00:00.243) 0:05:17.308 ***** 2025-12-04 12:02:30.759760 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-12-04 12:02:31.500455 | controller | 2025-12-04 12:02:31.500493 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-12-04 12:02:31.500501 | controller | Thursday 04 December 2025 12:02:30 +0000 (0:00:02.092) 0:05:19.400 ***** 2025-12-04 12:02:31.500512 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:32.373655 | controller | 2025-12-04 12:02:32.373692 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-12-04 12:02:32.373699 | controller | Thursday 04 December 2025 12:02:31 +0000 (0:00:00.742) 0:05:20.142 ***** 2025-12-04 12:02:32.373709 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:33.494924 | controller | 2025-12-04 12:02:33.494961 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-12-04 12:02:33.494968 | controller | Thursday 04 December 2025 12:02:32 +0000 (0:00:00.873) 0:05:21.016 ***** 2025-12-04 12:02:33.494979 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:34.164731 | controller | 2025-12-04 12:02:34.164765 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-12-04 12:02:34.164933 | controller | Thursday 04 December 2025 12:02:33 +0000 (0:00:01.121) 0:05:22.137 ***** 2025-12-04 12:02:34.164956 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:35.263794 | controller | 2025-12-04 12:02:35.263835 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-12-04 12:02:35.263843 | controller | Thursday 04 December 2025 12:02:34 +0000 (0:00:00.669) 0:05:22.806 ***** 2025-12-04 12:02:35.263854 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:35.264190 | controller | 2025-12-04 12:02:35.888192 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-12-04 12:02:35.888219 | controller | Thursday 04 December 2025 12:02:35 +0000 (0:00:01.099) 0:05:23.906 ***** 2025-12-04 12:02:35.888230 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:36.518636 | controller | 2025-12-04 12:02:36.518674 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-12-04 12:02:36.518682 | controller | Thursday 04 December 2025 12:02:35 +0000 (0:00:00.624) 0:05:24.531 ***** 2025-12-04 12:02:36.518693 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:37.990793 | controller | 2025-12-04 12:02:37.990829 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-12-04 12:02:37.990843 | controller | Thursday 04 December 2025 12:02:36 +0000 (0:00:00.629) 0:05:25.161 ***** 2025-12-04 12:02:37.990854 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-04 12:02:38.027186 | controller | 2025-12-04 12:02:38.027220 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-04 12:02:38.027228 | controller | Thursday 04 December 2025 12:02:37 +0000 (0:00:01.472) 0:05:26.633 ***** 2025-12-04 12:02:38.027239 | controller | skipping: [instance] 2025-12-04 12:02:38.063050 | controller | 2025-12-04 12:02:38.063077 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 12:02:38.063085 | controller | Thursday 04 December 2025 12:02:38 +0000 (0:00:00.036) 0:05:26.670 ***** 2025-12-04 12:02:38.063097 | controller | skipping: [instance] 2025-12-04 12:02:38.099615 | controller | 2025-12-04 12:02:38.099642 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-04 12:02:38.099650 | controller | Thursday 04 December 2025 12:02:38 +0000 (0:00:00.035) 0:05:26.706 ***** 2025-12-04 12:02:38.099660 | controller | skipping: [instance] 2025-12-04 12:02:38.134342 | controller | 2025-12-04 12:02:38.134363 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-04 12:02:38.134370 | controller | Thursday 04 December 2025 12:02:38 +0000 (0:00:00.036) 0:05:26.742 ***** 2025-12-04 12:02:38.134379 | controller | skipping: [instance] 2025-12-04 12:02:38.171715 | controller | 2025-12-04 12:02:38.171741 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-04 12:02:38.171749 | controller | Thursday 04 December 2025 12:02:38 +0000 (0:00:00.034) 0:05:26.777 ***** 2025-12-04 12:02:38.171765 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:38.281806 | controller | 2025-12-04 12:02:38.281847 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-04 12:02:38.281867 | controller | Thursday 04 December 2025 12:02:38 +0000 (0:00:00.037) 0:05:26.814 ***** 2025-12-04 12:02:38.281883 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-04 12:02:38.333837 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-12-04 12:02:38.333862 | controller | 2025-12-04 12:02:38.333870 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-04 12:02:38.333875 | controller | Thursday 04 December 2025 12:02:38 +0000 (0:00:00.109) 0:05:26.924 ***** 2025-12-04 12:02:38.333886 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-12-04 12:02:41.955328 | controller | 2025-12-04 12:02:41.955370 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-12-04 12:02:41.955378 | controller | Thursday 04 December 2025 12:02:38 +0000 (0:00:00.052) 0:05:26.976 ***** 2025-12-04 12:02:41.955389 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-04 12:02:43.092378 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-12-04 12:02:43.092436 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-04 12:02:43.092444 | controller | 2025-12-04 12:02:43.092450 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-12-04 12:02:43.092456 | controller | Thursday 04 December 2025 12:02:41 +0000 (0:00:03.620) 0:05:30.597 ***** 2025-12-04 12:02:43.092466 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:43.618570 | controller | 2025-12-04 12:02:43.618602 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-04 12:02:43.618610 | controller | Thursday 04 December 2025 12:02:43 +0000 (0:00:01.136) 0:05:31.734 ***** 2025-12-04 12:02:43.618620 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:44.595056 | controller | 2025-12-04 12:02:44.595089 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-04 12:02:44.595096 | controller | Thursday 04 December 2025 12:02:43 +0000 (0:00:00.527) 0:05:32.261 ***** 2025-12-04 12:02:44.595107 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:44.669208 | controller | 2025-12-04 12:02:44.669240 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-04 12:02:44.669247 | controller | Thursday 04 December 2025 12:02:44 +0000 (0:00:00.976) 0:05:33.237 ***** 2025-12-04 12:02:44.669258 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:44.717597 | controller | 2025-12-04 12:02:44.717633 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-04 12:02:44.717641 | controller | Thursday 04 December 2025 12:02:44 +0000 (0:00:00.074) 0:05:33.311 ***** 2025-12-04 12:02:44.717651 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:45.666833 | controller | 2025-12-04 12:02:45.666869 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-04 12:02:45.666876 | controller | Thursday 04 December 2025 12:02:44 +0000 (0:00:00.048) 0:05:33.360 ***** 2025-12-04 12:02:45.666887 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:46.555919 | controller | 2025-12-04 12:02:46.555956 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-12-04 12:02:46.555963 | controller | Thursday 04 December 2025 12:02:45 +0000 (0:00:00.949) 0:05:34.309 ***** 2025-12-04 12:02:46.555974 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:52.664593 | controller | 2025-12-04 12:02:52.664628 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-12-04 12:02:52.664636 | controller | Thursday 04 December 2025 12:02:46 +0000 (0:00:00.889) 0:05:35.198 ***** 2025-12-04 12:02:52.664646 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-12-04 12:02:52.872181 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:52.872209 | controller | 2025-12-04 12:02:52.872217 | controller | TASK [Configure ntp service] *************************************************** 2025-12-04 12:02:52.872222 | controller | Thursday 04 December 2025 12:02:52 +0000 (0:00:06.108) 0:05:41.307 ***** 2025-12-04 12:02:52.872233 | controller | 2025-12-04 12:02:53.932379 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-12-04 12:02:53.932417 | controller | Thursday 04 December 2025 12:02:52 +0000 (0:00:00.208) 0:05:41.515 ***** 2025-12-04 12:02:53.932430 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:55.011688 | controller | 2025-12-04 12:02:55.011729 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-12-04 12:02:55.011737 | controller | Thursday 04 December 2025 12:02:53 +0000 (0:00:01.059) 0:05:42.574 ***** 2025-12-04 12:02:55.011748 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-12-04 12:02:56.002744 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-12-04 12:02:56.002779 | controller | 2025-12-04 12:02:56.002787 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-12-04 12:02:56.002793 | controller | Thursday 04 December 2025 12:02:55 +0000 (0:00:01.079) 0:05:43.654 ***** 2025-12-04 12:02:56.002803 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:56.692955 | controller | 2025-12-04 12:02:56.692996 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-12-04 12:02:56.693004 | controller | Thursday 04 December 2025 12:02:55 +0000 (0:00:00.991) 0:05:44.645 ***** 2025-12-04 12:02:56.693016 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:56.842024 | controller | 2025-12-04 12:02:56.842067 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-12-04 12:02:56.842075 | controller | Thursday 04 December 2025 12:02:56 +0000 (0:00:00.690) 0:05:45.335 ***** 2025-12-04 12:02:56.842085 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-12-04 12:02:57.306299 | controller | 2025-12-04 12:02:57.306328 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-12-04 12:02:57.306336 | controller | Thursday 04 December 2025 12:02:56 +0000 (0:00:00.149) 0:05:45.484 ***** 2025-12-04 12:02:57.306347 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:02:57.784108 | controller | 2025-12-04 12:02:57.784147 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-12-04 12:02:57.784155 | controller | Thursday 04 December 2025 12:02:57 +0000 (0:00:00.464) 0:05:45.949 ***** 2025-12-04 12:02:57.784168 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-04 12:02:58.455553 | controller | 2025-12-04 12:02:58.455584 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-12-04 12:02:58.455591 | controller | Thursday 04 December 2025 12:02:57 +0000 (0:00:00.477) 0:05:46.426 ***** 2025-12-04 12:02:58.455601 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-04 12:02:59.044984 | controller | 2025-12-04 12:02:59.045012 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-12-04 12:02:59.045019 | controller | Thursday 04 December 2025 12:02:58 +0000 (0:00:00.671) 0:05:47.098 ***** 2025-12-04 12:02:59.045029 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-04 12:02:59.095583 | controller | 2025-12-04 12:02:59.095602 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-12-04 12:02:59.095609 | controller | Thursday 04 December 2025 12:02:59 +0000 (0:00:00.589) 0:05:47.687 ***** 2025-12-04 12:02:59.095619 | controller | 2025-12-04 12:02:59.551980 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-12-04 12:02:59.552014 | controller | Thursday 04 December 2025 12:02:59 +0000 (0:00:00.050) 0:05:47.738 ***** 2025-12-04 12:02:59.552032 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-04 12:03:00.292951 | controller | 2025-12-04 12:03:00.292991 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-12-04 12:03:00.292999 | controller | Thursday 04 December 2025 12:02:59 +0000 (0:00:00.456) 0:05:48.194 ***** 2025-12-04 12:03:00.293010 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-04 12:03:00.324166 | controller | 2025-12-04 12:03:00.324186 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-12-04 12:03:00.324193 | controller | Thursday 04 December 2025 12:03:00 +0000 (0:00:00.740) 0:05:48.935 ***** 2025-12-04 12:03:00.324202 | controller | skipping: [instance] 2025-12-04 12:03:00.362777 | controller | 2025-12-04 12:03:00.362795 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-12-04 12:03:00.362803 | controller | Thursday 04 December 2025 12:03:00 +0000 (0:00:00.031) 0:05:48.966 ***** 2025-12-04 12:03:00.362811 | controller | skipping: [instance] 2025-12-04 12:03:00.585933 | controller | 2025-12-04 12:03:00.585955 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-12-04 12:03:00.585963 | controller | Thursday 04 December 2025 12:03:00 +0000 (0:00:00.038) 0:05:49.005 ***** 2025-12-04 12:03:00.585972 | controller | changed: [instance] 2025-12-04 12:03:00.660852 | controller | 2025-12-04 12:03:00.660886 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-12-04 12:03:00.660913 | controller | Thursday 04 December 2025 12:03:00 +0000 (0:00:00.223) 0:05:49.228 ***** 2025-12-04 12:03:00.660931 | controller | skipping: [instance] => (item=) 2025-12-04 12:03:00.696510 | controller | 2025-12-04 12:03:00.696527 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-12-04 12:03:00.696533 | controller | Thursday 04 December 2025 12:03:00 +0000 (0:00:00.074) 0:05:49.303 ***** 2025-12-04 12:03:00.696541 | controller | ok: [instance] 2025-12-04 12:03:00.777263 | controller | 2025-12-04 12:03:00.777299 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 12:03:00.777307 | controller | Thursday 04 December 2025 12:03:00 +0000 (0:00:00.036) 0:05:49.339 ***** 2025-12-04 12:03:00.777316 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-04 12:03:01.025603 | controller | 2025-12-04 12:03:01.025641 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 12:03:01.025652 | controller | Thursday 04 December 2025 12:03:00 +0000 (0:00:00.080) 0:05:49.420 ***** 2025-12-04 12:03:01.025665 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-04 12:03:01.069918 | controller | 2025-12-04 12:03:01.069955 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-12-04 12:03:01.069969 | controller | Thursday 04 December 2025 12:03:01 +0000 (0:00:00.248) 0:05:49.668 ***** 2025-12-04 12:03:01.069980 | controller | 2025-12-04 12:03:01.134398 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-04 12:03:01.134426 | controller | Thursday 04 December 2025 12:03:01 +0000 (0:00:00.044) 0:05:49.712 ***** 2025-12-04 12:03:01.134439 | controller | ok: [instance] 2025-12-04 12:03:01.205152 | controller | 2025-12-04 12:03:01.205178 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 12:03:01.205186 | controller | Thursday 04 December 2025 12:03:01 +0000 (0:00:00.064) 0:05:49.777 ***** 2025-12-04 12:03:01.205196 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-04 12:03:01.472720 | controller | 2025-12-04 12:03:01.472756 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 12:03:01.472764 | controller | Thursday 04 December 2025 12:03:01 +0000 (0:00:00.070) 0:05:49.848 ***** 2025-12-04 12:03:01.472775 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-04 12:03:01.943362 | controller | 2025-12-04 12:03:01.943397 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-12-04 12:03:01.943410 | controller | Thursday 04 December 2025 12:03:01 +0000 (0:00:00.267) 0:05:50.115 ***** 2025-12-04 12:03:01.943420 | controller | changed: [instance] 2025-12-04 12:03:01.943906 | controller | 2025-12-04 12:03:01.943923 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-04 12:03:02.627301 | controller | Thursday 04 December 2025 12:03:01 +0000 (0:00:00.452) 0:05:50.568 ***** 2025-12-04 12:03:02.627351 | controller | 2025-12-04 12:03:02.627360 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-12-04 12:03:02.627366 | controller | Thursday 04 December 2025 12:03:01 +0000 (0:00:00.018) 0:05:50.586 ***** 2025-12-04 12:03:02.627377 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:02.627399 | controller | 2025-12-04 12:03:02.627413 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-04 12:03:02.627430 | controller | Thursday 04 December 2025 12:03:02 +0000 (0:00:00.683) 0:05:51.270 ***** 2025-12-04 12:03:03.025441 | controller | changed: [instance] 2025-12-04 12:03:03.025521 | controller | 2025-12-04 12:03:03.025673 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-12-04 12:03:03.025709 | controller | Thursday 04 December 2025 12:03:03 +0000 (0:00:00.398) 0:05:51.668 ***** 2025-12-04 12:03:03.212583 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 12:03:04.733953 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 12:03:04.733989 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-12-04 12:03:04.733996 | controller | 2025-12-04 12:03:04.734003 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-12-04 12:03:04.734008 | controller | Thursday 04 December 2025 12:03:03 +0000 (0:00:00.186) 0:05:51.854 ***** 2025-12-04 12:03:04.734019 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-04 12:03:04.752906 | controller | 2025-12-04 12:03:04.752944 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-04 12:03:04.752968 | controller | Thursday 04 December 2025 12:03:04 +0000 (0:00:01.521) 0:05:53.376 ***** 2025-12-04 12:03:04.752980 | controller | skipping: [instance] 2025-12-04 12:03:05.228045 | controller | 2025-12-04 12:03:05.228078 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-04 12:03:05.228086 | controller | Thursday 04 December 2025 12:03:04 +0000 (0:00:00.019) 0:05:53.395 ***** 2025-12-04 12:03:05.228097 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-12-04 12:03:05.261988 | controller | 2025-12-04 12:03:05.262016 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-04 12:03:05.262023 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.474) 0:05:53.870 ***** 2025-12-04 12:03:05.262033 | controller | skipping: [instance] 2025-12-04 12:03:05.299070 | controller | 2025-12-04 12:03:05.299104 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-04 12:03:05.299112 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.034) 0:05:53.905 ***** 2025-12-04 12:03:05.299122 | controller | skipping: [instance] 2025-12-04 12:03:05.331731 | controller | 2025-12-04 12:03:05.331760 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-04 12:03:05.331768 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.036) 0:05:53.941 ***** 2025-12-04 12:03:05.331778 | controller | skipping: [instance] 2025-12-04 12:03:05.373872 | controller | 2025-12-04 12:03:05.373919 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-04 12:03:05.373929 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.032) 0:05:53.974 ***** 2025-12-04 12:03:05.374064 | controller | skipping: [instance] 2025-12-04 12:03:05.412411 | controller | 2025-12-04 12:03:05.412433 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-12-04 12:03:05.412442 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.042) 0:05:54.016 ***** 2025-12-04 12:03:05.412464 | controller | skipping: [instance] 2025-12-04 12:03:05.412637 | controller | 2025-12-04 12:03:05.412659 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-12-04 12:03:05.433753 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.038) 0:05:54.055 ***** 2025-12-04 12:03:05.433774 | controller | skipping: [instance] 2025-12-04 12:03:05.433962 | controller | 2025-12-04 12:03:05.433980 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-12-04 12:03:05.461606 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.021) 0:05:54.076 ***** 2025-12-04 12:03:05.461629 | controller | skipping: [instance] 2025-12-04 12:03:05.461656 | controller | 2025-12-04 12:03:05.461873 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-12-04 12:03:05.515385 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.027) 0:05:54.104 ***** 2025-12-04 12:03:05.515407 | controller | ok: [instance] 2025-12-04 12:03:05.515595 | controller | 2025-12-04 12:03:05.515616 | controller | TASK [reproducer : Push local code] ******************************************** 2025-12-04 12:03:05.608406 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.053) 0:05:54.158 ***** 2025-12-04 12:03:05.608474 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-12-04 12:03:05.646959 | controller | 2025-12-04 12:03:05.646986 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-12-04 12:03:05.646995 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.092) 0:05:54.251 ***** 2025-12-04 12:03:05.647006 | controller | skipping: [instance] 2025-12-04 12:03:05.647031 | controller | 2025-12-04 12:03:05.647040 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-12-04 12:03:05.647121 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.038) 0:05:54.290 ***** 2025-12-04 12:03:05.686443 | controller | skipping: [instance] 2025-12-04 12:03:05.686531 | controller | 2025-12-04 12:03:05.686570 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-12-04 12:03:05.686587 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.039) 0:05:54.329 ***** 2025-12-04 12:03:05.721173 | controller | skipping: [instance] 2025-12-04 12:03:05.757818 | controller | 2025-12-04 12:03:05.757844 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-12-04 12:03:05.757851 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.034) 0:05:54.364 ***** 2025-12-04 12:03:05.757861 | controller | skipping: [instance] 2025-12-04 12:03:05.797675 | controller | 2025-12-04 12:03:05.797695 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-12-04 12:03:05.797708 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.036) 0:05:54.400 ***** 2025-12-04 12:03:05.797717 | controller | skipping: [instance] 2025-12-04 12:03:05.797879 | controller | 2025-12-04 12:03:05.797910 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-12-04 12:03:06.290062 | controller | Thursday 04 December 2025 12:03:05 +0000 (0:00:00.040) 0:05:54.440 ***** 2025-12-04 12:03:06.290109 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-12-04 12:03:06.290224 | controller | 2025-12-04 12:03:06.290262 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-12-04 12:03:06.856677 | controller | Thursday 04 December 2025 12:03:06 +0000 (0:00:00.492) 0:05:54.933 ***** 2025-12-04 12:03:06.856716 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-12-04 12:03:06.896447 | controller | 2025-12-04 12:03:06.896481 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-12-04 12:03:06.896489 | controller | Thursday 04 December 2025 12:03:06 +0000 (0:00:00.566) 0:05:55.499 ***** 2025-12-04 12:03:06.896500 | controller | skipping: [instance] => (item=ci-framework) 2025-12-04 12:03:06.964036 | controller | skipping: [instance] 2025-12-04 12:03:06.964063 | controller | 2025-12-04 12:03:06.964071 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-12-04 12:03:06.964083 | controller | Thursday 04 December 2025 12:03:06 +0000 (0:00:00.039) 0:05:55.539 ***** 2025-12-04 12:03:06.964094 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-12-04 12:03:07.463293 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-12-04 12:03:07.463339 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-12-04 12:03:07.463347 | controller | 2025-12-04 12:03:07.463354 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-12-04 12:03:07.463360 | controller | Thursday 04 December 2025 12:03:06 +0000 (0:00:00.067) 0:05:55.606 ***** 2025-12-04 12:03:07.463371 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:07.463404 | controller | 2025-12-04 12:03:07.463413 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-12-04 12:03:07.463553 | controller | Thursday 04 December 2025 12:03:07 +0000 (0:00:00.499) 0:05:56.106 ***** 2025-12-04 12:03:07.499368 | controller | skipping: [instance] 2025-12-04 12:03:07.499556 | controller | 2025-12-04 12:03:07.499578 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-12-04 12:03:07.499588 | controller | Thursday 04 December 2025 12:03:07 +0000 (0:00:00.036) 0:05:56.142 ***** 2025-12-04 12:03:08.000167 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:08.000286 | controller | 2025-12-04 12:03:08.000327 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-12-04 12:03:08.038196 | controller | Thursday 04 December 2025 12:03:07 +0000 (0:00:00.500) 0:05:56.643 ***** 2025-12-04 12:03:08.038233 | controller | skipping: [instance] 2025-12-04 12:03:08.491142 | controller | 2025-12-04 12:03:08.491177 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-12-04 12:03:08.491186 | controller | Thursday 04 December 2025 12:03:08 +0000 (0:00:00.037) 0:05:56.681 ***** 2025-12-04 12:03:08.491198 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:10.725840 | controller | 2025-12-04 12:03:10.725907 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-12-04 12:03:10.725916 | controller | Thursday 04 December 2025 12:03:08 +0000 (0:00:00.452) 0:05:57.133 ***** 2025-12-04 12:03:10.725934 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:30.385523 | controller | 2025-12-04 12:03:30.385564 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-12-04 12:03:30.385572 | controller | Thursday 04 December 2025 12:03:10 +0000 (0:00:02.233) 0:05:59.367 ***** 2025-12-04 12:03:30.385582 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:31.528987 | controller | 2025-12-04 12:03:31.529021 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-12-04 12:03:31.529029 | controller | Thursday 04 December 2025 12:03:30 +0000 (0:00:19.660) 0:06:19.028 ***** 2025-12-04 12:03:31.529039 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:31.632148 | controller | 2025-12-04 12:03:31.632189 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-12-04 12:03:31.632197 | controller | Thursday 04 December 2025 12:03:31 +0000 (0:00:01.143) 0:06:20.171 ***** 2025-12-04 12:03:31.632208 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-12-04 12:03:32.149165 | controller | 2025-12-04 12:03:32.149205 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-12-04 12:03:32.149213 | controller | Thursday 04 December 2025 12:03:31 +0000 (0:00:00.103) 0:06:20.275 ***** 2025-12-04 12:03:32.149225 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:32.197657 | controller | 2025-12-04 12:03:32.197692 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-12-04 12:03:32.197700 | controller | Thursday 04 December 2025 12:03:32 +0000 (0:00:00.516) 0:06:20.791 ***** 2025-12-04 12:03:32.197712 | controller | skipping: [instance] 2025-12-04 12:03:32.248994 | controller | 2025-12-04 12:03:32.249034 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-12-04 12:03:32.249042 | controller | Thursday 04 December 2025 12:03:32 +0000 (0:00:00.048) 0:06:20.840 ***** 2025-12-04 12:03:32.249054 | controller | skipping: [instance] 2025-12-04 12:03:32.347291 | controller | 2025-12-04 12:03:32.347331 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-12-04 12:03:32.347339 | controller | Thursday 04 December 2025 12:03:32 +0000 (0:00:00.051) 0:06:20.891 ***** 2025-12-04 12:03:32.347350 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:32.918629 | controller | 2025-12-04 12:03:32.918669 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-04 12:03:32.918677 | controller | Thursday 04 December 2025 12:03:32 +0000 (0:00:00.098) 0:06:20.989 ***** 2025-12-04 12:03:32.918690 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:32.961988 | controller | 2025-12-04 12:03:32.962025 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-04 12:03:32.962034 | controller | Thursday 04 December 2025 12:03:32 +0000 (0:00:00.571) 0:06:21.561 ***** 2025-12-04 12:03:32.962045 | controller | skipping: [instance] 2025-12-04 12:03:33.004121 | controller | 2025-12-04 12:03:33.004154 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-04 12:03:33.004162 | controller | Thursday 04 December 2025 12:03:32 +0000 (0:00:00.043) 0:06:21.604 ***** 2025-12-04 12:03:33.004173 | controller | skipping: [instance] 2025-12-04 12:03:33.061914 | controller | 2025-12-04 12:03:33.061938 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-04 12:03:33.061946 | controller | Thursday 04 December 2025 12:03:33 +0000 (0:00:00.042) 0:06:21.647 ***** 2025-12-04 12:03:33.061956 | controller | skipping: [instance] 2025-12-04 12:03:33.062170 | controller | 2025-12-04 12:03:33.062215 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-04 12:03:33.117556 | controller | Thursday 04 December 2025 12:03:33 +0000 (0:00:00.057) 0:06:21.704 ***** 2025-12-04 12:03:33.117587 | controller | skipping: [instance] 2025-12-04 12:03:34.670372 | controller | 2025-12-04 12:03:34.670417 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-04 12:03:34.670426 | controller | Thursday 04 December 2025 12:03:33 +0000 (0:00:00.055) 0:06:21.760 ***** 2025-12-04 12:03:34.670439 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:03:34.670448 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:03:34.670491 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:03:34.670711 | controller | changed: [instance -> controller-0] 2025-12-04 12:03:34.670819 | controller | 2025-12-04 12:03:34.670911 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-04 12:03:34.670925 | controller | Thursday 04 December 2025 12:03:34 +0000 (0:00:01.552) 0:06:23.313 ***** 2025-12-04 12:03:35.691943 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:35.692004 | controller | 2025-12-04 12:03:35.692016 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-04 12:03:35.692045 | controller | Thursday 04 December 2025 12:03:35 +0000 (0:00:01.021) 0:06:24.334 ***** 2025-12-04 12:03:37.015924 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:37.015987 | controller | 2025-12-04 12:03:37.016070 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-04 12:03:37.016219 | controller | Thursday 04 December 2025 12:03:37 +0000 (0:00:01.323) 0:06:25.658 ***** 2025-12-04 12:03:44.691795 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:44.692121 | controller | 2025-12-04 12:03:45.711358 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-04 12:03:45.711425 | controller | Thursday 04 December 2025 12:03:44 +0000 (0:00:07.675) 0:06:33.334 ***** 2025-12-04 12:03:45.711442 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:45.756484 | controller | 2025-12-04 12:03:45.756541 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-04 12:03:45.756549 | controller | Thursday 04 December 2025 12:03:45 +0000 (0:00:01.019) 0:06:34.354 ***** 2025-12-04 12:03:45.756562 | controller | skipping: [instance] 2025-12-04 12:03:46.941499 | controller | 2025-12-04 12:03:46.941592 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-04 12:03:46.941601 | controller | Thursday 04 December 2025 12:03:45 +0000 (0:00:00.045) 0:06:34.399 ***** 2025-12-04 12:03:46.941620 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:47.011486 | controller | 2025-12-04 12:03:47.011557 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-04 12:03:47.011567 | controller | Thursday 04 December 2025 12:03:46 +0000 (0:00:01.184) 0:06:35.584 ***** 2025-12-04 12:03:47.011580 | controller | skipping: [instance] 2025-12-04 12:03:47.011601 | controller | 2025-12-04 12:03:47.011607 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-04 12:03:47.011614 | controller | Thursday 04 December 2025 12:03:47 +0000 (0:00:00.070) 0:06:35.654 ***** 2025-12-04 12:03:47.080405 | controller | skipping: [instance] 2025-12-04 12:03:47.142049 | controller | 2025-12-04 12:03:47.142091 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-04 12:03:47.142100 | controller | Thursday 04 December 2025 12:03:47 +0000 (0:00:00.068) 0:06:35.722 ***** 2025-12-04 12:03:47.142122 | controller | skipping: [instance] 2025-12-04 12:03:47.142143 | controller | 2025-12-04 12:03:47.142150 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-04 12:03:47.142244 | controller | Thursday 04 December 2025 12:03:47 +0000 (0:00:00.062) 0:06:35.785 ***** 2025-12-04 12:03:48.026774 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:49.047912 | controller | 2025-12-04 12:03:49.047950 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-04 12:03:49.047958 | controller | Thursday 04 December 2025 12:03:48 +0000 (0:00:00.884) 0:06:36.669 ***** 2025-12-04 12:03:49.047969 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:49.097967 | controller | 2025-12-04 12:03:49.098038 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-04 12:03:49.098048 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:01.021) 0:06:37.690 ***** 2025-12-04 12:03:49.098064 | controller | skipping: [instance] 2025-12-04 12:03:49.143641 | controller | 2025-12-04 12:03:49.143718 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-04 12:03:49.143728 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.050) 0:06:37.741 ***** 2025-12-04 12:03:49.143740 | controller | skipping: [instance] 2025-12-04 12:03:49.143769 | controller | 2025-12-04 12:03:49.143784 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-04 12:03:49.143801 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.045) 0:06:37.786 ***** 2025-12-04 12:03:49.194978 | controller | skipping: [instance] 2025-12-04 12:03:49.195031 | controller | 2025-12-04 12:03:49.195143 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-04 12:03:49.195297 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.051) 0:06:37.837 ***** 2025-12-04 12:03:49.262050 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:49.262171 | controller | 2025-12-04 12:03:49.262342 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-04 12:03:49.262485 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.067) 0:06:37.905 ***** 2025-12-04 12:03:49.317265 | controller | skipping: [instance] 2025-12-04 12:03:49.317372 | controller | 2025-12-04 12:03:49.317478 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-04 12:03:49.317588 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.055) 0:06:37.960 ***** 2025-12-04 12:03:49.363719 | controller | skipping: [instance] 2025-12-04 12:03:49.363776 | controller | 2025-12-04 12:03:49.363900 | controller | TASK [Download the RPM] ******************************************************** 2025-12-04 12:03:49.364003 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.046) 0:06:38.006 ***** 2025-12-04 12:03:49.408787 | controller | skipping: [instance] 2025-12-04 12:03:49.408871 | controller | 2025-12-04 12:03:49.409008 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-04 12:03:49.409109 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.044) 0:06:38.051 ***** 2025-12-04 12:03:49.454198 | controller | skipping: [instance] 2025-12-04 12:03:49.454308 | controller | 2025-12-04 12:03:49.454415 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-04 12:03:49.454526 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.045) 0:06:38.097 ***** 2025-12-04 12:03:49.510192 | controller | skipping: [instance] 2025-12-04 12:03:49.510266 | controller | 2025-12-04 12:03:49.510390 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-04 12:03:49.510484 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.056) 0:06:38.153 ***** 2025-12-04 12:03:49.554978 | controller | skipping: [instance] 2025-12-04 12:03:49.555060 | controller | 2025-12-04 12:03:49.555166 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-04 12:03:49.555259 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.044) 0:06:38.197 ***** 2025-12-04 12:03:49.602198 | controller | skipping: [instance] 2025-12-04 12:03:49.602308 | controller | 2025-12-04 12:03:49.602419 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-04 12:03:49.602512 | controller | Thursday 04 December 2025 12:03:49 +0000 (0:00:00.047) 0:06:38.245 ***** 2025-12-04 12:03:50.148547 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:50.148616 | controller | 2025-12-04 12:03:50.148644 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-04 12:03:50.148750 | controller | Thursday 04 December 2025 12:03:50 +0000 (0:00:00.546) 0:06:38.791 ***** 2025-12-04 12:03:50.212997 | controller | skipping: [instance] 2025-12-04 12:03:50.213054 | controller | 2025-12-04 12:03:50.213145 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-04 12:03:50.213240 | controller | Thursday 04 December 2025 12:03:50 +0000 (0:00:00.064) 0:06:38.856 ***** 2025-12-04 12:03:50.276051 | controller | skipping: [instance] 2025-12-04 12:03:50.276104 | controller | 2025-12-04 12:03:50.276204 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-04 12:03:50.276305 | controller | Thursday 04 December 2025 12:03:50 +0000 (0:00:00.063) 0:06:38.919 ***** 2025-12-04 12:03:50.321552 | controller | skipping: [instance] 2025-12-04 12:03:50.321613 | controller | 2025-12-04 12:03:50.321734 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-04 12:03:50.321831 | controller | Thursday 04 December 2025 12:03:50 +0000 (0:00:00.045) 0:06:38.964 ***** 2025-12-04 12:03:50.388135 | controller | skipping: [instance] 2025-12-04 12:03:50.388182 | controller | 2025-12-04 12:03:50.388309 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-04 12:03:50.388412 | controller | Thursday 04 December 2025 12:03:50 +0000 (0:00:00.066) 0:06:39.031 ***** 2025-12-04 12:03:50.453906 | controller | skipping: [instance] 2025-12-04 12:03:50.453986 | controller | 2025-12-04 12:03:50.454099 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-04 12:03:50.454207 | controller | Thursday 04 December 2025 12:03:50 +0000 (0:00:00.065) 0:06:39.097 ***** 2025-12-04 12:03:50.515679 | controller | skipping: [instance] 2025-12-04 12:03:50.515771 | controller | 2025-12-04 12:03:50.515898 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-04 12:03:50.516019 | controller | Thursday 04 December 2025 12:03:50 +0000 (0:00:00.061) 0:06:39.158 ***** 2025-12-04 12:03:50.581339 | controller | skipping: [instance] 2025-12-04 12:03:50.581424 | controller | 2025-12-04 12:03:50.581527 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-04 12:03:50.581620 | controller | Thursday 04 December 2025 12:03:50 +0000 (0:00:00.065) 0:06:39.224 ***** 2025-12-04 12:03:50.640398 | controller | skipping: [instance] 2025-12-04 12:03:50.640453 | controller | 2025-12-04 12:03:50.640569 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-04 12:03:50.640666 | controller | Thursday 04 December 2025 12:03:50 +0000 (0:00:00.059) 0:06:39.283 ***** 2025-12-04 12:03:51.307307 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:51.307386 | controller | 2025-12-04 12:03:51.307417 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-04 12:03:51.307533 | controller | Thursday 04 December 2025 12:03:51 +0000 (0:00:00.666) 0:06:39.950 ***** 2025-12-04 12:03:52.436393 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:03:52.436488 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:03:52.436498 | controller | changed: [instance -> controller-0] 2025-12-04 12:03:52.436786 | controller | 2025-12-04 12:03:53.199354 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-04 12:03:53.199390 | controller | Thursday 04 December 2025 12:03:52 +0000 (0:00:01.128) 0:06:41.079 ***** 2025-12-04 12:03:53.199403 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:53.767716 | controller | 2025-12-04 12:03:53.767754 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-04 12:03:53.767762 | controller | Thursday 04 December 2025 12:03:53 +0000 (0:00:00.762) 0:06:41.842 ***** 2025-12-04 12:03:53.767773 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:53.830407 | controller | 2025-12-04 12:03:53.830462 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-04 12:03:53.830474 | controller | Thursday 04 December 2025 12:03:53 +0000 (0:00:00.568) 0:06:42.410 ***** 2025-12-04 12:03:53.830488 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:03:53.830510 | controller | ok: [instance -> controller-0] 2025-12-04 12:03:53.830520 | controller | 2025-12-04 12:03:53.830724 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-04 12:03:53.877285 | controller | Thursday 04 December 2025 12:03:53 +0000 (0:00:00.063) 0:06:42.473 ***** 2025-12-04 12:03:53.877308 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:03:53.877363 | controller | 2025-12-04 12:03:53.877464 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-04 12:03:53.877562 | controller | Thursday 04 December 2025 12:03:53 +0000 (0:00:00.046) 0:06:42.520 ***** 2025-12-04 12:04:22.950845 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:22.950905 | controller | 2025-12-04 12:04:22.950980 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-04 12:04:22.951074 | controller | Thursday 04 December 2025 12:04:22 +0000 (0:00:29.073) 0:07:11.593 ***** 2025-12-04 12:04:23.446773 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:23.446826 | controller | 2025-12-04 12:04:23.446988 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-04 12:04:23.447083 | controller | Thursday 04 December 2025 12:04:23 +0000 (0:00:00.496) 0:07:12.089 ***** 2025-12-04 12:04:23.952726 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:23.952776 | controller | 2025-12-04 12:04:23.952860 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-04 12:04:23.952948 | controller | Thursday 04 December 2025 12:04:23 +0000 (0:00:00.505) 0:07:12.595 ***** 2025-12-04 12:04:30.432942 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:30.432998 | controller | 2025-12-04 12:04:30.433078 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-04 12:04:30.433161 | controller | Thursday 04 December 2025 12:04:30 +0000 (0:00:06.480) 0:07:19.075 ***** 2025-12-04 12:04:30.492669 | controller | skipping: [instance] 2025-12-04 12:04:30.492748 | controller | 2025-12-04 12:04:30.492850 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-04 12:04:30.492966 | controller | Thursday 04 December 2025 12:04:30 +0000 (0:00:00.059) 0:07:19.135 ***** 2025-12-04 12:04:31.182358 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:31.182410 | controller | 2025-12-04 12:04:31.182420 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-04 12:04:31.182493 | controller | Thursday 04 December 2025 12:04:31 +0000 (0:00:00.689) 0:07:19.824 ***** 2025-12-04 12:04:31.721385 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:31.721457 | controller | 2025-12-04 12:04:31.721778 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-04 12:04:31.761650 | controller | Thursday 04 December 2025 12:04:31 +0000 (0:00:00.539) 0:07:20.364 ***** 2025-12-04 12:04:31.761709 | controller | skipping: [instance] 2025-12-04 12:04:31.761735 | controller | 2025-12-04 12:04:31.761746 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-04 12:04:31.761844 | controller | Thursday 04 December 2025 12:04:31 +0000 (0:00:00.040) 0:07:20.404 ***** 2025-12-04 12:04:31.804174 | controller | skipping: [instance] 2025-12-04 12:04:31.804672 | controller | 2025-12-04 12:04:31.804778 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-04 12:04:31.804905 | controller | Thursday 04 December 2025 12:04:31 +0000 (0:00:00.041) 0:07:20.446 ***** 2025-12-04 12:04:31.853731 | controller | skipping: [instance] 2025-12-04 12:04:31.853814 | controller | 2025-12-04 12:04:31.853823 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-04 12:04:31.853833 | controller | Thursday 04 December 2025 12:04:31 +0000 (0:00:00.049) 0:07:20.495 ***** 2025-12-04 12:04:31.894179 | controller | skipping: [instance] 2025-12-04 12:04:31.894292 | controller | 2025-12-04 12:04:31.894413 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-04 12:04:31.894515 | controller | Thursday 04 December 2025 12:04:31 +0000 (0:00:00.041) 0:07:20.537 ***** 2025-12-04 12:04:31.946322 | controller | skipping: [instance] 2025-12-04 12:04:31.946450 | controller | 2025-12-04 12:04:31.946589 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-04 12:04:31.946697 | controller | Thursday 04 December 2025 12:04:31 +0000 (0:00:00.051) 0:07:20.589 ***** 2025-12-04 12:04:32.015122 | controller | skipping: [instance] 2025-12-04 12:04:32.015174 | controller | 2025-12-04 12:04:32.015309 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-04 12:04:32.015418 | controller | Thursday 04 December 2025 12:04:32 +0000 (0:00:00.068) 0:07:20.657 ***** 2025-12-04 12:04:34.670377 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:04:34.670478 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:04:34.670562 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:04:34.670577 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:04:34.670643 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:04:34.670746 | controller | changed: [instance -> controller-0] 2025-12-04 12:04:34.670843 | controller | 2025-12-04 12:04:34.670928 | controller | TASK [Prepare install_yamls make targets] ************************************** 2025-12-04 12:04:34.671017 | controller | Thursday 04 December 2025 12:04:34 +0000 (0:00:02.655) 0:07:23.312 ***** 2025-12-04 12:04:34.840564 | controller | 2025-12-04 12:04:34.840693 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2025-12-04 12:04:34.840828 | controller | Thursday 04 December 2025 12:04:34 +0000 (0:00:00.170) 0:07:23.483 ***** 2025-12-04 12:04:36.410209 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:04:36.410322 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:04:36.410385 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:04:36.410398 | controller | changed: [instance -> controller-0] 2025-12-04 12:04:36.410499 | controller | 2025-12-04 12:04:36.410585 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2025-12-04 12:04:36.410684 | controller | Thursday 04 December 2025 12:04:36 +0000 (0:00:01.569) 0:07:25.052 ***** 2025-12-04 12:04:36.479637 | controller | 2025-12-04 12:04:36.479780 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2025-12-04 12:04:36.479937 | controller | Thursday 04 December 2025 12:04:36 +0000 (0:00:00.070) 0:07:25.122 ***** 2025-12-04 12:04:36.530709 | controller | skipping: [instance] 2025-12-04 12:04:36.530825 | controller | 2025-12-04 12:04:36.530999 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2025-12-04 12:04:36.531138 | controller | Thursday 04 December 2025 12:04:36 +0000 (0:00:00.050) 0:07:25.173 ***** 2025-12-04 12:04:36.584702 | controller | skipping: [instance] 2025-12-04 12:04:36.584765 | controller | 2025-12-04 12:04:36.584940 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2025-12-04 12:04:36.585024 | controller | Thursday 04 December 2025 12:04:36 +0000 (0:00:00.054) 0:07:25.228 ***** 2025-12-04 12:04:36.661491 | controller | 2025-12-04 12:04:36.661577 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 12:04:36.661700 | controller | Thursday 04 December 2025 12:04:36 +0000 (0:00:00.076) 0:07:25.304 ***** 2025-12-04 12:04:36.710247 | controller | skipping: [instance] 2025-12-04 12:04:36.710361 | controller | 2025-12-04 12:04:36.710472 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 12:04:36.710576 | controller | Thursday 04 December 2025 12:04:36 +0000 (0:00:00.048) 0:07:25.353 ***** 2025-12-04 12:04:36.754494 | controller | skipping: [instance] 2025-12-04 12:04:36.754580 | controller | 2025-12-04 12:04:36.754680 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 12:04:36.754773 | controller | Thursday 04 December 2025 12:04:36 +0000 (0:00:00.044) 0:07:25.397 ***** 2025-12-04 12:04:36.796026 | controller | skipping: [instance] 2025-12-04 12:04:36.796114 | controller | 2025-12-04 12:04:36.796220 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 12:04:36.796359 | controller | Thursday 04 December 2025 12:04:36 +0000 (0:00:00.041) 0:07:25.439 ***** 2025-12-04 12:04:36.843544 | controller | skipping: [instance] 2025-12-04 12:04:36.843619 | controller | 2025-12-04 12:04:36.843709 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2025-12-04 12:04:36.843798 | controller | Thursday 04 December 2025 12:04:36 +0000 (0:00:00.047) 0:07:25.486 ***** 2025-12-04 12:04:36.944495 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:04:36.944584 | controller | ok: [instance -> controller-0] 2025-12-04 12:04:36.944679 | controller | 2025-12-04 12:04:36.944781 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2025-12-04 12:04:36.944878 | controller | Thursday 04 December 2025 12:04:36 +0000 (0:00:00.100) 0:07:25.587 ***** 2025-12-04 12:04:37.023346 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:37.023431 | controller | 2025-12-04 12:04:37.023538 | controller | TASK [install_yamls : Get environment structure] ******************************* 2025-12-04 12:04:37.023651 | controller | Thursday 04 December 2025 12:04:37 +0000 (0:00:00.078) 0:07:25.666 ***** 2025-12-04 12:04:38.166467 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:38.166511 | controller | 2025-12-04 12:04:38.166518 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2025-12-04 12:04:38.166527 | controller | Thursday 04 December 2025 12:04:38 +0000 (0:00:01.142) 0:07:26.808 ***** 2025-12-04 12:04:38.222359 | controller | skipping: [instance] 2025-12-04 12:04:38.222654 | controller | 2025-12-04 12:04:38.222719 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2025-12-04 12:04:38.282525 | controller | Thursday 04 December 2025 12:04:38 +0000 (0:00:00.056) 0:07:26.865 ***** 2025-12-04 12:04:38.282594 | controller | skipping: [instance] 2025-12-04 12:04:38.282766 | controller | 2025-12-04 12:04:38.282784 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2025-12-04 12:04:38.332444 | controller | Thursday 04 December 2025 12:04:38 +0000 (0:00:00.060) 0:07:26.925 ***** 2025-12-04 12:04:38.332504 | controller | skipping: [instance] 2025-12-04 12:04:38.332608 | controller | 2025-12-04 12:04:38.332645 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2025-12-04 12:04:38.399681 | controller | Thursday 04 December 2025 12:04:38 +0000 (0:00:00.049) 0:07:26.975 ***** 2025-12-04 12:04:38.399730 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:38.399738 | controller | 2025-12-04 12:04:38.399744 | controller | TASK [install_yamls : Show the env structure] ********************************** 2025-12-04 12:04:38.399753 | controller | Thursday 04 December 2025 12:04:38 +0000 (0:00:00.066) 0:07:27.041 ***** 2025-12-04 12:04:38.455066 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:38.524729 | controller | 2025-12-04 12:04:38.524767 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2025-12-04 12:04:38.524775 | controller | Thursday 04 December 2025 12:04:38 +0000 (0:00:00.055) 0:07:27.097 ***** 2025-12-04 12:04:38.524787 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:38.524815 | controller | 2025-12-04 12:04:38.525044 | controller | TASK [install_yamls : Generate make targets] *********************************** 2025-12-04 12:04:39.227129 | controller | Thursday 04 December 2025 12:04:38 +0000 (0:00:00.069) 0:07:27.167 ***** 2025-12-04 12:04:39.227183 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:39.227477 | controller | 2025-12-04 12:04:39.284423 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2025-12-04 12:04:39.284495 | controller | Thursday 04 December 2025 12:04:39 +0000 (0:00:00.701) 0:07:27.869 ***** 2025-12-04 12:04:39.284514 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:39.284570 | controller | 2025-12-04 12:04:39.284601 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2025-12-04 12:04:40.254914 | controller | Thursday 04 December 2025 12:04:39 +0000 (0:00:00.058) 0:07:27.927 ***** 2025-12-04 12:04:40.254960 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:40.307638 | controller | 2025-12-04 12:04:40.307673 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2025-12-04 12:04:40.307682 | controller | Thursday 04 December 2025 12:04:40 +0000 (0:00:00.970) 0:07:28.897 ***** 2025-12-04 12:04:40.307693 | controller | skipping: [instance] 2025-12-04 12:04:41.235317 | controller | 2025-12-04 12:04:41.235362 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-04 12:04:41.235371 | controller | Thursday 04 December 2025 12:04:40 +0000 (0:00:00.052) 0:07:28.950 ***** 2025-12-04 12:04:41.235383 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:41.293211 | controller | 2025-12-04 12:04:41.293246 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-04 12:04:41.293255 | controller | Thursday 04 December 2025 12:04:41 +0000 (0:00:00.927) 0:07:29.877 ***** 2025-12-04 12:04:41.293266 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:42.268030 | controller | 2025-12-04 12:04:42.268073 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2025-12-04 12:04:42.268082 | controller | Thursday 04 December 2025 12:04:41 +0000 (0:00:00.058) 0:07:29.936 ***** 2025-12-04 12:04:42.268093 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:42.268112 | controller | 2025-12-04 12:04:42.268119 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2025-12-04 12:04:42.268189 | controller | Thursday 04 December 2025 12:04:42 +0000 (0:00:00.974) 0:07:30.911 ***** 2025-12-04 12:04:42.777264 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:42.777345 | controller | 2025-12-04 12:04:42.777441 | controller | TASK [Configure CRC network if needed] ***************************************** 2025-12-04 12:04:42.777541 | controller | Thursday 04 December 2025 12:04:42 +0000 (0:00:00.509) 0:07:31.420 ***** 2025-12-04 12:04:42.939823 | controller | 2025-12-04 12:04:42.939898 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2025-12-04 12:04:42.940010 | controller | Thursday 04 December 2025 12:04:42 +0000 (0:00:00.162) 0:07:31.582 ***** 2025-12-04 12:04:44.164970 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:44.165248 | controller | 2025-12-04 12:04:45.388921 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2025-12-04 12:04:45.388961 | controller | Thursday 04 December 2025 12:04:44 +0000 (0:00:01.225) 0:07:32.807 ***** 2025-12-04 12:04:45.388972 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:45.389051 | controller | 2025-12-04 12:04:45.389061 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2025-12-04 12:04:45.389068 | controller | Thursday 04 December 2025 12:04:45 +0000 (0:00:01.223) 0:07:34.031 ***** 2025-12-04 12:04:45.423426 | controller | skipping: [instance] 2025-12-04 12:04:45.470916 | controller | 2025-12-04 12:04:45.470942 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2025-12-04 12:04:45.470950 | controller | Thursday 04 December 2025 12:04:45 +0000 (0:00:00.034) 0:07:34.066 ***** 2025-12-04 12:04:45.470960 | controller | skipping: [instance] 2025-12-04 12:04:45.514659 | controller | 2025-12-04 12:04:45.514688 | controller | TASK [reproducer : Prepare architecture-based deployment] ********************** 2025-12-04 12:04:45.514697 | controller | Thursday 04 December 2025 12:04:45 +0000 (0:00:00.047) 0:07:34.113 ***** 2025-12-04 12:04:45.514707 | controller | skipping: [instance] 2025-12-04 12:04:45.560171 | controller | 2025-12-04 12:04:45.560195 | controller | TASK [reproducer : Prepare architecture-based post deployment] ***************** 2025-12-04 12:04:45.560203 | controller | Thursday 04 December 2025 12:04:45 +0000 (0:00:00.043) 0:07:34.157 ***** 2025-12-04 12:04:45.560213 | controller | skipping: [instance] 2025-12-04 12:04:46.592018 | controller | 2025-12-04 12:04:46.592057 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** 2025-12-04 12:04:46.592065 | controller | Thursday 04 December 2025 12:04:45 +0000 (0:00:00.042) 0:07:34.199 ***** 2025-12-04 12:04:46.592076 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:47.154137 | controller | 2025-12-04 12:04:47.154169 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** 2025-12-04 12:04:47.154178 | controller | Thursday 04 December 2025 12:04:46 +0000 (0:00:01.034) 0:07:35.234 ***** 2025-12-04 12:04:47.154188 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:47.661341 | controller | 2025-12-04 12:04:47.661378 | controller | TASK [Ensure we have needed inventory files] *********************************** 2025-12-04 12:04:47.661386 | controller | Thursday 04 December 2025 12:04:47 +0000 (0:00:00.562) 0:07:35.796 ***** 2025-12-04 12:04:47.661396 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:48.175536 | controller | 2025-12-04 12:04:48.175571 | controller | TASK [Ensure we have CRC ssh key] ********************************************** 2025-12-04 12:04:48.175578 | controller | Thursday 04 December 2025 12:04:47 +0000 (0:00:00.507) 0:07:36.304 ***** 2025-12-04 12:04:48.175589 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:48.660550 | controller | 2025-12-04 12:04:48.660588 | controller | TASK [Ensure we have the MAC mapping file] ************************************* 2025-12-04 12:04:48.660597 | controller | Thursday 04 December 2025 12:04:48 +0000 (0:00:00.514) 0:07:36.818 ***** 2025-12-04 12:04:48.660608 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:49.196878 | controller | 2025-12-04 12:04:49.196916 | controller | TASK [Load crc inventory] ****************************************************** 2025-12-04 12:04:49.196924 | controller | Thursday 04 December 2025 12:04:48 +0000 (0:00:00.484) 0:07:37.303 ***** 2025-12-04 12:04:49.196943 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:49.713789 | controller | 2025-12-04 12:04:49.713825 | controller | TASK [Load compute inventory] ************************************************** 2025-12-04 12:04:49.713833 | controller | Thursday 04 December 2025 12:04:49 +0000 (0:00:00.536) 0:07:37.839 ***** 2025-12-04 12:04:49.713844 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:50.208648 | controller | 2025-12-04 12:04:50.208695 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** 2025-12-04 12:04:50.208703 | controller | Thursday 04 December 2025 12:04:49 +0000 (0:00:00.517) 0:07:38.356 ***** 2025-12-04 12:04:50.208717 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:50.808436 | controller | 2025-12-04 12:04:50.808480 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* 2025-12-04 12:04:50.808488 | controller | Thursday 04 December 2025 12:04:50 +0000 (0:00:00.494) 0:07:38.851 ***** 2025-12-04 12:04:50.808499 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:51.414280 | controller | 2025-12-04 12:04:51.414327 | controller | TASK [Check default location secret file] ************************************** 2025-12-04 12:04:51.414350 | controller | Thursday 04 December 2025 12:04:50 +0000 (0:00:00.599) 0:07:39.450 ***** 2025-12-04 12:04:51.414364 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:52.057559 | controller | 2025-12-04 12:04:52.057597 | controller | TASK [Check non-default location secret] *************************************** 2025-12-04 12:04:52.057606 | controller | Thursday 04 December 2025 12:04:51 +0000 (0:00:00.605) 0:07:40.056 ***** 2025-12-04 12:04:52.057620 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:04:52.116528 | controller | 2025-12-04 12:04:52.116551 | controller | TASK [Assert all of the tests] ************************************************* 2025-12-04 12:04:52.116559 | controller | Thursday 04 December 2025 12:04:52 +0000 (0:00:00.643) 0:07:40.700 ***** 2025-12-04 12:04:52.116573 | controller | ok: [instance] 2025-12-04 12:04:52.382133 | controller | 2025-12-04 12:04:52.382171 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-12-04 12:04:52.382184 | controller | Thursday 04 December 2025 12:04:52 +0000 (0:00:00.059) 0:07:40.759 ***** 2025-12-04 12:04:52.382195 | controller | changed: [instance] 2025-12-04 12:04:52.758726 | controller | 2025-12-04 12:04:52.758769 | controller | TASK [Get journalctl in a file] ************************************************ 2025-12-04 12:04:52.758780 | controller | Thursday 04 December 2025 12:04:52 +0000 (0:00:00.260) 0:07:41.020 ***** 2025-12-04 12:04:52.758790 | controller | changed: [instance] 2025-12-04 12:04:53.277527 | controller | 2025-12-04 12:04:53.277566 | controller | TASK [Dump journalctl output] ************************************************** 2025-12-04 12:04:53.277576 | controller | Thursday 04 December 2025 12:04:52 +0000 (0:00:00.381) 0:07:41.401 ***** 2025-12-04 12:04:53.277586 | controller | changed: [instance] 2025-12-04 12:04:54.040565 | controller | 2025-12-04 12:04:54.040601 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-12-04 12:04:54.040612 | controller | Thursday 04 December 2025 12:04:53 +0000 (0:00:00.518) 0:07:41.919 ***** 2025-12-04 12:04:54.040624 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-04 12:04:54.445707 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-12-04 12:04:54.445748 | controller | 2025-12-04 12:04:54.445756 | controller | TASK [Create log directory] **************************************************** 2025-12-04 12:04:54.445766 | controller | Thursday 04 December 2025 12:04:54 +0000 (0:00:00.758) 0:07:42.678 ***** 2025-12-04 12:04:54.445780 | controller | changed: [instance] 2025-12-04 12:04:55.491102 | controller | 2025-12-04 12:04:55.491142 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-12-04 12:04:55.491151 | controller | Thursday 04 December 2025 12:04:54 +0000 (0:00:00.410) 0:07:43.088 ***** 2025-12-04 12:04:55.491162 | controller | changed: [instance] 2025-12-04 12:04:55.710654 | controller | 2025-12-04 12:04:55.710688 | controller | PLAY RECAP ********************************************************************* 2025-12-04 12:04:55.710706 | controller | instance : ok=537 changed=200 unreachable=0 failed=0 skipped=229 rescued=0 ignored=0 2025-12-04 12:04:55.710713 | controller | 2025-12-04 12:04:55.710719 | controller | Thursday 04 December 2025 12:04:55 +0000 (0:00:01.041) 0:07:44.129 ***** 2025-12-04 12:04:55.710727 | controller | =============================================================================== 2025-12-04 12:04:55.710733 | controller | reproducer : Check package install status ------------------------------ 78.64s 2025-12-04 12:04:55.710738 | controller | ci_setup : Install needed packages ------------------------------------- 29.07s 2025-12-04 12:04:55.710743 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.17s 2025-12-04 12:04:55.710748 | controller | libvirt_manager : Download base image ---------------------------------- 21.28s 2025-12-04 12:04:55.710753 | controller | reproducer : Install collections on controller-0 ----------------------- 19.66s 2025-12-04 12:04:55.710759 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.89s 2025-12-04 12:04:55.710764 | controller | libvirt_manager : Install packages required for using KVM -------------- 10.07s 2025-12-04 12:04:55.710768 | controller | ci_nmstate : Install required packages on localhost --------------------- 7.96s 2025-12-04 12:04:55.710777 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.68s 2025-12-04 12:04:55.710782 | controller | ci_setup : Install openshift client ------------------------------------- 6.48s 2025-12-04 12:04:55.710788 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.11s 2025-12-04 12:04:55.710798 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.47s 2025-12-04 12:04:55.710804 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.88s 2025-12-04 12:04:55.710809 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.67s 2025-12-04 12:04:55.710814 | controller | networking_mapper : Gather the facts ------------------------------------ 3.62s 2025-12-04 12:04:55.710819 | controller | sushy_emulator : Install required packages ------------------------------ 3.26s 2025-12-04 12:04:55.710824 | controller | ci_setup : Manage directories ------------------------------------------- 2.66s 2025-12-04 12:04:55.710829 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.24s 2025-12-04 12:04:55.710834 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.23s 2025-12-04 12:04:55.710839 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.09s 2025-12-04 12:04:55.710861 | controller | INFO Running crc_layout > cleanup 2025-12-04 12:04:55.711385 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 12:04:55.719106 | controller | INFO Running job_uri > prepare 2025-12-04 12:04:55.719562 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-04 12:04:55.730490 | controller | INFO Running job_uri > converge 2025-12-04 12:04:56.438911 | controller | 2025-12-04 12:04:56.439169 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 12:04:56.439349 | controller | 2025-12-04 12:04:56.439528 | controller | TASK [Call task file in loop] ************************************************** 2025-12-04 12:04:56.439701 | controller | Thursday 04 December 2025 12:04:56 +0000 (0:00:00.042) 0:00:00.042 ***** 2025-12-04 12:04:56.532966 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) 2025-12-04 12:04:56.533199 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-12-04 12:04:56.533427 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-12-04 12:04:56.533646 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) 2025-12-04 12:04:56.533890 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-12-04 12:04:56.534083 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-12-04 12:04:56.534257 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) 2025-12-04 12:04:56.534457 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) 2025-12-04 12:04:56.534654 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) 2025-12-04 12:04:56.534842 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) 2025-12-04 12:04:56.535033 | controller | 2025-12-04 12:04:56.535223 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** 2025-12-04 12:04:56.539380 | controller | Thursday 04 December 2025 12:04:56 +0000 (0:00:00.094) 0:00:00.137 ***** 2025-12-04 12:04:56.582877 | controller | 2025-12-04 12:04:56.583088 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:04:56.583301 | controller | Thursday 04 December 2025 12:04:56 +0000 (0:00:00.049) 0:00:00.187 ***** 2025-12-04 12:04:56.652891 | controller | ok: [instance] 2025-12-04 12:04:56.653081 | controller | 2025-12-04 12:04:56.653268 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:04:56.653489 | controller | Thursday 04 December 2025 12:04:56 +0000 (0:00:00.070) 0:00:00.257 ***** 2025-12-04 12:04:56.730266 | controller | ok: [instance] 2025-12-04 12:04:56.730464 | controller | 2025-12-04 12:04:56.730666 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:04:56.730874 | controller | Thursday 04 December 2025 12:04:56 +0000 (0:00:00.077) 0:00:00.334 ***** 2025-12-04 12:04:56.799652 | controller | ok: [instance] 2025-12-04 12:04:56.799824 | controller | 2025-12-04 12:04:56.800001 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:04:56.800197 | controller | Thursday 04 December 2025 12:04:56 +0000 (0:00:00.069) 0:00:00.404 ***** 2025-12-04 12:04:56.835768 | controller | skipping: [instance] 2025-12-04 12:04:56.835984 | controller | 2025-12-04 12:04:56.836170 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:04:56.836388 | controller | Thursday 04 December 2025 12:04:56 +0000 (0:00:00.034) 0:00:00.439 ***** 2025-12-04 12:04:56.927696 | controller | ok: [instance] => changed=false 2025-12-04 12:04:56.927940 | controller | msg: All assertions passed 2025-12-04 12:04:56.928150 | controller | 2025-12-04 12:04:56.928413 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-12-04 12:04:56.928644 | controller | Thursday 04 December 2025 12:04:56 +0000 (0:00:00.092) 0:00:00.531 ***** 2025-12-04 12:04:56.983377 | controller | 2025-12-04 12:04:56.983585 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:04:56.983762 | controller | Thursday 04 December 2025 12:04:56 +0000 (0:00:00.055) 0:00:00.587 ***** 2025-12-04 12:04:57.036779 | controller | ok: [instance] 2025-12-04 12:04:57.036986 | controller | 2025-12-04 12:04:57.037162 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:04:57.037373 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.053) 0:00:00.641 ***** 2025-12-04 12:04:57.141057 | controller | ok: [instance] 2025-12-04 12:04:57.141319 | controller | 2025-12-04 12:04:57.141531 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:04:57.141704 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.104) 0:00:00.745 ***** 2025-12-04 12:04:57.262346 | controller | ok: [instance] 2025-12-04 12:04:57.262515 | controller | 2025-12-04 12:04:57.262659 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:04:57.262815 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.120) 0:00:00.866 ***** 2025-12-04 12:04:57.328817 | controller | skipping: [instance] 2025-12-04 12:04:57.384122 | controller | 2025-12-04 12:04:57.384142 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:04:57.384154 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.066) 0:00:00.932 ***** 2025-12-04 12:04:57.384165 | controller | ok: [instance] => changed=false 2025-12-04 12:04:57.436853 | controller | msg: All assertions passed 2025-12-04 12:04:57.436885 | controller | 2025-12-04 12:04:57.436898 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-12-04 12:04:57.436905 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.055) 0:00:00.988 ***** 2025-12-04 12:04:57.436920 | controller | 2025-12-04 12:04:57.501188 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:04:57.501210 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.052) 0:00:01.040 ***** 2025-12-04 12:04:57.501221 | controller | ok: [instance] 2025-12-04 12:04:57.555552 | controller | 2025-12-04 12:04:57.555577 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:04:57.555591 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.064) 0:00:01.105 ***** 2025-12-04 12:04:57.555602 | controller | ok: [instance] 2025-12-04 12:04:57.612811 | controller | 2025-12-04 12:04:57.612842 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:04:57.612858 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.054) 0:00:01.159 ***** 2025-12-04 12:04:57.612871 | controller | ok: [instance] 2025-12-04 12:04:57.669143 | controller | 2025-12-04 12:04:57.669168 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:04:57.669176 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.057) 0:00:01.216 ***** 2025-12-04 12:04:57.669191 | controller | skipping: [instance] 2025-12-04 12:04:57.740610 | controller | 2025-12-04 12:04:57.740648 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:04:57.740656 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.056) 0:00:01.273 ***** 2025-12-04 12:04:57.740670 | controller | ok: [instance] => changed=false 2025-12-04 12:04:57.937807 | controller | msg: All assertions passed 2025-12-04 12:04:57.937853 | controller | 2025-12-04 12:04:57.937863 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** 2025-12-04 12:04:57.937870 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.069) 0:00:01.342 ***** 2025-12-04 12:04:57.937881 | controller | 2025-12-04 12:04:58.083338 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:04:58.083366 | controller | Thursday 04 December 2025 12:04:57 +0000 (0:00:00.183) 0:00:01.525 ***** 2025-12-04 12:04:58.083388 | controller | ok: [instance] 2025-12-04 12:04:58.083568 | controller | 2025-12-04 12:04:58.083739 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:04:58.083922 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.161) 0:00:01.687 ***** 2025-12-04 12:04:58.179458 | controller | ok: [instance] 2025-12-04 12:04:58.233768 | controller | 2025-12-04 12:04:58.233799 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:04:58.233807 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.095) 0:00:01.783 ***** 2025-12-04 12:04:58.233817 | controller | ok: [instance] 2025-12-04 12:04:58.302851 | controller | 2025-12-04 12:04:58.302887 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:04:58.302899 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.054) 0:00:01.837 ***** 2025-12-04 12:04:58.302912 | controller | skipping: [instance] 2025-12-04 12:04:58.353132 | controller | 2025-12-04 12:04:58.353161 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:04:58.353173 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.069) 0:00:01.907 ***** 2025-12-04 12:04:58.353183 | controller | ok: [instance] => changed=false 2025-12-04 12:04:58.396671 | controller | msg: All assertions passed 2025-12-04 12:04:58.396698 | controller | 2025-12-04 12:04:58.396706 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-12-04 12:04:58.396712 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.046) 0:00:01.954 ***** 2025-12-04 12:04:58.396722 | controller | 2025-12-04 12:04:58.435480 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:04:58.435513 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.047) 0:00:02.001 ***** 2025-12-04 12:04:58.435525 | controller | ok: [instance] 2025-12-04 12:04:58.479070 | controller | 2025-12-04 12:04:58.479103 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:04:58.479111 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.038) 0:00:02.039 ***** 2025-12-04 12:04:58.479126 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:04:58.500885 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 12:04:58.500911 | controller | evaluated_to: false 2025-12-04 12:04:58.500920 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 12:04:58.500929 | controller | 2025-12-04 12:04:58.548146 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 12:04:58.548182 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.048) 0:00:02.088 ***** 2025-12-04 12:04:58.548192 | controller | 2025-12-04 12:04:58.548201 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 12:04:58.548207 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.017) 0:00:02.105 ***** 2025-12-04 12:04:58.548216 | controller | skipping: [instance] 2025-12-04 12:04:58.589598 | controller | 2025-12-04 12:04:58.589624 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 12:04:58.589640 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.044) 0:00:02.149 ***** 2025-12-04 12:04:58.589649 | controller | skipping: [instance] 2025-12-04 12:04:58.631611 | controller | 2025-12-04 12:04:58.631631 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-12-04 12:04:58.631639 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.043) 0:00:02.193 ***** 2025-12-04 12:04:58.631647 | controller | 2025-12-04 12:04:58.672047 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:04:58.672072 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.042) 0:00:02.236 ***** 2025-12-04 12:04:58.672088 | controller | ok: [instance] 2025-12-04 12:04:58.705643 | controller | 2025-12-04 12:04:58.705669 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:04:58.705679 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.040) 0:00:02.276 ***** 2025-12-04 12:04:58.705688 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:04:58.735668 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 12:04:58.735692 | controller | evaluated_to: false 2025-12-04 12:04:58.735702 | controller | msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 12:04:58.735715 | controller | 2025-12-04 12:04:58.780213 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 12:04:58.780238 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.044) 0:00:02.321 ***** 2025-12-04 12:04:58.780250 | controller | 2025-12-04 12:04:58.780256 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 12:04:58.780262 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.018) 0:00:02.339 ***** 2025-12-04 12:04:58.780292 | controller | skipping: [instance] 2025-12-04 12:04:58.821952 | controller | 2025-12-04 12:04:58.821977 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 12:04:58.821984 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.041) 0:00:02.381 ***** 2025-12-04 12:04:58.821998 | controller | skipping: [instance] 2025-12-04 12:04:58.822171 | controller | 2025-12-04 12:04:58.822362 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** 2025-12-04 12:04:58.822549 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.045) 0:00:02.426 ***** 2025-12-04 12:04:58.866594 | controller | 2025-12-04 12:04:58.867216 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:04:58.867413 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.042) 0:00:02.469 ***** 2025-12-04 12:04:58.933345 | controller | ok: [instance] 2025-12-04 12:04:58.933539 | controller | 2025-12-04 12:04:58.933712 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:04:58.933887 | controller | Thursday 04 December 2025 12:04:58 +0000 (0:00:00.068) 0:00:02.537 ***** 2025-12-04 12:04:59.004727 | controller | ok: [instance] 2025-12-04 12:04:59.004937 | controller | 2025-12-04 12:04:59.005107 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:04:59.005293 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.071) 0:00:02.609 ***** 2025-12-04 12:04:59.052143 | controller | ok: [instance] 2025-12-04 12:04:59.052377 | controller | 2025-12-04 12:04:59.052596 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:04:59.052799 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.047) 0:00:02.656 ***** 2025-12-04 12:04:59.086052 | controller | skipping: [instance] 2025-12-04 12:04:59.086249 | controller | 2025-12-04 12:04:59.086450 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:04:59.086663 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.033) 0:00:02.690 ***** 2025-12-04 12:04:59.160366 | controller | ok: [instance] => changed=false 2025-12-04 12:04:59.160578 | controller | msg: All assertions passed 2025-12-04 12:04:59.160714 | controller | 2025-12-04 12:04:59.160867 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** 2025-12-04 12:04:59.161002 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.074) 0:00:02.764 ***** 2025-12-04 12:04:59.206113 | controller | 2025-12-04 12:04:59.206324 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:04:59.206512 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.046) 0:00:02.810 ***** 2025-12-04 12:04:59.244582 | controller | ok: [instance] 2025-12-04 12:04:59.244762 | controller | 2025-12-04 12:04:59.244942 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:04:59.245140 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.038) 0:00:02.849 ***** 2025-12-04 12:04:59.290412 | controller | ok: [instance] 2025-12-04 12:04:59.290610 | controller | 2025-12-04 12:04:59.290783 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:04:59.290965 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.044) 0:00:02.894 ***** 2025-12-04 12:04:59.337938 | controller | ok: [instance] 2025-12-04 12:04:59.338121 | controller | 2025-12-04 12:04:59.338289 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:04:59.338486 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.048) 0:00:02.942 ***** 2025-12-04 12:04:59.369624 | controller | skipping: [instance] 2025-12-04 12:04:59.369803 | controller | 2025-12-04 12:04:59.370005 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:04:59.370186 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.031) 0:00:02.974 ***** 2025-12-04 12:04:59.413967 | controller | ok: [instance] => changed=false 2025-12-04 12:04:59.414162 | controller | msg: All assertions passed 2025-12-04 12:04:59.414369 | controller | 2025-12-04 12:04:59.414563 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** 2025-12-04 12:04:59.414753 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.043) 0:00:03.018 ***** 2025-12-04 12:04:59.500138 | controller | 2025-12-04 12:04:59.500333 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:04:59.500526 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.086) 0:00:03.105 ***** 2025-12-04 12:04:59.543558 | controller | ok: [instance] 2025-12-04 12:04:59.543746 | controller | 2025-12-04 12:04:59.543954 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:04:59.544102 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.041) 0:00:03.146 ***** 2025-12-04 12:04:59.576972 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:04:59.577128 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 12:04:59.577259 | controller | evaluated_to: false 2025-12-04 12:04:59.577428 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 12:04:59.625440 | controller | 2025-12-04 12:04:59.625627 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 12:04:59.625822 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.050) 0:00:03.197 ***** 2025-12-04 12:04:59.625986 | controller | 2025-12-04 12:04:59.626151 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 12:04:59.626324 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.032) 0:00:03.229 ***** 2025-12-04 12:04:59.663924 | controller | skipping: [instance] 2025-12-04 12:04:59.664102 | controller | 2025-12-04 12:04:59.664289 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 12:04:59.664480 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.038) 0:00:03.268 ***** 2025-12-04 12:04:59.702756 | controller | skipping: [instance] 2025-12-04 12:04:59.702925 | controller | 2025-12-04 12:04:59.703113 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** 2025-12-04 12:04:59.703354 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.038) 0:00:03.307 ***** 2025-12-04 12:04:59.756407 | controller | 2025-12-04 12:04:59.756587 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:04:59.756754 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.053) 0:00:03.361 ***** 2025-12-04 12:04:59.803197 | controller | ok: [instance] 2025-12-04 12:04:59.803411 | controller | 2025-12-04 12:04:59.803584 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:04:59.803754 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.042) 0:00:03.404 ***** 2025-12-04 12:04:59.840625 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:04:59.840829 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 12:04:59.841022 | controller | evaluated_to: false 2025-12-04 12:04:59.841197 | controller | msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 12:04:59.868599 | controller | 2025-12-04 12:04:59.868809 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 12:04:59.868986 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.052) 0:00:03.457 ***** 2025-12-04 12:04:59.869144 | controller | 2025-12-04 12:04:59.869321 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 12:04:59.869498 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.016) 0:00:03.473 ***** 2025-12-04 12:04:59.914583 | controller | skipping: [instance] 2025-12-04 12:04:59.914730 | controller | 2025-12-04 12:04:59.914890 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 12:04:59.915057 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.041) 0:00:03.515 ***** 2025-12-04 12:04:59.948970 | controller | skipping: [instance] 2025-12-04 12:04:59.949160 | controller | 2025-12-04 12:04:59.949349 | controller | TASK [Print success message] *************************************************** 2025-12-04 12:04:59.949530 | controller | Thursday 04 December 2025 12:04:59 +0000 (0:00:00.037) 0:00:03.553 ***** 2025-12-04 12:05:00.027338 | controller | ok: [instance] => 2025-12-04 12:05:00.027575 | controller | msg: All strings passed! 2025-12-04 12:05:00.027769 | controller | 2025-12-04 12:05:00.027962 | controller | PLAY RECAP ********************************************************************* 2025-12-04 12:05:00.028160 | controller | instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 2025-12-04 12:05:00.028411 | controller | 2025-12-04 12:05:00.028608 | controller | Thursday 04 December 2025 12:05:00 +0000 (0:00:00.078) 0:00:03.631 ***** 2025-12-04 12:05:00.028771 | controller | =============================================================================== 2025-12-04 12:05:00.028945 | controller | Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35 --- 0.18s 2025-12-04 12:05:00.029114 | controller | reproducer : Apply regex match filter ----------------------------------- 0.16s 2025-12-04 12:05:00.029296 | controller | reproducer : Extract job id for later reference ------------------------- 0.12s 2025-12-04 12:05:00.029491 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.10s 2025-12-04 12:05:00.029663 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.10s 2025-12-04 12:05:00.029819 | controller | Call task file in loop -------------------------------------------------- 0.09s 2025-12-04 12:05:00.030002 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.09s 2025-12-04 12:05:00.030169 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 --- 0.09s 2025-12-04 12:05:00.030354 | controller | Print success message --------------------------------------------------- 0.08s 2025-12-04 12:05:00.030546 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.08s 2025-12-04 12:05:00.030713 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.07s 2025-12-04 12:05:00.030905 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.07s 2025-12-04 12:05:00.031074 | controller | reproducer : Apply regex match filter ----------------------------------- 0.07s 2025-12-04 12:05:00.031241 | controller | Fail if return string doesn't match expected value ---------------------- 0.07s 2025-12-04 12:05:00.031447 | controller | reproducer : Extract job id for later reference ------------------------- 0.07s 2025-12-04 12:05:00.031617 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.07s 2025-12-04 12:05:00.031789 | controller | reproducer : Apply regex match filter ----------------------------------- 0.07s 2025-12-04 12:05:00.031961 | controller | Fail if return string doesn't match expected value ---------------------- 0.07s 2025-12-04 12:05:00.032122 | controller | reproducer : Apply regex match filter ----------------------------------- 0.06s 2025-12-04 12:05:00.032304 | controller | reproducer : Extract job id for later reference ------------------------- 0.06s 2025-12-04 12:05:00.088174 | controller | INFO Running job_uri > cleanup 2025-12-04 12:05:00.088832 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 12:05:00.097059 | controller | INFO Running network_validations > prepare 2025-12-04 12:05:00.097598 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-04 12:05:00.109297 | controller | INFO Running network_validations > converge 2025-12-04 12:05:00.678440 | controller | 2025-12-04 12:05:00.678513 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 12:05:00.678530 | controller | 2025-12-04 12:05:00.678538 | controller | TASK [Set failed fact] ********************************************************* 2025-12-04 12:05:00.681214 | controller | Thursday 04 December 2025 12:05:00 +0000 (0:00:00.036) 0:00:00.036 ***** 2025-12-04 12:05:00.707859 | controller | ok: [instance] 2025-12-04 12:05:00.707958 | controller | 2025-12-04 12:05:00.708189 | controller | TASK [Load scenarios] ********************************************************** 2025-12-04 12:05:00.708351 | controller | Thursday 04 December 2025 12:05:00 +0000 (0:00:00.028) 0:00:00.064 ***** 2025-12-04 12:05:00.741348 | controller | ok: [instance] 2025-12-04 12:05:00.741420 | controller | 2025-12-04 12:05:00.741745 | controller | TASK [Test network validations] ************************************************ 2025-12-04 12:05:00.741941 | controller | Thursday 04 December 2025 12:05:00 +0000 (0:00:00.035) 0:00:00.100 ***** 2025-12-04 12:05:00.813598 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) 2025-12-04 12:05:00.813881 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) 2025-12-04 12:05:00.814040 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) 2025-12-04 12:05:00.814189 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) 2025-12-04 12:05:00.814359 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) 2025-12-04 12:05:00.815798 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) 2025-12-04 12:05:00.844214 | controller | 2025-12-04 12:05:00.844311 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:00.844332 | controller | Thursday 04 December 2025 12:05:00 +0000 (0:00:00.072) 0:00:00.173 ***** 2025-12-04 12:05:00.844343 | controller | ok: [instance] 2025-12-04 12:05:00.844470 | controller | 2025-12-04 12:05:00.844784 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:00.845021 | controller | Thursday 04 December 2025 12:05:00 +0000 (0:00:00.029) 0:00:00.202 ***** 2025-12-04 12:05:00.879186 | controller | ok: [instance] 2025-12-04 12:05:00.879363 | controller | 2025-12-04 12:05:00.879529 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:00.879812 | controller | Thursday 04 December 2025 12:05:00 +0000 (0:00:00.033) 0:00:00.236 ***** 2025-12-04 12:05:00.910872 | controller | ok: [instance] => 2025-12-04 12:05:00.911083 | controller | msg: 'Running: Default nets only' 2025-12-04 12:05:00.911199 | controller | 2025-12-04 12:05:00.911319 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:00.911661 | controller | Thursday 04 December 2025 12:05:00 +0000 (0:00:00.032) 0:00:00.268 ***** 2025-12-04 12:05:00.960103 | controller | 2025-12-04 12:05:00.960374 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:05:00.960532 | controller | Thursday 04 December 2025 12:05:00 +0000 (0:00:00.050) 0:00:00.319 ***** 2025-12-04 12:05:01.013149 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:05:01.013390 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:05:01.013585 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:05:01.013752 | controller | collisions and unexpected behavior. 2025-12-04 12:05:01.059561 | controller | ok: [instance] => (item=controller) 2025-12-04 12:05:01.059732 | controller | 2025-12-04 12:05:01.060044 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:05:01.060203 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.099) 0:00:00.418 ***** 2025-12-04 12:05:01.126355 | controller | ok: [instance] 2025-12-04 12:05:01.126612 | controller | 2025-12-04 12:05:01.126767 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 12:05:01.126876 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.063) 0:00:00.482 ***** 2025-12-04 12:05:01.200532 | controller | ok: [instance] => changed=false 2025-12-04 12:05:01.200855 | controller | msg: All assertions passed 2025-12-04 12:05:01.201086 | controller | 2025-12-04 12:05:01.201226 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:01.201433 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.077) 0:00:00.559 ***** 2025-12-04 12:05:01.244618 | controller | skipping: [instance] 2025-12-04 12:05:01.244812 | controller | 2025-12-04 12:05:01.245098 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:01.245327 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.042) 0:00:00.602 ***** 2025-12-04 12:05:01.284456 | controller | skipping: [instance] 2025-12-04 12:05:01.284600 | controller | 2025-12-04 12:05:01.284807 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:01.285101 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.040) 0:00:00.643 ***** 2025-12-04 12:05:01.335337 | controller | skipping: [instance] 2025-12-04 12:05:01.335403 | controller | 2025-12-04 12:05:01.335740 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:01.335831 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.051) 0:00:00.694 ***** 2025-12-04 12:05:01.402591 | controller | ok: [instance] 2025-12-04 12:05:01.402647 | controller | 2025-12-04 12:05:01.402877 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:01.403134 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.067) 0:00:00.761 ***** 2025-12-04 12:05:01.438312 | controller | ok: [instance] 2025-12-04 12:05:01.438476 | controller | 2025-12-04 12:05:01.438626 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:01.438784 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.035) 0:00:00.797 ***** 2025-12-04 12:05:01.469053 | controller | ok: [instance] => 2025-12-04 12:05:01.469121 | controller | msg: 'Running: Default nets and spine/leaf' 2025-12-04 12:05:01.469144 | controller | 2025-12-04 12:05:01.469405 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:01.469536 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.030) 0:00:00.828 ***** 2025-12-04 12:05:01.513623 | controller | 2025-12-04 12:05:01.513885 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:05:01.514257 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.045) 0:00:00.873 ***** 2025-12-04 12:05:01.545330 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:05:01.566858 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:05:01.566880 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:05:01.566894 | controller | collisions and unexpected behavior. 2025-12-04 12:05:01.566906 | controller | ok: [instance] => (item=controller) 2025-12-04 12:05:01.567009 | controller | 2025-12-04 12:05:01.567294 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:05:01.634713 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.053) 0:00:00.926 ***** 2025-12-04 12:05:01.634766 | controller | ok: [instance] 2025-12-04 12:05:01.634903 | controller | 2025-12-04 12:05:01.635088 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 12:05:01.635718 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.065) 0:00:00.991 ***** 2025-12-04 12:05:01.711177 | controller | ok: [instance] => changed=false 2025-12-04 12:05:01.711215 | controller | msg: All assertions passed 2025-12-04 12:05:01.711383 | controller | 2025-12-04 12:05:01.711582 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:01.712339 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.079) 0:00:01.070 ***** 2025-12-04 12:05:01.756530 | controller | skipping: [instance] 2025-12-04 12:05:01.756819 | controller | 2025-12-04 12:05:01.756898 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:01.757306 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.045) 0:00:01.115 ***** 2025-12-04 12:05:01.799556 | controller | skipping: [instance] 2025-12-04 12:05:01.799598 | controller | 2025-12-04 12:05:01.799781 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:01.800050 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.042) 0:00:01.158 ***** 2025-12-04 12:05:01.838391 | controller | skipping: [instance] 2025-12-04 12:05:01.838605 | controller | 2025-12-04 12:05:01.838793 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:01.838922 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.039) 0:00:01.197 ***** 2025-12-04 12:05:01.866490 | controller | ok: [instance] 2025-12-04 12:05:01.866690 | controller | 2025-12-04 12:05:01.866823 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:01.866919 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.028) 0:00:01.226 ***** 2025-12-04 12:05:01.901262 | controller | ok: [instance] 2025-12-04 12:05:01.901438 | controller | 2025-12-04 12:05:01.901548 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:01.901658 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.032) 0:00:01.258 ***** 2025-12-04 12:05:01.931321 | controller | ok: [instance] => 2025-12-04 12:05:01.931543 | controller | msg: 'Running: Default nets with extra defined net' 2025-12-04 12:05:01.931690 | controller | 2025-12-04 12:05:01.932368 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:02.005772 | controller | Thursday 04 December 2025 12:05:01 +0000 (0:00:00.030) 0:00:01.289 ***** 2025-12-04 12:05:02.005824 | controller | 2025-12-04 12:05:02.005997 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:05:02.006211 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.075) 0:00:01.365 ***** 2025-12-04 12:05:02.039759 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:05:02.041040 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:05:02.041057 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:05:02.041067 | controller | collisions and unexpected behavior. 2025-12-04 12:05:02.064096 | controller | ok: [instance] => (item=controller) 2025-12-04 12:05:02.064367 | controller | 2025-12-04 12:05:02.064671 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:05:02.064796 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.058) 0:00:01.423 ***** 2025-12-04 12:05:02.129124 | controller | ok: [instance] 2025-12-04 12:05:02.129309 | controller | 2025-12-04 12:05:02.129577 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 12:05:02.129709 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.064) 0:00:01.488 ***** 2025-12-04 12:05:02.180730 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:02.181060 | controller | assertion: _defined | difference(_all_nets) | length == 0 2025-12-04 12:05:02.181302 | controller | evaluated_to: false 2025-12-04 12:05:02.181549 | controller | msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' 2025-12-04 12:05:02.194988 | controller | 2025-12-04 12:05:02.195196 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 12:05:02.195508 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.066) 0:00:01.554 ***** 2025-12-04 12:05:02.260147 | controller | ok: [instance] => 2025-12-04 12:05:02.260617 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 12:05:02.260755 | controller | networks: 2025-12-04 12:05:02.260909 | controller | public: defined 2025-12-04 12:05:02.261077 | controller | vms: 2025-12-04 12:05:02.261405 | controller | controller: 2025-12-04 12:05:02.261519 | controller | nets: 2025-12-04 12:05:02.261529 | controller | - public 2025-12-04 12:05:02.261635 | controller | 2025-12-04 12:05:02.261851 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 12:05:02.262150 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.037) 0:00:01.592 ***** 2025-12-04 12:05:02.304934 | controller | skipping: [instance] 2025-12-04 12:05:02.305042 | controller | 2025-12-04 12:05:02.305324 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 12:05:02.305394 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.072) 0:00:01.664 ***** 2025-12-04 12:05:02.440112 | controller | skipping: [instance] 2025-12-04 12:05:02.440211 | controller | 2025-12-04 12:05:02.440392 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 12:05:02.440592 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.134) 0:00:01.799 ***** 2025-12-04 12:05:02.517858 | controller | ok: [instance] => 2025-12-04 12:05:02.517973 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 12:05:02.518179 | controller | networks: 2025-12-04 12:05:02.518254 | controller | extra_net_1: defined 2025-12-04 12:05:02.518478 | controller | public: defined 2025-12-04 12:05:02.518617 | controller | vms: 2025-12-04 12:05:02.518994 | controller | controller: 2025-12-04 12:05:02.519163 | controller | nets: 2025-12-04 12:05:02.519174 | controller | - public 2025-12-04 12:05:02.519342 | controller | 2025-12-04 12:05:02.519540 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 12:05:02.519561 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.077) 0:00:01.876 ***** 2025-12-04 12:05:02.546721 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:02.546896 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 12:05:02.581469 | controller | 2025-12-04 12:05:02.581617 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:02.582004 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.047) 0:00:01.923 ***** 2025-12-04 12:05:02.582228 | controller | 2025-12-04 12:05:02.582369 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:02.582577 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.017) 0:00:01.940 ***** 2025-12-04 12:05:02.615790 | controller | ok: [instance] 2025-12-04 12:05:02.615836 | controller | 2025-12-04 12:05:02.616026 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:02.616184 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.034) 0:00:01.975 ***** 2025-12-04 12:05:02.662513 | controller | skipping: [instance] 2025-12-04 12:05:02.662656 | controller | 2025-12-04 12:05:02.662788 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:02.662960 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.046) 0:00:02.022 ***** 2025-12-04 12:05:02.712417 | controller | skipping: [instance] 2025-12-04 12:05:02.712602 | controller | 2025-12-04 12:05:02.712865 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:02.713142 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.045) 0:00:02.068 ***** 2025-12-04 12:05:02.752319 | controller | skipping: [instance] 2025-12-04 12:05:02.752508 | controller | 2025-12-04 12:05:02.752594 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:02.752775 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.041) 0:00:02.109 ***** 2025-12-04 12:05:02.785695 | controller | ok: [instance] 2025-12-04 12:05:02.785878 | controller | 2025-12-04 12:05:02.786063 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:02.786195 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.035) 0:00:02.145 ***** 2025-12-04 12:05:02.816850 | controller | ok: [instance] 2025-12-04 12:05:02.817038 | controller | 2025-12-04 12:05:02.817184 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:02.817353 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.031) 0:00:02.176 ***** 2025-12-04 12:05:02.856630 | controller | ok: [instance] => 2025-12-04 12:05:02.856774 | controller | msg: 'Running: Missing default net definition' 2025-12-04 12:05:02.856964 | controller | 2025-12-04 12:05:02.857142 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:02.857294 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.039) 0:00:02.216 ***** 2025-12-04 12:05:02.905470 | controller | 2025-12-04 12:05:02.905617 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:05:02.905805 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.048) 0:00:02.265 ***** 2025-12-04 12:05:02.942338 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:05:02.966031 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:05:02.966050 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:05:02.966057 | controller | collisions and unexpected behavior. 2025-12-04 12:05:02.966066 | controller | ok: [instance] => (item=controller) 2025-12-04 12:05:02.966106 | controller | 2025-12-04 12:05:02.966348 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:05:02.966546 | controller | Thursday 04 December 2025 12:05:02 +0000 (0:00:00.060) 0:00:02.325 ***** 2025-12-04 12:05:03.023330 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:03.027322 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-12-04 12:05:03.027350 | controller | evaluated_to: false 2025-12-04 12:05:03.027382 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' 2025-12-04 12:05:03.040137 | controller | 2025-12-04 12:05:03.040304 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 12:05:03.040475 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.070) 0:00:02.396 ***** 2025-12-04 12:05:03.088817 | controller | ok: [instance] => 2025-12-04 12:05:03.089068 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 12:05:03.089229 | controller | networks: 2025-12-04 12:05:03.089453 | controller | public: defined 2025-12-04 12:05:03.089561 | controller | vms: 2025-12-04 12:05:03.089678 | controller | controller: 2025-12-04 12:05:03.089860 | controller | nets: 2025-12-04 12:05:03.089994 | controller | - public 2025-12-04 12:05:03.090173 | controller | 2025-12-04 12:05:03.091093 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 12:05:03.125048 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.052) 0:00:02.448 ***** 2025-12-04 12:05:03.125073 | controller | skipping: [instance] 2025-12-04 12:05:03.125280 | controller | 2025-12-04 12:05:03.125405 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 12:05:03.125690 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.035) 0:00:02.483 ***** 2025-12-04 12:05:03.260958 | controller | skipping: [instance] 2025-12-04 12:05:03.261065 | controller | 2025-12-04 12:05:03.261229 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 12:05:03.261410 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.136) 0:00:02.620 ***** 2025-12-04 12:05:03.315518 | controller | ok: [instance] => 2025-12-04 12:05:03.315564 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 12:05:03.315808 | controller | networks: 2025-12-04 12:05:03.315822 | controller | public: defined 2025-12-04 12:05:03.315836 | controller | vms: 2025-12-04 12:05:03.315853 | controller | controller: 2025-12-04 12:05:03.315880 | controller | nets: 2025-12-04 12:05:03.316100 | controller | - public 2025-12-04 12:05:03.316411 | controller | - foo 2025-12-04 12:05:03.316675 | controller | 2025-12-04 12:05:03.316890 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 12:05:03.317038 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.054) 0:00:02.674 ***** 2025-12-04 12:05:03.332352 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:03.332500 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 12:05:03.363465 | controller | 2025-12-04 12:05:03.363627 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:03.363905 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.030) 0:00:02.704 ***** 2025-12-04 12:05:03.364025 | controller | 2025-12-04 12:05:03.364291 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:03.364511 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.018) 0:00:02.722 ***** 2025-12-04 12:05:03.389740 | controller | ok: [instance] 2025-12-04 12:05:03.389820 | controller | 2025-12-04 12:05:03.390041 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:03.390231 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.026) 0:00:02.749 ***** 2025-12-04 12:05:03.437913 | controller | skipping: [instance] 2025-12-04 12:05:03.438211 | controller | 2025-12-04 12:05:03.438253 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:03.438564 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.045) 0:00:02.794 ***** 2025-12-04 12:05:03.475933 | controller | skipping: [instance] 2025-12-04 12:05:03.476201 | controller | 2025-12-04 12:05:03.476245 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:03.476572 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.040) 0:00:02.835 ***** 2025-12-04 12:05:03.515830 | controller | skipping: [instance] 2025-12-04 12:05:03.516008 | controller | 2025-12-04 12:05:03.516267 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:03.555139 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.039) 0:00:02.875 ***** 2025-12-04 12:05:03.555162 | controller | ok: [instance] 2025-12-04 12:05:03.555253 | controller | 2025-12-04 12:05:03.555463 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:03.555641 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.039) 0:00:02.914 ***** 2025-12-04 12:05:03.592041 | controller | ok: [instance] 2025-12-04 12:05:03.592192 | controller | 2025-12-04 12:05:03.592433 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:03.592776 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.036) 0:00:02.951 ***** 2025-12-04 12:05:03.655653 | controller | ok: [instance] => 2025-12-04 12:05:03.655785 | controller | msg: 'Running: Missing spine/leaf net definition' 2025-12-04 12:05:03.655928 | controller | 2025-12-04 12:05:03.656038 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:03.656154 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.061) 0:00:03.012 ***** 2025-12-04 12:05:03.706070 | controller | 2025-12-04 12:05:03.706283 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:05:03.706427 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.052) 0:00:03.065 ***** 2025-12-04 12:05:03.743863 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:05:03.771668 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:05:03.771699 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:05:03.771706 | controller | collisions and unexpected behavior. 2025-12-04 12:05:03.771729 | controller | ok: [instance] => (item=controller) 2025-12-04 12:05:03.886310 | controller | 2025-12-04 12:05:03.886392 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:05:03.886402 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.065) 0:00:03.130 ***** 2025-12-04 12:05:03.886416 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:03.886705 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-12-04 12:05:03.886901 | controller | evaluated_to: false 2025-12-04 12:05:03.887065 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' 2025-12-04 12:05:03.902432 | controller | 2025-12-04 12:05:03.902726 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 12:05:03.902986 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.128) 0:00:03.259 ***** 2025-12-04 12:05:03.944003 | controller | ok: [instance] => 2025-12-04 12:05:03.944285 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 12:05:03.944542 | controller | networks: 2025-12-04 12:05:03.944735 | controller | l00-s0: defined 2025-12-04 12:05:03.944939 | controller | public: defined 2025-12-04 12:05:03.945196 | controller | vms: 2025-12-04 12:05:03.945504 | controller | controller: 2025-12-04 12:05:03.945684 | controller | nets: 2025-12-04 12:05:03.945956 | controller | - public 2025-12-04 12:05:03.946193 | controller | spineleafnets: 2025-12-04 12:05:03.946477 | controller | - l00-s0 2025-12-04 12:05:03.946725 | controller | 2025-12-04 12:05:03.946996 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 12:05:03.947189 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.043) 0:00:03.302 ***** 2025-12-04 12:05:03.977239 | controller | skipping: [instance] 2025-12-04 12:05:03.977566 | controller | 2025-12-04 12:05:03.977826 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 12:05:03.978124 | controller | Thursday 04 December 2025 12:05:03 +0000 (0:00:00.033) 0:00:03.336 ***** 2025-12-04 12:05:04.064639 | controller | skipping: [instance] 2025-12-04 12:05:04.113607 | controller | 2025-12-04 12:05:04.113642 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 12:05:04.113656 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.087) 0:00:03.423 ***** 2025-12-04 12:05:04.113667 | controller | ok: [instance] => 2025-12-04 12:05:04.126528 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 12:05:04.126553 | controller | networks: 2025-12-04 12:05:04.126561 | controller | l00-s0: defined 2025-12-04 12:05:04.126567 | controller | public: defined 2025-12-04 12:05:04.126573 | controller | vms: 2025-12-04 12:05:04.126579 | controller | controller: 2025-12-04 12:05:04.126585 | controller | nets: 2025-12-04 12:05:04.126590 | controller | - public 2025-12-04 12:05:04.126602 | controller | spineleafnets: 2025-12-04 12:05:04.126617 | controller | - l00-s0 2025-12-04 12:05:04.126624 | controller | - l00-s1 2025-12-04 12:05:04.126629 | controller | 2025-12-04 12:05:04.126638 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 12:05:04.126645 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.047) 0:00:03.470 ***** 2025-12-04 12:05:04.126656 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:04.156406 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 12:05:04.156509 | controller | 2025-12-04 12:05:04.156604 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:04.156616 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.026) 0:00:03.497 ***** 2025-12-04 12:05:04.156625 | controller | 2025-12-04 12:05:04.156765 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:04.157068 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.017) 0:00:03.515 ***** 2025-12-04 12:05:04.184650 | controller | ok: [instance] 2025-12-04 12:05:04.184898 | controller | 2025-12-04 12:05:04.185239 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:04.257031 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.026) 0:00:03.542 ***** 2025-12-04 12:05:04.257066 | controller | skipping: [instance] 2025-12-04 12:05:04.257199 | controller | 2025-12-04 12:05:04.257219 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:04.257537 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.074) 0:00:03.616 ***** 2025-12-04 12:05:04.301474 | controller | skipping: [instance] 2025-12-04 12:05:04.301558 | controller | 2025-12-04 12:05:04.301863 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:04.344831 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.040) 0:00:03.656 ***** 2025-12-04 12:05:04.344870 | controller | skipping: [instance] 2025-12-04 12:05:04.345086 | controller | 2025-12-04 12:05:04.345402 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:04.371814 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.047) 0:00:03.704 ***** 2025-12-04 12:05:04.371857 | controller | ok: [instance] 2025-12-04 12:05:04.372031 | controller | 2025-12-04 12:05:04.372294 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:04.402078 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.027) 0:00:03.731 ***** 2025-12-04 12:05:04.402112 | controller | ok: [instance] 2025-12-04 12:05:04.402240 | controller | 2025-12-04 12:05:04.402363 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:04.402493 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.030) 0:00:03.761 ***** 2025-12-04 12:05:04.446123 | controller | ok: [instance] => 2025-12-04 12:05:04.446295 | controller | msg: 'Running: No network for a VM' 2025-12-04 12:05:04.446447 | controller | 2025-12-04 12:05:04.446657 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:04.446934 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.044) 0:00:03.805 ***** 2025-12-04 12:05:04.497812 | controller | 2025-12-04 12:05:04.497974 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:05:04.498224 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.051) 0:00:03.857 ***** 2025-12-04 12:05:04.529390 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:05:04.534305 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:05:04.534337 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:05:04.546899 | controller | collisions and unexpected behavior. 2025-12-04 12:05:04.546942 | controller | failed: [instance] (item=foo) => changed=false 2025-12-04 12:05:04.547168 | controller | ansible_loop_var: item 2025-12-04 12:05:04.547266 | controller | assertion: item.value.nets is defined 2025-12-04 12:05:04.547507 | controller | evaluated_to: false 2025-12-04 12:05:04.547590 | controller | item: 2025-12-04 12:05:04.547835 | controller | key: foo 2025-12-04 12:05:04.548661 | controller | value: 2025-12-04 12:05:04.569408 | controller | disksize: 10 2025-12-04 12:05:04.569439 | controller | msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' 2025-12-04 12:05:04.569452 | controller | ok: [instance] => (item=controller) 2025-12-04 12:05:04.569764 | controller | 2025-12-04 12:05:04.633541 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 12:05:04.633570 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.070) 0:00:03.928 ***** 2025-12-04 12:05:04.633583 | controller | ok: [instance] => 2025-12-04 12:05:04.633650 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 12:05:04.633782 | controller | networks: 2025-12-04 12:05:04.633967 | controller | public: defined 2025-12-04 12:05:04.634146 | controller | vms: 2025-12-04 12:05:04.634260 | controller | controller: 2025-12-04 12:05:04.634512 | controller | nets: 2025-12-04 12:05:04.634617 | controller | - public 2025-12-04 12:05:04.634763 | controller | 2025-12-04 12:05:04.635037 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 12:05:04.635115 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.063) 0:00:03.992 ***** 2025-12-04 12:05:04.683379 | controller | skipping: [instance] 2025-12-04 12:05:04.683498 | controller | 2025-12-04 12:05:04.683832 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 12:05:04.784181 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.047) 0:00:04.039 ***** 2025-12-04 12:05:04.784226 | controller | skipping: [instance] 2025-12-04 12:05:04.784433 | controller | 2025-12-04 12:05:04.784584 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 12:05:04.784742 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.103) 0:00:04.143 ***** 2025-12-04 12:05:04.875540 | controller | ok: [instance] => 2025-12-04 12:05:04.875645 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 12:05:04.875802 | controller | networks: 2025-12-04 12:05:04.876049 | controller | public: defined 2025-12-04 12:05:04.876206 | controller | vms: 2025-12-04 12:05:04.876460 | controller | controller: 2025-12-04 12:05:04.876477 | controller | nets: 2025-12-04 12:05:04.876700 | controller | - public 2025-12-04 12:05:04.876907 | controller | foo: 2025-12-04 12:05:04.877071 | controller | disksize: 10 2025-12-04 12:05:04.877286 | controller | 2025-12-04 12:05:04.877459 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 12:05:04.877475 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.090) 0:00:04.234 ***** 2025-12-04 12:05:04.908366 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:04.946500 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 12:05:04.946542 | controller | 2025-12-04 12:05:04.946647 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:04.946761 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.048) 0:00:04.282 ***** 2025-12-04 12:05:04.946926 | controller | 2025-12-04 12:05:04.947056 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:04.947192 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.023) 0:00:04.305 ***** 2025-12-04 12:05:04.992748 | controller | ok: [instance] 2025-12-04 12:05:04.992985 | controller | 2025-12-04 12:05:04.993174 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:04.993225 | controller | Thursday 04 December 2025 12:05:04 +0000 (0:00:00.046) 0:00:04.352 ***** 2025-12-04 12:05:05.087887 | controller | skipping: [instance] 2025-12-04 12:05:05.088190 | controller | 2025-12-04 12:05:05.088941 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:05.089284 | controller | Thursday 04 December 2025 12:05:05 +0000 (0:00:00.093) 0:00:04.446 ***** 2025-12-04 12:05:05.164508 | controller | skipping: [instance] 2025-12-04 12:05:05.164647 | controller | 2025-12-04 12:05:05.165215 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:05.165504 | controller | Thursday 04 December 2025 12:05:05 +0000 (0:00:00.072) 0:00:04.518 ***** 2025-12-04 12:05:05.228638 | controller | skipping: [instance] 2025-12-04 12:05:05.228848 | controller | 2025-12-04 12:05:05.229137 | controller | TASK [Fail if needed] ********************************************************** 2025-12-04 12:05:05.229347 | controller | Thursday 04 December 2025 12:05:05 +0000 (0:00:00.069) 0:00:04.587 ***** 2025-12-04 12:05:05.338044 | controller | skipping: [instance] 2025-12-04 12:05:05.338096 | controller | 2025-12-04 12:05:05.338323 | controller | PLAY RECAP ********************************************************************* 2025-12-04 12:05:05.338515 | controller | instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 2025-12-04 12:05:05.338775 | controller | 2025-12-04 12:05:05.338996 | controller | Thursday 04 December 2025 12:05:05 +0000 (0:00:00.108) 0:00:04.696 ***** 2025-12-04 12:05:05.339189 | controller | =============================================================================== 2025-12-04 12:05:05.339204 | controller | reproducer : Dump layout patches ---------------------------------------- 0.14s 2025-12-04 12:05:05.339481 | controller | reproducer : Dump layout patches ---------------------------------------- 0.13s 2025-12-04 12:05:05.339503 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.13s 2025-12-04 12:05:05.339595 | controller | Fail if needed ---------------------------------------------------------- 0.11s 2025-12-04 12:05:05.339718 | controller | reproducer : Dump layout patches ---------------------------------------- 0.10s 2025-12-04 12:05:05.339822 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.10s 2025-12-04 12:05:05.340050 | controller | Mark failure ------------------------------------------------------------ 0.09s 2025-12-04 12:05:05.340146 | controller | reproducer : Dump built layout ------------------------------------------ 0.09s 2025-12-04 12:05:05.340247 | controller | reproducer : Dump layout patches ---------------------------------------- 0.09s 2025-12-04 12:05:05.340603 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.08s 2025-12-04 12:05:05.340767 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.08s 2025-12-04 12:05:05.340783 | controller | reproducer : Dump built layout ------------------------------------------ 0.08s 2025-12-04 12:05:05.340965 | controller | Validate data ----------------------------------------------------------- 0.08s 2025-12-04 12:05:05.341190 | controller | Mark failure ------------------------------------------------------------ 0.07s 2025-12-04 12:05:05.341419 | controller | Test network validations ------------------------------------------------ 0.07s 2025-12-04 12:05:05.341442 | controller | Display error message --------------------------------------------------- 0.07s 2025-12-04 12:05:05.341524 | controller | reproducer : Dump CI reproducer generated layout ------------------------ 0.07s 2025-12-04 12:05:05.341752 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.07s 2025-12-04 12:05:05.341864 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.07s 2025-12-04 12:05:05.342184 | controller | Append failed scenario to list ------------------------------------------ 0.07s 2025-12-04 12:05:05.482452 | controller | INFO Running network_validations > cleanup 2025-12-04 12:05:05.483073 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 12:05:05.495554 | controller | INFO Running ocp_validations > prepare 2025-12-04 12:05:05.496215 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-04 12:05:05.508473 | controller | INFO Running ocp_validations > converge 2025-12-04 12:05:06.255663 | controller | 2025-12-04 12:05:06.256124 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 12:05:06.302736 | controller | 2025-12-04 12:05:06.302770 | controller | TASK [Set failed fact] ********************************************************* 2025-12-04 12:05:06.302780 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.039) 0:00:00.039 ***** 2025-12-04 12:05:06.302794 | controller | ok: [instance] 2025-12-04 12:05:06.302892 | controller | 2025-12-04 12:05:06.303147 | controller | TASK [Load scenarios] ********************************************************** 2025-12-04 12:05:06.303230 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.047) 0:00:00.087 ***** 2025-12-04 12:05:06.343265 | controller | ok: [instance] 2025-12-04 12:05:06.343436 | controller | 2025-12-04 12:05:06.343614 | controller | TASK [Test no volumes] ********************************************************* 2025-12-04 12:05:06.343797 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.040) 0:00:00.127 ***** 2025-12-04 12:05:06.506646 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) 2025-12-04 12:05:06.506762 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) 2025-12-04 12:05:06.507094 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) 2025-12-04 12:05:06.507422 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) 2025-12-04 12:05:06.507451 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) 2025-12-04 12:05:06.507800 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) 2025-12-04 12:05:06.507823 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) 2025-12-04 12:05:06.508079 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) 2025-12-04 12:05:06.508100 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) 2025-12-04 12:05:06.508259 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) 2025-12-04 12:05:06.508425 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) 2025-12-04 12:05:06.508616 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) 2025-12-04 12:05:06.508801 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) 2025-12-04 12:05:06.508938 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) 2025-12-04 12:05:06.509123 | controller | 2025-12-04 12:05:06.509234 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:06.509514 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.163) 0:00:00.290 ***** 2025-12-04 12:05:06.545917 | controller | ok: [instance] 2025-12-04 12:05:06.546292 | controller | 2025-12-04 12:05:06.546320 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:06.546342 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.039) 0:00:00.330 ***** 2025-12-04 12:05:06.582672 | controller | ok: [instance] 2025-12-04 12:05:06.582862 | controller | 2025-12-04 12:05:06.582897 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:06.583214 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.037) 0:00:00.367 ***** 2025-12-04 12:05:06.625513 | controller | ok: [instance] => 2025-12-04 12:05:06.625753 | controller | msg: 'Running: No volume, no worker' 2025-12-04 12:05:06.625906 | controller | 2025-12-04 12:05:06.625922 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:06.626118 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.042) 0:00:00.410 ***** 2025-12-04 12:05:06.709847 | controller | 2025-12-04 12:05:06.710025 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:06.710158 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.084) 0:00:00.494 ***** 2025-12-04 12:05:06.781179 | controller | ok: [instance] 2025-12-04 12:05:06.781291 | controller | 2025-12-04 12:05:06.781439 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:06.781575 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.067) 0:00:00.562 ***** 2025-12-04 12:05:06.849515 | controller | ok: [instance] 2025-12-04 12:05:06.849631 | controller | 2025-12-04 12:05:06.849775 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:06.849956 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.071) 0:00:00.634 ***** 2025-12-04 12:05:06.941066 | controller | ok: [instance] 2025-12-04 12:05:06.941317 | controller | 2025-12-04 12:05:06.941455 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:06.941644 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.090) 0:00:00.724 ***** 2025-12-04 12:05:06.992922 | controller | skipping: [instance] 2025-12-04 12:05:06.993070 | controller | 2025-12-04 12:05:06.993171 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:06.993336 | controller | Thursday 04 December 2025 12:05:06 +0000 (0:00:00.052) 0:00:00.777 ***** 2025-12-04 12:05:07.065502 | controller | ok: [instance] 2025-12-04 12:05:07.065621 | controller | 2025-12-04 12:05:07.065743 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:05:07.065906 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.072) 0:00:00.849 ***** 2025-12-04 12:05:07.157875 | controller | skipping: [instance] 2025-12-04 12:05:07.158009 | controller | 2025-12-04 12:05:07.158124 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:05:07.158292 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.092) 0:00:00.942 ***** 2025-12-04 12:05:07.215914 | controller | skipping: [instance] 2025-12-04 12:05:07.216024 | controller | 2025-12-04 12:05:07.216175 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:05:07.216461 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.058) 0:00:01.000 ***** 2025-12-04 12:05:07.261176 | controller | skipping: [instance] 2025-12-04 12:05:07.261429 | controller | 2025-12-04 12:05:07.261625 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:05:07.261792 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.045) 0:00:01.046 ***** 2025-12-04 12:05:07.309646 | controller | skipping: [instance] 2025-12-04 12:05:07.309790 | controller | 2025-12-04 12:05:07.309997 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:05:07.310124 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.048) 0:00:01.094 ***** 2025-12-04 12:05:07.362336 | controller | skipping: [instance] 2025-12-04 12:05:07.362508 | controller | 2025-12-04 12:05:07.362651 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:05:07.362784 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.049) 0:00:01.144 ***** 2025-12-04 12:05:07.426510 | controller | skipping: [instance] 2025-12-04 12:05:07.426742 | controller | 2025-12-04 12:05:07.426903 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:07.427100 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.067) 0:00:01.211 ***** 2025-12-04 12:05:07.540824 | controller | skipping: [instance] 2025-12-04 12:05:07.540979 | controller | 2025-12-04 12:05:07.541092 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:07.541290 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.113) 0:00:01.325 ***** 2025-12-04 12:05:07.602578 | controller | skipping: [instance] 2025-12-04 12:05:07.602672 | controller | 2025-12-04 12:05:07.602778 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:07.603034 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.061) 0:00:01.386 ***** 2025-12-04 12:05:07.653515 | controller | skipping: [instance] 2025-12-04 12:05:07.653646 | controller | 2025-12-04 12:05:07.653669 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:07.653753 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.048) 0:00:01.435 ***** 2025-12-04 12:05:07.683852 | controller | ok: [instance] 2025-12-04 12:05:07.684050 | controller | 2025-12-04 12:05:07.684251 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:07.684428 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.033) 0:00:01.468 ***** 2025-12-04 12:05:07.720434 | controller | ok: [instance] 2025-12-04 12:05:07.720522 | controller | 2025-12-04 12:05:07.720746 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:07.720765 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.036) 0:00:01.504 ***** 2025-12-04 12:05:07.755912 | controller | ok: [instance] => 2025-12-04 12:05:07.756099 | controller | msg: 'Running: No volume, with worker' 2025-12-04 12:05:07.756267 | controller | 2025-12-04 12:05:07.756533 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:07.756832 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.035) 0:00:01.540 ***** 2025-12-04 12:05:07.810216 | controller | 2025-12-04 12:05:07.810364 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:07.810517 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.054) 0:00:01.595 ***** 2025-12-04 12:05:07.888380 | controller | ok: [instance] 2025-12-04 12:05:08.009556 | controller | 2025-12-04 12:05:08.009621 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:08.009632 | controller | Thursday 04 December 2025 12:05:07 +0000 (0:00:00.073) 0:00:01.668 ***** 2025-12-04 12:05:08.009646 | controller | ok: [instance] 2025-12-04 12:05:08.009720 | controller | 2025-12-04 12:05:08.009890 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:08.010084 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.124) 0:00:01.793 ***** 2025-12-04 12:05:08.112634 | controller | ok: [instance] 2025-12-04 12:05:08.112687 | controller | 2025-12-04 12:05:08.112975 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:08.113067 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.103) 0:00:01.897 ***** 2025-12-04 12:05:08.267382 | controller | ok: [instance] 2025-12-04 12:05:08.267572 | controller | 2025-12-04 12:05:08.267797 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:08.267988 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.149) 0:00:02.046 ***** 2025-12-04 12:05:08.347378 | controller | ok: [instance] 2025-12-04 12:05:08.347472 | controller | 2025-12-04 12:05:08.347591 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:05:08.347754 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.085) 0:00:02.131 ***** 2025-12-04 12:05:08.388921 | controller | skipping: [instance] 2025-12-04 12:05:08.389042 | controller | 2025-12-04 12:05:08.389222 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:05:08.389461 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.041) 0:00:02.173 ***** 2025-12-04 12:05:08.438150 | controller | skipping: [instance] 2025-12-04 12:05:08.438260 | controller | 2025-12-04 12:05:08.438458 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:05:08.438676 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.049) 0:00:02.222 ***** 2025-12-04 12:05:08.499116 | controller | skipping: [instance] 2025-12-04 12:05:08.499304 | controller | 2025-12-04 12:05:08.499494 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:05:08.499646 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.060) 0:00:02.283 ***** 2025-12-04 12:05:08.562319 | controller | skipping: [instance] 2025-12-04 12:05:08.562474 | controller | 2025-12-04 12:05:08.562610 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:05:08.562821 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.060) 0:00:02.343 ***** 2025-12-04 12:05:08.611208 | controller | skipping: [instance] 2025-12-04 12:05:08.611328 | controller | 2025-12-04 12:05:08.611456 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:05:08.611618 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.049) 0:00:02.393 ***** 2025-12-04 12:05:08.713541 | controller | skipping: [instance] 2025-12-04 12:05:08.756705 | controller | 2025-12-04 12:05:08.756733 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:08.756742 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.101) 0:00:02.495 ***** 2025-12-04 12:05:08.756752 | controller | skipping: [instance] 2025-12-04 12:05:08.756826 | controller | 2025-12-04 12:05:08.756984 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:08.757093 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.046) 0:00:02.541 ***** 2025-12-04 12:05:08.818437 | controller | skipping: [instance] 2025-12-04 12:05:08.818616 | controller | 2025-12-04 12:05:08.818746 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:08.818968 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.051) 0:00:02.593 ***** 2025-12-04 12:05:08.878034 | controller | skipping: [instance] 2025-12-04 12:05:08.878766 | controller | 2025-12-04 12:05:08.878920 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:08.879229 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.066) 0:00:02.660 ***** 2025-12-04 12:05:08.913149 | controller | ok: [instance] 2025-12-04 12:05:08.913417 | controller | 2025-12-04 12:05:08.913557 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:08.913597 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.034) 0:00:02.694 ***** 2025-12-04 12:05:08.946781 | controller | ok: [instance] 2025-12-04 12:05:08.947100 | controller | 2025-12-04 12:05:08.947287 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:08.947569 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.036) 0:00:02.731 ***** 2025-12-04 12:05:08.982192 | controller | ok: [instance] => 2025-12-04 12:05:08.982448 | controller | msg: 'Running: Volume, no worker' 2025-12-04 12:05:08.982585 | controller | 2025-12-04 12:05:08.982762 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:08.982920 | controller | Thursday 04 December 2025 12:05:08 +0000 (0:00:00.035) 0:00:02.767 ***** 2025-12-04 12:05:09.025127 | controller | 2025-12-04 12:05:09.025249 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:09.025367 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.043) 0:00:02.810 ***** 2025-12-04 12:05:09.127873 | controller | ok: [instance] 2025-12-04 12:05:09.127993 | controller | 2025-12-04 12:05:09.128157 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:09.128367 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.098) 0:00:02.908 ***** 2025-12-04 12:05:09.192071 | controller | ok: [instance] 2025-12-04 12:05:09.192161 | controller | 2025-12-04 12:05:09.192258 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:09.192454 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.067) 0:00:02.976 ***** 2025-12-04 12:05:09.301772 | controller | ok: [instance] 2025-12-04 12:05:09.301924 | controller | 2025-12-04 12:05:09.302144 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:09.302408 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.109) 0:00:03.086 ***** 2025-12-04 12:05:09.439311 | controller | skipping: [instance] 2025-12-04 12:05:09.439492 | controller | 2025-12-04 12:05:09.439757 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:09.440050 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.137) 0:00:03.223 ***** 2025-12-04 12:05:09.503651 | controller | skipping: [instance] 2025-12-04 12:05:09.503990 | controller | 2025-12-04 12:05:09.504247 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:05:09.504499 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.064) 0:00:03.288 ***** 2025-12-04 12:05:09.566262 | controller | ok: [instance] 2025-12-04 12:05:09.566582 | controller | 2025-12-04 12:05:09.566791 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:05:09.567006 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.062) 0:00:03.350 ***** 2025-12-04 12:05:09.620096 | controller | skipping: [instance] 2025-12-04 12:05:09.620328 | controller | 2025-12-04 12:05:09.620631 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:05:09.621004 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.053) 0:00:03.404 ***** 2025-12-04 12:05:09.703629 | controller | ok: [instance] 2025-12-04 12:05:09.703862 | controller | 2025-12-04 12:05:09.704082 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:05:09.704335 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.084) 0:00:03.488 ***** 2025-12-04 12:05:09.781092 | controller | ok: [instance] 2025-12-04 12:05:09.871808 | controller | 2025-12-04 12:05:09.871912 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:05:09.871932 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.076) 0:00:03.565 ***** 2025-12-04 12:05:09.871946 | controller | ok: [instance] => changed=false 2025-12-04 12:05:09.961928 | controller | msg: All assertions passed 2025-12-04 12:05:09.962017 | controller | 2025-12-04 12:05:09.962055 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:05:09.962070 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.085) 0:00:03.650 ***** 2025-12-04 12:05:09.962084 | controller | ok: [instance] => changed=false 2025-12-04 12:05:10.007151 | controller | msg: All assertions passed 2025-12-04 12:05:10.007196 | controller | 2025-12-04 12:05:10.007205 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:10.007212 | controller | Thursday 04 December 2025 12:05:09 +0000 (0:00:00.094) 0:00:03.745 ***** 2025-12-04 12:05:10.007256 | controller | skipping: [instance] 2025-12-04 12:05:10.042010 | controller | 2025-12-04 12:05:10.042042 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:10.042051 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.042) 0:00:03.788 ***** 2025-12-04 12:05:10.042113 | controller | skipping: [instance] 2025-12-04 12:05:10.042318 | controller | 2025-12-04 12:05:10.042551 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:10.042751 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.036) 0:00:03.824 ***** 2025-12-04 12:05:10.080605 | controller | skipping: [instance] 2025-12-04 12:05:10.080806 | controller | 2025-12-04 12:05:10.081103 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:10.081349 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.040) 0:00:03.865 ***** 2025-12-04 12:05:10.104883 | controller | ok: [instance] 2025-12-04 12:05:10.105103 | controller | 2025-12-04 12:05:10.105347 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:10.105542 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.022) 0:00:03.887 ***** 2025-12-04 12:05:10.135722 | controller | ok: [instance] 2025-12-04 12:05:10.135936 | controller | 2025-12-04 12:05:10.136155 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:10.136395 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.030) 0:00:03.918 ***** 2025-12-04 12:05:10.166218 | controller | ok: [instance] => 2025-12-04 12:05:10.166505 | controller | msg: 'Running: Volume, with worker' 2025-12-04 12:05:10.166758 | controller | 2025-12-04 12:05:10.167133 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:10.167491 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.032) 0:00:03.951 ***** 2025-12-04 12:05:10.211977 | controller | 2025-12-04 12:05:10.212215 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:10.212512 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.045) 0:00:03.996 ***** 2025-12-04 12:05:10.283598 | controller | ok: [instance] 2025-12-04 12:05:10.283953 | controller | 2025-12-04 12:05:10.284139 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:10.284320 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.066) 0:00:04.063 ***** 2025-12-04 12:05:10.335171 | controller | ok: [instance] 2025-12-04 12:05:10.416230 | controller | 2025-12-04 12:05:10.416292 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:10.416312 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.052) 0:00:04.116 ***** 2025-12-04 12:05:10.416324 | controller | ok: [instance] 2025-12-04 12:05:10.501582 | controller | 2025-12-04 12:05:10.501611 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:10.501619 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.084) 0:00:04.200 ***** 2025-12-04 12:05:10.501631 | controller | ok: [instance] 2025-12-04 12:05:10.571426 | controller | 2025-12-04 12:05:10.571456 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:10.571465 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.081) 0:00:04.282 ***** 2025-12-04 12:05:10.571476 | controller | skipping: [instance] 2025-12-04 12:05:10.694294 | controller | 2025-12-04 12:05:10.694345 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:05:10.694360 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.068) 0:00:04.350 ***** 2025-12-04 12:05:10.694378 | controller | ok: [instance] 2025-12-04 12:05:10.694629 | controller | 2025-12-04 12:05:10.694919 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:05:10.695124 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.127) 0:00:04.478 ***** 2025-12-04 12:05:10.776394 | controller | ok: [instance] 2025-12-04 12:05:10.776584 | controller | 2025-12-04 12:05:10.776727 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:05:10.776887 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.072) 0:00:04.550 ***** 2025-12-04 12:05:10.849577 | controller | ok: [instance] 2025-12-04 12:05:10.849773 | controller | 2025-12-04 12:05:10.849942 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:05:10.850170 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.083) 0:00:04.634 ***** 2025-12-04 12:05:10.962736 | controller | ok: [instance] 2025-12-04 12:05:11.064884 | controller | 2025-12-04 12:05:11.064949 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:05:11.064958 | controller | Thursday 04 December 2025 12:05:10 +0000 (0:00:00.112) 0:00:04.746 ***** 2025-12-04 12:05:11.064972 | controller | ok: [instance] => changed=false 2025-12-04 12:05:11.177653 | controller | msg: All assertions passed 2025-12-04 12:05:11.177686 | controller | 2025-12-04 12:05:11.177700 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:05:11.177722 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.101) 0:00:04.848 ***** 2025-12-04 12:05:11.177737 | controller | ok: [instance] => changed=false 2025-12-04 12:05:11.227361 | controller | msg: All assertions passed 2025-12-04 12:05:11.227488 | controller | 2025-12-04 12:05:11.227499 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:11.227507 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.113) 0:00:04.961 ***** 2025-12-04 12:05:11.227520 | controller | skipping: [instance] 2025-12-04 12:05:11.266312 | controller | 2025-12-04 12:05:11.266344 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:11.266357 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.048) 0:00:05.010 ***** 2025-12-04 12:05:11.266422 | controller | skipping: [instance] 2025-12-04 12:05:11.303873 | controller | 2025-12-04 12:05:11.303894 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:11.303902 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.038) 0:00:05.048 ***** 2025-12-04 12:05:11.303911 | controller | skipping: [instance] 2025-12-04 12:05:11.328488 | controller | 2025-12-04 12:05:11.328508 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:11.328532 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.039) 0:00:05.087 ***** 2025-12-04 12:05:11.328543 | controller | ok: [instance] 2025-12-04 12:05:11.361575 | controller | 2025-12-04 12:05:11.361628 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:11.361639 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.024) 0:00:05.112 ***** 2025-12-04 12:05:11.361649 | controller | ok: [instance] 2025-12-04 12:05:11.394659 | controller | 2025-12-04 12:05:11.394683 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:11.394691 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.032) 0:00:05.145 ***** 2025-12-04 12:05:11.394701 | controller | ok: [instance] => 2025-12-04 12:05:11.394909 | controller | msg: 'Running: Too many allocated volumes' 2025-12-04 12:05:11.395148 | controller | 2025-12-04 12:05:11.395407 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:11.395673 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.034) 0:00:05.179 ***** 2025-12-04 12:05:11.439860 | controller | 2025-12-04 12:05:11.440356 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:11.440672 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.045) 0:00:05.224 ***** 2025-12-04 12:05:11.507892 | controller | ok: [instance] 2025-12-04 12:05:11.508097 | controller | 2025-12-04 12:05:11.508566 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:11.508848 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.067) 0:00:05.292 ***** 2025-12-04 12:05:11.563346 | controller | ok: [instance] 2025-12-04 12:05:11.563736 | controller | 2025-12-04 12:05:11.564134 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:11.564385 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.051) 0:00:05.343 ***** 2025-12-04 12:05:11.643256 | controller | ok: [instance] 2025-12-04 12:05:11.643578 | controller | 2025-12-04 12:05:11.643853 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:11.644088 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.083) 0:00:05.427 ***** 2025-12-04 12:05:11.690759 | controller | skipping: [instance] 2025-12-04 12:05:11.691024 | controller | 2025-12-04 12:05:11.691432 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:11.691741 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.047) 0:00:05.475 ***** 2025-12-04 12:05:11.740890 | controller | skipping: [instance] 2025-12-04 12:05:11.741129 | controller | 2025-12-04 12:05:11.741412 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:05:11.741604 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.050) 0:00:05.525 ***** 2025-12-04 12:05:11.799422 | controller | ok: [instance] 2025-12-04 12:05:11.799683 | controller | 2025-12-04 12:05:11.799931 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:05:11.800094 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.055) 0:00:05.581 ***** 2025-12-04 12:05:11.853949 | controller | skipping: [instance] 2025-12-04 12:05:11.854285 | controller | 2025-12-04 12:05:11.854614 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:05:11.854932 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.055) 0:00:05.636 ***** 2025-12-04 12:05:11.981642 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:11.981928 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-12-04 12:05:11.982092 | controller | evaluated_to: false 2025-12-04 12:05:11.982265 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' 2025-12-04 12:05:12.013268 | controller | 2025-12-04 12:05:12.015972 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:12.016313 | controller | Thursday 04 December 2025 12:05:11 +0000 (0:00:00.142) 0:00:05.779 ***** 2025-12-04 12:05:12.016511 | controller | 2025-12-04 12:05:12.016793 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:12.017033 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.018) 0:00:05.798 ***** 2025-12-04 12:05:12.041372 | controller | ok: [instance] 2025-12-04 12:05:12.041675 | controller | 2025-12-04 12:05:12.041913 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:12.042121 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.027) 0:00:05.825 ***** 2025-12-04 12:05:12.084094 | controller | skipping: [instance] 2025-12-04 12:05:12.084445 | controller | 2025-12-04 12:05:12.084735 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:12.084977 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.042) 0:00:05.867 ***** 2025-12-04 12:05:12.121495 | controller | skipping: [instance] 2025-12-04 12:05:12.121806 | controller | 2025-12-04 12:05:12.122078 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:12.122299 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.038) 0:00:05.906 ***** 2025-12-04 12:05:12.161447 | controller | skipping: [instance] 2025-12-04 12:05:12.161686 | controller | 2025-12-04 12:05:12.161880 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:12.162068 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.039) 0:00:05.945 ***** 2025-12-04 12:05:12.190779 | controller | ok: [instance] 2025-12-04 12:05:12.191037 | controller | 2025-12-04 12:05:12.191363 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:12.191558 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.029) 0:00:05.974 ***** 2025-12-04 12:05:12.224786 | controller | ok: [instance] 2025-12-04 12:05:12.225096 | controller | 2025-12-04 12:05:12.225568 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:12.225882 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.035) 0:00:06.009 ***** 2025-12-04 12:05:12.256887 | controller | ok: [instance] => 2025-12-04 12:05:12.257172 | controller | msg: 'Running: Different volume amount' 2025-12-04 12:05:12.257450 | controller | 2025-12-04 12:05:12.257688 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:12.257957 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.032) 0:00:06.041 ***** 2025-12-04 12:05:12.304584 | controller | 2025-12-04 12:05:12.305001 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:12.305226 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.047) 0:00:06.089 ***** 2025-12-04 12:05:12.380308 | controller | ok: [instance] 2025-12-04 12:05:12.434816 | controller | 2025-12-04 12:05:12.434852 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:12.434876 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.075) 0:00:06.164 ***** 2025-12-04 12:05:12.434888 | controller | ok: [instance] 2025-12-04 12:05:12.514214 | controller | 2025-12-04 12:05:12.514298 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:12.514313 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.051) 0:00:06.215 ***** 2025-12-04 12:05:12.514326 | controller | ok: [instance] 2025-12-04 12:05:12.607736 | controller | 2025-12-04 12:05:12.607798 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:12.607809 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.082) 0:00:06.297 ***** 2025-12-04 12:05:12.607822 | controller | ok: [instance] 2025-12-04 12:05:12.660619 | controller | 2025-12-04 12:05:12.660686 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:12.660704 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.090) 0:00:06.388 ***** 2025-12-04 12:05:12.660735 | controller | skipping: [instance] 2025-12-04 12:05:12.717794 | controller | 2025-12-04 12:05:12.717828 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:05:12.717848 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.055) 0:00:06.444 ***** 2025-12-04 12:05:12.717876 | controller | ok: [instance] 2025-12-04 12:05:12.860859 | controller | 2025-12-04 12:05:12.860905 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:05:12.860922 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.057) 0:00:06.501 ***** 2025-12-04 12:05:12.860935 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:12.909755 | controller | assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 2025-12-04 12:05:12.909796 | controller | evaluated_to: false 2025-12-04 12:05:12.909805 | controller | msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' 2025-12-04 12:05:12.909816 | controller | 2025-12-04 12:05:13.036136 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:13.036177 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.169) 0:00:06.670 ***** 2025-12-04 12:05:13.036187 | controller | 2025-12-04 12:05:13.036192 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:13.036202 | controller | Thursday 04 December 2025 12:05:12 +0000 (0:00:00.019) 0:00:06.690 ***** 2025-12-04 12:05:13.036212 | controller | ok: [instance] 2025-12-04 12:05:13.172465 | controller | 2025-12-04 12:05:13.172529 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:13.172539 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.130) 0:00:06.820 ***** 2025-12-04 12:05:13.172558 | controller | skipping: [instance] 2025-12-04 12:05:13.241453 | controller | 2025-12-04 12:05:13.241494 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:13.241546 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.135) 0:00:06.956 ***** 2025-12-04 12:05:13.241570 | controller | skipping: [instance] 2025-12-04 12:05:13.290490 | controller | 2025-12-04 12:05:13.290515 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:13.290523 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.069) 0:00:07.025 ***** 2025-12-04 12:05:13.290535 | controller | skipping: [instance] 2025-12-04 12:05:13.336926 | controller | 2025-12-04 12:05:13.336961 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:13.336974 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.048) 0:00:07.074 ***** 2025-12-04 12:05:13.336992 | controller | ok: [instance] 2025-12-04 12:05:13.374618 | controller | 2025-12-04 12:05:13.374641 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:13.374649 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.046) 0:00:07.120 ***** 2025-12-04 12:05:13.374665 | controller | ok: [instance] 2025-12-04 12:05:13.413456 | controller | 2025-12-04 12:05:13.413481 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:13.413489 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.038) 0:00:07.158 ***** 2025-12-04 12:05:13.413509 | controller | ok: [instance] => 2025-12-04 12:05:13.469750 | controller | msg: 'Running: Create LVM without volume' 2025-12-04 12:05:13.469775 | controller | 2025-12-04 12:05:13.469790 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:13.469796 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.038) 0:00:07.197 ***** 2025-12-04 12:05:13.469805 | controller | 2025-12-04 12:05:13.470101 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:13.470352 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.056) 0:00:07.254 ***** 2025-12-04 12:05:13.553156 | controller | ok: [instance] 2025-12-04 12:05:13.623877 | controller | 2025-12-04 12:05:13.623902 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:13.623911 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.082) 0:00:07.336 ***** 2025-12-04 12:05:13.623921 | controller | ok: [instance] 2025-12-04 12:05:13.722604 | controller | 2025-12-04 12:05:13.722630 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:13.722639 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.070) 0:00:07.407 ***** 2025-12-04 12:05:13.722650 | controller | ok: [instance] 2025-12-04 12:05:13.782747 | controller | 2025-12-04 12:05:13.782789 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:13.782804 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.098) 0:00:07.506 ***** 2025-12-04 12:05:13.782815 | controller | skipping: [instance] 2025-12-04 12:05:13.783031 | controller | 2025-12-04 12:05:13.783384 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:13.783632 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.060) 0:00:07.567 ***** 2025-12-04 12:05:13.878851 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:13.879074 | controller | assertion: not cifmw_devscripts_create_logical_volume | bool 2025-12-04 12:05:13.879259 | controller | evaluated_to: false 2025-12-04 12:05:13.879494 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-12-04 12:05:13.910321 | controller | 2025-12-04 12:05:13.910609 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:13.910972 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.108) 0:00:07.675 ***** 2025-12-04 12:05:13.911215 | controller | 2025-12-04 12:05:13.911465 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:13.911827 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.019) 0:00:07.695 ***** 2025-12-04 12:05:13.935663 | controller | ok: [instance] 2025-12-04 12:05:13.935940 | controller | 2025-12-04 12:05:13.936212 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:13.936407 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.025) 0:00:07.720 ***** 2025-12-04 12:05:13.994347 | controller | skipping: [instance] 2025-12-04 12:05:13.994559 | controller | 2025-12-04 12:05:13.994824 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:13.995110 | controller | Thursday 04 December 2025 12:05:13 +0000 (0:00:00.058) 0:00:07.778 ***** 2025-12-04 12:05:14.038972 | controller | skipping: [instance] 2025-12-04 12:05:14.039308 | controller | 2025-12-04 12:05:14.039633 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:14.039854 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.039) 0:00:07.818 ***** 2025-12-04 12:05:14.099075 | controller | skipping: [instance] 2025-12-04 12:05:14.099460 | controller | 2025-12-04 12:05:14.099668 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:14.100049 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.065) 0:00:07.883 ***** 2025-12-04 12:05:14.124247 | controller | ok: [instance] 2025-12-04 12:05:14.124442 | controller | 2025-12-04 12:05:14.124643 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:14.124825 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.023) 0:00:07.907 ***** 2025-12-04 12:05:14.157374 | controller | ok: [instance] 2025-12-04 12:05:14.157699 | controller | 2025-12-04 12:05:14.157955 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:14.158180 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.034) 0:00:07.942 ***** 2025-12-04 12:05:14.210242 | controller | ok: [instance] => 2025-12-04 12:05:14.289049 | controller | msg: 'Running: Create LVMS without volume' 2025-12-04 12:05:14.289081 | controller | 2025-12-04 12:05:14.289089 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:14.289096 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.049) 0:00:07.991 ***** 2025-12-04 12:05:14.289106 | controller | 2025-12-04 12:05:14.530445 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:14.530557 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.081) 0:00:08.072 ***** 2025-12-04 12:05:14.530574 | controller | ok: [instance] 2025-12-04 12:05:14.600228 | controller | 2025-12-04 12:05:14.600313 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:14.600324 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.240) 0:00:08.313 ***** 2025-12-04 12:05:14.600345 | controller | ok: [instance] 2025-12-04 12:05:14.695460 | controller | 2025-12-04 12:05:14.695524 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:14.695534 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.070) 0:00:08.383 ***** 2025-12-04 12:05:14.695546 | controller | ok: [instance] 2025-12-04 12:05:14.695686 | controller | 2025-12-04 12:05:14.695697 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:14.695704 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.094) 0:00:08.478 ***** 2025-12-04 12:05:14.756806 | controller | skipping: [instance] 2025-12-04 12:05:14.756981 | controller | 2025-12-04 12:05:14.757154 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:14.760697 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.062) 0:00:08.541 ***** 2025-12-04 12:05:14.832634 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:14.832808 | controller | assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 2025-12-04 12:05:14.833040 | controller | evaluated_to: false 2025-12-04 12:05:14.833255 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-12-04 12:05:14.869537 | controller | 2025-12-04 12:05:14.869728 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:14.870107 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.094) 0:00:08.635 ***** 2025-12-04 12:05:14.870301 | controller | 2025-12-04 12:05:14.870504 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:14.870696 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.018) 0:00:08.653 ***** 2025-12-04 12:05:14.910607 | controller | ok: [instance] 2025-12-04 12:05:14.910773 | controller | 2025-12-04 12:05:14.910939 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:14.911107 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.041) 0:00:08.695 ***** 2025-12-04 12:05:14.967753 | controller | skipping: [instance] 2025-12-04 12:05:14.967981 | controller | 2025-12-04 12:05:14.968130 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:14.968503 | controller | Thursday 04 December 2025 12:05:14 +0000 (0:00:00.056) 0:00:08.752 ***** 2025-12-04 12:05:15.031564 | controller | skipping: [instance] 2025-12-04 12:05:15.031729 | controller | 2025-12-04 12:05:15.031855 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:15.032060 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.063) 0:00:08.815 ***** 2025-12-04 12:05:15.080284 | controller | skipping: [instance] 2025-12-04 12:05:15.080323 | controller | 2025-12-04 12:05:15.080615 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:15.080726 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.048) 0:00:08.864 ***** 2025-12-04 12:05:15.115402 | controller | ok: [instance] 2025-12-04 12:05:15.115591 | controller | 2025-12-04 12:05:15.115676 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:15.115863 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.035) 0:00:08.900 ***** 2025-12-04 12:05:15.191488 | controller | ok: [instance] 2025-12-04 12:05:15.191607 | controller | 2025-12-04 12:05:15.191862 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:15.192043 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.075) 0:00:08.976 ***** 2025-12-04 12:05:15.267547 | controller | ok: [instance] => 2025-12-04 12:05:15.267758 | controller | msg: 'Running: Allocate same volume twice' 2025-12-04 12:05:15.267908 | controller | 2025-12-04 12:05:15.268083 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:15.268406 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.074) 0:00:09.050 ***** 2025-12-04 12:05:15.357931 | controller | 2025-12-04 12:05:15.358066 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:15.358220 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.091) 0:00:09.142 ***** 2025-12-04 12:05:15.453495 | controller | ok: [instance] 2025-12-04 12:05:15.453612 | controller | 2025-12-04 12:05:15.453847 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:15.454202 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.091) 0:00:09.233 ***** 2025-12-04 12:05:15.601074 | controller | ok: [instance] 2025-12-04 12:05:15.601180 | controller | 2025-12-04 12:05:15.601353 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:15.601501 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.150) 0:00:09.384 ***** 2025-12-04 12:05:15.700450 | controller | ok: [instance] 2025-12-04 12:05:15.700572 | controller | 2025-12-04 12:05:15.700867 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:15.701092 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.099) 0:00:09.484 ***** 2025-12-04 12:05:15.765834 | controller | skipping: [instance] 2025-12-04 12:05:15.766015 | controller | 2025-12-04 12:05:15.766313 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:15.766424 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.061) 0:00:09.546 ***** 2025-12-04 12:05:15.827072 | controller | skipping: [instance] 2025-12-04 12:05:15.827243 | controller | 2025-12-04 12:05:15.827500 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:05:15.827676 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.065) 0:00:09.611 ***** 2025-12-04 12:05:15.881436 | controller | ok: [instance] 2025-12-04 12:05:15.881574 | controller | 2025-12-04 12:05:15.881695 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:05:15.881938 | controller | Thursday 04 December 2025 12:05:15 +0000 (0:00:00.054) 0:00:09.666 ***** 2025-12-04 12:05:16.010640 | controller | skipping: [instance] 2025-12-04 12:05:16.010854 | controller | 2025-12-04 12:05:16.011086 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:05:16.011228 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.128) 0:00:09.795 ***** 2025-12-04 12:05:16.085025 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:16.085256 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-12-04 12:05:16.085452 | controller | evaluated_to: false 2025-12-04 12:05:16.085620 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' 2025-12-04 12:05:16.115197 | controller | 2025-12-04 12:05:16.115449 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:16.115663 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.086) 0:00:09.881 ***** 2025-12-04 12:05:16.115791 | controller | 2025-12-04 12:05:16.115954 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:16.116112 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.017) 0:00:09.899 ***** 2025-12-04 12:05:16.147985 | controller | ok: [instance] 2025-12-04 12:05:16.148170 | controller | 2025-12-04 12:05:16.148352 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:16.148505 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.033) 0:00:09.932 ***** 2025-12-04 12:05:16.185738 | controller | skipping: [instance] 2025-12-04 12:05:16.185951 | controller | 2025-12-04 12:05:16.186178 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:16.186388 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.038) 0:00:09.970 ***** 2025-12-04 12:05:16.221401 | controller | skipping: [instance] 2025-12-04 12:05:16.221598 | controller | 2025-12-04 12:05:16.221736 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:16.222012 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.035) 0:00:10.006 ***** 2025-12-04 12:05:16.263192 | controller | skipping: [instance] 2025-12-04 12:05:16.263399 | controller | 2025-12-04 12:05:16.263647 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:16.263813 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.041) 0:00:10.047 ***** 2025-12-04 12:05:16.297535 | controller | ok: [instance] 2025-12-04 12:05:16.297690 | controller | 2025-12-04 12:05:16.297859 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:16.298078 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.034) 0:00:10.082 ***** 2025-12-04 12:05:16.330176 | controller | ok: [instance] 2025-12-04 12:05:16.330416 | controller | 2025-12-04 12:05:16.330607 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:16.330858 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.032) 0:00:10.115 ***** 2025-12-04 12:05:16.365595 | controller | ok: [instance] => 2025-12-04 12:05:16.365848 | controller | msg: 'Running: Allocate same volume twice - no LVMS' 2025-12-04 12:05:16.366066 | controller | 2025-12-04 12:05:16.366209 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:16.366485 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.035) 0:00:10.150 ***** 2025-12-04 12:05:16.421593 | controller | 2025-12-04 12:05:16.421915 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:16.422130 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.056) 0:00:10.206 ***** 2025-12-04 12:05:16.509971 | controller | ok: [instance] 2025-12-04 12:05:16.510158 | controller | 2025-12-04 12:05:16.510385 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:16.510527 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.083) 0:00:10.290 ***** 2025-12-04 12:05:16.563861 | controller | ok: [instance] 2025-12-04 12:05:16.564010 | controller | 2025-12-04 12:05:16.564172 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:16.564355 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.058) 0:00:10.348 ***** 2025-12-04 12:05:16.659751 | controller | ok: [instance] 2025-12-04 12:05:16.659942 | controller | 2025-12-04 12:05:16.660133 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:16.660431 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.095) 0:00:10.444 ***** 2025-12-04 12:05:16.711479 | controller | skipping: [instance] 2025-12-04 12:05:16.711701 | controller | 2025-12-04 12:05:16.711917 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:16.712350 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.052) 0:00:10.496 ***** 2025-12-04 12:05:16.763990 | controller | skipping: [instance] 2025-12-04 12:05:16.764180 | controller | 2025-12-04 12:05:16.764409 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:05:16.764630 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.052) 0:00:10.548 ***** 2025-12-04 12:05:16.821293 | controller | ok: [instance] 2025-12-04 12:05:16.821484 | controller | 2025-12-04 12:05:16.821693 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:05:16.822022 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.057) 0:00:10.605 ***** 2025-12-04 12:05:16.882391 | controller | skipping: [instance] 2025-12-04 12:05:16.882695 | controller | 2025-12-04 12:05:16.882894 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:05:16.883136 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.060) 0:00:10.666 ***** 2025-12-04 12:05:16.962538 | controller | ok: [instance] 2025-12-04 12:05:16.962731 | controller | 2025-12-04 12:05:16.962941 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:05:16.963097 | controller | Thursday 04 December 2025 12:05:16 +0000 (0:00:00.075) 0:00:10.742 ***** 2025-12-04 12:05:17.034629 | controller | skipping: [instance] 2025-12-04 12:05:17.034745 | controller | 2025-12-04 12:05:17.034998 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:05:17.035144 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.072) 0:00:10.815 ***** 2025-12-04 12:05:17.133499 | controller | ok: [instance] => changed=false 2025-12-04 12:05:17.133693 | controller | msg: All assertions passed 2025-12-04 12:05:17.133985 | controller | 2025-12-04 12:05:17.134016 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:05:17.134342 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.098) 0:00:10.914 ***** 2025-12-04 12:05:17.319098 | controller | ok: [instance] => changed=false 2025-12-04 12:05:17.319148 | controller | msg: All assertions passed 2025-12-04 12:05:17.319266 | controller | 2025-12-04 12:05:17.319425 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:17.319656 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.188) 0:00:11.102 ***** 2025-12-04 12:05:17.367113 | controller | skipping: [instance] 2025-12-04 12:05:17.367256 | controller | 2025-12-04 12:05:17.367468 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:17.367620 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.049) 0:00:11.152 ***** 2025-12-04 12:05:17.407016 | controller | skipping: [instance] 2025-12-04 12:05:17.407290 | controller | 2025-12-04 12:05:17.407539 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:17.407739 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.039) 0:00:11.191 ***** 2025-12-04 12:05:17.451748 | controller | skipping: [instance] 2025-12-04 12:05:17.451904 | controller | 2025-12-04 12:05:17.452026 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:17.452172 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.044) 0:00:11.236 ***** 2025-12-04 12:05:17.482325 | controller | ok: [instance] 2025-12-04 12:05:17.482494 | controller | 2025-12-04 12:05:17.482751 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:17.483040 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.029) 0:00:11.266 ***** 2025-12-04 12:05:17.519264 | controller | ok: [instance] 2025-12-04 12:05:17.519420 | controller | 2025-12-04 12:05:17.519600 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:17.519791 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.037) 0:00:11.303 ***** 2025-12-04 12:05:17.575353 | controller | ok: [instance] => 2025-12-04 12:05:17.575536 | controller | msg: 'Running: Allocate same volume twice - no cinder_lvm' 2025-12-04 12:05:17.575694 | controller | 2025-12-04 12:05:17.575849 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:17.576118 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.056) 0:00:11.360 ***** 2025-12-04 12:05:17.635811 | controller | 2025-12-04 12:05:17.636011 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:17.636290 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.060) 0:00:11.420 ***** 2025-12-04 12:05:17.708106 | controller | ok: [instance] 2025-12-04 12:05:17.708225 | controller | 2025-12-04 12:05:17.708419 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:17.708579 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.072) 0:00:11.492 ***** 2025-12-04 12:05:17.765951 | controller | ok: [instance] 2025-12-04 12:05:17.766055 | controller | 2025-12-04 12:05:17.766198 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:17.766465 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.057) 0:00:11.550 ***** 2025-12-04 12:05:17.846605 | controller | ok: [instance] 2025-12-04 12:05:17.846699 | controller | 2025-12-04 12:05:17.846873 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:17.847077 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.080) 0:00:11.631 ***** 2025-12-04 12:05:17.891442 | controller | skipping: [instance] 2025-12-04 12:05:17.891630 | controller | 2025-12-04 12:05:17.891809 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:17.891963 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.044) 0:00:11.676 ***** 2025-12-04 12:05:17.945891 | controller | skipping: [instance] 2025-12-04 12:05:17.946055 | controller | 2025-12-04 12:05:17.946187 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:05:17.946396 | controller | Thursday 04 December 2025 12:05:17 +0000 (0:00:00.054) 0:00:11.730 ***** 2025-12-04 12:05:18.004673 | controller | ok: [instance] 2025-12-04 12:05:18.004804 | controller | 2025-12-04 12:05:18.004990 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:05:18.005151 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.059) 0:00:11.789 ***** 2025-12-04 12:05:18.055496 | controller | skipping: [instance] 2025-12-04 12:05:18.055719 | controller | 2025-12-04 12:05:18.055881 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:05:18.055981 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.050) 0:00:11.840 ***** 2025-12-04 12:05:18.151817 | controller | ok: [instance] 2025-12-04 12:05:18.151966 | controller | 2025-12-04 12:05:18.152146 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:05:18.152302 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.092) 0:00:11.932 ***** 2025-12-04 12:05:18.207765 | controller | skipping: [instance] 2025-12-04 12:05:18.208035 | controller | 2025-12-04 12:05:18.208188 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:05:18.208378 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.059) 0:00:11.992 ***** 2025-12-04 12:05:18.295152 | controller | ok: [instance] => changed=false 2025-12-04 12:05:18.295216 | controller | msg: All assertions passed 2025-12-04 12:05:18.295333 | controller | 2025-12-04 12:05:18.295576 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:05:18.373329 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.083) 0:00:12.076 ***** 2025-12-04 12:05:18.373363 | controller | skipping: [instance] 2025-12-04 12:05:18.373513 | controller | 2025-12-04 12:05:18.373663 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:18.373782 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.081) 0:00:12.157 ***** 2025-12-04 12:05:18.473691 | controller | skipping: [instance] 2025-12-04 12:05:18.473804 | controller | 2025-12-04 12:05:18.474146 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:18.474396 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.100) 0:00:12.257 ***** 2025-12-04 12:05:18.523504 | controller | skipping: [instance] 2025-12-04 12:05:18.523686 | controller | 2025-12-04 12:05:18.523853 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:18.523985 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.047) 0:00:12.305 ***** 2025-12-04 12:05:18.576171 | controller | skipping: [instance] 2025-12-04 12:05:18.576367 | controller | 2025-12-04 12:05:18.576512 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:18.576681 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.055) 0:00:12.361 ***** 2025-12-04 12:05:18.609871 | controller | ok: [instance] 2025-12-04 12:05:18.609985 | controller | 2025-12-04 12:05:18.610086 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:18.610188 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.033) 0:00:12.394 ***** 2025-12-04 12:05:18.650039 | controller | ok: [instance] 2025-12-04 12:05:18.650187 | controller | 2025-12-04 12:05:18.650309 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:18.650417 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.035) 0:00:12.430 ***** 2025-12-04 12:05:18.690470 | controller | ok: [instance] => 2025-12-04 12:05:18.690719 | controller | msg: 'Running: Config overrides via devscripts' 2025-12-04 12:05:18.690847 | controller | 2025-12-04 12:05:18.691031 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:18.691237 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.044) 0:00:12.475 ***** 2025-12-04 12:05:18.740876 | controller | 2025-12-04 12:05:18.741355 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:18.811032 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.050) 0:00:12.525 ***** 2025-12-04 12:05:18.811303 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:18.841141 | controller | assertion: cifmw_devscripts_config.master_memory is undefined 2025-12-04 12:05:18.841164 | controller | evaluated_to: false 2025-12-04 12:05:18.841174 | controller | msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' 2025-12-04 12:05:18.841191 | controller | 2025-12-04 12:05:18.876100 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:18.876139 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.080) 0:00:12.606 ***** 2025-12-04 12:05:18.876147 | controller | 2025-12-04 12:05:18.876164 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:18.876170 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.018) 0:00:12.625 ***** 2025-12-04 12:05:18.876179 | controller | ok: [instance] 2025-12-04 12:05:18.933184 | controller | 2025-12-04 12:05:18.933226 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:18.933236 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.035) 0:00:12.660 ***** 2025-12-04 12:05:18.933246 | controller | skipping: [instance] 2025-12-04 12:05:18.988986 | controller | 2025-12-04 12:05:18.989123 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:18.989155 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.056) 0:00:12.716 ***** 2025-12-04 12:05:18.989172 | controller | skipping: [instance] 2025-12-04 12:05:18.989450 | controller | 2025-12-04 12:05:18.989761 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:18.990121 | controller | Thursday 04 December 2025 12:05:18 +0000 (0:00:00.050) 0:00:12.767 ***** 2025-12-04 12:05:19.042749 | controller | skipping: [instance] 2025-12-04 12:05:19.043205 | controller | 2025-12-04 12:05:19.043476 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:19.043819 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.055) 0:00:12.823 ***** 2025-12-04 12:05:19.071478 | controller | ok: [instance] 2025-12-04 12:05:19.071640 | controller | 2025-12-04 12:05:19.071821 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:19.072058 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.032) 0:00:12.856 ***** 2025-12-04 12:05:19.127752 | controller | ok: [instance] 2025-12-04 12:05:19.128114 | controller | 2025-12-04 12:05:19.128351 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:19.128614 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.052) 0:00:12.909 ***** 2025-12-04 12:05:19.165107 | controller | ok: [instance] => 2025-12-04 12:05:19.165430 | controller | msg: 'Running: Inject 10 dev-scripts extra_worker' 2025-12-04 12:05:19.165709 | controller | 2025-12-04 12:05:19.165957 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:19.166190 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.040) 0:00:12.949 ***** 2025-12-04 12:05:19.212170 | controller | 2025-12-04 12:05:19.212549 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:19.212750 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.046) 0:00:12.996 ***** 2025-12-04 12:05:19.301821 | controller | ok: [instance] 2025-12-04 12:05:19.302120 | controller | 2025-12-04 12:05:19.302136 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:19.343580 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.089) 0:00:13.085 ***** 2025-12-04 12:05:19.343665 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:05:19.372134 | controller | assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 2025-12-04 12:05:19.372178 | controller | evaluated_to: false 2025-12-04 12:05:19.372197 | controller | msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' 2025-12-04 12:05:19.372210 | controller | 2025-12-04 12:05:19.400161 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:05:19.400201 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.052) 0:00:13.138 ***** 2025-12-04 12:05:19.400208 | controller | 2025-12-04 12:05:19.400214 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:19.400220 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.016) 0:00:13.155 ***** 2025-12-04 12:05:19.400231 | controller | ok: [instance] 2025-12-04 12:05:19.496508 | controller | 2025-12-04 12:05:19.496608 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:19.496619 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.026) 0:00:13.181 ***** 2025-12-04 12:05:19.496633 | controller | skipping: [instance] 2025-12-04 12:05:19.496815 | controller | 2025-12-04 12:05:19.497023 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:19.497186 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.091) 0:00:13.273 ***** 2025-12-04 12:05:19.540555 | controller | skipping: [instance] 2025-12-04 12:05:19.540782 | controller | 2025-12-04 12:05:19.541053 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:19.541226 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.051) 0:00:13.325 ***** 2025-12-04 12:05:19.590857 | controller | skipping: [instance] 2025-12-04 12:05:19.591131 | controller | 2025-12-04 12:05:19.591364 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:05:19.591597 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.050) 0:00:13.375 ***** 2025-12-04 12:05:19.632610 | controller | ok: [instance] 2025-12-04 12:05:19.632770 | controller | 2025-12-04 12:05:19.632932 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:05:19.633076 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.037) 0:00:13.413 ***** 2025-12-04 12:05:19.674761 | controller | ok: [instance] 2025-12-04 12:05:19.675016 | controller | 2025-12-04 12:05:19.675264 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:05:19.675491 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.046) 0:00:13.459 ***** 2025-12-04 12:05:19.724887 | controller | ok: [instance] => 2025-12-04 12:05:19.725088 | controller | msg: 'Running: Inject 0 dev-scripts extra_worker' 2025-12-04 12:05:19.725234 | controller | 2025-12-04 12:05:19.725403 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:05:19.725562 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.050) 0:00:13.510 ***** 2025-12-04 12:05:19.790787 | controller | 2025-12-04 12:05:19.791875 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:05:19.792072 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.063) 0:00:13.573 ***** 2025-12-04 12:05:19.878775 | controller | ok: [instance] 2025-12-04 12:05:19.878975 | controller | 2025-12-04 12:05:19.879166 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:05:19.879398 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.089) 0:00:13.663 ***** 2025-12-04 12:05:19.934020 | controller | ok: [instance] 2025-12-04 12:05:19.934203 | controller | 2025-12-04 12:05:19.934508 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:05:19.934701 | controller | Thursday 04 December 2025 12:05:19 +0000 (0:00:00.055) 0:00:13.718 ***** 2025-12-04 12:05:20.026768 | controller | ok: [instance] 2025-12-04 12:05:20.069918 | controller | 2025-12-04 12:05:20.069945 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:05:20.069953 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.089) 0:00:13.808 ***** 2025-12-04 12:05:20.069964 | controller | skipping: [instance] 2025-12-04 12:05:20.160589 | controller | 2025-12-04 12:05:20.168375 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:05:20.168389 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.045) 0:00:13.854 ***** 2025-12-04 12:05:20.168401 | controller | ok: [instance] 2025-12-04 12:05:20.210538 | controller | 2025-12-04 12:05:20.210560 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:05:20.210569 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.090) 0:00:13.944 ***** 2025-12-04 12:05:20.210579 | controller | skipping: [instance] 2025-12-04 12:05:20.210728 | controller | 2025-12-04 12:05:20.210891 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:05:20.211035 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.050) 0:00:13.995 ***** 2025-12-04 12:05:20.295788 | controller | skipping: [instance] 2025-12-04 12:05:20.295993 | controller | 2025-12-04 12:05:20.296192 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:05:20.296445 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.072) 0:00:14.067 ***** 2025-12-04 12:05:20.337780 | controller | skipping: [instance] 2025-12-04 12:05:20.337993 | controller | 2025-12-04 12:05:20.338181 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:05:20.338406 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.054) 0:00:14.122 ***** 2025-12-04 12:05:20.404265 | controller | skipping: [instance] 2025-12-04 12:05:20.404697 | controller | 2025-12-04 12:05:20.404972 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:05:20.405179 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.066) 0:00:14.189 ***** 2025-12-04 12:05:20.457595 | controller | skipping: [instance] 2025-12-04 12:05:20.457777 | controller | 2025-12-04 12:05:20.458061 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:05:20.458262 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.053) 0:00:14.242 ***** 2025-12-04 12:05:20.525612 | controller | skipping: [instance] 2025-12-04 12:05:20.525819 | controller | 2025-12-04 12:05:20.526035 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:05:20.526255 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.067) 0:00:14.310 ***** 2025-12-04 12:05:20.572092 | controller | skipping: [instance] 2025-12-04 12:05:20.572392 | controller | 2025-12-04 12:05:20.572674 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:05:20.572958 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.045) 0:00:14.355 ***** 2025-12-04 12:05:20.612574 | controller | skipping: [instance] 2025-12-04 12:05:20.612839 | controller | 2025-12-04 12:05:20.613110 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:05:20.613344 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.041) 0:00:14.397 ***** 2025-12-04 12:05:20.693413 | controller | skipping: [instance] 2025-12-04 12:05:20.693644 | controller | 2025-12-04 12:05:20.693935 | controller | TASK [Fail if needed] ********************************************************** 2025-12-04 12:05:20.694142 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.080) 0:00:14.478 ***** 2025-12-04 12:05:20.766554 | controller | skipping: [instance] 2025-12-04 12:05:20.766733 | controller | 2025-12-04 12:05:20.766917 | controller | PLAY RECAP ********************************************************************* 2025-12-04 12:05:20.770419 | controller | instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 2025-12-04 12:05:20.770694 | controller | 2025-12-04 12:05:20.770879 | controller | Thursday 04 December 2025 12:05:20 +0000 (0:00:00.072) 0:00:14.550 ***** 2025-12-04 12:05:20.771079 | controller | =============================================================================== 2025-12-04 12:05:20.771287 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.24s 2025-12-04 12:05:20.771573 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.19s 2025-12-04 12:05:20.771761 | controller | reproducer : Ensure same amount of disks are created -------------------- 0.17s 2025-12-04 12:05:20.771940 | controller | Test no volumes --------------------------------------------------------- 0.16s 2025-12-04 12:05:20.772152 | controller | reproducer : Ensure we don't try to create extra_workers ---------------- 0.15s 2025-12-04 12:05:20.772471 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.15s 2025-12-04 12:05:20.772887 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.14s 2025-12-04 12:05:20.772975 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.14s 2025-12-04 12:05:20.773181 | controller | Mark failure ------------------------------------------------------------ 0.14s 2025-12-04 12:05:20.773404 | controller | Mark run as failed ------------------------------------------------------ 0.13s 2025-12-04 12:05:20.773558 | controller | reproducer : Ensure same amount of disks are created -------------------- 0.13s 2025-12-04 12:05:20.773697 | controller | reproducer : Ensure we get disk_size ------------------------------------ 0.13s 2025-12-04 12:05:20.773879 | controller | reproducer : Ensure we don't try to create extra_workers ---------------- 0.12s 2025-12-04 12:05:20.774117 | controller | Mark failure ------------------------------------------------------------ 0.11s 2025-12-04 12:05:20.774305 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.11s 2025-12-04 12:05:20.774511 | controller | reproducer : Ensure no allocation overlap ------------------------------- 0.11s 2025-12-04 12:05:20.774654 | controller | reproducer : Ensure we get required data in the layout description ------ 0.11s 2025-12-04 12:05:20.774880 | controller | reproducer : Ensure we don't set some parameters when no extra disks ---- 0.11s 2025-12-04 12:05:20.775060 | controller | reproducer : Ensure we get required data in the layout description ------ 0.10s 2025-12-04 12:05:20.775368 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.10s 2025-12-04 12:05:20.850849 | controller | INFO Running ocp_validations > cleanup 2025-12-04 12:05:20.851797 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 12:05:20.853132 | controller | INFO Writing /tmp/report.html report. 2025-12-04 12:05:21.092813 | [controller] Waiting on logger 2025-12-04 12:05:26.280054 | [controller] Waiting on logger 2025-12-04 12:05:36.712179 | [controller] Waiting on logger 2025-12-04 12:05:46.092512 | [controller] Waiting on logger 2025-12-04 12:05:51.063428 | [Zuul] Log Stream did not terminate 2025-12-04 12:05:51.063644 | controller | changed 2025-12-04 12:05:51.125021 | 2025-12-04 12:05:51.125098 | PLAY RECAP 2025-12-04 12:05:51.125138 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-04 12:05:51.125161 | 2025-12-04 12:05:51.183532 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-04 12:05:51.184334 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-04 12:05:51.683105 | 2025-12-04 12:05:51.683200 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-12-04 12:05:51.702375 | 2025-12-04 12:05:51.702453 | TASK [Filter out host if needed] 2025-12-04 12:05:51.710572 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-12-04 12:05:51.714942 | 2025-12-04 12:05:51.715008 | TASK [Ensure file is present] 2025-12-04 12:05:52.281366 | controller | ok 2025-12-04 12:05:52.286891 | 2025-12-04 12:05:52.286956 | TASK [Manage molecule report file] 2025-12-04 12:05:52.306636 | [controller] Waiting on logger 2025-12-04 12:06:01.672254 | [controller] Waiting on logger 2025-12-04 12:06:12.104316 | [controller] Waiting on logger 2025-12-04 12:06:21.448178 | [controller] Waiting on logger 2025-12-04 12:06:22.770594 | [Zuul] Log Stream did not terminate 2025-12-04 12:06:22.770814 | controller | changed 2025-12-04 12:06:22.776042 | 2025-12-04 12:06:22.776102 | TASK [Check if we get ci-framework-data basedir] 2025-12-04 12:06:23.229994 | controller | ok 2025-12-04 12:06:23.235051 | 2025-12-04 12:06:23.235113 | TASK [Create ci-framework-data log directory for zuul] 2025-12-04 12:06:23.699700 | controller | changed 2025-12-04 12:06:23.705706 | 2025-12-04 12:06:23.705807 | TASK [Copy ci-framework interesting files] 2025-12-04 12:06:23.729252 | [controller] Waiting on logger 2025-12-04 12:06:40.264390 | [controller] Waiting on logger 2025-12-04 12:06:50.696213 | [controller] Waiting on logger 2025-12-04 12:06:54.092186 | [Zuul] Log Stream did not terminate 2025-12-04 12:06:54.092501 | controller | changed 2025-12-04 12:06:54.097854 | 2025-12-04 12:06:54.097919 | TASK [Get SELinux listing] 2025-12-04 12:06:54.116640 | [controller] Waiting on logger 2025-12-04 12:07:07.272514 | [controller] Waiting on logger 2025-12-04 12:07:13.800211 | [controller] Waiting on logger 2025-12-04 12:07:24.865898 | [Zuul] Log Stream did not terminate 2025-12-04 12:07:24.866122 | controller | changed 2025-12-04 12:07:24.871854 | 2025-12-04 12:07:24.871915 | TASK [Generate log index] 2025-12-04 12:07:26.567030 | controller | changed 2025-12-04 12:07:26.572018 | 2025-12-04 12:07:26.572083 | TASK [Get some env related data] 2025-12-04 12:07:26.591854 | [controller] Waiting on logger 2025-12-04 12:07:37.032220 | [controller] Waiting on logger 2025-12-04 12:07:46.376328 | [controller] Waiting on logger 2025-12-04 12:07:56.808226 | [controller] Waiting on logger 2025-12-04 12:07:58.305509 | [Zuul] Log Stream did not terminate 2025-12-04 12:07:58.305687 | controller | changed 2025-12-04 12:07:58.310630 | 2025-12-04 12:07:58.310708 | TASK [Generate list of logs to collect in home directory] 2025-12-04 12:07:58.683458 | controller | ok: All paths examined 2025-12-04 12:07:58.688802 | 2025-12-04 12:07:58.688868 | LOOP [Copy logs from home directory] 2025-12-04 12:07:59.309629 | controller | changed: 2025-12-04 12:07:59.309833 | controller | { 2025-12-04 12:07:59.309862 | controller | "atime": 1763989167.9348345, 2025-12-04 12:07:59.309882 | controller | "ctime": 1763990251.6129293, 2025-12-04 12:07:59.309901 | controller | "dev": 64513, 2025-12-04 12:07:59.309922 | controller | "gid": 1000, 2025-12-04 12:07:59.309940 | controller | "gr_name": "zuul", 2025-12-04 12:07:59.309956 | controller | "inode": 5131423, 2025-12-04 12:07:59.309971 | controller | "isblk": false, 2025-12-04 12:07:59.309988 | controller | "ischr": false, 2025-12-04 12:07:59.310003 | controller | "isdir": false, 2025-12-04 12:07:59.310017 | controller | "isfifo": false, 2025-12-04 12:07:59.310032 | controller | "isgid": false, 2025-12-04 12:07:59.310049 | controller | "islnk": false, 2025-12-04 12:07:59.310064 | controller | "isreg": true, 2025-12-04 12:07:59.310079 | controller | "issock": false, 2025-12-04 12:07:59.310093 | controller | "isuid": false, 2025-12-04 12:07:59.310108 | controller | "mode": "0644", 2025-12-04 12:07:59.310123 | controller | "mtime": 1763990251.6129293, 2025-12-04 12:07:59.310137 | controller | "nlink": 1, 2025-12-04 12:07:59.310152 | controller | "path": "/home/zuul/crc-setup.log", 2025-12-04 12:07:59.310167 | controller | "pw_name": "zuul", 2025-12-04 12:07:59.310182 | controller | "rgrp": true, 2025-12-04 12:07:59.310196 | controller | "roth": true, 2025-12-04 12:07:59.310210 | controller | "rusr": true, 2025-12-04 12:07:59.310223 | controller | "size": 4108, 2025-12-04 12:07:59.310237 | controller | "uid": 1000, 2025-12-04 12:07:59.310250 | controller | "wgrp": false, 2025-12-04 12:07:59.310262 | controller | "woth": false, 2025-12-04 12:07:59.310275 | controller | "wusr": true, 2025-12-04 12:07:59.310288 | controller | "xgrp": false, 2025-12-04 12:07:59.310301 | controller | "xoth": false, 2025-12-04 12:07:59.310314 | controller | "xusr": false 2025-12-04 12:07:59.310327 | controller | } 2025-12-04 12:07:59.917073 | controller | changed: 2025-12-04 12:07:59.917157 | controller | { 2025-12-04 12:07:59.917183 | controller | "atime": 1763990253.7119775, 2025-12-04 12:07:59.917202 | controller | "ctime": 1763991032.5164254, 2025-12-04 12:07:59.917219 | controller | "dev": 64513, 2025-12-04 12:07:59.917234 | controller | "gid": 1000, 2025-12-04 12:07:59.917249 | controller | "gr_name": "zuul", 2025-12-04 12:07:59.917264 | controller | "inode": 5131425, 2025-12-04 12:07:59.917278 | controller | "isblk": false, 2025-12-04 12:07:59.917302 | controller | "ischr": false, 2025-12-04 12:07:59.917318 | controller | "isdir": false, 2025-12-04 12:07:59.917331 | controller | "isfifo": false, 2025-12-04 12:07:59.917346 | controller | "isgid": false, 2025-12-04 12:07:59.917359 | controller | "islnk": false, 2025-12-04 12:07:59.917372 | controller | "isreg": true, 2025-12-04 12:07:59.917385 | controller | "issock": false, 2025-12-04 12:07:59.917398 | controller | "isuid": false, 2025-12-04 12:07:59.917449 | controller | "mode": "0644", 2025-12-04 12:07:59.917466 | controller | "mtime": 1763991032.5164254, 2025-12-04 12:07:59.917480 | controller | "nlink": 1, 2025-12-04 12:07:59.917514 | controller | "path": "/home/zuul/crc-start.log", 2025-12-04 12:07:59.917529 | controller | "pw_name": "zuul", 2025-12-04 12:07:59.917543 | controller | "rgrp": true, 2025-12-04 12:07:59.917557 | controller | "roth": true, 2025-12-04 12:07:59.917570 | controller | "rusr": true, 2025-12-04 12:07:59.917583 | controller | "size": 4428, 2025-12-04 12:07:59.917596 | controller | "uid": 1000, 2025-12-04 12:07:59.917609 | controller | "wgrp": false, 2025-12-04 12:07:59.917622 | controller | "woth": false, 2025-12-04 12:07:59.917636 | controller | "wusr": true, 2025-12-04 12:07:59.917649 | controller | "xgrp": false, 2025-12-04 12:07:59.917682 | controller | "xoth": false, 2025-12-04 12:07:59.917698 | controller | "xusr": false 2025-12-04 12:07:59.917716 | controller | } 2025-12-04 12:08:00.524344 | controller | changed: 2025-12-04 12:08:00.524429 | controller | { 2025-12-04 12:08:00.524453 | controller | "atime": 1764849314.202156, 2025-12-04 12:08:00.524472 | controller | "ctime": 1764849331.153359, 2025-12-04 12:08:00.524487 | controller | "dev": 64513, 2025-12-04 12:08:00.524516 | controller | "gid": 1000, 2025-12-04 12:08:00.524533 | controller | "gr_name": "zuul", 2025-12-04 12:08:00.524548 | controller | "inode": 4751296, 2025-12-04 12:08:00.524565 | controller | "isblk": false, 2025-12-04 12:08:00.524580 | controller | "ischr": false, 2025-12-04 12:08:00.524594 | controller | "isdir": false, 2025-12-04 12:08:00.524607 | controller | "isfifo": false, 2025-12-04 12:08:00.524620 | controller | "isgid": false, 2025-12-04 12:08:00.524634 | controller | "islnk": false, 2025-12-04 12:08:00.524646 | controller | "isreg": true, 2025-12-04 12:08:00.524682 | controller | "issock": false, 2025-12-04 12:08:00.524697 | controller | "isuid": false, 2025-12-04 12:08:00.524711 | controller | "mode": "0644", 2025-12-04 12:08:00.524724 | controller | "mtime": 1764849331.153359, 2025-12-04 12:08:00.524737 | controller | "nlink": 1, 2025-12-04 12:08:00.524750 | controller | "path": "/home/zuul/ansible.log", 2025-12-04 12:08:00.524763 | controller | "pw_name": "zuul", 2025-12-04 12:08:00.524777 | controller | "rgrp": true, 2025-12-04 12:08:00.524790 | controller | "roth": true, 2025-12-04 12:08:00.524803 | controller | "rusr": true, 2025-12-04 12:08:00.524816 | controller | "size": 6749, 2025-12-04 12:08:00.524829 | controller | "uid": 1000, 2025-12-04 12:08:00.524842 | controller | "wgrp": false, 2025-12-04 12:08:00.524854 | controller | "woth": false, 2025-12-04 12:08:00.524867 | controller | "wusr": true, 2025-12-04 12:08:00.524879 | controller | "xgrp": false, 2025-12-04 12:08:00.524892 | controller | "xoth": false, 2025-12-04 12:08:00.524904 | controller | "xusr": false 2025-12-04 12:08:00.524917 | controller | } 2025-12-04 12:08:00.532794 | 2025-12-04 12:08:00.532859 | TASK [Copy crio stats log file] 2025-12-04 12:08:00.546461 | controller | skipping: Conditional result was False 2025-12-04 12:08:00.551534 | 2025-12-04 12:08:00.551597 | TASK [Get SELinux related data] 2025-12-04 12:08:03.656469 | [controller] Waiting on logger 2025-12-04 12:08:11.336233 | [controller] Waiting on logger 2025-12-04 12:08:22.280224 | [controller] Waiting on logger 2025-12-04 12:08:30.891449 | [Zuul] Log Stream did not terminate 2025-12-04 12:08:30.891727 | controller | ERROR 2025-12-04 12:08:30.891841 | controller | { 2025-12-04 12:08:30.891875 | controller | "delta": "0:00:00.014366", 2025-12-04 12:08:30.891899 | controller | "end": "2025-12-04 12:08:00.862037", 2025-12-04 12:08:30.891920 | controller | "msg": "non-zero return code", 2025-12-04 12:08:30.891936 | controller | "rc": 1, 2025-12-04 12:08:30.891950 | controller | "start": "2025-12-04 12:08:00.847671" 2025-12-04 12:08:30.891964 | controller | } 2025-12-04 12:08:30.891983 | controller | ERROR: Ignoring Errors 2025-12-04 12:08:30.896711 | 2025-12-04 12:08:30.896767 | TASK [Create system configuration directory] 2025-12-04 12:08:31.159129 | controller | changed 2025-12-04 12:08:31.163733 | 2025-12-04 12:08:31.163794 | TASK [Get some of the system configurations] 2025-12-04 12:08:31.186681 | [controller] Waiting on logger 2025-12-04 12:08:41.992316 | [controller] Waiting on logger 2025-12-04 12:08:44.987714 | controller | changed 2025-12-04 12:08:44.992893 | 2025-12-04 12:08:44.992956 | TASK [Copy generated documentation if available] 2025-12-04 12:08:45.006030 | controller | skipping: Conditional result was False 2025-12-04 12:08:45.010673 | 2025-12-04 12:08:45.010730 | TASK [Copy generated AsciiDoc documentation if available] 2025-12-04 12:08:45.023018 | controller | skipping: Conditional result was False 2025-12-04 12:08:45.027588 | 2025-12-04 12:08:45.027645 | TASK [Compress logs bigger than 2MB] 2025-12-04 12:08:48.136249 | [controller] Waiting on logger 2025-12-04 12:08:58.568412 | [controller] Waiting on logger 2025-12-04 12:09:09.000201 | [controller] Waiting on logger 2025-12-04 12:09:15.317619 | [Zuul] Log Stream did not terminate 2025-12-04 12:09:15.317887 | controller | changed 2025-12-04 12:09:15.323083 | 2025-12-04 12:09:15.323143 | TASK [Copy files from workspace on node] 2025-12-04 12:09:15.340724 | controller | ok 2025-12-04 12:09:15.360527 | 2025-12-04 12:09:15.360598 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-04 12:09:15.373853 | controller | skipping: Conditional result was False 2025-12-04 12:09:15.378909 | 2025-12-04 12:09:15.378971 | TASK [fetch-output : Set log path for single node] 2025-12-04 12:09:15.405795 | controller | ok 2025-12-04 12:09:15.410210 | 2025-12-04 12:09:15.410270 | LOOP [fetch-output : Ensure local output dirs] 2025-12-04 12:09:15.588835 | controller -> localhost | ok: "/var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/logs" 2025-12-04 12:09:15.589084 | controller -> localhost | changed: All items complete 2025-12-04 12:09:15.589114 | 2025-12-04 12:09:15.746966 | controller -> localhost | changed: "/var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/artifacts" 2025-12-04 12:09:15.908327 | controller -> localhost | changed: "/var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/docs" 2025-12-04 12:09:15.917230 | 2025-12-04 12:09:15.917322 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-04 12:09:16.551929 | controller | changed: 2025-12-04 12:09:16.552089 | controller | .d..t...... ./ 2025-12-04 12:09:16.552119 | controller | >f+++++++++ README.html 2025-12-04 12:09:16.552141 | controller | >f+++++++++ ansible-execution.log 2025-12-04 12:09:16.552162 | controller | >f+++++++++ ansible.log 2025-12-04 12:09:16.552181 | controller | >f+++++++++ crc-setup.log 2025-12-04 12:09:16.552198 | controller | >f+++++++++ crc-start.log 2025-12-04 12:09:16.552215 | controller | >f+++++++++ dmesg.log 2025-12-04 12:09:16.552231 | controller | >f+++++++++ installed-pkgs.log 2025-12-04 12:09:16.552248 | controller | >f+++++++++ python.log 2025-12-04 12:09:16.552264 | controller | >f+++++++++ registries.conf 2025-12-04 12:09:16.552279 | controller | >f+++++++++ report.html 2025-12-04 12:09:16.552295 | controller | >f+++++++++ selinux-denials.log 2025-12-04 12:09:16.552311 | controller | >f+++++++++ selinux-listing.log 2025-12-04 12:09:16.552327 | controller | cd+++++++++ ci-framework-data/ 2025-12-04 12:09:16.552343 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-12-04 12:09:16.552359 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-12-04 12:09:16.552376 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-12-04 12:09:16.552393 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-12-04 12:09:16.552410 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-12-04 12:09:16.552426 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-12-04 12:09:16.552442 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-12-04 12:09:16.552459 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-12-04 12:09:16.552475 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-12-04 12:09:16.552491 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-12-04 12:09:16.552507 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-12-04 12:09:16.552522 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-12-04 12:09:16.552537 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-12-04 12:09:16.552565 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-12-04 12:09:16.552582 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:2a:3b:cc 2025-12-04 12:09:16.552597 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:22:1a:9a 2025-12-04 12:09:16.552619 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:fc:b1:08 2025-12-04 12:09:16.552636 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:9f:fc:b1 2025-12-04 12:09:16.552668 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:a5:cd:1f 2025-12-04 12:09:16.552694 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:42:57:23 2025-12-04 12:09:16.552713 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-12-04 12:09:16.552730 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-12-04 12:09:16.552746 | controller | cd+++++++++ ci-framework-data/logs/ 2025-12-04 12:09:16.552762 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-12-04 12:09:16.552778 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-12-04 12:09:16.552793 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-12-04 12:09:16.552809 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-12-04 12:09:16.552824 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-12-04 12:09:16.552839 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-12-04 12:09:16.552857 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-12-04 12:09:16.552874 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2025-12-04 12:09:16.552890 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2025-12-04 12:09:16.552906 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2025-12-04 12:09:16.552921 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2025-12-04 12:09:16.552938 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2025-12-04 12:09:16.552954 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2025-12-04 12:09:16.552970 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2025-12-04 12:09:16.552987 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2025-12-04 12:09:16.553003 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2025-12-04 12:09:16.553018 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2025-12-04 12:09:16.553033 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2025-12-04 12:09:16.553048 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2025-12-04 12:09:16.553064 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2025-12-04 12:09:16.553079 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2025-12-04 12:09:16.553094 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2025-12-04 12:09:16.553109 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-12-04 12:09:16.553127 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-12-04 12:09:16.553144 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-12-04 12:09:16.553159 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-12-04 12:09:16.553174 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2025-12-04 12:09:16.553189 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-12-04 12:09:16.553204 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-12-04 12:09:16.553219 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-12-04 12:09:16.553234 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-12-04 12:09:16.553249 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-12-04 12:09:16.553266 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-12-04 12:09:16.553282 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-12-04 12:09:16.553298 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2025-12-04 12:09:16.553313 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-12-04 12:09:16.553329 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-12-04 12:09:16.553344 | controller | cd+++++++++ registries.conf.d/ 2025-12-04 12:09:16.553360 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-12-04 12:09:16.553375 | controller | cd+++++++++ system-config/ 2025-12-04 12:09:16.553390 | controller | cd+++++++++ system-config/libvirt/ 2025-12-04 12:09:16.553405 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-12-04 12:09:16.553420 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-12-04 12:09:16.553435 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-12-04 12:09:16.553450 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-12-04 12:09:16.553465 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-12-04 12:09:16.553481 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-12-04 12:09:16.553497 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-12-04 12:09:16.553513 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-12-04 12:09:16.553529 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-12-04 12:09:16.553552 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-12-04 12:09:16.553570 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-12-04 12:09:16.553585 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-12-04 12:09:16.553600 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-12-04 12:09:16.553615 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-12-04 12:09:16.553629 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-12-04 12:09:16.553644 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-12-04 12:09:17.004576 | controller | changed: .d..t...... ./ 2025-12-04 12:09:17.444943 | controller | changed: .d..t...... ./ 2025-12-04 12:09:17.460538 | 2025-12-04 12:09:17.460640 | TASK [Return artifact to Zuul] 2025-12-04 12:09:17.488864 | controller | ok 2025-12-04 12:09:17.506845 | 2025-12-04 12:09:17.506898 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-12-04 12:09:17.506988 | 2025-12-04 12:09:17.507014 | PLAY RECAP 2025-12-04 12:09:17.507050 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-12-04 12:09:17.507076 | 2025-12-04 12:09:17.576265 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-04 12:09:17.576967 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-04 12:09:18.044413 | 2025-12-04 12:09:18.044510 | PLAY [all] 2025-12-04 12:09:18.063450 | 2025-12-04 12:09:18.063522 | TASK [include_role : fetch-output] 2025-12-04 12:09:18.092083 | controller | ok 2025-12-04 12:09:18.107785 | 2025-12-04 12:09:18.107860 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-04 12:09:18.161861 | controller | skipping: Conditional result was False 2025-12-04 12:09:18.167536 | 2025-12-04 12:09:18.167616 | TASK [fetch-output : Set log path for single node] 2025-12-04 12:09:18.207255 | controller | ok 2025-12-04 12:09:18.212086 | 2025-12-04 12:09:18.212156 | LOOP [fetch-output : Ensure local output dirs] 2025-12-04 12:09:18.537025 | controller -> localhost | ok: "/var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/logs" 2025-12-04 12:09:18.708465 | controller -> localhost | ok: "/var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/artifacts" 2025-12-04 12:09:18.883718 | controller -> localhost | ok: "/var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/docs" 2025-12-04 12:09:18.893220 | 2025-12-04 12:09:18.893323 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-04 12:09:19.494430 | controller | ok 2025-12-04 12:09:19.494795 | controller | ok: All items complete 2025-12-04 12:09:19.494841 | 2025-12-04 12:09:19.935477 | controller | ok 2025-12-04 12:09:20.396160 | controller | ok 2025-12-04 12:09:20.416781 | 2025-12-04 12:09:20.416897 | TASK [include_role : fetch-output-openshift] 2025-12-04 12:09:20.431370 | controller | skipping: Conditional result was False 2025-12-04 12:09:20.436927 | 2025-12-04 12:09:20.436994 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-12-04 12:09:20.794218 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.007047 2025-12-04 12:09:20.982067 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.007424 2025-12-04 12:09:21.010977 | 2025-12-04 12:09:21.011071 | PLAY [all] 2025-12-04 12:09:21.024044 | 2025-12-04 12:09:21.024108 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-12-04 12:09:21.571398 | controller | changed 2025-12-04 12:09:21.591407 | 2025-12-04 12:09:21.591465 | PLAY RECAP 2025-12-04 12:09:21.591515 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-12-04 12:09:21.591536 | 2025-12-04 12:09:21.677112 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-04 12:09:21.677852 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-12-04 12:09:22.196258 | 2025-12-04 12:09:22.196383 | PLAY [localhost] 2025-12-04 12:09:22.214094 | 2025-12-04 12:09:22.214170 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-12-04 12:09:22.548028 | localhost | changed 2025-12-04 12:09:22.552832 | 2025-12-04 12:09:22.552930 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-12-04 12:09:22.582131 | localhost | ok 2025-12-04 12:09:22.589473 | 2025-12-04 12:09:22.589541 | TASK [add-fileserver : Create SSH private key tempfile] 2025-12-04 12:09:22.880723 | localhost | changed 2025-12-04 12:09:22.886722 | 2025-12-04 12:09:22.886796 | TASK [add-fileserver : Create SSH private key from secret] 2025-12-04 12:09:23.422681 | localhost | changed 2025-12-04 12:09:23.427830 | 2025-12-04 12:09:23.427905 | TASK [add-fileserver : Add fileserver ssh key] 2025-12-04 12:09:23.752315 | localhost | Identity added: /var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/tmp/ansible.0uuur7gx (/var/lib/zuul/builds/0eb1bc396fbe48c99260d746275559ee/work/tmp/ansible.0uuur7gx) 2025-12-04 12:09:23.752504 | localhost | ok: Runtime: 0:00:00.007929 2025-12-04 12:09:23.756634 | 2025-12-04 12:09:23.756716 | TASK [add-fileserver : Remove SSH private key from disk] 2025-12-04 12:09:23.968636 | localhost | ok: Runtime: 0:00:00.005460 2025-12-04 12:09:23.973491 | 2025-12-04 12:09:23.973587 | TASK [add-fileserver : Add fileserver to inventory] 2025-12-04 12:09:24.022640 | localhost | changed 2025-12-04 12:09:24.027828 | 2025-12-04 12:09:24.027902 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-12-04 12:09:24.329317 | localhost | changed 2025-12-04 12:09:24.348482 | 2025-12-04 12:09:24.348540 | PLAY [localhost] 2025-12-04 12:09:24.359729 | 2025-12-04 12:09:24.359792 | TASK [Generate bulk log download script] 2025-12-04 12:09:24.379047 | localhost | ok 2025-12-04 12:09:24.390149 | 2025-12-04 12:09:24.390218 | TASK [local-log-download : Check API endpoint is defined] 2025-12-04 12:09:24.418125 | localhost | ok: All assertions passed 2025-12-04 12:09:24.422465 | 2025-12-04 12:09:24.422531 | TASK [local-log-download : Create download script] 2025-12-04 12:09:24.750993 | localhost -> localhost | changed 2025-12-04 12:09:24.759864 | 2025-12-04 12:09:24.759931 | TASK [Register quick-download link] 2025-12-04 12:09:24.777580 | localhost | ok 2025-12-04 12:09:24.814200 | 2025-12-04 12:09:24.814286 | PLAY [logserver.rdoproject.org] 2025-12-04 12:09:24.824099 | 2025-12-04 12:09:24.824161 | TASK [Set zuul-log-path fact] 2025-12-04 12:09:24.841576 | logserver.rdoproject.org | ok 2025-12-04 12:09:24.850723 | 2025-12-04 12:09:24.850790 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-04 12:09:24.878930 | logserver.rdoproject.org | ok 2025-12-04 12:09:24.884252 | 2025-12-04 12:09:24.884319 | TASK [upload-logs : Create log directories] 2025-12-04 12:09:26.656698 | logserver.rdoproject.org | changed 2025-12-04 12:09:26.659695 | 2025-12-04 12:09:26.659762 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-12-04 12:09:26.877874 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005280 2025-12-04 12:09:26.882926 | 2025-12-04 12:09:26.883014 | TASK [upload-logs : Upload logs to log server] 2025-12-04 12:09:28.319628 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-12-04 12:09:28.322500 | 2025-12-04 12:09:28.322578 | LOOP [upload-logs : Compress console log and json output] 2025-12-04 12:09:28.369523 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 12:09:28.377219 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 12:09:28.381519 | 2025-12-04 12:09:28.381618 | LOOP [upload-logs : Upload compressed console log and json output] 2025-12-04 12:09:28.422016 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 12:09:28.422249 | 2025-12-04 12:09:28.424952 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 12:09:28.430497 | 2025-12-04 12:09:28.430594 | LOOP [upload-logs : Upload console log and json output]