2025-11-24 08:37:56.264908 | Job console starting... 2025-11-24 08:37:56.545313 | Updating repositories 2025-11-24 08:37:57.255984 | Preparing job workspace 2025-11-24 08:38:07.712591 | Running Ansible setup... 2025-11-24 08:38:12.884291 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-11-24 08:38:13.665932 | 2025-11-24 08:38:13.666108 | PLAY [localhost] 2025-11-24 08:38:13.676311 | 2025-11-24 08:38:13.676410 | TASK [Gathering Facts] 2025-11-24 08:38:14.892152 | localhost | ok 2025-11-24 08:38:14.909806 | 2025-11-24 08:38:14.909902 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-11-24 08:38:15.269870 | localhost -> localhost | changed 2025-11-24 08:38:15.275654 | 2025-11-24 08:38:15.275729 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-11-24 08:38:16.122926 | localhost -> localhost | changed 2025-11-24 08:38:16.132231 | 2025-11-24 08:38:16.132325 | TASK [Setup log path fact] 2025-11-24 08:38:16.168223 | localhost | ok 2025-11-24 08:38:16.203164 | 2025-11-24 08:38:16.203243 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-11-24 08:38:16.240681 | localhost | ok 2025-11-24 08:38:16.256958 | 2025-11-24 08:38:16.257047 | TASK [emit-job-header : Print job information] 2025-11-24 08:38:16.334693 | # Job Information 2025-11-24 08:38:16.334913 | Ansible Version: 2.15.12 2025-11-24 08:38:16.334943 | Job: cifmw-molecule-reproducer 2025-11-24 08:38:16.334965 | Pipeline: github-check 2025-11-24 08:38:16.334997 | Executor: ibm-bm3-ze.softwarefactory-project.io 2025-11-24 08:38:16.335019 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3451 2025-11-24 08:38:16.335038 | Log URL (when completed): https://logserver.rdoproject.org/2f2/rdoproject.org/2f211890a52f4c8593fc0ced0988b7a8/ 2025-11-24 08:38:16.335057 | Event ID: 2dae9040-c910-11f0-818a-433f9d14d6bc 2025-11-24 08:38:16.342133 | 2025-11-24 08:38:16.342207 | LOOP [emit-job-header : Print node information] 2025-11-24 08:38:16.510035 | localhost | ok: 2025-11-24 08:38:16.510259 | localhost | # Node Information 2025-11-24 08:38:16.510290 | localhost | Inventory Hostname: controller 2025-11-24 08:38:16.510314 | localhost | Hostname: np0005533220 2025-11-24 08:38:16.510334 | localhost | Username: zuul 2025-11-24 08:38:16.510470 | localhost | Distro: CentOS 9 2025-11-24 08:38:16.510498 | localhost | Provider: ibm-bm3-nodepool 2025-11-24 08:38:16.510517 | localhost | Region: regionOne 2025-11-24 08:38:16.510535 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-11-24 08:38:16.510552 | localhost | Product Name: OpenStack Compute 2025-11-24 08:38:16.510569 | localhost | Interface IP: 192.168.25.123 2025-11-24 08:38:16.538107 | 2025-11-24 08:38:16.538227 | PLAY [all] 2025-11-24 08:38:16.544727 | 2025-11-24 08:38:16.544792 | TASK [Gather network facts] 2025-11-24 08:38:17.050691 | controller | ok 2025-11-24 08:38:17.067122 | 2025-11-24 08:38:17.067202 | TASK [include_role : start-zuul-console] 2025-11-24 08:38:17.101165 | controller | ok 2025-11-24 08:38:17.112812 | 2025-11-24 08:38:17.112877 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-11-24 08:38:17.627826 | controller | ok 2025-11-24 08:38:17.651328 | 2025-11-24 08:38:17.651424 | TASK [include_role : add-build-sshkey] 2025-11-24 08:38:17.683882 | controller | ok 2025-11-24 08:38:17.717408 | 2025-11-24 08:38:17.717494 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-11-24 08:38:18.098779 | controller -> localhost | ok 2025-11-24 08:38:18.104674 | 2025-11-24 08:38:18.104753 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-11-24 08:38:18.134796 | controller | ok 2025-11-24 08:38:18.170153 | controller | included: /var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-11-24 08:38:18.190371 | 2025-11-24 08:38:18.190508 | TASK [add-build-sshkey : Create Temp SSH key] 2025-11-24 08:38:18.990969 | controller -> localhost | Generating public/private rsa key pair. 2025-11-24 08:38:18.991206 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/2f211890a52f4c8593fc0ced0988b7a8_id_rsa. 2025-11-24 08:38:18.991240 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/2f211890a52f4c8593fc0ced0988b7a8_id_rsa.pub. 2025-11-24 08:38:18.991265 | controller -> localhost | The key fingerprint is: 2025-11-24 08:38:18.991287 | controller -> localhost | SHA256:l1ZtReBfGzDvEJGe4JVwzcYkZFR6j1b8wcVST5ts+os zuul-build-sshkey 2025-11-24 08:38:18.991308 | controller -> localhost | The key's randomart image is: 2025-11-24 08:38:18.991328 | controller -> localhost | +---[RSA 3072]----+ 2025-11-24 08:38:18.991347 | controller -> localhost | | .+@@B*| 2025-11-24 08:38:18.991368 | controller -> localhost | | .o*@O*| 2025-11-24 08:38:18.991600 | controller -> localhost | | . =o*%=| 2025-11-24 08:38:18.991637 | controller -> localhost | | + +*+B| 2025-11-24 08:38:18.991661 | controller -> localhost | | S + .oo+| 2025-11-24 08:38:18.991682 | controller -> localhost | | o .. | 2025-11-24 08:38:18.991701 | controller -> localhost | | . | 2025-11-24 08:38:18.991721 | controller -> localhost | | . .| 2025-11-24 08:38:18.991741 | controller -> localhost | | E . | 2025-11-24 08:38:18.991761 | controller -> localhost | +----[SHA256]-----+ 2025-11-24 08:38:18.991815 | controller -> localhost | ok: Runtime: 0:00:00.238448 2025-11-24 08:38:19.000900 | 2025-11-24 08:38:19.000965 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-11-24 08:38:19.044826 | controller | ok 2025-11-24 08:38:19.061031 | controller | included: /var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-11-24 08:38:19.070334 | 2025-11-24 08:38:19.070418 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-11-24 08:38:19.093992 | controller | skipping: Conditional result was False 2025-11-24 08:38:19.099236 | 2025-11-24 08:38:19.099302 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-11-24 08:38:19.608586 | controller | changed 2025-11-24 08:38:19.616828 | 2025-11-24 08:38:19.616900 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-11-24 08:38:19.876854 | controller | ok 2025-11-24 08:38:19.882144 | 2025-11-24 08:38:19.882210 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-11-24 08:38:20.969541 | controller | changed 2025-11-24 08:38:20.974451 | 2025-11-24 08:38:20.974514 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-11-24 08:38:22.137686 | controller | changed 2025-11-24 08:38:22.143177 | 2025-11-24 08:38:22.143243 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-11-24 08:38:22.172138 | controller | skipping: Conditional result was False 2025-11-24 08:38:22.177843 | 2025-11-24 08:38:22.177910 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-11-24 08:38:22.714718 | controller -> localhost | changed 2025-11-24 08:38:22.726842 | 2025-11-24 08:38:22.726940 | TASK [add-build-sshkey : Add back temp key] 2025-11-24 08:38:22.975458 | controller -> localhost | Identity added: /var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/2f211890a52f4c8593fc0ced0988b7a8_id_rsa (zuul-build-sshkey) 2025-11-24 08:38:22.975692 | controller -> localhost | ok: Runtime: 0:00:00.007880 2025-11-24 08:38:22.982929 | 2025-11-24 08:38:22.983012 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-11-24 08:38:23.399578 | controller | ok 2025-11-24 08:38:23.404935 | 2025-11-24 08:38:23.405014 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-11-24 08:38:23.465920 | controller | skipping: Conditional result was False 2025-11-24 08:38:23.476742 | 2025-11-24 08:38:23.476813 | TASK [include_role : validate-host] 2025-11-24 08:38:23.511346 | controller | ok 2025-11-24 08:38:23.553192 | 2025-11-24 08:38:23.553282 | TASK [validate-host : Define zuul_info_dir fact] 2025-11-24 08:38:23.632307 | controller | ok 2025-11-24 08:38:23.637459 | 2025-11-24 08:38:23.637522 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-11-24 08:38:24.047990 | controller -> localhost | ok 2025-11-24 08:38:24.054044 | 2025-11-24 08:38:24.054108 | TASK [validate-host : Collect information about the host] 2025-11-24 08:38:24.715984 | controller | ok 2025-11-24 08:38:24.727559 | 2025-11-24 08:38:24.727716 | TASK [validate-host : Sanitize hostname] 2025-11-24 08:38:24.777964 | controller | ok 2025-11-24 08:38:24.786862 | 2025-11-24 08:38:24.786953 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-11-24 08:38:25.246562 | controller -> localhost | changed 2025-11-24 08:38:25.253055 | 2025-11-24 08:38:25.253124 | TASK [validate-host : Collect information about zuul worker] 2025-11-24 08:38:25.702427 | controller | ok 2025-11-24 08:38:25.708776 | 2025-11-24 08:38:25.708920 | TASK [validate-host : Write out all zuul information for each host] 2025-11-24 08:38:26.138271 | controller -> localhost | changed 2025-11-24 08:38:26.147803 | 2025-11-24 08:38:26.147868 | TASK [include_role : prepare-workspace-openshift] 2025-11-24 08:38:26.174280 | controller | skipping: Conditional result was False 2025-11-24 08:38:26.180189 | 2025-11-24 08:38:26.180257 | TASK [include_role : remove-zuul-sshkey] 2025-11-24 08:38:26.208091 | controller | skipping: Conditional result was False 2025-11-24 08:38:26.214709 | 2025-11-24 08:38:26.214789 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-11-24 08:38:26.492405 | controller | ok: "logs" 2025-11-24 08:38:26.492644 | controller | ok: All items complete 2025-11-24 08:38:26.492674 | 2025-11-24 08:38:26.718552 | controller | ok: "artifacts" 2025-11-24 08:38:26.955724 | controller | ok: "docs" 2025-11-24 08:38:26.967101 | 2025-11-24 08:38:26.967268 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-11-24 08:38:27.236678 | controller | changed: "logs" 2025-11-24 08:38:27.466972 | controller | changed: "artifacts" 2025-11-24 08:38:27.707168 | controller | changed: "docs" 2025-11-24 08:38:27.754335 | 2025-11-24 08:38:27.754449 | PLAY RECAP 2025-11-24 08:38:27.754495 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-11-24 08:38:27.754524 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-11-24 08:38:27.754542 | 2025-11-24 08:38:27.928617 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-11-24 08:38:27.929415 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-11-24 08:38:28.678446 | 2025-11-24 08:38:28.678545 | PLAY [all] 2025-11-24 08:38:28.711427 | 2025-11-24 08:38:28.711507 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-11-24 08:38:28.790588 | controller | ok 2025-11-24 08:38:28.802294 | 2025-11-24 08:38:28.802398 | TASK [mirror-info-fork : Create /etc/ci] 2025-11-24 08:38:29.203643 | controller | changed 2025-11-24 08:38:29.209127 | 2025-11-24 08:38:29.209202 | TASK [mirror-info-fork : Install ci_mirror script] 2025-11-24 08:38:30.502746 | controller | changed 2025-11-24 08:38:30.514127 | 2025-11-24 08:38:30.514197 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-11-24 08:38:30.988519 | controller | changed: 2025-11-24 08:38:30.989969 | controller | { 2025-11-24 08:38:30.990042 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-11-24 08:38:30.990079 | controller | } 2025-11-24 08:38:31.272543 | controller | changed: 2025-11-24 08:38:31.272644 | controller | { 2025-11-24 08:38:31.272677 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-11-24 08:38:31.272701 | controller | } 2025-11-24 08:38:31.542356 | controller | changed: 2025-11-24 08:38:31.542524 | controller | { 2025-11-24 08:38:31.542561 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-11-24 08:38:31.542588 | controller | } 2025-11-24 08:38:31.820318 | controller | changed: 2025-11-24 08:38:31.820435 | controller | { 2025-11-24 08:38:31.820465 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-11-24 08:38:31.820486 | controller | } 2025-11-24 08:38:32.092899 | controller | changed: 2025-11-24 08:38:32.093027 | controller | { 2025-11-24 08:38:32.093060 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-11-24 08:38:32.093082 | controller | } 2025-11-24 08:38:32.366487 | controller | changed: 2025-11-24 08:38:32.366653 | controller | { 2025-11-24 08:38:32.366682 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-11-24 08:38:32.366704 | controller | } 2025-11-24 08:38:32.645045 | controller | changed: 2025-11-24 08:38:32.645166 | controller | { 2025-11-24 08:38:32.645226 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-11-24 08:38:32.645250 | controller | } 2025-11-24 08:38:32.944087 | controller | changed: 2025-11-24 08:38:32.944222 | controller | { 2025-11-24 08:38:32.944251 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-11-24 08:38:32.944273 | controller | } 2025-11-24 08:38:33.247794 | controller | changed: 2025-11-24 08:38:33.247944 | controller | { 2025-11-24 08:38:33.247997 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-11-24 08:38:33.248023 | controller | } 2025-11-24 08:38:33.557018 | controller | changed: 2025-11-24 08:38:33.557148 | controller | { 2025-11-24 08:38:33.557176 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-11-24 08:38:33.557197 | controller | } 2025-11-24 08:38:33.806751 | controller | changed: 2025-11-24 08:38:33.806894 | controller | { 2025-11-24 08:38:33.806925 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-11-24 08:38:33.806947 | controller | } 2025-11-24 08:38:34.086326 | controller | changed: 2025-11-24 08:38:34.086456 | controller | { 2025-11-24 08:38:34.086485 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-11-24 08:38:34.086513 | controller | } 2025-11-24 08:38:34.362203 | controller | changed: 2025-11-24 08:38:34.362284 | controller | { 2025-11-24 08:38:34.362311 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-11-24 08:38:34.362333 | controller | } 2025-11-24 08:38:34.648937 | controller | changed: 2025-11-24 08:38:34.649166 | controller | { 2025-11-24 08:38:34.649207 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-11-24 08:38:34.649231 | controller | } 2025-11-24 08:38:34.939856 | controller | changed: 2025-11-24 08:38:34.939944 | controller | { 2025-11-24 08:38:34.939971 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-11-24 08:38:34.940005 | controller | } 2025-11-24 08:38:35.228631 | controller | changed: 2025-11-24 08:38:35.228782 | controller | { 2025-11-24 08:38:35.228816 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-11-24 08:38:35.228839 | controller | } 2025-11-24 08:38:35.511185 | controller | changed: 2025-11-24 08:38:35.511272 | controller | { 2025-11-24 08:38:35.511298 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-11-24 08:38:35.511319 | controller | } 2025-11-24 08:38:35.792246 | controller | changed: 2025-11-24 08:38:35.792329 | controller | { 2025-11-24 08:38:35.792357 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-11-24 08:38:35.792406 | controller | } 2025-11-24 08:38:36.085904 | controller | changed: 2025-11-24 08:38:36.086012 | controller | { 2025-11-24 08:38:36.086048 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-11-24 08:38:36.086075 | controller | } 2025-11-24 08:38:36.373769 | controller | changed: 2025-11-24 08:38:36.373869 | controller | { 2025-11-24 08:38:36.373898 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-11-24 08:38:36.373919 | controller | } 2025-11-24 08:38:36.678085 | controller | changed: 2025-11-24 08:38:36.678269 | controller | { 2025-11-24 08:38:36.678304 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-11-24 08:38:36.678326 | controller | } 2025-11-24 08:38:36.980279 | controller | changed: 2025-11-24 08:38:36.980366 | controller | { 2025-11-24 08:38:36.980422 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-11-24 08:38:36.980447 | controller | } 2025-11-24 08:38:37.279216 | controller | changed: 2025-11-24 08:38:37.279329 | controller | { 2025-11-24 08:38:37.279356 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-11-24 08:38:37.279377 | controller | } 2025-11-24 08:38:37.597989 | controller | changed: 2025-11-24 08:38:37.598094 | controller | { 2025-11-24 08:38:37.598124 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-11-24 08:38:37.598145 | controller | } 2025-11-24 08:38:37.923352 | controller | changed: 2025-11-24 08:38:37.923453 | controller | { 2025-11-24 08:38:37.923482 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-11-24 08:38:37.923503 | controller | } 2025-11-24 08:38:38.214294 | controller | changed: 2025-11-24 08:38:38.214374 | controller | { 2025-11-24 08:38:38.214427 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-11-24 08:38:38.214453 | controller | } 2025-11-24 08:38:38.238118 | 2025-11-24 08:38:38.238186 | TASK [Set timezone to UTC] 2025-11-24 08:38:38.758449 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-11-24 08:38:38.763810 | 2025-11-24 08:38:38.763903 | TASK [Create nodepool directory] 2025-11-24 08:38:39.059643 | controller | changed 2025-11-24 08:38:39.065455 | 2025-11-24 08:38:39.065538 | TASK [Create nodepool sub_nodes file] 2025-11-24 08:38:40.038588 | controller | changed 2025-11-24 08:38:40.043886 | 2025-11-24 08:38:40.043962 | TASK [Create nodepool sub_nodes_private file] 2025-11-24 08:38:41.040305 | controller | changed 2025-11-24 08:38:41.045365 | 2025-11-24 08:38:41.045488 | LOOP [Populate nodepool sub_nodes file] 2025-11-24 08:38:41.074690 | 2025-11-24 08:38:41.074844 | LOOP [Populate nodepool sub_nodes_private file] 2025-11-24 08:38:41.105032 | 2025-11-24 08:38:41.105206 | TASK [Create nodepool primary file] 2025-11-24 08:38:41.129118 | controller | skipping: Conditional result was False 2025-11-24 08:38:41.134600 | 2025-11-24 08:38:41.134700 | TASK [Create nodepool node_private for this node] 2025-11-24 08:38:42.128516 | controller | changed 2025-11-24 08:38:42.134485 | 2025-11-24 08:38:42.134554 | LOOP [Copy ssh keys to nodepool directory] 2025-11-24 08:38:42.613675 | controller | ok: Item: id_rsa Runtime: 0:00:00.004501 2025-11-24 08:38:42.613870 | 2025-11-24 08:38:42.845488 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004982 2025-11-24 08:38:42.858071 | 2025-11-24 08:38:42.858209 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-11-24 08:38:43.847616 | controller | changed 2025-11-24 08:38:43.852699 | 2025-11-24 08:38:43.852766 | TASK [Validate sudoers config after edits] 2025-11-24 08:38:44.108634 | controller | /etc/sudoers: parsed OK 2025-11-24 08:38:44.108716 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-11-24 08:38:44.108727 | controller | /etc/sudoers.d/zuul: parsed OK 2025-11-24 08:38:44.108733 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-11-24 08:38:44.379503 | controller | ok: Runtime: 0:00:00.004878 2025-11-24 08:38:44.385552 | 2025-11-24 08:38:44.385637 | TASK [Show the environment passed in to job shell scripts] 2025-11-24 08:38:44.624025 | controller | SHELL=/bin/bash 2025-11-24 08:38:44.624090 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-11-24 08:38:44.624158 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-11-24 08:38:44.624172 | controller | ZUUL_CHANGES=rdo-jobs:master:refs/changes/88/58488/1^openstack-k8s-operators/ci-framework:main:refs/changes/51/3451/9e962b797235f287fc3e87d5e76ab3a88eb03cd8 2025-11-24 08:38:44.624181 | controller | PWD=/home/zuul 2025-11-24 08:38:44.624187 | controller | ZUUL_PIPELINE=github-check 2025-11-24 08:38:44.624192 | controller | LOGNAME=zuul 2025-11-24 08:38:44.624197 | controller | XDG_SESSION_TYPE=tty 2025-11-24 08:38:44.624203 | controller | _=/usr/bin/env 2025-11-24 08:38:44.624208 | controller | MOTD_SHOWN=pam 2025-11-24 08:38:44.624213 | controller | HOME=/home/zuul 2025-11-24 08:38:44.624218 | controller | LANG=en_US.UTF-8 2025-11-24 08:38:44.624224 | controller | SSH_CONNECTION=192.168.25.12 39182 192.168.25.123 22 2025-11-24 08:38:44.624229 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-11-24 08:38:44.624236 | controller | ZUUL_CHANGE_IDS=58488,1 3451,9e962b797235f287fc3e87d5e76ab3a88eb03cd8 2025-11-24 08:38:44.624241 | controller | WORKSPACE=/home/zuul/workspace 2025-11-24 08:38:44.624247 | controller | XDG_SESSION_CLASS=user 2025-11-24 08:38:44.624253 | controller | SELINUX_ROLE_REQUESTED= 2025-11-24 08:38:44.624258 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-11-24 08:38:44.624263 | controller | USER=zuul 2025-11-24 08:38:44.624268 | controller | ZUUL_VOTING=True 2025-11-24 08:38:44.624273 | controller | BUILD_TIMEOUT=5400000 2025-11-24 08:38:44.624279 | controller | SELINUX_USE_CURRENT_RANGE= 2025-11-24 08:38:44.624284 | controller | SHLVL=1 2025-11-24 08:38:44.624289 | controller | ZUUL_PATCHSET=9e962b797235f287fc3e87d5e76ab3a88eb03cd8 2025-11-24 08:38:44.624295 | controller | XDG_SESSION_ID=1 2025-11-24 08:38:44.624300 | controller | ZUUL_BRANCH=main 2025-11-24 08:38:44.624306 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-11-24 08:38:44.624311 | controller | SSH_CLIENT=192.168.25.12 39182 22 2025-11-24 08:38:44.624317 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-11-24 08:38:44.624322 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-11-24 08:38:44.624327 | controller | which_declare=declare -f 2025-11-24 08:38:44.624333 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-11-24 08:38:44.624339 | controller | SELINUX_LEVEL_REQUESTED= 2025-11-24 08:38:44.624344 | controller | ZUUL_CHANGE=3451 2025-11-24 08:38:44.624349 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-11-24 08:38:44.624354 | controller | ZUUL_UUID=2f211890a52f4c8593fc0ced0988b7a8 2025-11-24 08:38:44.624359 | controller | BASH_FUNC_which%%=() { ( alias; 2025-11-24 08:38:44.624364 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-11-24 08:38:44.624370 | controller | } 2025-11-24 08:38:44.915730 | controller | ok: Runtime: 0:00:00.006437 2025-11-24 08:38:44.921544 | 2025-11-24 08:38:44.921630 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-11-24 08:38:44.935276 | controller | skipping: Conditional result was False 2025-11-24 08:38:44.941026 | 2025-11-24 08:38:44.941101 | TASK [Symlink /home/zuul-worker/workspace] 2025-11-24 08:38:45.490658 | controller | skipping: Conditional result was False 2025-11-24 08:38:45.496685 | 2025-11-24 08:38:45.496760 | TASK [Ensure legacy workspace directory] 2025-11-24 08:38:45.770355 | controller | changed 2025-11-24 08:38:45.800566 | 2025-11-24 08:38:45.800665 | PLAY RECAP 2025-11-24 08:38:45.800721 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-11-24 08:38:45.800747 | 2025-11-24 08:38:45.951173 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-11-24 08:38:45.951974 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-11-24 08:38:46.599268 | 2025-11-24 08:38:46.599365 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-11-24 08:38:46.625428 | 2025-11-24 08:38:46.625503 | TASK [Create zuul-output directory] 2025-11-24 08:38:47.027329 | controller | changed 2025-11-24 08:38:47.033110 | 2025-11-24 08:38:47.033201 | TASK [Slurp Zuul inventory test] 2025-11-24 08:38:47.331444 | controller -> localhost | ok 2025-11-24 08:38:47.338305 | 2025-11-24 08:38:47.338409 | TASK [Save zuul inventory] 2025-11-24 08:38:48.552141 | controller | changed 2025-11-24 08:38:48.559798 | 2025-11-24 08:38:48.559924 | TASK [Save zuul vars without the change_message] 2025-11-24 08:38:49.607971 | controller | changed 2025-11-24 08:38:49.653015 | 2025-11-24 08:38:49.653106 | PLAY RECAP 2025-11-24 08:38:49.653153 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-11-24 08:38:49.653176 | 2025-11-24 08:38:49.812440 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-11-24 08:38:49.813164 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-11-24 08:38:50.516749 | 2025-11-24 08:38:50.516869 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-11-24 08:38:50.537595 | 2025-11-24 08:38:50.537683 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-11-24 08:38:50.555906 | controller | ok 2025-11-24 08:38:50.572430 | 2025-11-24 08:38:50.572515 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-11-24 08:38:50.596216 | controller | skipping: Conditional result was False 2025-11-24 08:38:50.602789 | 2025-11-24 08:38:50.602862 | TASK [mirror-info-fork : Create /etc/ci] 2025-11-24 08:38:50.986854 | controller | ok 2025-11-24 08:38:50.992639 | 2025-11-24 08:38:50.992711 | TASK [mirror-info-fork : Install ci_mirror script] 2025-11-24 08:38:51.914257 | controller | ok 2025-11-24 08:38:51.931308 | 2025-11-24 08:38:51.931375 | TASK [Prepare workspace] 2025-11-24 08:38:51.960037 | controller | ok 2025-11-24 08:38:51.992444 | 2025-11-24 08:38:51.992522 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-11-24 08:38:52.471079 | controller | ok 2025-11-24 08:38:52.477801 | 2025-11-24 08:38:52.477868 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-11-24 08:38:55.951685 | controller | Output suppressed because no_log was given 2025-11-24 08:38:55.973691 | 2025-11-24 08:38:55.973782 | LOOP [Create zuul-output directory] 2025-11-24 08:38:56.226201 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-11-24 08:38:56.443793 | controller | ok: "/home/zuul/zuul-output/logs" 2025-11-24 08:38:56.458339 | 2025-11-24 08:38:56.458428 | TASK [Install required packages] 2025-11-24 08:39:21.448051 | controller | ok: Nothing to do 2025-11-24 08:39:21.456111 | 2025-11-24 08:39:21.456360 | TASK [Install venv] 2025-11-24 08:40:20.116253 | controller | changed 2025-11-24 08:40:20.174074 | 2025-11-24 08:40:20.174199 | PLAY RECAP 2025-11-24 08:40:20.174250 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-11-24 08:40:20.174274 | 2025-11-24 08:40:20.342777 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-11-24 08:40:20.343695 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-11-24 08:40:20.957522 | 2025-11-24 08:40:20.957692 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-11-24 08:40:21.005907 | 2025-11-24 08:40:21.006000 | TASK [Gather required facts] 2025-11-24 08:40:21.624733 | controller | ok 2025-11-24 08:40:21.633700 | 2025-11-24 08:40:21.633784 | TASK [Load environment var if instructed to] 2025-11-24 08:40:21.687525 | controller | skipping: Conditional result was False 2025-11-24 08:40:21.694823 | 2025-11-24 08:40:21.694905 | TASK [Ensure group_vars dir exists] 2025-11-24 08:40:22.156553 | controller | ok 2025-11-24 08:40:22.165033 | 2025-11-24 08:40:22.165112 | TASK [Print related variables] 2025-11-24 08:40:22.195484 | controller | ok: 2025-11-24 08:40:22.195636 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2025-11-24 08:40:22.195666 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2025-11-24 08:40:22.202144 | 2025-11-24 08:40:22.202218 | TASK [Run molecule] 2025-11-24 08:40:23.209208 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-11-24 08:40:23.494236 | controller | INFO Performing prerun with role_name_check=0... 2025-11-24 08:40:39.462901 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.463463 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.463957 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.464471 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.464987 | controller | WARNING Another version of 'cifmw.general' 1.0.0+9e962b79 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+9e962b79 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.465481 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.465953 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.466452 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.466918 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.467420 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.467894 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.468406 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.468876 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.469375 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.469860 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-24 08:40:39.479387 | controller | INFO Running crc_layout > prepare 2025-11-24 08:40:40.194566 | controller | 2025-11-24 08:40:40.194797 | controller | PLAY [Prepare] ***************************************************************** 2025-11-24 08:40:40.194947 | controller | 2025-11-24 08:40:40.195093 | controller | TASK [Gathering Facts] ********************************************************* 2025-11-24 08:40:40.195282 | controller | Monday 24 November 2025 08:40:40 +0000 (0:00:00.019) 0:00:00.019 ******* 2025-11-24 08:40:41.017562 | controller | ok: [instance] 2025-11-24 08:40:41.017616 | controller | 2025-11-24 08:40:41.017701 | controller | TASK [Create custom basedir] *************************************************** 2025-11-24 08:40:41.017808 | controller | Monday 24 November 2025 08:40:41 +0000 (0:00:00.823) 0:00:00.843 ******* 2025-11-24 08:40:41.322631 | controller | changed: [instance] 2025-11-24 08:40:41.322684 | controller | 2025-11-24 08:40:41.322792 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-11-24 08:40:41.322890 | controller | Monday 24 November 2025 08:40:41 +0000 (0:00:00.305) 0:00:01.148 ******* 2025-11-24 08:40:41.340360 | controller | skipping: [instance] 2025-11-24 08:40:41.340472 | controller | 2025-11-24 08:40:41.340614 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-11-24 08:40:41.340738 | controller | Monday 24 November 2025 08:40:41 +0000 (0:00:00.017) 0:00:01.166 ******* 2025-11-24 08:40:41.381545 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-11-24 08:40:41.381661 | controller | 2025-11-24 08:40:41.381789 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-11-24 08:40:41.381893 | controller | Monday 24 November 2025 08:40:41 +0000 (0:00:00.041) 0:00:01.207 ******* 2025-11-24 08:40:41.660745 | controller | ok: [instance] 2025-11-24 08:40:41.660799 | controller | 2025-11-24 08:40:41.660910 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-11-24 08:40:41.661013 | controller | Monday 24 November 2025 08:40:41 +0000 (0:00:00.279) 0:00:01.486 ******* 2025-11-24 08:40:41.869331 | controller | ok: [instance] 2025-11-24 08:40:41.869392 | controller | 2025-11-24 08:40:41.869486 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-11-24 08:40:41.869584 | controller | Monday 24 November 2025 08:40:41 +0000 (0:00:00.208) 0:00:01.694 ******* 2025-11-24 08:40:42.556376 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-11-24 08:40:42.556443 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-11-24 08:40:42.556558 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-11-24 08:40:42.556653 | controller | 2025-11-24 08:40:42.556755 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-11-24 08:40:42.556846 | controller | Monday 24 November 2025 08:40:42 +0000 (0:00:00.686) 0:00:02.381 ******* 2025-11-24 08:40:42.628853 | controller | 2025-11-24 08:40:42.628954 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-11-24 08:40:42.629139 | controller | Monday 24 November 2025 08:40:42 +0000 (0:00:00.072) 0:00:02.454 ******* 2025-11-24 08:40:43.165537 | controller | changed: [instance] => (item=tmp) 2025-11-24 08:40:43.165614 | controller | changed: [instance] => (item=artifacts/repositories) 2025-11-24 08:40:43.165723 | controller | changed: [instance] => (item=venv/repo_setup) 2025-11-24 08:40:43.165821 | controller | 2025-11-24 08:40:43.165920 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-11-24 08:40:43.166011 | controller | Monday 24 November 2025 08:40:43 +0000 (0:00:00.536) 0:00:02.991 ******* 2025-11-24 08:40:43.987950 | controller | ok: [instance] 2025-11-24 08:40:43.988005 | controller | 2025-11-24 08:40:43.988237 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-11-24 08:40:45.041251 | controller | Monday 24 November 2025 08:40:43 +0000 (0:00:00.822) 0:00:03.813 ******* 2025-11-24 08:40:45.041305 | controller | changed: [instance] 2025-11-24 08:40:52.955246 | controller | 2025-11-24 08:40:52.955300 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-11-24 08:40:52.955308 | controller | Monday 24 November 2025 08:40:45 +0000 (0:00:01.053) 0:00:04.866 ******* 2025-11-24 08:40:52.955319 | controller | changed: [instance] 2025-11-24 08:40:52.955337 | controller | 2025-11-24 08:40:52.955584 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-11-24 08:40:53.649658 | controller | Monday 24 November 2025 08:40:52 +0000 (0:00:07.914) 0:00:12.780 ******* 2025-11-24 08:40:53.649696 | controller | changed: [instance] 2025-11-24 08:40:53.670943 | controller | 2025-11-24 08:40:53.670965 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-11-24 08:40:53.670975 | controller | Monday 24 November 2025 08:40:53 +0000 (0:00:00.694) 0:00:13.474 ******* 2025-11-24 08:40:53.670985 | controller | skipping: [instance] 2025-11-24 08:40:54.443974 | controller | 2025-11-24 08:40:54.444004 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-11-24 08:40:54.444012 | controller | Monday 24 November 2025 08:40:53 +0000 (0:00:00.021) 0:00:13.496 ******* 2025-11-24 08:40:54.444022 | controller | changed: [instance] 2025-11-24 08:40:54.487031 | controller | 2025-11-24 08:40:54.487058 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-11-24 08:40:54.487066 | controller | Monday 24 November 2025 08:40:54 +0000 (0:00:00.772) 0:00:14.269 ******* 2025-11-24 08:40:54.487077 | controller | skipping: [instance] 2025-11-24 08:40:54.523774 | controller | 2025-11-24 08:40:54.523796 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-11-24 08:40:54.523805 | controller | Monday 24 November 2025 08:40:54 +0000 (0:00:00.042) 0:00:14.312 ******* 2025-11-24 08:40:54.523816 | controller | skipping: [instance] 2025-11-24 08:40:54.560705 | controller | 2025-11-24 08:40:54.560730 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-11-24 08:40:54.560739 | controller | Monday 24 November 2025 08:40:54 +0000 (0:00:00.037) 0:00:14.349 ******* 2025-11-24 08:40:54.560751 | controller | skipping: [instance] 2025-11-24 08:40:55.095250 | controller | 2025-11-24 08:40:55.095292 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-11-24 08:40:55.095302 | controller | Monday 24 November 2025 08:40:54 +0000 (0:00:00.036) 0:00:14.386 ******* 2025-11-24 08:40:55.095315 | controller | changed: [instance] 2025-11-24 08:40:55.558912 | controller | 2025-11-24 08:40:55.558947 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-11-24 08:40:55.558955 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.534) 0:00:14.920 ******* 2025-11-24 08:40:55.558966 | controller | changed: [instance] 2025-11-24 08:40:55.588959 | controller | 2025-11-24 08:40:55.588985 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-11-24 08:40:55.588994 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.463) 0:00:15.384 ******* 2025-11-24 08:40:55.589004 | controller | skipping: [instance] 2025-11-24 08:40:55.617595 | controller | 2025-11-24 08:40:55.617623 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-11-24 08:40:55.617632 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.030) 0:00:15.414 ******* 2025-11-24 08:40:55.617649 | controller | skipping: [instance] 2025-11-24 08:40:55.658230 | controller | 2025-11-24 08:40:55.658260 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-11-24 08:40:55.658271 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.028) 0:00:15.442 ******* 2025-11-24 08:40:55.658282 | controller | skipping: [instance] 2025-11-24 08:40:55.705865 | controller | 2025-11-24 08:40:55.705887 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-11-24 08:40:55.705897 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.040) 0:00:15.483 ******* 2025-11-24 08:40:55.705907 | controller | ok: [instance] 2025-11-24 08:40:55.737699 | controller | 2025-11-24 08:40:55.737718 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-11-24 08:40:55.737725 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.047) 0:00:15.531 ******* 2025-11-24 08:40:55.737741 | controller | skipping: [instance] 2025-11-24 08:40:55.773849 | controller | 2025-11-24 08:40:55.773872 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-11-24 08:40:55.773881 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.031) 0:00:15.563 ******* 2025-11-24 08:40:55.773891 | controller | skipping: [instance] 2025-11-24 08:40:55.774063 | controller | 2025-11-24 08:40:55.774269 | controller | TASK [Download the RPM] ******************************************************** 2025-11-24 08:40:55.774412 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.036) 0:00:15.599 ******* 2025-11-24 08:40:55.811017 | controller | skipping: [instance] 2025-11-24 08:40:55.811234 | controller | 2025-11-24 08:40:55.811409 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-11-24 08:40:55.811561 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.037) 0:00:15.636 ******* 2025-11-24 08:40:55.846848 | controller | skipping: [instance] 2025-11-24 08:40:55.847029 | controller | 2025-11-24 08:40:55.847235 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-11-24 08:40:55.847410 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.035) 0:00:15.672 ******* 2025-11-24 08:40:55.903826 | controller | skipping: [instance] 2025-11-24 08:40:55.904027 | controller | 2025-11-24 08:40:55.904234 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-11-24 08:40:55.904407 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.056) 0:00:15.729 ******* 2025-11-24 08:40:55.936476 | controller | skipping: [instance] 2025-11-24 08:40:55.936661 | controller | 2025-11-24 08:40:55.936811 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-11-24 08:40:55.936949 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.032) 0:00:15.762 ******* 2025-11-24 08:40:55.965528 | controller | skipping: [instance] 2025-11-24 08:40:55.965714 | controller | 2025-11-24 08:40:55.965858 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-11-24 08:40:55.965995 | controller | Monday 24 November 2025 08:40:55 +0000 (0:00:00.029) 0:00:15.791 ******* 2025-11-24 08:40:56.152202 | controller | ok: [instance] 2025-11-24 08:40:56.152246 | controller | 2025-11-24 08:40:56.152257 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-11-24 08:40:56.152268 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.186) 0:00:15.977 ******* 2025-11-24 08:40:56.371189 | controller | changed: [instance] 2025-11-24 08:40:56.371236 | controller | 2025-11-24 08:40:56.371247 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-11-24 08:40:56.371354 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.219) 0:00:16.196 ******* 2025-11-24 08:40:56.609978 | controller | changed: [instance] 2025-11-24 08:40:56.633194 | controller | 2025-11-24 08:40:56.633227 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-11-24 08:40:56.633236 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.238) 0:00:16.435 ******* 2025-11-24 08:40:56.633247 | controller | skipping: [instance] 2025-11-24 08:40:56.657163 | controller | 2025-11-24 08:40:56.657181 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-11-24 08:40:56.657188 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.023) 0:00:16.458 ******* 2025-11-24 08:40:56.657197 | controller | skipping: [instance] 2025-11-24 08:40:56.678768 | controller | 2025-11-24 08:40:56.678794 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-11-24 08:40:56.678812 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.024) 0:00:16.482 ******* 2025-11-24 08:40:56.678824 | controller | skipping: [instance] 2025-11-24 08:40:56.699826 | controller | 2025-11-24 08:40:56.699853 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-11-24 08:40:56.699862 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.021) 0:00:16.504 ******* 2025-11-24 08:40:56.699874 | controller | skipping: [instance] 2025-11-24 08:40:56.721267 | controller | 2025-11-24 08:40:56.721317 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-11-24 08:40:56.721334 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.021) 0:00:16.525 ******* 2025-11-24 08:40:56.721350 | controller | skipping: [instance] 2025-11-24 08:40:56.721383 | controller | 2025-11-24 08:40:56.721393 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-11-24 08:40:56.721465 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.021) 0:00:16.547 ******* 2025-11-24 08:40:56.742934 | controller | skipping: [instance] 2025-11-24 08:40:56.743142 | controller | 2025-11-24 08:40:56.743302 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-11-24 08:40:56.743437 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.021) 0:00:16.568 ******* 2025-11-24 08:40:56.760575 | controller | skipping: [instance] 2025-11-24 08:40:56.760729 | controller | 2025-11-24 08:40:56.760876 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-11-24 08:40:56.761016 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.017) 0:00:16.586 ******* 2025-11-24 08:40:56.790434 | controller | skipping: [instance] 2025-11-24 08:40:56.790607 | controller | 2025-11-24 08:40:56.790748 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-11-24 08:40:56.790890 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.029) 0:00:16.616 ******* 2025-11-24 08:40:56.807631 | controller | skipping: [instance] 2025-11-24 08:40:56.807771 | controller | 2025-11-24 08:40:56.807908 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-11-24 08:40:56.808042 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.017) 0:00:16.633 ******* 2025-11-24 08:40:56.827613 | controller | skipping: [instance] 2025-11-24 08:40:56.827765 | controller | 2025-11-24 08:40:56.827906 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-11-24 08:40:56.828041 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.019) 0:00:16.653 ******* 2025-11-24 08:40:56.856168 | controller | skipping: [instance] 2025-11-24 08:40:56.856330 | controller | 2025-11-24 08:40:56.856478 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-11-24 08:40:56.856631 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.028) 0:00:16.682 ******* 2025-11-24 08:40:56.887685 | controller | skipping: [instance] 2025-11-24 08:40:56.887904 | controller | 2025-11-24 08:40:56.888086 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-11-24 08:40:56.888290 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.031) 0:00:16.713 ******* 2025-11-24 08:40:56.919153 | controller | skipping: [instance] 2025-11-24 08:40:56.919382 | controller | 2025-11-24 08:40:56.919556 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-11-24 08:40:56.919711 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.031) 0:00:16.744 ******* 2025-11-24 08:40:56.950214 | controller | skipping: [instance] 2025-11-24 08:40:56.950388 | controller | 2025-11-24 08:40:56.950542 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-11-24 08:40:56.950686 | controller | Monday 24 November 2025 08:40:56 +0000 (0:00:00.031) 0:00:16.775 ******* 2025-11-24 08:41:44.916621 | controller | ok: [instance] 2025-11-24 08:41:46.136757 | controller | 2025-11-24 08:41:46.136786 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-11-24 08:41:46.136795 | controller | Monday 24 November 2025 08:41:44 +0000 (0:00:47.966) 0:01:04.742 ******* 2025-11-24 08:41:46.136805 | controller | ok: [instance] 2025-11-24 08:41:46.168174 | controller | 2025-11-24 08:41:46.168193 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-11-24 08:41:46.168200 | controller | Monday 24 November 2025 08:41:46 +0000 (0:00:01.220) 0:01:05.962 ******* 2025-11-24 08:41:46.168210 | controller | skipping: [instance] 2025-11-24 08:41:46.208869 | controller | 2025-11-24 08:41:46.208887 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-11-24 08:41:46.208894 | controller | Monday 24 November 2025 08:41:46 +0000 (0:00:00.031) 0:01:05.993 ******* 2025-11-24 08:41:46.208903 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-11-24 08:41:46.228228 | controller | 2025-11-24 08:41:46.228250 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-11-24 08:41:46.228260 | controller | Monday 24 November 2025 08:41:46 +0000 (0:00:00.040) 0:01:06.034 ******* 2025-11-24 08:41:46.228278 | controller | ok: [instance] => 2025-11-24 08:41:46.228306 | controller | cifmw_ci_setup_packages: 2025-11-24 08:41:46.228314 | controller | - bash-completion 2025-11-24 08:41:46.228320 | controller | - ca-certificates 2025-11-24 08:41:46.228327 | controller | - git-core 2025-11-24 08:41:46.228333 | controller | - make 2025-11-24 08:41:46.228340 | controller | - tar 2025-11-24 08:41:46.228348 | controller | - tmux 2025-11-24 08:41:46.228698 | controller | - python3-pip 2025-11-24 08:41:57.190651 | controller | 2025-11-24 08:41:57.190681 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-11-24 08:41:57.190689 | controller | Monday 24 November 2025 08:41:46 +0000 (0:00:00.018) 0:01:06.053 ******* 2025-11-24 08:41:57.190699 | controller | changed: [instance] 2025-11-24 08:41:57.745091 | controller | 2025-11-24 08:41:57.745133 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-11-24 08:41:57.745142 | controller | Monday 24 November 2025 08:41:57 +0000 (0:00:10.962) 0:01:17.015 ******* 2025-11-24 08:41:57.745152 | controller | ok: [instance] 2025-11-24 08:41:57.745179 | controller | 2025-11-24 08:41:57.745188 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-11-24 08:41:57.745340 | controller | Monday 24 November 2025 08:41:57 +0000 (0:00:00.554) 0:01:17.570 ******* 2025-11-24 08:41:57.949191 | controller | changed: [instance] 2025-11-24 08:41:57.949300 | controller | 2025-11-24 08:41:57.949328 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-11-24 08:41:57.949340 | controller | Monday 24 November 2025 08:41:57 +0000 (0:00:00.204) 0:01:17.774 ******* 2025-11-24 08:42:03.885790 | controller | changed: [instance] 2025-11-24 08:42:03.921657 | controller | 2025-11-24 08:42:03.921689 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-11-24 08:42:03.921698 | controller | Monday 24 November 2025 08:42:03 +0000 (0:00:05.936) 0:01:23.710 ******* 2025-11-24 08:42:03.921708 | controller | ok: [instance] 2025-11-24 08:42:04.185176 | controller | 2025-11-24 08:42:04.185205 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-11-24 08:42:04.185213 | controller | Monday 24 November 2025 08:42:03 +0000 (0:00:00.036) 0:01:23.746 ******* 2025-11-24 08:42:04.185223 | controller | changed: [instance] 2025-11-24 08:42:04.438951 | controller | 2025-11-24 08:42:04.438980 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-11-24 08:42:04.438988 | controller | Monday 24 November 2025 08:42:04 +0000 (0:00:00.263) 0:01:24.010 ******* 2025-11-24 08:42:04.438998 | controller | changed: [instance] 2025-11-24 08:42:04.455239 | controller | 2025-11-24 08:42:04.455275 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-11-24 08:42:04.455284 | controller | Monday 24 November 2025 08:42:04 +0000 (0:00:00.253) 0:01:24.264 ******* 2025-11-24 08:42:04.455294 | controller | skipping: [instance] 2025-11-24 08:42:04.455321 | controller | 2025-11-24 08:42:04.455517 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-11-24 08:42:04.470290 | controller | Monday 24 November 2025 08:42:04 +0000 (0:00:00.016) 0:01:24.281 ******* 2025-11-24 08:42:04.470315 | controller | skipping: [instance] 2025-11-24 08:42:04.470485 | controller | 2025-11-24 08:42:04.470502 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-11-24 08:42:04.485210 | controller | Monday 24 November 2025 08:42:04 +0000 (0:00:00.014) 0:01:24.295 ******* 2025-11-24 08:42:04.485237 | controller | skipping: [instance] 2025-11-24 08:42:04.485248 | controller | 2025-11-24 08:42:04.485255 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-11-24 08:42:04.485264 | controller | Monday 24 November 2025 08:42:04 +0000 (0:00:00.014) 0:01:24.310 ******* 2025-11-24 08:42:04.501026 | controller | skipping: [instance] 2025-11-24 08:42:04.516796 | controller | 2025-11-24 08:42:04.516814 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-11-24 08:42:04.516828 | controller | Monday 24 November 2025 08:42:04 +0000 (0:00:00.015) 0:01:24.326 ******* 2025-11-24 08:42:04.516837 | controller | skipping: [instance] 2025-11-24 08:42:04.537655 | controller | 2025-11-24 08:42:04.537677 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-11-24 08:42:04.537686 | controller | Monday 24 November 2025 08:42:04 +0000 (0:00:00.015) 0:01:24.342 ******* 2025-11-24 08:42:04.537697 | controller | skipping: [instance] 2025-11-24 08:42:05.486192 | controller | 2025-11-24 08:42:05.486223 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-11-24 08:42:05.486231 | controller | Monday 24 November 2025 08:42:04 +0000 (0:00:00.020) 0:01:24.363 ******* 2025-11-24 08:42:05.486241 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-11-24 08:42:05.486264 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-11-24 08:42:05.486272 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-11-24 08:42:05.486708 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-11-24 08:42:05.815176 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-11-24 08:42:05.815206 | controller | 2025-11-24 08:42:05.815213 | controller | TASK [Create secret file] ****************************************************** 2025-11-24 08:42:05.815220 | controller | Monday 24 November 2025 08:42:05 +0000 (0:00:00.948) 0:01:25.311 ******* 2025-11-24 08:42:05.815229 | controller | changed: [instance] 2025-11-24 08:42:05.815251 | controller | 2025-11-24 08:42:05.815264 | controller | PLAY RECAP ********************************************************************* 2025-11-24 08:42:05.815271 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-11-24 08:42:05.815276 | controller | 2025-11-24 08:42:05.815283 | controller | Monday 24 November 2025 08:42:05 +0000 (0:00:00.328) 0:01:25.640 ******* 2025-11-24 08:42:05.816156 | controller | =============================================================================== 2025-11-24 08:42:05.817130 | controller | test_deps : Install selinux python libs -------------------------------- 47.97s 2025-11-24 08:42:05.817151 | controller | ci_setup : Install needed packages ------------------------------------- 10.96s 2025-11-24 08:42:05.817158 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.91s 2025-11-24 08:42:05.817164 | controller | ci_setup : Install openshift client ------------------------------------- 5.94s 2025-11-24 08:42:05.817169 | controller | test_deps : Install python yaml libs ------------------------------------ 1.22s 2025-11-24 08:42:05.817174 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.05s 2025-11-24 08:42:05.817179 | controller | ci_setup : Manage directories ------------------------------------------- 0.95s 2025-11-24 08:42:05.817184 | controller | Gathering Facts --------------------------------------------------------- 0.82s 2025-11-24 08:42:05.817189 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.82s 2025-11-24 08:42:05.817198 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.77s 2025-11-24 08:42:05.868175 | controller | repo_setup : Install repo-setup package --------------------------------- 0.69s 2025-11-24 08:42:05.868205 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.69s 2025-11-24 08:42:05.868212 | controller | ci_setup : Gather version of openshift client --------------------------- 0.55s 2025-11-24 08:42:05.868218 | controller | repo_setup : Ensure directories are present ----------------------------- 0.54s 2025-11-24 08:42:05.868223 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s 2025-11-24 08:42:05.868228 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.46s 2025-11-24 08:42:05.868233 | controller | Create secret file ------------------------------------------------------ 0.33s 2025-11-24 08:42:05.868238 | controller | Create custom basedir --------------------------------------------------- 0.31s 2025-11-24 08:42:05.868244 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.28s 2025-11-24 08:42:05.868255 | controller | ci_setup : Create completion file --------------------------------------- 0.26s 2025-11-24 08:42:05.868265 | controller | INFO Running crc_layout > converge 2025-11-24 08:42:06.465753 | controller | 2025-11-24 08:42:06.465968 | controller | PLAY [Converge] **************************************************************** 2025-11-24 08:42:06.466152 | controller | 2025-11-24 08:42:06.466323 | controller | TASK [Gathering Facts] ********************************************************* 2025-11-24 08:42:06.466467 | controller | Monday 24 November 2025 08:42:06 +0000 (0:00:00.026) 0:00:00.026 ******* 2025-11-24 08:42:07.266286 | controller | ok: [instance] 2025-11-24 08:42:07.266339 | controller | 2025-11-24 08:42:07.266349 | controller | TASK [Load networking definition from scenario file] *************************** 2025-11-24 08:42:07.266359 | controller | Monday 24 November 2025 08:42:07 +0000 (0:00:00.800) 0:00:00.827 ******* 2025-11-24 08:42:07.288956 | controller | ok: [instance] 2025-11-24 08:42:08.871066 | controller | 2025-11-24 08:42:08.871096 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-11-24 08:42:08.871104 | controller | Monday 24 November 2025 08:42:07 +0000 (0:00:00.022) 0:00:00.850 ******* 2025-11-24 08:42:08.871140 | controller | changed: [instance] 2025-11-24 08:42:08.897222 | controller | 2025-11-24 08:42:08.897242 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-11-24 08:42:08.897255 | controller | Monday 24 November 2025 08:42:08 +0000 (0:00:01.581) 0:00:02.431 ******* 2025-11-24 08:42:08.897265 | controller | ok: [instance] 2025-11-24 08:42:08.918228 | controller | 2025-11-24 08:42:08.918250 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-11-24 08:42:08.918260 | controller | Monday 24 November 2025 08:42:08 +0000 (0:00:00.026) 0:00:02.458 ******* 2025-11-24 08:42:08.918271 | controller | skipping: [instance] 2025-11-24 08:42:08.918278 | controller | 2025-11-24 08:42:08.918287 | controller | TASK [Build final libvirt layout] ********************************************** 2025-11-24 08:42:08.918296 | controller | Monday 24 November 2025 08:42:08 +0000 (0:00:00.021) 0:00:02.479 ******* 2025-11-24 08:42:08.988885 | controller | 2025-11-24 08:42:09.070278 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-11-24 08:42:09.070309 | controller | Monday 24 November 2025 08:42:08 +0000 (0:00:00.070) 0:00:02.550 ******* 2025-11-24 08:42:09.070323 | controller | ok: [instance] 2025-11-24 08:42:09.070416 | controller | 2025-11-24 08:42:09.070436 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-11-24 08:42:09.070447 | controller | Monday 24 November 2025 08:42:09 +0000 (0:00:00.081) 0:00:02.631 ******* 2025-11-24 08:42:09.130848 | controller | skipping: [instance] 2025-11-24 08:42:09.157868 | controller | 2025-11-24 08:42:09.157897 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-11-24 08:42:09.157906 | controller | Monday 24 November 2025 08:42:09 +0000 (0:00:00.060) 0:00:02.691 ******* 2025-11-24 08:42:09.157918 | controller | ok: [instance] 2025-11-24 08:42:09.158091 | controller | 2025-11-24 08:42:09.158332 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-11-24 08:42:09.158509 | controller | Monday 24 November 2025 08:42:09 +0000 (0:00:00.027) 0:00:02.719 ******* 2025-11-24 08:42:09.181466 | controller | ok: [instance] => changed=false 2025-11-24 08:42:09.181658 | controller | msg: All assertions passed 2025-11-24 08:42:09.181792 | controller | 2025-11-24 08:42:09.181928 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-11-24 08:42:09.182064 | controller | Monday 24 November 2025 08:42:09 +0000 (0:00:00.023) 0:00:02.742 ******* 2025-11-24 08:42:09.225237 | controller | ok: [instance] 2025-11-24 08:42:09.225430 | controller | 2025-11-24 08:42:09.225605 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-11-24 08:42:09.225773 | controller | Monday 24 November 2025 08:42:09 +0000 (0:00:00.041) 0:00:02.784 ******* 2025-11-24 08:42:09.655942 | controller | ok: [instance] => (item=artifacts) 2025-11-24 08:42:09.730970 | controller | ok: [instance] => (item=logs) 2025-11-24 08:42:09.730994 | controller | 2025-11-24 08:42:09.731001 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-11-24 08:42:09.731014 | controller | Monday 24 November 2025 08:42:09 +0000 (0:00:00.432) 0:00:03.216 ******* 2025-11-24 08:42:09.731024 | controller | 2025-11-24 08:42:09.913832 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-11-24 08:42:09.913858 | controller | Monday 24 November 2025 08:42:09 +0000 (0:00:00.075) 0:00:03.292 ******* 2025-11-24 08:42:09.913869 | controller | ok: [instance] 2025-11-24 08:42:10.183198 | controller | 2025-11-24 08:42:10.183229 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-11-24 08:42:10.183238 | controller | Monday 24 November 2025 08:42:09 +0000 (0:00:00.182) 0:00:03.474 ******* 2025-11-24 08:42:10.183250 | controller | changed: [instance] 2025-11-24 08:42:10.183258 | controller | 2025-11-24 08:42:10.183264 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-11-24 08:42:10.183273 | controller | Monday 24 November 2025 08:42:10 +0000 (0:00:00.267) 0:00:03.742 ******* 2025-11-24 08:42:10.471197 | controller | ok: [instance] 2025-11-24 08:42:10.471242 | controller | 2025-11-24 08:42:10.471254 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-11-24 08:42:10.471367 | controller | Monday 24 November 2025 08:42:10 +0000 (0:00:00.290) 0:00:04.032 ******* 2025-11-24 08:42:10.499252 | controller | skipping: [instance] 2025-11-24 08:42:10.516227 | controller | 2025-11-24 08:42:10.516250 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-11-24 08:42:10.516259 | controller | Monday 24 November 2025 08:42:10 +0000 (0:00:00.028) 0:00:04.060 ******* 2025-11-24 08:42:10.516270 | controller | skipping: [instance] 2025-11-24 08:42:10.516302 | controller | 2025-11-24 08:42:10.516563 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-11-24 08:42:10.536953 | controller | Monday 24 November 2025 08:42:10 +0000 (0:00:00.017) 0:00:04.077 ******* 2025-11-24 08:42:10.536980 | controller | ok: [instance] 2025-11-24 08:42:10.565987 | controller | 2025-11-24 08:42:10.566010 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-11-24 08:42:10.566026 | controller | Monday 24 November 2025 08:42:10 +0000 (0:00:00.020) 0:00:04.098 ******* 2025-11-24 08:42:10.566037 | controller | skipping: [instance] 2025-11-24 08:42:26.767653 | controller | 2025-11-24 08:42:26.767695 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-11-24 08:42:26.767703 | controller | Monday 24 November 2025 08:42:10 +0000 (0:00:00.028) 0:00:04.127 ******* 2025-11-24 08:42:26.767716 | controller | changed: [instance] 2025-11-24 08:42:27.015497 | controller | 2025-11-24 08:42:27.015531 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-11-24 08:42:27.015541 | controller | Monday 24 November 2025 08:42:26 +0000 (0:00:16.201) 0:00:20.328 ******* 2025-11-24 08:42:27.015554 | controller | changed: [instance] 2025-11-24 08:42:27.015816 | controller | 2025-11-24 08:42:27.015848 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-11-24 08:42:27.497195 | controller | Monday 24 November 2025 08:42:27 +0000 (0:00:00.247) 0:00:20.576 ******* 2025-11-24 08:42:27.497232 | controller | changed: [instance] 2025-11-24 08:42:27.497263 | controller | 2025-11-24 08:42:27.497271 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-11-24 08:42:27.497280 | controller | Monday 24 November 2025 08:42:27 +0000 (0:00:00.481) 0:00:21.058 ******* 2025-11-24 08:42:28.082506 | controller | changed: [instance] 2025-11-24 08:42:28.274564 | controller | 2025-11-24 08:42:28.274594 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-11-24 08:42:28.274602 | controller | Monday 24 November 2025 08:42:28 +0000 (0:00:00.585) 0:00:21.643 ******* 2025-11-24 08:42:28.274611 | controller | ok: [instance] 2025-11-24 08:42:28.930186 | controller | 2025-11-24 08:42:28.930215 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-11-24 08:42:28.930223 | controller | Monday 24 November 2025 08:42:28 +0000 (0:00:00.191) 0:00:21.835 ******* 2025-11-24 08:42:28.930234 | controller | ok: [instance] 2025-11-24 08:42:28.930255 | controller | 2025-11-24 08:42:28.930263 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-11-24 08:42:28.930344 | controller | Monday 24 November 2025 08:42:28 +0000 (0:00:00.655) 0:00:22.491 ******* 2025-11-24 08:42:29.814608 | controller | changed: [instance] 2025-11-24 08:42:29.899246 | controller | 2025-11-24 08:42:29.899280 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-11-24 08:42:29.899290 | controller | Monday 24 November 2025 08:42:29 +0000 (0:00:00.884) 0:00:23.375 ******* 2025-11-24 08:42:29.899303 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-11-24 08:42:29.899334 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-11-24 08:42:29.899345 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-11-24 08:42:29.899371 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-11-24 08:42:29.900145 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-11-24 08:42:30.222312 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-11-24 08:42:30.222342 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-11-24 08:42:30.222349 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-11-24 08:42:30.222355 | controller | 2025-11-24 08:42:30.222362 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-11-24 08:42:30.222367 | controller | Monday 24 November 2025 08:42:29 +0000 (0:00:00.084) 0:00:23.460 ******* 2025-11-24 08:42:30.222377 | controller | ok: [instance] 2025-11-24 08:42:30.545930 | controller | 2025-11-24 08:42:30.545962 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-11-24 08:42:30.545970 | controller | Monday 24 November 2025 08:42:30 +0000 (0:00:00.322) 0:00:23.783 ******* 2025-11-24 08:42:30.545980 | controller | ok: [instance] 2025-11-24 08:42:30.867819 | controller | 2025-11-24 08:42:30.867847 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-11-24 08:42:30.867855 | controller | Monday 24 November 2025 08:42:30 +0000 (0:00:00.323) 0:00:24.106 ******* 2025-11-24 08:42:30.867866 | controller | ok: [instance] 2025-11-24 08:42:32.190675 | controller | 2025-11-24 08:42:32.190704 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-11-24 08:42:32.190712 | controller | Monday 24 November 2025 08:42:30 +0000 (0:00:00.321) 0:00:24.428 ******* 2025-11-24 08:42:32.190723 | controller | ok: [instance] 2025-11-24 08:42:32.508554 | controller | 2025-11-24 08:42:32.508583 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-11-24 08:42:32.508591 | controller | Monday 24 November 2025 08:42:32 +0000 (0:00:01.322) 0:00:25.751 ******* 2025-11-24 08:42:32.508600 | controller | ok: [instance] 2025-11-24 08:42:32.835175 | controller | 2025-11-24 08:42:32.835204 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-11-24 08:42:32.835212 | controller | Monday 24 November 2025 08:42:32 +0000 (0:00:00.317) 0:00:26.069 ******* 2025-11-24 08:42:32.835222 | controller | ok: [instance] 2025-11-24 08:42:32.835445 | controller | 2025-11-24 08:42:32.835459 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-11-24 08:42:33.164583 | controller | Monday 24 November 2025 08:42:32 +0000 (0:00:00.326) 0:00:26.396 ******* 2025-11-24 08:42:33.164622 | controller | ok: [instance] 2025-11-24 08:42:33.486590 | controller | 2025-11-24 08:42:33.486619 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-11-24 08:42:33.486627 | controller | Monday 24 November 2025 08:42:33 +0000 (0:00:00.329) 0:00:26.725 ******* 2025-11-24 08:42:33.486644 | controller | ok: [instance] 2025-11-24 08:42:33.805760 | controller | 2025-11-24 08:42:33.805799 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-11-24 08:42:33.805808 | controller | Monday 24 November 2025 08:42:33 +0000 (0:00:00.322) 0:00:27.047 ******* 2025-11-24 08:42:33.805818 | controller | ok: [instance] 2025-11-24 08:42:34.125199 | controller | 2025-11-24 08:42:34.125231 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-11-24 08:42:34.125239 | controller | Monday 24 November 2025 08:42:33 +0000 (0:00:00.319) 0:00:27.366 ******* 2025-11-24 08:42:34.125249 | controller | ok: [instance] 2025-11-24 08:42:34.125273 | controller | 2025-11-24 08:42:34.125281 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-11-24 08:42:34.125363 | controller | Monday 24 November 2025 08:42:34 +0000 (0:00:00.319) 0:00:27.686 ******* 2025-11-24 08:42:34.446424 | controller | ok: [instance] 2025-11-24 08:42:34.765666 | controller | 2025-11-24 08:42:34.765701 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-11-24 08:42:34.765709 | controller | Monday 24 November 2025 08:42:34 +0000 (0:00:00.321) 0:00:28.007 ******* 2025-11-24 08:42:34.765719 | controller | ok: [instance] 2025-11-24 08:42:35.087575 | controller | 2025-11-24 08:42:35.087605 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-11-24 08:42:35.087612 | controller | Monday 24 November 2025 08:42:34 +0000 (0:00:00.319) 0:00:28.326 ******* 2025-11-24 08:42:35.087622 | controller | ok: [instance] 2025-11-24 08:42:35.444208 | controller | 2025-11-24 08:42:35.444251 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-11-24 08:42:35.444260 | controller | Monday 24 November 2025 08:42:35 +0000 (0:00:00.321) 0:00:28.648 ******* 2025-11-24 08:42:35.444274 | controller | ok: [instance] 2025-11-24 08:42:35.765786 | controller | 2025-11-24 08:42:35.765819 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-11-24 08:42:35.765827 | controller | Monday 24 November 2025 08:42:35 +0000 (0:00:00.356) 0:00:29.004 ******* 2025-11-24 08:42:35.765837 | controller | ok: [instance] 2025-11-24 08:42:36.103134 | controller | 2025-11-24 08:42:36.103162 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-11-24 08:42:36.103170 | controller | Monday 24 November 2025 08:42:35 +0000 (0:00:00.321) 0:00:29.326 ******* 2025-11-24 08:42:36.103180 | controller | ok: [instance] 2025-11-24 08:42:36.444218 | controller | 2025-11-24 08:42:36.444275 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-11-24 08:42:36.444286 | controller | Monday 24 November 2025 08:42:36 +0000 (0:00:00.337) 0:00:29.664 ******* 2025-11-24 08:42:36.444299 | controller | ok: [instance] 2025-11-24 08:42:36.784664 | controller | 2025-11-24 08:42:36.784694 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-11-24 08:42:36.784701 | controller | Monday 24 November 2025 08:42:36 +0000 (0:00:00.341) 0:00:30.005 ******* 2025-11-24 08:42:36.784712 | controller | ok: [instance] 2025-11-24 08:42:37.120787 | controller | 2025-11-24 08:42:37.120815 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-11-24 08:42:37.120823 | controller | Monday 24 November 2025 08:42:36 +0000 (0:00:00.340) 0:00:30.345 ******* 2025-11-24 08:42:37.120832 | controller | ok: [instance] 2025-11-24 08:42:37.457853 | controller | 2025-11-24 08:42:37.457894 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-11-24 08:42:37.457903 | controller | Monday 24 November 2025 08:42:37 +0000 (0:00:00.336) 0:00:30.681 ******* 2025-11-24 08:42:37.457912 | controller | ok: [instance] 2025-11-24 08:42:37.792220 | controller | 2025-11-24 08:42:37.792251 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-11-24 08:42:37.792259 | controller | Monday 24 November 2025 08:42:37 +0000 (0:00:00.336) 0:00:31.018 ******* 2025-11-24 08:42:37.792269 | controller | ok: [instance] 2025-11-24 08:42:38.131137 | controller | 2025-11-24 08:42:38.131169 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-11-24 08:42:38.131177 | controller | Monday 24 November 2025 08:42:37 +0000 (0:00:00.334) 0:00:31.352 ******* 2025-11-24 08:42:38.131195 | controller | ok: [instance] 2025-11-24 08:42:38.483812 | controller | 2025-11-24 08:42:38.483845 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-11-24 08:42:38.483860 | controller | Monday 24 November 2025 08:42:38 +0000 (0:00:00.339) 0:00:31.692 ******* 2025-11-24 08:42:38.483871 | controller | ok: [instance] 2025-11-24 08:42:38.830742 | controller | 2025-11-24 08:42:38.830773 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-11-24 08:42:38.830781 | controller | Monday 24 November 2025 08:42:38 +0000 (0:00:00.352) 0:00:32.044 ******* 2025-11-24 08:42:38.830792 | controller | ok: [instance] 2025-11-24 08:42:38.857049 | controller | 2025-11-24 08:42:38.857071 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-11-24 08:42:38.857080 | controller | Monday 24 November 2025 08:42:38 +0000 (0:00:00.346) 0:00:32.391 ******* 2025-11-24 08:42:38.857091 | controller | skipping: [instance] 2025-11-24 08:42:39.153192 | controller | 2025-11-24 08:42:39.153227 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-11-24 08:42:39.153235 | controller | Monday 24 November 2025 08:42:38 +0000 (0:00:00.026) 0:00:32.418 ******* 2025-11-24 08:42:39.153246 | controller | ok: [instance] 2025-11-24 08:42:39.153270 | controller | 2025-11-24 08:42:39.153278 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-11-24 08:42:39.153414 | controller | Monday 24 November 2025 08:42:39 +0000 (0:00:00.295) 0:00:32.713 ******* 2025-11-24 08:42:39.556988 | controller | ok: [instance] 2025-11-24 08:42:39.885332 | controller | 2025-11-24 08:42:39.885365 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-11-24 08:42:39.885375 | controller | Monday 24 November 2025 08:42:39 +0000 (0:00:00.402) 0:00:33.116 ******* 2025-11-24 08:42:39.885388 | controller | changed: [instance] 2025-11-24 08:42:40.188774 | controller | 2025-11-24 08:42:40.188812 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-11-24 08:42:40.188820 | controller | Monday 24 November 2025 08:42:39 +0000 (0:00:00.329) 0:00:33.446 ******* 2025-11-24 08:42:40.188884 | controller | [WARNING]: Reset is not implemented for this connection 2025-11-24 08:42:40.198794 | controller | changed: [instance] 2025-11-24 08:42:40.199085 | controller | 2025-11-24 08:42:40.199121 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-11-24 08:42:40.199953 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.296) 0:00:33.742 ******* 2025-11-24 08:42:40.200187 | controller | 2025-11-24 08:42:40.200664 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-11-24 08:42:40.200821 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.015) 0:00:33.758 ******* 2025-11-24 08:42:40.306878 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-11-24 08:42:40.306987 | controller | 2025-11-24 08:42:40.307123 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-11-24 08:42:40.307248 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.110) 0:00:33.868 ******* 2025-11-24 08:42:40.354839 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-11-24 08:42:40.354988 | controller | 2025-11-24 08:42:40.355173 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-24 08:42:40.355326 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.047) 0:00:33.916 ******* 2025-11-24 08:42:40.442625 | controller | ok: [instance] => (item=compute) 2025-11-24 08:42:40.442740 | controller | ok: [instance] => (item=controller) 2025-11-24 08:42:40.442899 | controller | ok: [instance] => (item=crc) 2025-11-24 08:42:40.442981 | controller | 2025-11-24 08:42:40.443124 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-24 08:42:40.443302 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.087) 0:00:34.004 ******* 2025-11-24 08:42:40.487609 | controller | ok: [instance] 2025-11-24 08:42:40.487711 | controller | 2025-11-24 08:42:40.487877 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-24 08:42:40.487956 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.045) 0:00:34.049 ******* 2025-11-24 08:42:40.534895 | controller | ok: [instance] => changed=false 2025-11-24 08:42:40.535089 | controller | msg: All assertions passed 2025-11-24 08:42:40.535224 | controller | 2025-11-24 08:42:40.535415 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-11-24 08:42:40.535522 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.047) 0:00:34.096 ******* 2025-11-24 08:42:40.585035 | controller | 2025-11-24 08:42:40.585182 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-11-24 08:42:40.585309 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.050) 0:00:34.146 ******* 2025-11-24 08:42:40.663805 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-11-24 08:42:40.664047 | controller | ok: [instance] => (item={}) 2025-11-24 08:42:40.664164 | controller | 2025-11-24 08:42:40.664303 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-11-24 08:42:40.664413 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.078) 0:00:34.225 ******* 2025-11-24 08:42:40.682332 | controller | skipping: [instance] 2025-11-24 08:42:40.682453 | controller | 2025-11-24 08:42:40.682644 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-11-24 08:42:40.682755 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.018) 0:00:34.243 ******* 2025-11-24 08:42:40.917866 | controller | ok: [instance] 2025-11-24 08:42:41.285938 | controller | 2025-11-24 08:42:41.286013 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-11-24 08:42:41.286023 | controller | Monday 24 November 2025 08:42:40 +0000 (0:00:00.234) 0:00:34.478 ******* 2025-11-24 08:42:41.286037 | controller | changed: [instance] 2025-11-24 08:42:42.084207 | controller | 2025-11-24 08:42:42.084249 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-11-24 08:42:42.084257 | controller | Monday 24 November 2025 08:42:41 +0000 (0:00:00.368) 0:00:34.846 ******* 2025-11-24 08:42:42.084270 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-11-24 08:42:42.084295 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-11-24 08:42:42.084301 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-11-24 08:42:42.084306 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-11-24 08:42:42.084313 | controller | 2025-11-24 08:42:42.084556 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-11-24 08:42:42.113230 | controller | Monday 24 November 2025 08:42:42 +0000 (0:00:00.798) 0:00:35.644 ******* 2025-11-24 08:42:42.113282 | controller | skipping: [instance] 2025-11-24 08:42:42.113312 | controller | 2025-11-24 08:42:42.113321 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-11-24 08:42:42.113478 | controller | Monday 24 November 2025 08:42:42 +0000 (0:00:00.029) 0:00:35.674 ******* 2025-11-24 08:42:42.506380 | controller | changed: [instance] 2025-11-24 08:42:42.506465 | controller | 2025-11-24 08:42:42.506476 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-11-24 08:42:42.506486 | controller | Monday 24 November 2025 08:42:42 +0000 (0:00:00.384) 0:00:36.058 ******* 2025-11-24 08:42:42.506749 | controller | 2025-11-24 08:42:42.506795 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-11-24 08:42:42.959872 | controller | Monday 24 November 2025 08:42:42 +0000 (0:00:00.008) 0:00:36.067 ******* 2025-11-24 08:42:42.959917 | controller | changed: [instance] 2025-11-24 08:42:43.032377 | controller | 2025-11-24 08:42:43.032412 | controller | TASK [Ensure no default networks exists] *************************************** 2025-11-24 08:42:43.032422 | controller | Monday 24 November 2025 08:42:42 +0000 (0:00:00.453) 0:00:36.520 ******* 2025-11-24 08:42:43.032435 | controller | 2025-11-24 08:42:44.281055 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-11-24 08:42:44.281095 | controller | Monday 24 November 2025 08:42:43 +0000 (0:00:00.072) 0:00:36.593 ******* 2025-11-24 08:42:44.281120 | controller | ok: [instance] 2025-11-24 08:42:44.524660 | controller | 2025-11-24 08:42:44.524692 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-11-24 08:42:44.524699 | controller | Monday 24 November 2025 08:42:44 +0000 (0:00:01.248) 0:00:37.842 ******* 2025-11-24 08:42:44.524709 | controller | ok: [instance] 2025-11-24 08:42:45.099565 | controller | 2025-11-24 08:42:45.099598 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-11-24 08:42:45.099605 | controller | Monday 24 November 2025 08:42:44 +0000 (0:00:00.243) 0:00:38.085 ******* 2025-11-24 08:42:45.099615 | controller | ok: [instance] 2025-11-24 08:42:45.338986 | controller | 2025-11-24 08:42:45.339017 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-11-24 08:42:45.339025 | controller | Monday 24 November 2025 08:42:45 +0000 (0:00:00.575) 0:00:38.660 ******* 2025-11-24 08:42:45.339035 | controller | ok: [instance] 2025-11-24 08:42:46.598614 | controller | 2025-11-24 08:42:46.598647 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-11-24 08:42:46.598658 | controller | Monday 24 November 2025 08:42:45 +0000 (0:00:00.239) 0:00:38.899 ******* 2025-11-24 08:42:46.598668 | controller | ok: [instance] 2025-11-24 08:42:46.923258 | controller | 2025-11-24 08:42:46.923291 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-11-24 08:42:46.923300 | controller | Monday 24 November 2025 08:42:46 +0000 (0:00:01.259) 0:00:40.159 ******* 2025-11-24 08:42:46.923317 | controller | ok: [instance] 2025-11-24 08:42:47.248359 | controller | 2025-11-24 08:42:47.248388 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-11-24 08:42:47.248396 | controller | Monday 24 November 2025 08:42:46 +0000 (0:00:00.324) 0:00:40.484 ******* 2025-11-24 08:42:47.248406 | controller | changed: [instance] 2025-11-24 08:42:47.565482 | controller | 2025-11-24 08:42:47.565519 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-11-24 08:42:47.565528 | controller | Monday 24 November 2025 08:42:47 +0000 (0:00:00.324) 0:00:40.809 ******* 2025-11-24 08:42:47.565538 | controller | changed: [instance] 2025-11-24 08:42:48.157267 | controller | 2025-11-24 08:42:48.157305 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-11-24 08:42:48.157315 | controller | Monday 24 November 2025 08:42:47 +0000 (0:00:00.317) 0:00:41.126 ******* 2025-11-24 08:42:48.157328 | controller | changed: [instance] => (item=arptables) 2025-11-24 08:42:48.157361 | controller | changed: [instance] => (item=iptables) 2025-11-24 08:42:48.157370 | controller | changed: [instance] => (item=ip6tables) 2025-11-24 08:42:48.157668 | controller | 2025-11-24 08:42:48.480210 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-11-24 08:42:48.480242 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.591) 0:00:41.718 ******* 2025-11-24 08:42:48.480255 | controller | ok: [instance] 2025-11-24 08:42:48.573532 | controller | 2025-11-24 08:42:48.573563 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-11-24 08:42:48.573571 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.322) 0:00:42.041 ******* 2025-11-24 08:42:48.573581 | controller | ok: [instance] 2025-11-24 08:42:48.618271 | controller | 2025-11-24 08:42:48.618307 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-11-24 08:42:48.618316 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.093) 0:00:42.134 ******* 2025-11-24 08:42:48.618329 | controller | 2025-11-24 08:42:48.642178 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-11-24 08:42:48.642221 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.044) 0:00:42.179 ******* 2025-11-24 08:42:48.642236 | controller | skipping: [instance] 2025-11-24 08:42:48.642416 | controller | 2025-11-24 08:42:48.642442 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-11-24 08:42:48.665783 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.023) 0:00:42.203 ******* 2025-11-24 08:42:48.665810 | controller | skipping: [instance] 2025-11-24 08:42:48.689069 | controller | 2025-11-24 08:42:48.689090 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-24 08:42:48.689099 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.023) 0:00:42.226 ******* 2025-11-24 08:42:48.689134 | controller | skipping: [instance] 2025-11-24 08:42:48.717247 | controller | 2025-11-24 08:42:48.717292 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-11-24 08:42:48.717303 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.023) 0:00:42.250 ******* 2025-11-24 08:42:48.717317 | controller | skipping: [instance] 2025-11-24 08:42:48.758158 | controller | 2025-11-24 08:42:48.758201 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-11-24 08:42:48.758212 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.028) 0:00:42.278 ******* 2025-11-24 08:42:48.758225 | controller | ok: [instance] 2025-11-24 08:42:48.758363 | controller | 2025-11-24 08:42:48.758495 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-11-24 08:42:48.758623 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.041) 0:00:42.319 ******* 2025-11-24 08:42:48.793799 | controller | skipping: [instance] 2025-11-24 08:42:48.793935 | controller | 2025-11-24 08:42:48.794119 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-11-24 08:42:48.794267 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.035) 0:00:42.355 ******* 2025-11-24 08:42:48.817312 | controller | skipping: [instance] 2025-11-24 08:42:48.817483 | controller | 2025-11-24 08:42:48.817604 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-11-24 08:42:48.817733 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.023) 0:00:42.378 ******* 2025-11-24 08:42:48.875564 | controller | ok: [instance] 2025-11-24 08:42:48.875636 | controller | 2025-11-24 08:42:48.875773 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-11-24 08:42:48.875889 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.058) 0:00:42.437 ******* 2025-11-24 08:42:48.898610 | controller | skipping: [instance] 2025-11-24 08:42:48.898711 | controller | 2025-11-24 08:42:48.898868 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-11-24 08:42:48.898965 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.023) 0:00:42.460 ******* 2025-11-24 08:42:48.947171 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-11-24 08:42:48.947372 | controller | 2025-11-24 08:42:48.947497 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-11-24 08:42:48.947670 | controller | Monday 24 November 2025 08:42:48 +0000 (0:00:00.048) 0:00:42.508 ******* 2025-11-24 08:42:49.269744 | controller | ok: [instance -> localhost] 2025-11-24 08:42:56.936991 | controller | 2025-11-24 08:42:56.937022 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-11-24 08:42:56.937031 | controller | Monday 24 November 2025 08:42:49 +0000 (0:00:00.322) 0:00:42.830 ******* 2025-11-24 08:42:56.937040 | controller | changed: [instance -> localhost] 2025-11-24 08:42:57.124956 | controller | 2025-11-24 08:42:57.124985 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-11-24 08:42:57.124993 | controller | Monday 24 November 2025 08:42:56 +0000 (0:00:07.667) 0:00:50.497 ******* 2025-11-24 08:42:57.125003 | controller | changed: [instance] 2025-11-24 08:42:57.467836 | controller | 2025-11-24 08:42:57.467870 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-11-24 08:42:57.467880 | controller | Monday 24 November 2025 08:42:57 +0000 (0:00:00.187) 0:00:50.685 ******* 2025-11-24 08:42:57.467902 | controller | changed: [instance] 2025-11-24 08:42:59.071181 | controller | 2025-11-24 08:42:59.071218 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-11-24 08:42:59.071226 | controller | Monday 24 November 2025 08:42:57 +0000 (0:00:00.342) 0:00:51.028 ******* 2025-11-24 08:42:59.071236 | controller | changed: [instance -> localhost] 2025-11-24 08:42:59.071260 | controller | 2025-11-24 08:42:59.071267 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-11-24 08:42:59.071274 | controller | Monday 24 November 2025 08:42:59 +0000 (0:00:01.603) 0:00:52.631 ******* 2025-11-24 08:42:59.412718 | controller | changed: [instance] 2025-11-24 08:42:59.441053 | controller | 2025-11-24 08:42:59.441071 | controller | TASK [reproducer : Select right domain] **************************************** 2025-11-24 08:42:59.441079 | controller | Monday 24 November 2025 08:42:59 +0000 (0:00:00.341) 0:00:52.973 ******* 2025-11-24 08:42:59.441087 | controller | ok: [instance] 2025-11-24 08:42:59.553957 | controller | 2025-11-24 08:42:59.553990 | controller | TASK [Create the virtual networks] ********************************************* 2025-11-24 08:42:59.554003 | controller | Monday 24 November 2025 08:42:59 +0000 (0:00:00.028) 0:00:53.002 ******* 2025-11-24 08:42:59.554019 | controller | 2025-11-24 08:42:59.571713 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-11-24 08:42:59.571735 | controller | Monday 24 November 2025 08:42:59 +0000 (0:00:00.112) 0:00:53.115 ******* 2025-11-24 08:42:59.571747 | controller | ok: [instance] 2025-11-24 08:42:59.757223 | controller | 2025-11-24 08:42:59.757266 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-11-24 08:42:59.757276 | controller | Monday 24 November 2025 08:42:59 +0000 (0:00:00.017) 0:00:53.132 ******* 2025-11-24 08:42:59.757290 | controller | ok: [instance] 2025-11-24 08:42:59.757429 | controller | 2025-11-24 08:42:59.757460 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-11-24 08:42:59.757497 | controller | Monday 24 November 2025 08:42:59 +0000 (0:00:00.185) 0:00:53.318 ******* 2025-11-24 08:42:59.784857 | controller | skipping: [instance] 2025-11-24 08:42:59.811876 | controller | 2025-11-24 08:42:59.811894 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-11-24 08:42:59.811902 | controller | Monday 24 November 2025 08:42:59 +0000 (0:00:00.027) 0:00:53.345 ******* 2025-11-24 08:42:59.811910 | controller | skipping: [instance] 2025-11-24 08:42:59.812051 | controller | 2025-11-24 08:42:59.812411 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-11-24 08:42:59.812566 | controller | Monday 24 November 2025 08:42:59 +0000 (0:00:00.027) 0:00:53.373 ******* 2025-11-24 08:42:59.866589 | controller | ok: [instance] 2025-11-24 08:42:59.866771 | controller | 2025-11-24 08:42:59.866925 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-11-24 08:42:59.867063 | controller | Monday 24 November 2025 08:42:59 +0000 (0:00:00.054) 0:00:53.428 ******* 2025-11-24 08:42:59.994721 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-24 08:42:59.994884 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-24 08:42:59.995035 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-24 08:42:59.995196 | controller | 2025-11-24 08:42:59.995338 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-11-24 08:42:59.995473 | controller | Monday 24 November 2025 08:42:59 +0000 (0:00:00.128) 0:00:53.556 ******* 2025-11-24 08:43:00.028271 | controller | skipping: [instance] 2025-11-24 08:43:00.028464 | controller | 2025-11-24 08:43:00.028500 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-11-24 08:43:00.367658 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.033) 0:00:53.589 ******* 2025-11-24 08:43:00.367691 | controller | changed: [instance] 2025-11-24 08:43:00.483812 | controller | 2025-11-24 08:43:00.483835 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-11-24 08:43:00.483844 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.338) 0:00:53.928 ******* 2025-11-24 08:43:00.483865 | controller | changed: [instance] => (item=Adding compute-0 to computes) 2025-11-24 08:43:00.505260 | controller | changed: [instance] => (item=Adding controller-0 to controllers) 2025-11-24 08:43:00.505303 | controller | changed: [instance] => (item=Adding crc-0 to ocps) 2025-11-24 08:43:00.505312 | controller | 2025-11-24 08:43:00.505320 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-11-24 08:43:00.505328 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.116) 0:00:54.044 ******* 2025-11-24 08:43:00.505341 | controller | skipping: [instance] 2025-11-24 08:43:00.527240 | controller | 2025-11-24 08:43:00.527263 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-24 08:43:00.527272 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.021) 0:00:54.066 ******* 2025-11-24 08:43:00.527283 | controller | skipping: [instance] 2025-11-24 08:43:00.527314 | controller | 2025-11-24 08:43:00.527321 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-11-24 08:43:00.527330 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.022) 0:00:54.088 ******* 2025-11-24 08:43:00.549748 | controller | skipping: [instance] 2025-11-24 08:43:00.573538 | controller | 2025-11-24 08:43:00.573556 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-11-24 08:43:00.573564 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.022) 0:00:54.111 ******* 2025-11-24 08:43:00.573572 | controller | skipping: [instance] 2025-11-24 08:43:00.591043 | controller | 2025-11-24 08:43:00.591063 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-11-24 08:43:00.591071 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.023) 0:00:54.134 ******* 2025-11-24 08:43:00.591081 | controller | ok: [instance] 2025-11-24 08:43:00.667145 | controller | 2025-11-24 08:43:00.667168 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-11-24 08:43:00.667177 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.017) 0:00:54.152 ******* 2025-11-24 08:43:00.667191 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-11-24 08:43:00.667377 | controller | 2025-11-24 08:43:00.667533 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-11-24 08:43:00.667678 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.076) 0:00:54.228 ******* 2025-11-24 08:43:00.683096 | controller | skipping: [instance] 2025-11-24 08:43:00.683313 | controller | 2025-11-24 08:43:00.683470 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-11-24 08:43:00.683622 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.016) 0:00:54.244 ******* 2025-11-24 08:43:00.891440 | controller | changed: [instance] 2025-11-24 08:43:01.286243 | controller | 2025-11-24 08:43:01.286291 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-11-24 08:43:01.286302 | controller | Monday 24 November 2025 08:43:00 +0000 (0:00:00.207) 0:00:54.452 ******* 2025-11-24 08:43:01.286316 | controller | changed: [instance] 2025-11-24 08:43:01.286357 | controller | 2025-11-24 08:43:01.286365 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-11-24 08:43:01.286375 | controller | Monday 24 November 2025 08:43:01 +0000 (0:00:00.394) 0:00:54.847 ******* 2025-11-24 08:43:01.347288 | controller | ok: [instance] 2025-11-24 08:43:01.377211 | controller | 2025-11-24 08:43:01.377234 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-11-24 08:43:01.377243 | controller | Monday 24 November 2025 08:43:01 +0000 (0:00:00.061) 0:00:54.908 ******* 2025-11-24 08:43:01.377254 | controller | ok: [instance] 2025-11-24 08:43:01.377285 | controller | 2025-11-24 08:43:01.377295 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-11-24 08:43:01.377429 | controller | Monday 24 November 2025 08:43:01 +0000 (0:00:00.030) 0:00:54.938 ******* 2025-11-24 08:43:01.758255 | controller | changed: [instance] 2025-11-24 08:43:01.758299 | controller | 2025-11-24 08:43:01.758309 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-11-24 08:43:01.758319 | controller | Monday 24 November 2025 08:43:01 +0000 (0:00:00.380) 0:00:55.319 ******* 2025-11-24 08:43:01.836830 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-11-24 08:43:01.886294 | controller | 2025-11-24 08:43:01.886341 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-11-24 08:43:01.886363 | controller | Monday 24 November 2025 08:43:01 +0000 (0:00:00.078) 0:00:55.397 ******* 2025-11-24 08:43:01.886377 | controller | ok: [instance] => (item=public) 2025-11-24 08:43:01.886412 | controller | ok: [instance] => (item=osp_trunk) 2025-11-24 08:43:01.886423 | controller | 2025-11-24 08:43:01.886753 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-11-24 08:43:02.314787 | controller | Monday 24 November 2025 08:43:01 +0000 (0:00:00.049) 0:00:55.447 ******* 2025-11-24 08:43:02.314819 | controller | changed: [instance] => (item=cifmw-public) 2025-11-24 08:43:02.897900 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:43:02.897935 | controller | 2025-11-24 08:43:02.897944 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-11-24 08:43:02.897950 | controller | Monday 24 November 2025 08:43:02 +0000 (0:00:00.428) 0:00:55.875 ******* 2025-11-24 08:43:02.897960 | controller | ok: [instance] => (item=cifmw-public) 2025-11-24 08:43:03.337167 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:43:03.337192 | controller | 2025-11-24 08:43:03.337202 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-11-24 08:43:03.337209 | controller | Monday 24 November 2025 08:43:02 +0000 (0:00:00.582) 0:00:56.458 ******* 2025-11-24 08:43:03.337220 | controller | ok: [instance] => (item=cifmw-public) 2025-11-24 08:43:03.773670 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:43:03.773692 | controller | 2025-11-24 08:43:03.773700 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-11-24 08:43:03.773706 | controller | Monday 24 November 2025 08:43:03 +0000 (0:00:00.439) 0:00:56.897 ******* 2025-11-24 08:43:03.773720 | controller | changed: [instance] => (item=cifmw-public) 2025-11-24 08:43:03.833265 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:43:03.833300 | controller | 2025-11-24 08:43:03.833310 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-11-24 08:43:03.833317 | controller | Monday 24 November 2025 08:43:03 +0000 (0:00:00.436) 0:00:57.334 ******* 2025-11-24 08:43:03.833330 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-11-24 08:43:04.017205 | controller | 2025-11-24 08:43:04.017246 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-11-24 08:43:04.017257 | controller | Monday 24 November 2025 08:43:03 +0000 (0:00:00.059) 0:00:57.394 ******* 2025-11-24 08:43:04.017270 | controller | ok: [instance] 2025-11-24 08:43:04.017358 | controller | 2025-11-24 08:43:04.017382 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-11-24 08:43:04.017395 | controller | Monday 24 November 2025 08:43:04 +0000 (0:00:00.183) 0:00:57.578 ******* 2025-11-24 08:43:04.397266 | controller | ok: [instance] => (item=cifmw-public) 2025-11-24 08:43:04.397331 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:43:04.397342 | controller | 2025-11-24 08:43:04.397352 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-11-24 08:43:04.397405 | controller | Monday 24 November 2025 08:43:04 +0000 (0:00:00.379) 0:00:57.958 ******* 2025-11-24 08:43:04.466001 | controller | 2025-11-24 08:43:04.502269 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-11-24 08:43:04.502303 | controller | Monday 24 November 2025 08:43:04 +0000 (0:00:00.068) 0:00:58.027 ******* 2025-11-24 08:43:04.502315 | controller | skipping: [instance] 2025-11-24 08:43:04.502345 | controller | 2025-11-24 08:43:04.502561 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-11-24 08:43:05.790937 | controller | Monday 24 November 2025 08:43:04 +0000 (0:00:00.036) 0:00:58.063 ******* 2025-11-24 08:43:05.790978 | controller | ok: [instance] 2025-11-24 08:43:05.978618 | controller | 2025-11-24 08:43:05.978666 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-11-24 08:43:05.978675 | controller | Monday 24 November 2025 08:43:05 +0000 (0:00:01.288) 0:00:59.351 ******* 2025-11-24 08:43:05.978686 | controller | ok: [instance] 2025-11-24 08:43:06.337162 | controller | 2025-11-24 08:43:06.337202 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-11-24 08:43:06.337210 | controller | Monday 24 November 2025 08:43:05 +0000 (0:00:00.187) 0:00:59.539 ******* 2025-11-24 08:43:06.337222 | controller | changed: [instance] 2025-11-24 08:43:07.987022 | controller | 2025-11-24 08:43:07.987056 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-11-24 08:43:07.987066 | controller | Monday 24 November 2025 08:43:06 +0000 (0:00:00.358) 0:00:59.898 ******* 2025-11-24 08:43:07.987078 | controller | changed: [instance] 2025-11-24 08:43:08.358882 | controller | 2025-11-24 08:43:08.358911 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-11-24 08:43:08.358919 | controller | Monday 24 November 2025 08:43:07 +0000 (0:00:01.649) 0:01:01.547 ******* 2025-11-24 08:43:08.358929 | controller | changed: [instance] 2025-11-24 08:43:08.393848 | controller | 2025-11-24 08:43:08.393866 | controller | TASK [Create extra network configuration] ************************************** 2025-11-24 08:43:08.393874 | controller | Monday 24 November 2025 08:43:08 +0000 (0:00:00.372) 0:01:01.919 ******* 2025-11-24 08:43:08.393889 | controller | skipping: [instance] 2025-11-24 08:43:08.424256 | controller | 2025-11-24 08:43:08.424292 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-11-24 08:43:08.424302 | controller | Monday 24 November 2025 08:43:08 +0000 (0:00:00.035) 0:01:01.955 ******* 2025-11-24 08:43:08.424314 | controller | skipping: [instance] 2025-11-24 08:43:08.866237 | controller | 2025-11-24 08:43:08.866279 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-11-24 08:43:08.866294 | controller | Monday 24 November 2025 08:43:08 +0000 (0:00:00.030) 0:01:01.985 ******* 2025-11-24 08:43:08.866308 | controller | ok: [instance] 2025-11-24 08:43:08.866338 | controller | 2025-11-24 08:43:08.866347 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-11-24 08:43:08.866432 | controller | Monday 24 November 2025 08:43:08 +0000 (0:00:00.442) 0:01:02.427 ******* 2025-11-24 08:43:09.017073 | controller | ok: [instance] => (item=cifmw-public) 2025-11-24 08:43:10.264205 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:43:10.264243 | controller | 2025-11-24 08:43:10.264252 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-11-24 08:43:10.264260 | controller | Monday 24 November 2025 08:43:09 +0000 (0:00:00.150) 0:01:02.578 ******* 2025-11-24 08:43:10.264273 | controller | ok: [instance] 2025-11-24 08:43:13.998197 | controller | 2025-11-24 08:43:13.998237 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-11-24 08:43:13.998246 | controller | Monday 24 November 2025 08:43:10 +0000 (0:00:01.247) 0:01:03.825 ******* 2025-11-24 08:43:13.998258 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-11-24 08:43:14.224097 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-11-24 08:43:14.224150 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-11-24 08:43:14.224160 | controller | 2025-11-24 08:43:14.224168 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-11-24 08:43:14.224176 | controller | Monday 24 November 2025 08:43:13 +0000 (0:00:03.733) 0:01:07.558 ******* 2025-11-24 08:43:14.224187 | controller | changed: [instance] 2025-11-24 08:43:14.590177 | controller | 2025-11-24 08:43:14.590206 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-11-24 08:43:14.590214 | controller | Monday 24 November 2025 08:43:14 +0000 (0:00:00.226) 0:01:07.784 ******* 2025-11-24 08:43:14.590224 | controller | changed: [instance] 2025-11-24 08:43:14.590397 | controller | 2025-11-24 08:43:14.590409 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-11-24 08:43:14.590418 | controller | Monday 24 November 2025 08:43:14 +0000 (0:00:00.366) 0:01:08.151 ******* 2025-11-24 08:43:14.983902 | controller | changed: [instance] 2025-11-24 08:43:15.015972 | controller | 2025-11-24 08:43:15.016005 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-11-24 08:43:15.016013 | controller | Monday 24 November 2025 08:43:14 +0000 (0:00:00.393) 0:01:08.545 ******* 2025-11-24 08:43:15.016030 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-11-24 08:43:15.408280 | controller | 2025-11-24 08:43:15.408323 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-11-24 08:43:15.408335 | controller | Monday 24 November 2025 08:43:15 +0000 (0:00:00.032) 0:01:08.577 ******* 2025-11-24 08:43:15.408352 | controller | changed: [instance] 2025-11-24 08:43:15.408392 | controller | 2025-11-24 08:43:15.408405 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-11-24 08:43:15.408494 | controller | Monday 24 November 2025 08:43:15 +0000 (0:00:00.392) 0:01:08.969 ******* 2025-11-24 08:43:15.428228 | controller | skipping: [instance] 2025-11-24 08:43:15.428251 | controller | 2025-11-24 08:43:15.428260 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-11-24 08:43:15.428268 | controller | Monday 24 November 2025 08:43:15 +0000 (0:00:00.020) 0:01:08.989 ******* 2025-11-24 08:43:15.462832 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-11-24 08:43:15.843005 | controller | 2025-11-24 08:43:15.843034 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-11-24 08:43:15.843043 | controller | Monday 24 November 2025 08:43:15 +0000 (0:00:00.034) 0:01:09.024 ******* 2025-11-24 08:43:15.843053 | controller | changed: [instance] 2025-11-24 08:43:15.862686 | controller | 2025-11-24 08:43:15.862718 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-11-24 08:43:15.862726 | controller | Monday 24 November 2025 08:43:15 +0000 (0:00:00.379) 0:01:09.404 ******* 2025-11-24 08:43:15.862735 | controller | skipping: [instance] 2025-11-24 08:43:16.079369 | controller | 2025-11-24 08:43:16.079398 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-11-24 08:43:16.079406 | controller | Monday 24 November 2025 08:43:15 +0000 (0:00:00.019) 0:01:09.423 ******* 2025-11-24 08:43:16.079416 | controller | ok: [instance] => (item=127.0.0.2) 2025-11-24 08:43:16.763075 | controller | 2025-11-24 08:43:16.763128 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-11-24 08:43:16.763151 | controller | Monday 24 November 2025 08:43:16 +0000 (0:00:00.216) 0:01:09.640 ******* 2025-11-24 08:43:16.763166 | controller | changed: [instance] 2025-11-24 08:43:16.782716 | controller | 2025-11-24 08:43:16.782735 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-11-24 08:43:16.782744 | controller | Monday 24 November 2025 08:43:16 +0000 (0:00:00.683) 0:01:10.323 ******* 2025-11-24 08:43:16.782755 | controller | skipping: [instance] 2025-11-24 08:43:16.802223 | controller | 2025-11-24 08:43:16.802259 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-11-24 08:43:16.802270 | controller | Monday 24 November 2025 08:43:16 +0000 (0:00:00.020) 0:01:10.343 ******* 2025-11-24 08:43:16.802282 | controller | skipping: [instance] 2025-11-24 08:43:16.832268 | controller | 2025-11-24 08:43:16.832305 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-11-24 08:43:16.832315 | controller | Monday 24 November 2025 08:43:16 +0000 (0:00:00.019) 0:01:10.363 ******* 2025-11-24 08:43:16.832328 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-11-24 08:43:16.832359 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-11-24 08:43:16.832367 | controller | skipping: [instance] 2025-11-24 08:43:16.832374 | controller | 2025-11-24 08:43:16.832383 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-11-24 08:43:16.832487 | controller | Monday 24 November 2025 08:43:16 +0000 (0:00:00.029) 0:01:10.393 ******* 2025-11-24 08:43:16.949908 | controller | 2025-11-24 08:43:16.980349 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-11-24 08:43:16.980395 | controller | Monday 24 November 2025 08:43:16 +0000 (0:00:00.117) 0:01:10.511 ******* 2025-11-24 08:43:16.980410 | controller | ok: [instance] => changed=false 2025-11-24 08:43:16.980521 | controller | msg: All assertions passed 2025-11-24 08:43:16.980532 | controller | 2025-11-24 08:43:16.980543 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-11-24 08:43:16.980767 | controller | Monday 24 November 2025 08:43:16 +0000 (0:00:00.030) 0:01:10.541 ******* 2025-11-24 08:43:17.018342 | controller | ok: [instance] => changed=false 2025-11-24 08:43:17.018522 | controller | msg: All assertions passed 2025-11-24 08:43:17.018634 | controller | 2025-11-24 08:43:17.018770 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-11-24 08:43:17.018892 | controller | Monday 24 November 2025 08:43:17 +0000 (0:00:00.038) 0:01:10.579 ******* 2025-11-24 08:43:17.495754 | controller | changed: [instance] 2025-11-24 08:43:17.515252 | controller | 2025-11-24 08:43:17.515289 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-11-24 08:43:17.515304 | controller | Monday 24 November 2025 08:43:17 +0000 (0:00:00.476) 0:01:11.056 ******* 2025-11-24 08:43:17.515317 | controller | skipping: [instance] 2025-11-24 08:43:17.540141 | controller | 2025-11-24 08:43:17.540174 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-11-24 08:43:17.540184 | controller | Monday 24 November 2025 08:43:17 +0000 (0:00:00.019) 0:01:11.076 ******* 2025-11-24 08:43:17.540196 | controller | skipping: [instance] 2025-11-24 08:43:17.570196 | controller | 2025-11-24 08:43:17.570220 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-11-24 08:43:17.570229 | controller | Monday 24 November 2025 08:43:17 +0000 (0:00:00.024) 0:01:11.101 ******* 2025-11-24 08:43:17.570247 | controller | ok: [instance] => changed=false 2025-11-24 08:43:17.570276 | controller | msg: All assertions passed 2025-11-24 08:43:17.570611 | controller | 2025-11-24 08:43:17.609278 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-11-24 08:43:17.609314 | controller | Monday 24 November 2025 08:43:17 +0000 (0:00:00.030) 0:01:11.131 ******* 2025-11-24 08:43:17.609328 | controller | ok: [instance] => changed=false 2025-11-24 08:43:17.609403 | controller | msg: All assertions passed 2025-11-24 08:43:17.609424 | controller | 2025-11-24 08:43:17.609433 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-11-24 08:43:17.609444 | controller | Monday 24 November 2025 08:43:17 +0000 (0:00:00.038) 0:01:11.170 ******* 2025-11-24 08:43:18.050598 | controller | changed: [instance] 2025-11-24 08:43:18.069833 | controller | 2025-11-24 08:43:18.069851 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-11-24 08:43:18.069859 | controller | Monday 24 November 2025 08:43:18 +0000 (0:00:00.441) 0:01:11.611 ******* 2025-11-24 08:43:18.069868 | controller | skipping: [instance] 2025-11-24 08:43:18.095238 | controller | 2025-11-24 08:43:18.095264 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-11-24 08:43:18.095273 | controller | Monday 24 November 2025 08:43:18 +0000 (0:00:00.019) 0:01:11.631 ******* 2025-11-24 08:43:18.095284 | controller | skipping: [instance] 2025-11-24 08:43:18.095375 | controller | 2025-11-24 08:43:18.095405 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2025-11-24 08:43:18.095418 | controller | Monday 24 November 2025 08:43:18 +0000 (0:00:00.025) 0:01:11.656 ******* 2025-11-24 08:43:18.126592 | controller | skipping: [instance] 2025-11-24 08:43:18.599829 | controller | 2025-11-24 08:43:18.599858 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-11-24 08:43:18.599867 | controller | Monday 24 November 2025 08:43:18 +0000 (0:00:00.031) 0:01:11.687 ******* 2025-11-24 08:43:18.599877 | controller | changed: [instance] => (item=cifmw-public) 2025-11-24 08:43:18.634946 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:43:18.634965 | controller | 2025-11-24 08:43:18.634972 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-11-24 08:43:18.634978 | controller | Monday 24 November 2025 08:43:18 +0000 (0:00:00.472) 0:01:12.160 ******* 2025-11-24 08:43:18.634987 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-11-24 08:43:18.957674 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-11-24 08:43:18.957703 | controller | 2025-11-24 08:43:18.957711 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-11-24 08:43:18.957718 | controller | Monday 24 November 2025 08:43:18 +0000 (0:00:00.035) 0:01:12.195 ******* 2025-11-24 08:43:18.957727 | controller | ok: [instance] 2025-11-24 08:43:18.992563 | controller | 2025-11-24 08:43:18.992584 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-11-24 08:43:18.992591 | controller | Monday 24 November 2025 08:43:18 +0000 (0:00:00.322) 0:01:12.518 ******* 2025-11-24 08:43:18.992601 | controller | ok: [instance] 2025-11-24 08:43:19.189248 | controller | 2025-11-24 08:43:19.189276 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-11-24 08:43:19.189284 | controller | Monday 24 November 2025 08:43:18 +0000 (0:00:00.035) 0:01:12.553 ******* 2025-11-24 08:43:19.189295 | controller | ok: [instance] 2025-11-24 08:43:19.224227 | controller | 2025-11-24 08:43:19.224261 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-11-24 08:43:19.224271 | controller | Monday 24 November 2025 08:43:19 +0000 (0:00:00.196) 0:01:12.750 ******* 2025-11-24 08:43:19.224284 | controller | ok: [instance] 2025-11-24 08:43:19.564132 | controller | 2025-11-24 08:43:19.564160 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-11-24 08:43:19.564168 | controller | Monday 24 November 2025 08:43:19 +0000 (0:00:00.035) 0:01:12.785 ******* 2025-11-24 08:43:19.564183 | controller | changed: [instance] 2025-11-24 08:43:19.907762 | controller | 2025-11-24 08:43:19.907792 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-11-24 08:43:19.907801 | controller | Monday 24 November 2025 08:43:19 +0000 (0:00:00.339) 0:01:13.125 ******* 2025-11-24 08:43:19.907811 | controller | changed: [instance] 2025-11-24 08:43:19.907905 | controller | 2025-11-24 08:43:19.907942 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-11-24 08:43:19.907954 | controller | Monday 24 November 2025 08:43:19 +0000 (0:00:00.343) 0:01:13.468 ******* 2025-11-24 08:43:20.250234 | controller | changed: [instance] 2025-11-24 08:43:20.347204 | controller | 2025-11-24 08:43:20.347228 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-11-24 08:43:20.347238 | controller | Monday 24 November 2025 08:43:20 +0000 (0:00:00.341) 0:01:13.810 ******* 2025-11-24 08:43:20.347249 | controller | ok: [instance] 2025-11-24 08:43:20.347278 | controller | 2025-11-24 08:43:20.347288 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-11-24 08:43:20.347378 | controller | Monday 24 November 2025 08:43:20 +0000 (0:00:00.097) 0:01:13.908 ******* 2025-11-24 08:43:20.685345 | controller | changed: [instance] 2025-11-24 08:43:20.709670 | controller | 2025-11-24 08:43:20.709687 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-11-24 08:43:20.709695 | controller | Monday 24 November 2025 08:43:20 +0000 (0:00:00.337) 0:01:14.246 ******* 2025-11-24 08:43:20.709704 | controller | skipping: [instance] 2025-11-24 08:43:20.733803 | controller | 2025-11-24 08:43:20.733820 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-24 08:43:20.733827 | controller | Monday 24 November 2025 08:43:20 +0000 (0:00:00.024) 0:01:14.271 ******* 2025-11-24 08:43:20.733835 | controller | skipping: [instance] 2025-11-24 08:43:20.757864 | controller | 2025-11-24 08:43:20.757880 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-11-24 08:43:20.757887 | controller | Monday 24 November 2025 08:43:20 +0000 (0:00:00.024) 0:01:14.295 ******* 2025-11-24 08:43:20.757895 | controller | skipping: [instance] 2025-11-24 08:43:20.782042 | controller | 2025-11-24 08:43:20.782059 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-11-24 08:43:20.782066 | controller | Monday 24 November 2025 08:43:20 +0000 (0:00:00.024) 0:01:14.319 ******* 2025-11-24 08:43:20.782075 | controller | skipping: [instance] 2025-11-24 08:43:20.801896 | controller | 2025-11-24 08:43:20.801913 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-11-24 08:43:20.801925 | controller | Monday 24 November 2025 08:43:20 +0000 (0:00:00.024) 0:01:14.343 ******* 2025-11-24 08:43:20.801934 | controller | ok: [instance] 2025-11-24 08:43:20.892260 | controller | 2025-11-24 08:43:20.892296 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-11-24 08:43:20.892306 | controller | Monday 24 November 2025 08:43:20 +0000 (0:00:00.019) 0:01:14.363 ******* 2025-11-24 08:43:20.892322 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-11-24 08:43:20.892364 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-11-24 08:43:20.892378 | controller | 2025-11-24 08:43:20.892405 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-11-24 08:43:20.892518 | controller | Monday 24 November 2025 08:43:20 +0000 (0:00:00.090) 0:01:14.453 ******* 2025-11-24 08:43:20.911544 | controller | skipping: [instance] 2025-11-24 08:43:21.117792 | controller | 2025-11-24 08:43:21.117814 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-11-24 08:43:21.117822 | controller | Monday 24 November 2025 08:43:20 +0000 (0:00:00.019) 0:01:14.472 ******* 2025-11-24 08:43:21.117831 | controller | ok: [instance] 2025-11-24 08:43:21.514570 | controller | 2025-11-24 08:43:21.514599 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-11-24 08:43:21.514607 | controller | Monday 24 November 2025 08:43:21 +0000 (0:00:00.206) 0:01:14.678 ******* 2025-11-24 08:43:21.514617 | controller | changed: [instance] 2025-11-24 08:43:21.577608 | controller | 2025-11-24 08:43:21.577638 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-11-24 08:43:21.577646 | controller | Monday 24 November 2025 08:43:21 +0000 (0:00:00.396) 0:01:15.075 ******* 2025-11-24 08:43:21.577656 | controller | ok: [instance] 2025-11-24 08:43:21.611773 | controller | 2025-11-24 08:43:21.611795 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-11-24 08:43:21.611803 | controller | Monday 24 November 2025 08:43:21 +0000 (0:00:00.062) 0:01:15.138 ******* 2025-11-24 08:43:21.611812 | controller | ok: [instance] 2025-11-24 08:43:22.021705 | controller | 2025-11-24 08:43:22.021735 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-11-24 08:43:22.021743 | controller | Monday 24 November 2025 08:43:21 +0000 (0:00:00.034) 0:01:15.173 ******* 2025-11-24 08:43:22.021754 | controller | changed: [instance] 2025-11-24 08:43:22.050561 | controller | 2025-11-24 08:43:22.050585 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-11-24 08:43:22.050592 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.409) 0:01:15.582 ******* 2025-11-24 08:43:22.050602 | controller | ok: [instance] 2025-11-24 08:43:22.071154 | controller | 2025-11-24 08:43:22.071178 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-11-24 08:43:22.071186 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.029) 0:01:15.611 ******* 2025-11-24 08:43:22.071205 | controller | ok: [instance] 2025-11-24 08:43:22.090285 | controller | 2025-11-24 08:43:22.090321 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-11-24 08:43:22.090331 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.020) 0:01:15.631 ******* 2025-11-24 08:43:22.090344 | controller | ok: [instance] 2025-11-24 08:43:22.090382 | controller | 2025-11-24 08:43:22.090393 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-11-24 08:43:22.090498 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.019) 0:01:15.651 ******* 2025-11-24 08:43:22.165237 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-11-24 08:43:22.166074 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-11-24 08:43:22.166099 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-11-24 08:43:22.306243 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-11-24 08:43:22.306273 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-11-24 08:43:22.306282 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-11-24 08:43:22.306290 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-11-24 08:43:22.306296 | controller | 2025-11-24 08:43:22.306304 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-24 08:43:22.306310 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.074) 0:01:15.726 ******* 2025-11-24 08:43:22.306322 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-11-24 08:43:22.306354 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-11-24 08:43:22.306363 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-11-24 08:43:22.306579 | controller | 2025-11-24 08:43:22.306611 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-24 08:43:22.423275 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.140) 0:01:15.867 ******* 2025-11-24 08:43:22.423307 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-11-24 08:43:22.423366 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-11-24 08:43:22.423378 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-11-24 08:43:22.423385 | controller | skipping: [instance] 2025-11-24 08:43:22.423394 | controller | 2025-11-24 08:43:22.423496 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-24 08:43:22.423645 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.116) 0:01:15.984 ******* 2025-11-24 08:43:22.506926 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-11-24 08:43:22.507096 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-11-24 08:43:22.507246 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-11-24 08:43:22.507393 | controller | skipping: [instance] 2025-11-24 08:43:22.507501 | controller | 2025-11-24 08:43:22.507605 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-24 08:43:22.507723 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.083) 0:01:16.068 ******* 2025-11-24 08:43:22.590873 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-11-24 08:43:22.591013 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-11-24 08:43:22.591177 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-11-24 08:43:22.591338 | controller | skipping: [instance] 2025-11-24 08:43:22.591469 | controller | 2025-11-24 08:43:22.591580 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-24 08:43:22.591689 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.084) 0:01:16.152 ******* 2025-11-24 08:43:22.712724 | controller | skipping: [instance] => (item=compute-0 - external) 2025-11-24 08:43:22.712856 | controller | skipping: [instance] => (item=controller-0 - external) 2025-11-24 08:43:22.712975 | controller | skipping: [instance] => (item=crc-0 - external) 2025-11-24 08:43:22.713087 | controller | skipping: [instance] 2025-11-24 08:43:22.713229 | controller | 2025-11-24 08:43:22.713342 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-24 08:43:22.713460 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.121) 0:01:16.274 ******* 2025-11-24 08:43:22.796617 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-11-24 08:43:22.796729 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-11-24 08:43:22.796881 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-11-24 08:43:22.796954 | controller | skipping: [instance] 2025-11-24 08:43:22.797074 | controller | 2025-11-24 08:43:22.797266 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-24 08:43:22.797344 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.083) 0:01:16.358 ******* 2025-11-24 08:43:22.939993 | controller | ok: [instance] => (item=compute-0 - public) 2025-11-24 08:43:22.940104 | controller | ok: [instance] => (item=controller-0 - public) 2025-11-24 08:43:22.940252 | controller | ok: [instance] => (item=crc-0 - public) 2025-11-24 08:43:22.940376 | controller | 2025-11-24 08:43:22.940489 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-11-24 08:43:22.940591 | controller | Monday 24 November 2025 08:43:22 +0000 (0:00:00.143) 0:01:16.501 ******* 2025-11-24 08:43:23.050878 | controller | 2025-11-24 08:43:23.051006 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-11-24 08:43:23.051203 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.110) 0:01:16.612 ******* 2025-11-24 08:43:23.090102 | controller | ok: [instance] 2025-11-24 08:43:23.090287 | controller | 2025-11-24 08:43:23.090427 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-11-24 08:43:23.090570 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.039) 0:01:16.651 ******* 2025-11-24 08:43:23.191462 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:d3:a6:9d', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-11-24 08:43:23.191601 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:74:9d:d0', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-11-24 08:43:23.191738 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:b1:5b:24', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-11-24 08:43:23.191856 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:c4:56:fa', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-11-24 08:43:23.191977 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:68:a0:ec', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-11-24 08:43:23.192121 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:7a:e2:40', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-11-24 08:43:23.192222 | controller | 2025-11-24 08:43:23.192358 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-11-24 08:43:23.192474 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.101) 0:01:16.752 ******* 2025-11-24 08:43:23.242557 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-11-24 08:43:23.242728 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-11-24 08:43:23.242850 | controller | 2025-11-24 08:43:23.242968 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-11-24 08:43:23.243084 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.051) 0:01:16.804 ******* 2025-11-24 08:43:23.423457 | controller | ok: [instance] 2025-11-24 08:43:23.448918 | controller | 2025-11-24 08:43:23.448944 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-11-24 08:43:23.448957 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.180) 0:01:16.984 ******* 2025-11-24 08:43:23.448967 | controller | ok: [instance] 2025-11-24 08:43:23.449217 | controller | 2025-11-24 08:43:23.449604 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-11-24 08:43:23.449774 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.025) 0:01:17.010 ******* 2025-11-24 08:43:23.633023 | controller | ok: [instance] 2025-11-24 08:43:23.657555 | controller | 2025-11-24 08:43:23.657574 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-11-24 08:43:23.657582 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.183) 0:01:17.194 ******* 2025-11-24 08:43:23.657591 | controller | ok: [instance] 2025-11-24 08:43:23.677818 | controller | 2025-11-24 08:43:23.677836 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-11-24 08:43:23.677843 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.024) 0:01:17.218 ******* 2025-11-24 08:43:23.677852 | controller | ok: [instance] 2025-11-24 08:43:23.860234 | controller | 2025-11-24 08:43:23.860285 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-11-24 08:43:23.860297 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.020) 0:01:17.239 ******* 2025-11-24 08:43:23.860310 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:d3:a6:9d', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-11-24 08:43:23.860351 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:74:9d:d0', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-11-24 08:43:23.860359 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:b1:5b:24', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-11-24 08:43:23.860366 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:c4:56:fa', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-11-24 08:43:23.860375 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:68:a0:ec', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-11-24 08:43:23.860613 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:7a:e2:40', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-11-24 08:43:23.860633 | controller | 2025-11-24 08:43:23.898718 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-11-24 08:43:23.898741 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.181) 0:01:17.421 ******* 2025-11-24 08:43:23.898753 | controller | ok: [instance] 2025-11-24 08:43:25.970059 | controller | 2025-11-24 08:43:25.970091 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-11-24 08:43:25.970099 | controller | Monday 24 November 2025 08:43:23 +0000 (0:00:00.038) 0:01:17.459 ******* 2025-11-24 08:43:25.970127 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:d3:a6:9d', 'entry': 'set:compute,52:54:00:d3:a6:9d,192.168.140.100,compute-0', 'state': 'present'}) 2025-11-24 08:43:25.991986 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:74:9d:d0', 'entry': 'set:controller,52:54:01:74:9d:d0,192.168.140.9,controller-0', 'state': 'present'}) 2025-11-24 08:43:25.992009 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:b1:5b:24', 'entry': 'set:ocp,52:54:02:b1:5b:24,192.168.140.10,crc-0', 'state': 'present'}) 2025-11-24 08:43:25.992018 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:c4:56:fa', 'entry': 'set:compute,52:54:00:c4:56:fa,192.168.101.100,compute-0', 'state': 'present'}) 2025-11-24 08:43:25.992025 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:68:a0:ec', 'entry': 'set:controller,52:54:01:68:a0:ec,192.168.101.9,controller-0', 'state': 'present'}) 2025-11-24 08:43:25.992032 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:7a:e2:40', 'entry': 'set:ocp,52:54:02:7a:e2:40,192.168.101.10,crc-0', 'state': 'present'}) 2025-11-24 08:43:25.992044 | controller | 2025-11-24 08:43:25.992052 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-11-24 08:43:25.992063 | controller | Monday 24 November 2025 08:43:25 +0000 (0:00:02.070) 0:01:19.530 ******* 2025-11-24 08:43:25.992072 | controller | skipping: [instance] 2025-11-24 08:43:26.211275 | controller | 2025-11-24 08:43:26.211309 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-11-24 08:43:26.211319 | controller | Monday 24 November 2025 08:43:25 +0000 (0:00:00.022) 0:01:19.553 ******* 2025-11-24 08:43:26.211332 | controller | ok: [instance] => (item=compute-0) 2025-11-24 08:43:26.211379 | controller | ok: [instance] => (item=controller-0) 2025-11-24 08:43:26.211389 | controller | ok: [instance] => (item=crc-0) 2025-11-24 08:43:26.211416 | controller | 2025-11-24 08:43:26.211651 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-11-24 08:43:26.330736 | controller | Monday 24 November 2025 08:43:26 +0000 (0:00:00.219) 0:01:19.772 ******* 2025-11-24 08:43:26.330762 | controller | 2025-11-24 08:43:26.373471 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-11-24 08:43:26.373514 | controller | Monday 24 November 2025 08:43:26 +0000 (0:00:00.119) 0:01:19.891 ******* 2025-11-24 08:43:26.373530 | controller | ok: [instance] 2025-11-24 08:43:26.373566 | controller | 2025-11-24 08:43:26.373770 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-24 08:43:26.582473 | controller | Monday 24 November 2025 08:43:26 +0000 (0:00:00.042) 0:01:19.934 ******* 2025-11-24 08:43:26.582512 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-24 08:43:26.582716 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-24 08:43:26.582900 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-11-24 08:43:26.583069 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-11-24 08:43:26.583260 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-11-24 08:43:26.583428 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-11-24 08:43:26.583570 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-11-24 08:43:26.583716 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-24 08:43:26.583863 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-24 08:43:26.584013 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-11-24 08:43:26.584177 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-24 08:43:26.584321 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-24 08:43:26.584471 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-11-24 08:43:26.584605 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-11-24 08:43:26.584743 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-11-24 08:43:26.584874 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-11-24 08:43:26.584992 | controller | 2025-11-24 08:43:26.585145 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-24 08:43:26.585287 | controller | Monday 24 November 2025 08:43:26 +0000 (0:00:00.209) 0:01:20.143 ******* 2025-11-24 08:43:29.857205 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-24 08:43:29.857258 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-24 08:43:29.857266 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-11-24 08:43:29.857272 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-11-24 08:43:29.857278 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-11-24 08:43:29.857283 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-11-24 08:43:29.857289 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-11-24 08:43:29.857296 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-24 08:43:29.857318 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-24 08:43:29.857767 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-11-24 08:43:29.857809 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-24 08:43:29.857820 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-24 08:43:29.858020 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-11-24 08:43:29.858143 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-11-24 08:43:29.858159 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-11-24 08:43:29.858516 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-11-24 08:43:29.878644 | controller | 2025-11-24 08:43:29.878662 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2025-11-24 08:43:29.878670 | controller | Monday 24 November 2025 08:43:29 +0000 (0:00:03.273) 0:01:23.417 ******* 2025-11-24 08:43:29.878679 | controller | ok: [instance] 2025-11-24 08:43:29.922189 | controller | 2025-11-24 08:43:29.922220 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2025-11-24 08:43:29.922229 | controller | Monday 24 November 2025 08:43:29 +0000 (0:00:00.021) 0:01:23.439 ******* 2025-11-24 08:43:29.922241 | controller | skipping: [instance] => (item=compute) 2025-11-24 08:43:29.922275 | controller | skipping: [instance] => (item=controller) 2025-11-24 08:43:29.922283 | controller | skipping: [instance] => (item=crc) 2025-11-24 08:43:29.922290 | controller | skipping: [instance] 2025-11-24 08:43:29.922299 | controller | 2025-11-24 08:43:29.922503 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2025-11-24 08:43:29.953549 | controller | Monday 24 November 2025 08:43:29 +0000 (0:00:00.043) 0:01:23.483 ******* 2025-11-24 08:43:29.953583 | controller | skipping: [instance] 2025-11-24 08:43:29.953781 | controller | 2025-11-24 08:43:29.953922 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-11-24 08:43:29.954056 | controller | Monday 24 November 2025 08:43:29 +0000 (0:00:00.031) 0:01:23.514 ******* 2025-11-24 08:43:30.378027 | controller | changed: [instance] 2025-11-24 08:43:31.187053 | controller | 2025-11-24 08:43:31.187083 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-11-24 08:43:31.187090 | controller | Monday 24 November 2025 08:43:30 +0000 (0:00:00.412) 0:01:23.927 ******* 2025-11-24 08:43:31.187096 | controller | 2025-11-24 08:43:31.187101 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-11-24 08:43:31.187125 | controller | Monday 24 November 2025 08:43:30 +0000 (0:00:00.011) 0:01:23.938 ******* 2025-11-24 08:43:31.187139 | controller | changed: [instance] 2025-11-24 08:43:31.531129 | controller | 2025-11-24 08:43:31.531160 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-11-24 08:43:31.531168 | controller | Monday 24 November 2025 08:43:31 +0000 (0:00:00.809) 0:01:24.747 ******* 2025-11-24 08:43:31.531178 | controller | changed: [instance] 2025-11-24 08:43:31.871629 | controller | 2025-11-24 08:43:31.871657 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-11-24 08:43:31.871666 | controller | Monday 24 November 2025 08:43:31 +0000 (0:00:00.344) 0:01:25.092 ******* 2025-11-24 08:43:31.871675 | controller | changed: [instance] 2025-11-24 08:43:32.236162 | controller | 2025-11-24 08:43:32.236193 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-11-24 08:43:32.236202 | controller | Monday 24 November 2025 08:43:31 +0000 (0:00:00.340) 0:01:25.432 ******* 2025-11-24 08:43:32.236212 | controller | changed: [instance] 2025-11-24 08:43:32.610652 | controller | 2025-11-24 08:43:32.610680 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-11-24 08:43:32.610688 | controller | Monday 24 November 2025 08:43:32 +0000 (0:00:00.364) 0:01:25.797 ******* 2025-11-24 08:43:32.610703 | controller | changed: [instance] 2025-11-24 08:43:32.643229 | controller | 2025-11-24 08:43:32.643275 | controller | TASK [Build utility records dataset] ******************************************* 2025-11-24 08:43:32.643288 | controller | Monday 24 November 2025 08:43:32 +0000 (0:00:00.374) 0:01:26.171 ******* 2025-11-24 08:43:32.643302 | controller | 2025-11-24 08:43:32.737594 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-11-24 08:43:32.737639 | controller | Monday 24 November 2025 08:43:32 +0000 (0:00:00.032) 0:01:26.204 ******* 2025-11-24 08:43:32.737655 | controller | ok: [instance] 2025-11-24 08:43:32.837979 | controller | 2025-11-24 08:43:32.838021 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-24 08:43:32.838031 | controller | Monday 24 November 2025 08:43:32 +0000 (0:00:00.094) 0:01:26.298 ******* 2025-11-24 08:43:32.838047 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-11-24 08:43:33.319252 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-24 08:43:33.319291 | controller | 2025-11-24 08:43:33.319302 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-24 08:43:33.319309 | controller | Monday 24 November 2025 08:43:32 +0000 (0:00:00.100) 0:01:26.398 ******* 2025-11-24 08:43:33.319328 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-11-24 08:43:33.319368 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-24 08:43:33.319377 | controller | 2025-11-24 08:43:33.319383 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-11-24 08:43:33.319390 | controller | Monday 24 November 2025 08:43:33 +0000 (0:00:00.470) 0:01:26.869 ******* 2025-11-24 08:43:33.319396 | controller | 2025-11-24 08:43:33.319405 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-11-24 08:43:33.319455 | controller | Monday 24 November 2025 08:43:33 +0000 (0:00:00.010) 0:01:26.879 ******* 2025-11-24 08:43:33.777253 | controller | changed: [instance] 2025-11-24 08:43:33.777335 | controller | 2025-11-24 08:43:33.777348 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-11-24 08:43:33.777427 | controller | Monday 24 November 2025 08:43:33 +0000 (0:00:00.458) 0:01:27.338 ******* 2025-11-24 08:43:34.132200 | controller | changed: [instance] 2025-11-24 08:43:34.164981 | controller | 2025-11-24 08:43:34.165020 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-11-24 08:43:34.165030 | controller | Monday 24 November 2025 08:43:34 +0000 (0:00:00.354) 0:01:27.693 ******* 2025-11-24 08:43:34.165044 | controller | skipping: [instance] 2025-11-24 08:43:34.244042 | controller | 2025-11-24 08:43:34.244083 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-11-24 08:43:34.244097 | controller | Monday 24 November 2025 08:43:34 +0000 (0:00:00.032) 0:01:27.726 ******* 2025-11-24 08:43:34.244141 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-11-24 08:43:34.487047 | controller | 2025-11-24 08:43:34.487086 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-11-24 08:43:34.487096 | controller | Monday 24 November 2025 08:43:34 +0000 (0:00:00.078) 0:01:27.805 ******* 2025-11-24 08:43:34.487128 | controller | ok: [instance] 2025-11-24 08:43:34.506772 | controller | 2025-11-24 08:43:34.506801 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-11-24 08:43:34.506811 | controller | Monday 24 November 2025 08:43:34 +0000 (0:00:00.242) 0:01:28.048 ******* 2025-11-24 08:43:34.506823 | controller | skipping: [instance] 2025-11-24 08:43:34.854530 | controller | 2025-11-24 08:43:34.854573 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-11-24 08:43:34.854582 | controller | Monday 24 November 2025 08:43:34 +0000 (0:00:00.019) 0:01:28.067 ******* 2025-11-24 08:43:34.854594 | controller | ok: [instance] 2025-11-24 08:43:35.084293 | controller | 2025-11-24 08:43:35.084335 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-11-24 08:43:35.084345 | controller | Monday 24 November 2025 08:43:34 +0000 (0:00:00.347) 0:01:28.415 ******* 2025-11-24 08:43:35.084359 | controller | ok: [instance] 2025-11-24 08:43:35.302495 | controller | 2025-11-24 08:43:35.302528 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-11-24 08:43:35.302536 | controller | Monday 24 November 2025 08:43:35 +0000 (0:00:00.229) 0:01:28.645 ******* 2025-11-24 08:43:35.302547 | controller | ok: [instance] 2025-11-24 08:43:35.534029 | controller | 2025-11-24 08:43:35.534059 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-11-24 08:43:35.534067 | controller | Monday 24 November 2025 08:43:35 +0000 (0:00:00.218) 0:01:28.863 ******* 2025-11-24 08:43:35.534077 | controller | ok: [instance] 2025-11-24 08:43:35.753826 | controller | 2025-11-24 08:43:35.753854 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-11-24 08:43:35.753866 | controller | Monday 24 November 2025 08:43:35 +0000 (0:00:00.231) 0:01:29.095 ******* 2025-11-24 08:43:35.753877 | controller | ok: [instance] 2025-11-24 08:43:35.793101 | controller | 2025-11-24 08:43:35.793144 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-24 08:43:35.793158 | controller | Monday 24 November 2025 08:43:35 +0000 (0:00:00.219) 0:01:29.314 ******* 2025-11-24 08:43:35.793168 | controller | 2025-11-24 08:43:35.988228 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-11-24 08:43:35.988266 | controller | Monday 24 November 2025 08:43:35 +0000 (0:00:00.039) 0:01:29.354 ******* 2025-11-24 08:43:35.988282 | controller | ok: [instance] 2025-11-24 08:43:35.988315 | controller | 2025-11-24 08:43:35.988504 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-11-24 08:43:36.008868 | controller | Monday 24 November 2025 08:43:35 +0000 (0:00:00.195) 0:01:29.549 ******* 2025-11-24 08:43:36.008903 | controller | ok: [instance] 2025-11-24 08:43:36.031953 | controller | 2025-11-24 08:43:36.031975 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-11-24 08:43:36.031984 | controller | Monday 24 November 2025 08:43:36 +0000 (0:00:00.020) 0:01:29.570 ******* 2025-11-24 08:43:36.031995 | controller | skipping: [instance] 2025-11-24 08:43:36.318537 | controller | 2025-11-24 08:43:36.318571 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-11-24 08:43:36.318581 | controller | Monday 24 November 2025 08:43:36 +0000 (0:00:00.023) 0:01:29.593 ******* 2025-11-24 08:43:36.318592 | controller | ok: [instance] 2025-11-24 08:43:36.538240 | controller | 2025-11-24 08:43:36.538275 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-11-24 08:43:36.538285 | controller | Monday 24 November 2025 08:43:36 +0000 (0:00:00.286) 0:01:29.879 ******* 2025-11-24 08:43:36.538297 | controller | ok: [instance] 2025-11-24 08:43:36.711667 | controller | 2025-11-24 08:43:36.711701 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-11-24 08:43:36.711710 | controller | Monday 24 November 2025 08:43:36 +0000 (0:00:00.219) 0:01:30.099 ******* 2025-11-24 08:43:36.711720 | controller | ok: [instance] 2025-11-24 08:43:36.768721 | controller | 2025-11-24 08:43:36.768749 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-11-24 08:43:36.768772 | controller | Monday 24 November 2025 08:43:36 +0000 (0:00:00.173) 0:01:30.272 ******* 2025-11-24 08:43:36.768784 | controller | 2025-11-24 08:43:36.813718 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-11-24 08:43:36.813744 | controller | Monday 24 November 2025 08:43:36 +0000 (0:00:00.057) 0:01:30.329 ******* 2025-11-24 08:43:36.813768 | controller | ok: [instance] => changed=false 2025-11-24 08:43:36.992226 | controller | msg: All assertions passed 2025-11-24 08:43:36.992258 | controller | 2025-11-24 08:43:36.992266 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-11-24 08:43:36.992272 | controller | Monday 24 November 2025 08:43:36 +0000 (0:00:00.044) 0:01:30.374 ******* 2025-11-24 08:43:36.992282 | controller | ok: [instance] 2025-11-24 08:43:36.992372 | controller | 2025-11-24 08:43:36.992384 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-11-24 08:43:36.992516 | controller | Monday 24 November 2025 08:43:36 +0000 (0:00:00.178) 0:01:30.553 ******* 2025-11-24 08:43:37.211699 | controller | ok: [instance] 2025-11-24 08:43:37.235832 | controller | 2025-11-24 08:43:37.235855 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-11-24 08:43:37.235863 | controller | Monday 24 November 2025 08:43:37 +0000 (0:00:00.219) 0:01:30.772 ******* 2025-11-24 08:43:37.235873 | controller | ok: [instance] => changed=false 2025-11-24 08:43:37.420799 | controller | msg: All assertions passed 2025-11-24 08:43:37.420826 | controller | 2025-11-24 08:43:37.420835 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-11-24 08:43:37.420843 | controller | Monday 24 November 2025 08:43:37 +0000 (0:00:00.024) 0:01:30.796 ******* 2025-11-24 08:43:37.420853 | controller | ok: [instance] 2025-11-24 08:43:37.621633 | controller | 2025-11-24 08:43:37.621660 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-11-24 08:43:37.621668 | controller | Monday 24 November 2025 08:43:37 +0000 (0:00:00.184) 0:01:30.981 ******* 2025-11-24 08:43:37.621678 | controller | ok: [instance] 2025-11-24 08:43:37.670769 | controller | 2025-11-24 08:43:37.670807 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-11-24 08:43:37.670816 | controller | Monday 24 November 2025 08:43:37 +0000 (0:00:00.200) 0:01:31.182 ******* 2025-11-24 08:43:37.670831 | controller | ok: [instance] 2025-11-24 08:43:38.061123 | controller | 2025-11-24 08:43:38.061157 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-11-24 08:43:38.061165 | controller | Monday 24 November 2025 08:43:37 +0000 (0:00:00.049) 0:01:31.231 ******* 2025-11-24 08:43:38.061175 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-11-24 08:43:38.080193 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-11-24 08:43:38.080233 | controller | 2025-11-24 08:43:38.080241 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-11-24 08:43:38.080247 | controller | Monday 24 November 2025 08:43:38 +0000 (0:00:00.390) 0:01:31.622 ******* 2025-11-24 08:43:38.080257 | controller | skipping: [instance] 2025-11-24 08:43:38.080281 | controller | 2025-11-24 08:43:38.080289 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-11-24 08:43:38.080415 | controller | Monday 24 November 2025 08:43:38 +0000 (0:00:00.019) 0:01:31.641 ******* 2025-11-24 08:43:38.104298 | controller | skipping: [instance] 2025-11-24 08:43:38.104431 | controller | 2025-11-24 08:43:38.104452 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-11-24 08:43:38.104463 | controller | Monday 24 November 2025 08:43:38 +0000 (0:00:00.024) 0:01:31.665 ******* 2025-11-24 08:43:38.236418 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-11-24 08:43:38.261056 | controller | 2025-11-24 08:43:38.261075 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-11-24 08:43:38.261085 | controller | Monday 24 November 2025 08:43:38 +0000 (0:00:00.131) 0:01:31.797 ******* 2025-11-24 08:43:38.261095 | controller | skipping: [instance] 2025-11-24 08:43:38.687990 | controller | 2025-11-24 08:43:38.688013 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-11-24 08:43:38.688021 | controller | Monday 24 November 2025 08:43:38 +0000 (0:00:00.024) 0:01:31.822 ******* 2025-11-24 08:43:38.688030 | controller | changed: [instance] 2025-11-24 08:43:39.214201 | controller | 2025-11-24 08:43:39.214231 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-11-24 08:43:39.214241 | controller | Monday 24 November 2025 08:43:38 +0000 (0:00:00.426) 0:01:32.249 ******* 2025-11-24 08:43:39.214253 | controller | changed: [instance] 2025-11-24 08:43:39.214581 | controller | 2025-11-24 08:43:39.214597 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-11-24 08:43:39.214608 | controller | Monday 24 November 2025 08:43:39 +0000 (0:00:00.515) 0:01:32.764 ******* 2025-11-24 08:43:39.641537 | controller | 2025-11-24 08:43:39.641566 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-11-24 08:43:39.641574 | controller | Monday 24 November 2025 08:43:39 +0000 (0:00:00.011) 0:01:32.775 ******* 2025-11-24 08:43:39.641583 | controller | changed: [instance] 2025-11-24 08:43:40.462621 | controller | 2025-11-24 08:43:40.462651 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-11-24 08:43:40.462659 | controller | Monday 24 November 2025 08:43:39 +0000 (0:00:00.426) 0:01:33.202 ******* 2025-11-24 08:43:40.462669 | controller | changed: [instance] 2025-11-24 08:43:40.494211 | controller | 2025-11-24 08:43:40.494238 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-11-24 08:43:40.494248 | controller | Monday 24 November 2025 08:43:40 +0000 (0:00:00.821) 0:01:34.023 ******* 2025-11-24 08:43:40.494267 | controller | skipping: [instance] 2025-11-24 08:43:40.494288 | controller | 2025-11-24 08:43:40.494295 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-11-24 08:43:40.494304 | controller | Monday 24 November 2025 08:43:40 +0000 (0:00:00.031) 0:01:34.055 ******* 2025-11-24 08:43:40.525239 | controller | skipping: [instance] 2025-11-24 08:43:40.525324 | controller | 2025-11-24 08:43:40.525431 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-11-24 08:43:40.525554 | controller | Monday 24 November 2025 08:43:40 +0000 (0:00:00.031) 0:01:34.086 ******* 2025-11-24 08:43:41.065243 | controller | changed: [instance] => (item=workload) 2025-11-24 08:43:41.065280 | controller | changed: [instance] => (item=reproducer-inventory) 2025-11-24 08:43:41.065290 | controller | ok: [instance] => (item=volumes) 2025-11-24 08:43:41.065299 | controller | 2025-11-24 08:43:41.065306 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-11-24 08:43:41.065316 | controller | Monday 24 November 2025 08:43:41 +0000 (0:00:00.538) 0:01:34.625 ******* 2025-11-24 08:43:41.458606 | controller | changed: [instance] => (item=workload) 2025-11-24 08:43:41.483098 | controller | changed: [instance] => (item=volumes) 2025-11-24 08:43:41.483138 | controller | 2025-11-24 08:43:41.483146 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-11-24 08:43:41.483152 | controller | Monday 24 November 2025 08:43:41 +0000 (0:00:00.393) 0:01:35.019 ******* 2025-11-24 08:43:41.483161 | controller | skipping: [instance] 2025-11-24 08:43:42.510256 | controller | 2025-11-24 08:43:42.510289 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-11-24 08:43:42.510304 | controller | Monday 24 November 2025 08:43:41 +0000 (0:00:00.024) 0:01:35.044 ******* 2025-11-24 08:43:42.510316 | controller | changed: [instance] => (item=compute) 2025-11-24 08:43:42.510339 | controller | changed: [instance] => (item=controller) 2025-11-24 08:43:42.510386 | controller | changed: [instance] => (item=crc) 2025-11-24 08:43:42.510711 | controller | 2025-11-24 08:43:42.877642 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-11-24 08:43:42.877671 | controller | Monday 24 November 2025 08:43:42 +0000 (0:00:01.027) 0:01:36.071 ******* 2025-11-24 08:43:42.877682 | controller | changed: [instance] 2025-11-24 08:43:42.916203 | controller | 2025-11-24 08:43:42.916236 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-11-24 08:43:42.916245 | controller | Monday 24 November 2025 08:43:42 +0000 (0:00:00.366) 0:01:36.438 ******* 2025-11-24 08:43:42.916255 | controller | skipping: [instance] 2025-11-24 08:43:42.916274 | controller | 2025-11-24 08:43:42.916499 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-11-24 08:43:42.978187 | controller | Monday 24 November 2025 08:43:42 +0000 (0:00:00.038) 0:01:36.477 ******* 2025-11-24 08:43:42.978218 | controller | skipping: [instance] => (item=crc) 2025-11-24 08:43:42.978251 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-11-24 08:43:42.978261 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-11-24 08:43:42.978270 | controller | 2025-11-24 08:43:42.978485 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-11-24 08:43:43.183217 | controller | Monday 24 November 2025 08:43:42 +0000 (0:00:00.061) 0:01:36.539 ******* 2025-11-24 08:43:43.183257 | controller | changed: [instance] 2025-11-24 08:43:43.363077 | controller | 2025-11-24 08:43:43.363104 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-11-24 08:43:43.363130 | controller | Monday 24 November 2025 08:43:43 +0000 (0:00:00.205) 0:01:36.744 ******* 2025-11-24 08:43:43.363141 | controller | ok: [instance] 2025-11-24 08:44:04.515278 | controller | 2025-11-24 08:44:04.515317 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-11-24 08:44:04.515328 | controller | Monday 24 November 2025 08:43:43 +0000 (0:00:00.179) 0:01:36.924 ******* 2025-11-24 08:44:04.515340 | controller | changed: [instance] 2025-11-24 08:44:04.751208 | controller | 2025-11-24 08:44:04.751250 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-11-24 08:44:04.751258 | controller | Monday 24 November 2025 08:44:04 +0000 (0:00:21.151) 0:01:58.076 ******* 2025-11-24 08:44:04.751269 | controller | ok: [instance] 2025-11-24 08:44:04.792240 | controller | 2025-11-24 08:44:04.792270 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-11-24 08:44:04.792287 | controller | Monday 24 November 2025 08:44:04 +0000 (0:00:00.236) 0:01:58.312 ******* 2025-11-24 08:44:04.792300 | controller | ok: [instance] => changed=false 2025-11-24 08:44:04.792330 | controller | msg: All assertions passed 2025-11-24 08:44:04.792340 | controller | 2025-11-24 08:44:04.792364 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-11-24 08:44:04.792473 | controller | Monday 24 November 2025 08:44:04 +0000 (0:00:00.041) 0:01:58.353 ******* 2025-11-24 08:44:05.003808 | controller | changed: [instance] 2025-11-24 08:44:05.211060 | controller | 2025-11-24 08:44:05.211090 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-11-24 08:44:05.211098 | controller | Monday 24 November 2025 08:44:05 +0000 (0:00:00.211) 0:01:58.564 ******* 2025-11-24 08:44:05.211124 | controller | ok: [instance] 2025-11-24 08:44:05.408267 | controller | 2025-11-24 08:44:05.408305 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-11-24 08:44:05.408315 | controller | Monday 24 November 2025 08:44:05 +0000 (0:00:00.207) 0:01:58.772 ******* 2025-11-24 08:44:05.408328 | controller | ok: [instance] 2025-11-24 08:44:05.430074 | controller | 2025-11-24 08:44:05.430100 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-11-24 08:44:05.430127 | controller | Monday 24 November 2025 08:44:05 +0000 (0:00:00.197) 0:01:58.969 ******* 2025-11-24 08:44:05.430138 | controller | skipping: [instance] 2025-11-24 08:44:05.653209 | controller | 2025-11-24 08:44:05.653249 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-11-24 08:44:05.653260 | controller | Monday 24 November 2025 08:44:05 +0000 (0:00:00.021) 0:01:58.991 ******* 2025-11-24 08:44:05.653274 | controller | ok: [instance] 2025-11-24 08:44:05.695137 | controller | 2025-11-24 08:44:05.695170 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-11-24 08:44:05.695180 | controller | Monday 24 November 2025 08:44:05 +0000 (0:00:00.223) 0:01:59.214 ******* 2025-11-24 08:44:05.695193 | controller | ok: [instance] => changed=false 2025-11-24 08:44:05.905482 | controller | msg: All assertions passed 2025-11-24 08:44:05.905515 | controller | 2025-11-24 08:44:05.905525 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-11-24 08:44:05.905532 | controller | Monday 24 November 2025 08:44:05 +0000 (0:00:00.041) 0:01:59.256 ******* 2025-11-24 08:44:05.905549 | controller | ok: [instance] 2025-11-24 08:44:06.085832 | controller | 2025-11-24 08:44:06.085862 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-11-24 08:44:06.085870 | controller | Monday 24 November 2025 08:44:05 +0000 (0:00:00.210) 0:01:59.466 ******* 2025-11-24 08:44:06.085890 | controller | ok: [instance] 2025-11-24 08:44:06.446682 | controller | 2025-11-24 08:44:06.446717 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-11-24 08:44:06.446728 | controller | Monday 24 November 2025 08:44:06 +0000 (0:00:00.180) 0:01:59.646 ******* 2025-11-24 08:44:06.446740 | controller | changed: [instance] 2025-11-24 08:44:06.624240 | controller | 2025-11-24 08:44:06.624277 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-11-24 08:44:06.624287 | controller | Monday 24 November 2025 08:44:06 +0000 (0:00:00.360) 0:02:00.007 ******* 2025-11-24 08:44:06.624299 | controller | ok: [instance] 2025-11-24 08:44:06.806848 | controller | 2025-11-24 08:44:06.806881 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-11-24 08:44:06.806889 | controller | Monday 24 November 2025 08:44:06 +0000 (0:00:00.177) 0:02:00.185 ******* 2025-11-24 08:44:06.806910 | controller | ok: [instance] 2025-11-24 08:44:07.214845 | controller | 2025-11-24 08:44:07.214877 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-11-24 08:44:07.214885 | controller | Monday 24 November 2025 08:44:06 +0000 (0:00:00.182) 0:02:00.367 ******* 2025-11-24 08:44:07.214896 | controller | changed: [instance] 2025-11-24 08:44:07.235244 | controller | 2025-11-24 08:44:07.235290 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-11-24 08:44:07.235300 | controller | Monday 24 November 2025 08:44:07 +0000 (0:00:00.407) 0:02:00.775 ******* 2025-11-24 08:44:07.235318 | controller | ok: [instance] 2025-11-24 08:44:07.235349 | controller | 2025-11-24 08:44:07.235359 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-11-24 08:44:07.235508 | controller | Monday 24 November 2025 08:44:07 +0000 (0:00:00.020) 0:02:00.796 ******* 2025-11-24 08:44:07.463979 | controller | ok: [instance] 2025-11-24 08:44:07.932723 | controller | 2025-11-24 08:44:07.932759 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-11-24 08:44:07.932769 | controller | Monday 24 November 2025 08:44:07 +0000 (0:00:00.228) 0:02:01.024 ******* 2025-11-24 08:44:07.932781 | controller | ok: [instance] 2025-11-24 08:44:08.056281 | controller | 2025-11-24 08:44:08.056321 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-11-24 08:44:08.056329 | controller | Monday 24 November 2025 08:44:07 +0000 (0:00:00.468) 0:02:01.493 ******* 2025-11-24 08:44:08.056340 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-24 08:44:08.056369 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-24 08:44:08.056376 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-24 08:44:08.056384 | controller | 2025-11-24 08:44:08.056557 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-11-24 08:44:08.317871 | controller | Monday 24 November 2025 08:44:08 +0000 (0:00:00.123) 0:02:01.617 ******* 2025-11-24 08:44:08.317905 | controller | changed: [instance] 2025-11-24 08:44:08.544212 | controller | 2025-11-24 08:44:08.544326 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-11-24 08:44:08.544338 | controller | Monday 24 November 2025 08:44:08 +0000 (0:00:00.261) 0:02:01.878 ******* 2025-11-24 08:44:08.544354 | controller | changed: [instance] 2025-11-24 08:44:08.837915 | controller | 2025-11-24 08:44:08.837945 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-11-24 08:44:08.837953 | controller | Monday 24 November 2025 08:44:08 +0000 (0:00:00.226) 0:02:02.105 ******* 2025-11-24 08:44:08.837964 | controller | changed: [instance] 2025-11-24 08:44:08.867611 | controller | 2025-11-24 08:44:08.867634 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-11-24 08:44:08.867643 | controller | Monday 24 November 2025 08:44:08 +0000 (0:00:00.293) 0:02:02.398 ******* 2025-11-24 08:44:08.867654 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-11-24 08:44:08.913256 | controller | 2025-11-24 08:44:08.913293 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-11-24 08:44:08.913303 | controller | Monday 24 November 2025 08:44:08 +0000 (0:00:00.029) 0:02:02.428 ******* 2025-11-24 08:44:08.913316 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-11-24 08:44:08.913348 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-11-24 08:44:08.913356 | controller | 2025-11-24 08:44:08.913365 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-24 08:44:08.913513 | controller | Monday 24 November 2025 08:44:08 +0000 (0:00:00.045) 0:02:02.474 ******* 2025-11-24 08:44:09.145195 | controller | ok: [instance] 2025-11-24 08:44:09.145425 | controller | 2025-11-24 08:44:09.145458 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-24 08:44:09.189231 | controller | Monday 24 November 2025 08:44:09 +0000 (0:00:00.231) 0:02:02.706 ******* 2025-11-24 08:44:09.189261 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:44:09.189294 | controller | ok: [instance] => (item=cifmw-public) 2025-11-24 08:44:09.189314 | controller | 2025-11-24 08:44:09.189421 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-24 08:44:09.189483 | controller | Monday 24 November 2025 08:44:09 +0000 (0:00:00.044) 0:02:02.750 ******* 2025-11-24 08:44:09.428291 | controller | ok: [instance] 2025-11-24 08:44:09.428337 | controller | 2025-11-24 08:44:09.428347 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-24 08:44:09.428357 | controller | Monday 24 November 2025 08:44:09 +0000 (0:00:00.238) 0:02:02.989 ******* 2025-11-24 08:44:09.633909 | controller | ok: [instance] 2025-11-24 08:44:10.931231 | controller | 2025-11-24 08:44:10.931274 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-11-24 08:44:10.931282 | controller | Monday 24 November 2025 08:44:09 +0000 (0:00:00.205) 0:02:03.194 ******* 2025-11-24 08:44:10.931293 | controller | changed: [instance] 2025-11-24 08:44:11.161224 | controller | 2025-11-24 08:44:11.161259 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-24 08:44:11.161272 | controller | Monday 24 November 2025 08:44:10 +0000 (0:00:01.297) 0:02:04.492 ******* 2025-11-24 08:44:11.161284 | controller | ok: [instance] 2025-11-24 08:44:11.204252 | controller | 2025-11-24 08:44:11.204279 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-24 08:44:11.204288 | controller | Monday 24 November 2025 08:44:11 +0000 (0:00:00.229) 0:02:04.722 ******* 2025-11-24 08:44:11.204299 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:44:11.204496 | controller | ok: [instance] => (item=cifmw-public) 2025-11-24 08:44:11.204525 | controller | 2025-11-24 08:44:11.204537 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-24 08:44:11.432740 | controller | Monday 24 November 2025 08:44:11 +0000 (0:00:00.043) 0:02:04.765 ******* 2025-11-24 08:44:11.432774 | controller | ok: [instance] 2025-11-24 08:44:11.632687 | controller | 2025-11-24 08:44:11.632716 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-24 08:44:11.632724 | controller | Monday 24 November 2025 08:44:11 +0000 (0:00:00.228) 0:02:04.993 ******* 2025-11-24 08:44:11.632734 | controller | ok: [instance] 2025-11-24 08:44:11.916044 | controller | 2025-11-24 08:44:11.916073 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-11-24 08:44:11.916081 | controller | Monday 24 November 2025 08:44:11 +0000 (0:00:00.199) 0:02:05.193 ******* 2025-11-24 08:44:11.916091 | controller | changed: [instance] 2025-11-24 08:44:11.937017 | controller | 2025-11-24 08:44:11.937036 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-11-24 08:44:11.937043 | controller | Monday 24 November 2025 08:44:11 +0000 (0:00:00.283) 0:02:05.477 ******* 2025-11-24 08:44:11.937052 | controller | skipping: [instance] 2025-11-24 08:44:11.965565 | controller | 2025-11-24 08:44:11.965586 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-11-24 08:44:11.965595 | controller | Monday 24 November 2025 08:44:11 +0000 (0:00:00.021) 0:02:05.498 ******* 2025-11-24 08:44:11.965605 | controller | skipping: [instance] 2025-11-24 08:44:11.993248 | controller | 2025-11-24 08:44:11.993284 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-11-24 08:44:11.993294 | controller | Monday 24 November 2025 08:44:11 +0000 (0:00:00.028) 0:02:05.526 ******* 2025-11-24 08:44:11.993307 | controller | skipping: [instance] 2025-11-24 08:44:12.019731 | controller | 2025-11-24 08:44:12.019761 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-11-24 08:44:12.019770 | controller | Monday 24 November 2025 08:44:11 +0000 (0:00:00.027) 0:02:05.554 ******* 2025-11-24 08:44:12.019782 | controller | skipping: [instance] 2025-11-24 08:44:12.231833 | controller | 2025-11-24 08:44:12.231864 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-11-24 08:44:12.231873 | controller | Monday 24 November 2025 08:44:12 +0000 (0:00:00.026) 0:02:05.580 ******* 2025-11-24 08:44:12.231883 | controller | changed: [instance] 2025-11-24 08:44:12.268886 | controller | 2025-11-24 08:44:12.268912 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-11-24 08:44:12.268924 | controller | Monday 24 November 2025 08:44:12 +0000 (0:00:00.212) 0:02:05.792 ******* 2025-11-24 08:44:12.268934 | controller | ok: [instance] 2025-11-24 08:44:12.322248 | controller | 2025-11-24 08:44:12.322282 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-11-24 08:44:12.322292 | controller | Monday 24 November 2025 08:44:12 +0000 (0:00:00.037) 0:02:05.830 ******* 2025-11-24 08:44:12.322309 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-11-24 08:44:12.322339 | controller | 2025-11-24 08:44:12.322348 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-11-24 08:44:12.322472 | controller | Monday 24 November 2025 08:44:12 +0000 (0:00:00.053) 0:02:05.883 ******* 2025-11-24 08:44:12.517059 | controller | ok: [instance] 2025-11-24 08:44:12.578966 | controller | 2025-11-24 08:44:12.578995 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-11-24 08:44:12.579003 | controller | Monday 24 November 2025 08:44:12 +0000 (0:00:00.194) 0:02:06.078 ******* 2025-11-24 08:44:12.579014 | controller | ok: [instance] 2025-11-24 08:44:12.624287 | controller | 2025-11-24 08:44:12.624322 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-11-24 08:44:12.624332 | controller | Monday 24 November 2025 08:44:12 +0000 (0:00:00.062) 0:02:06.140 ******* 2025-11-24 08:44:12.624344 | controller | ok: [instance] 2025-11-24 08:44:12.624375 | controller | 2025-11-24 08:44:12.624383 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-11-24 08:44:12.624391 | controller | Monday 24 November 2025 08:44:12 +0000 (0:00:00.045) 0:02:06.185 ******* 2025-11-24 08:44:12.666839 | controller | skipping: [instance] 2025-11-24 08:44:12.709223 | controller | 2025-11-24 08:44:12.709253 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-11-24 08:44:12.709262 | controller | Monday 24 November 2025 08:44:12 +0000 (0:00:00.042) 0:02:06.228 ******* 2025-11-24 08:44:12.709273 | controller | skipping: [instance] 2025-11-24 08:44:12.768747 | controller | 2025-11-24 08:44:12.768769 | controller | TASK [Call the config_drive role] ********************************************** 2025-11-24 08:44:12.768783 | controller | Monday 24 November 2025 08:44:12 +0000 (0:00:00.042) 0:02:06.270 ******* 2025-11-24 08:44:12.768793 | controller | 2025-11-24 08:44:13.168225 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-11-24 08:44:13.168263 | controller | Monday 24 November 2025 08:44:12 +0000 (0:00:00.059) 0:02:06.330 ******* 2025-11-24 08:44:13.168277 | controller | ok: [instance] => (item=artifacts) 2025-11-24 08:44:13.168314 | controller | ok: [instance] => (item=logs) 2025-11-24 08:44:13.168325 | controller | 2025-11-24 08:44:13.168345 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-11-24 08:44:13.168471 | controller | Monday 24 November 2025 08:44:13 +0000 (0:00:00.399) 0:02:06.729 ******* 2025-11-24 08:44:14.406682 | controller | ok: [instance] 2025-11-24 08:44:14.625844 | controller | 2025-11-24 08:44:14.625876 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-11-24 08:44:14.625884 | controller | Monday 24 November 2025 08:44:14 +0000 (0:00:01.238) 0:02:07.967 ******* 2025-11-24 08:44:14.625894 | controller | changed: [instance] 2025-11-24 08:44:15.004229 | controller | 2025-11-24 08:44:15.004264 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-11-24 08:44:15.004272 | controller | Monday 24 November 2025 08:44:14 +0000 (0:00:00.219) 0:02:08.186 ******* 2025-11-24 08:44:15.004283 | controller | changed: [instance] 2025-11-24 08:44:15.391624 | controller | 2025-11-24 08:44:15.391655 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-11-24 08:44:15.391663 | controller | Monday 24 November 2025 08:44:15 +0000 (0:00:00.378) 0:02:08.565 ******* 2025-11-24 08:44:15.391673 | controller | changed: [instance] 2025-11-24 08:44:15.436678 | controller | 2025-11-24 08:44:15.436702 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-11-24 08:44:15.436709 | controller | Monday 24 November 2025 08:44:15 +0000 (0:00:00.387) 0:02:08.952 ******* 2025-11-24 08:44:15.436724 | controller | skipping: [instance] 2025-11-24 08:44:15.641103 | controller | 2025-11-24 08:44:15.641150 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-11-24 08:44:15.641158 | controller | Monday 24 November 2025 08:44:15 +0000 (0:00:00.045) 0:02:08.997 ******* 2025-11-24 08:44:15.641168 | controller | ok: [instance] 2025-11-24 08:44:15.685618 | controller | 2025-11-24 08:44:15.685651 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-11-24 08:44:15.685661 | controller | Monday 24 November 2025 08:44:15 +0000 (0:00:00.204) 0:02:09.202 ******* 2025-11-24 08:44:15.685673 | controller | skipping: [instance] 2025-11-24 08:44:15.925276 | controller | 2025-11-24 08:44:15.925316 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-11-24 08:44:15.925326 | controller | Monday 24 November 2025 08:44:15 +0000 (0:00:00.044) 0:02:09.246 ******* 2025-11-24 08:44:15.925340 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-11-24 08:44:15.925366 | controller | changed: [instance] 2025-11-24 08:44:15.925372 | controller | 2025-11-24 08:44:15.925383 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-11-24 08:44:15.925444 | controller | Monday 24 November 2025 08:44:15 +0000 (0:00:00.239) 0:02:09.486 ******* 2025-11-24 08:44:16.234662 | controller | changed: [instance] 2025-11-24 08:44:16.281621 | controller | 2025-11-24 08:44:16.281641 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-11-24 08:44:16.281649 | controller | Monday 24 November 2025 08:44:16 +0000 (0:00:00.309) 0:02:09.795 ******* 2025-11-24 08:44:16.281665 | controller | skipping: [instance] 2025-11-24 08:44:16.310239 | controller | 2025-11-24 08:44:16.310292 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2025-11-24 08:44:16.310303 | controller | Monday 24 November 2025 08:44:16 +0000 (0:00:00.047) 0:02:09.842 ******* 2025-11-24 08:44:16.310316 | controller | skipping: [instance] 2025-11-24 08:44:16.310409 | controller | 2025-11-24 08:44:16.310428 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-11-24 08:44:16.310439 | controller | Monday 24 November 2025 08:44:16 +0000 (0:00:00.028) 0:02:09.871 ******* 2025-11-24 08:44:16.558263 | controller | changed: [instance] 2025-11-24 08:44:16.558330 | controller | 2025-11-24 08:44:16.558342 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-11-24 08:44:16.558479 | controller | Monday 24 November 2025 08:44:16 +0000 (0:00:00.247) 0:02:10.119 ******* 2025-11-24 08:44:16.787751 | controller | changed: [instance] 2025-11-24 08:44:17.082226 | controller | 2025-11-24 08:44:17.082260 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-11-24 08:44:17.082269 | controller | Monday 24 November 2025 08:44:16 +0000 (0:00:00.229) 0:02:10.348 ******* 2025-11-24 08:44:17.082279 | controller | changed: [instance] 2025-11-24 08:44:17.082316 | controller | 2025-11-24 08:44:17.082606 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-11-24 08:44:17.130940 | controller | Monday 24 November 2025 08:44:17 +0000 (0:00:00.294) 0:02:10.643 ******* 2025-11-24 08:44:17.131010 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-11-24 08:44:17.182882 | controller | 2025-11-24 08:44:17.182913 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-11-24 08:44:17.182921 | controller | Monday 24 November 2025 08:44:17 +0000 (0:00:00.048) 0:02:10.691 ******* 2025-11-24 08:44:17.182932 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-11-24 08:44:17.418972 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-11-24 08:44:17.419016 | controller | 2025-11-24 08:44:17.419027 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-24 08:44:17.419034 | controller | Monday 24 November 2025 08:44:17 +0000 (0:00:00.051) 0:02:10.743 ******* 2025-11-24 08:44:17.419054 | controller | ok: [instance] 2025-11-24 08:44:17.464068 | controller | 2025-11-24 08:44:17.464099 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-24 08:44:17.464128 | controller | Monday 24 November 2025 08:44:17 +0000 (0:00:00.236) 0:02:10.979 ******* 2025-11-24 08:44:17.464145 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:44:17.701682 | controller | ok: [instance] => (item=cifmw-public) 2025-11-24 08:44:17.701713 | controller | 2025-11-24 08:44:17.701721 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-24 08:44:17.701728 | controller | Monday 24 November 2025 08:44:17 +0000 (0:00:00.045) 0:02:11.025 ******* 2025-11-24 08:44:17.701738 | controller | ok: [instance] 2025-11-24 08:44:17.901174 | controller | 2025-11-24 08:44:17.901206 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-24 08:44:17.901214 | controller | Monday 24 November 2025 08:44:17 +0000 (0:00:00.237) 0:02:11.262 ******* 2025-11-24 08:44:17.901224 | controller | ok: [instance] 2025-11-24 08:44:19.202253 | controller | 2025-11-24 08:44:19.202287 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-11-24 08:44:19.202297 | controller | Monday 24 November 2025 08:44:17 +0000 (0:00:00.199) 0:02:11.462 ******* 2025-11-24 08:44:19.202311 | controller | changed: [instance] 2025-11-24 08:44:19.202345 | controller | 2025-11-24 08:44:19.202373 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-24 08:44:19.202527 | controller | Monday 24 November 2025 08:44:19 +0000 (0:00:01.301) 0:02:12.763 ******* 2025-11-24 08:44:19.435823 | controller | ok: [instance] 2025-11-24 08:44:19.481244 | controller | 2025-11-24 08:44:19.481281 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-24 08:44:19.481291 | controller | Monday 24 November 2025 08:44:19 +0000 (0:00:00.233) 0:02:12.996 ******* 2025-11-24 08:44:19.481303 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:44:19.481400 | controller | ok: [instance] => (item=cifmw-public) 2025-11-24 08:44:19.481444 | controller | 2025-11-24 08:44:19.481459 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-24 08:44:19.481474 | controller | Monday 24 November 2025 08:44:19 +0000 (0:00:00.045) 0:02:13.042 ******* 2025-11-24 08:44:19.712702 | controller | ok: [instance] 2025-11-24 08:44:19.921545 | controller | 2025-11-24 08:44:19.921575 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-24 08:44:19.921583 | controller | Monday 24 November 2025 08:44:19 +0000 (0:00:00.231) 0:02:13.273 ******* 2025-11-24 08:44:19.921593 | controller | ok: [instance] 2025-11-24 08:44:20.245222 | controller | 2025-11-24 08:44:20.245254 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-11-24 08:44:20.245262 | controller | Monday 24 November 2025 08:44:19 +0000 (0:00:00.208) 0:02:13.482 ******* 2025-11-24 08:44:20.245272 | controller | changed: [instance] 2025-11-24 08:44:20.265920 | controller | 2025-11-24 08:44:20.265939 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-11-24 08:44:20.265947 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.323) 0:02:13.806 ******* 2025-11-24 08:44:20.265956 | controller | skipping: [instance] 2025-11-24 08:44:20.293258 | controller | 2025-11-24 08:44:20.293293 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-11-24 08:44:20.293302 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.020) 0:02:13.827 ******* 2025-11-24 08:44:20.293314 | controller | skipping: [instance] 2025-11-24 08:44:20.293523 | controller | 2025-11-24 08:44:20.293549 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-11-24 08:44:20.322251 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.027) 0:02:13.854 ******* 2025-11-24 08:44:20.322291 | controller | skipping: [instance] 2025-11-24 08:44:20.322507 | controller | 2025-11-24 08:44:20.322533 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-11-24 08:44:20.348028 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.028) 0:02:13.883 ******* 2025-11-24 08:44:20.348056 | controller | skipping: [instance] 2025-11-24 08:44:20.564155 | controller | 2025-11-24 08:44:20.564191 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-11-24 08:44:20.564201 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.025) 0:02:13.909 ******* 2025-11-24 08:44:20.564213 | controller | changed: [instance] 2025-11-24 08:44:20.600752 | controller | 2025-11-24 08:44:20.600777 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-11-24 08:44:20.600786 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.215) 0:02:14.125 ******* 2025-11-24 08:44:20.600797 | controller | ok: [instance] 2025-11-24 08:44:20.600966 | controller | 2025-11-24 08:44:20.601162 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-11-24 08:44:20.601336 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.037) 0:02:14.162 ******* 2025-11-24 08:44:20.653939 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-11-24 08:44:20.654158 | controller | 2025-11-24 08:44:20.654353 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-11-24 08:44:20.654535 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.053) 0:02:14.215 ******* 2025-11-24 08:44:20.851609 | controller | ok: [instance] 2025-11-24 08:44:20.851806 | controller | 2025-11-24 08:44:20.851960 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-11-24 08:44:20.852097 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.197) 0:02:14.412 ******* 2025-11-24 08:44:20.913252 | controller | ok: [instance] 2025-11-24 08:44:20.913437 | controller | 2025-11-24 08:44:20.913627 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-11-24 08:44:20.913795 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.061) 0:02:14.474 ******* 2025-11-24 08:44:20.960025 | controller | ok: [instance] 2025-11-24 08:44:20.960213 | controller | 2025-11-24 08:44:20.960361 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-11-24 08:44:20.960498 | controller | Monday 24 November 2025 08:44:20 +0000 (0:00:00.046) 0:02:14.521 ******* 2025-11-24 08:44:21.003016 | controller | skipping: [instance] 2025-11-24 08:44:21.003219 | controller | 2025-11-24 08:44:21.003367 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-11-24 08:44:21.003520 | controller | Monday 24 November 2025 08:44:21 +0000 (0:00:00.042) 0:02:14.564 ******* 2025-11-24 08:44:21.046401 | controller | skipping: [instance] 2025-11-24 08:44:21.046609 | controller | 2025-11-24 08:44:21.046793 | controller | TASK [Call the config_drive role] ********************************************** 2025-11-24 08:44:21.046959 | controller | Monday 24 November 2025 08:44:21 +0000 (0:00:00.043) 0:02:14.607 ******* 2025-11-24 08:44:21.105835 | controller | 2025-11-24 08:44:21.106009 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-11-24 08:44:21.106175 | controller | Monday 24 November 2025 08:44:21 +0000 (0:00:00.059) 0:02:14.667 ******* 2025-11-24 08:44:21.511973 | controller | ok: [instance] => (item=artifacts) 2025-11-24 08:44:22.736042 | controller | ok: [instance] => (item=logs) 2025-11-24 08:44:22.736072 | controller | 2025-11-24 08:44:22.736080 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-11-24 08:44:22.736086 | controller | Monday 24 November 2025 08:44:21 +0000 (0:00:00.405) 0:02:15.072 ******* 2025-11-24 08:44:22.736096 | controller | ok: [instance] 2025-11-24 08:44:22.950231 | controller | 2025-11-24 08:44:22.950262 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-11-24 08:44:22.950272 | controller | Monday 24 November 2025 08:44:22 +0000 (0:00:01.224) 0:02:16.297 ******* 2025-11-24 08:44:22.950284 | controller | changed: [instance] 2025-11-24 08:44:22.950316 | controller | 2025-11-24 08:44:22.950332 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-11-24 08:44:22.950343 | controller | Monday 24 November 2025 08:44:22 +0000 (0:00:00.214) 0:02:16.511 ******* 2025-11-24 08:44:23.349012 | controller | changed: [instance] 2025-11-24 08:44:23.760895 | controller | 2025-11-24 08:44:23.760925 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-11-24 08:44:23.760938 | controller | Monday 24 November 2025 08:44:23 +0000 (0:00:00.398) 0:02:16.910 ******* 2025-11-24 08:44:23.760948 | controller | changed: [instance] 2025-11-24 08:44:23.805663 | controller | 2025-11-24 08:44:23.805684 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-11-24 08:44:23.805692 | controller | Monday 24 November 2025 08:44:23 +0000 (0:00:00.411) 0:02:17.321 ******* 2025-11-24 08:44:23.805701 | controller | skipping: [instance] 2025-11-24 08:44:24.010295 | controller | 2025-11-24 08:44:24.010327 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-11-24 08:44:24.010335 | controller | Monday 24 November 2025 08:44:23 +0000 (0:00:00.044) 0:02:17.366 ******* 2025-11-24 08:44:24.010345 | controller | ok: [instance] 2025-11-24 08:44:24.087602 | controller | 2025-11-24 08:44:24.087632 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-11-24 08:44:24.087641 | controller | Monday 24 November 2025 08:44:24 +0000 (0:00:00.204) 0:02:17.571 ******* 2025-11-24 08:44:24.087651 | controller | skipping: [instance] 2025-11-24 08:44:24.322073 | controller | 2025-11-24 08:44:24.322104 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-11-24 08:44:24.322131 | controller | Monday 24 November 2025 08:44:24 +0000 (0:00:00.077) 0:02:17.648 ******* 2025-11-24 08:44:24.322142 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-11-24 08:44:24.597582 | controller | changed: [instance] 2025-11-24 08:44:24.597613 | controller | 2025-11-24 08:44:24.597621 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-11-24 08:44:24.597628 | controller | Monday 24 November 2025 08:44:24 +0000 (0:00:00.234) 0:02:17.883 ******* 2025-11-24 08:44:24.597637 | controller | changed: [instance] 2025-11-24 08:44:24.644055 | controller | 2025-11-24 08:44:24.644079 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-11-24 08:44:24.644087 | controller | Monday 24 November 2025 08:44:24 +0000 (0:00:00.275) 0:02:18.158 ******* 2025-11-24 08:44:24.644097 | controller | skipping: [instance] 2025-11-24 08:44:24.673014 | controller | 2025-11-24 08:44:24.673037 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2025-11-24 08:44:24.673046 | controller | Monday 24 November 2025 08:44:24 +0000 (0:00:00.046) 0:02:18.205 ******* 2025-11-24 08:44:24.673057 | controller | skipping: [instance] 2025-11-24 08:44:24.920598 | controller | 2025-11-24 08:44:24.920633 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-11-24 08:44:24.920643 | controller | Monday 24 November 2025 08:44:24 +0000 (0:00:00.028) 0:02:18.234 ******* 2025-11-24 08:44:24.920655 | controller | changed: [instance] 2025-11-24 08:44:25.146835 | controller | 2025-11-24 08:44:25.146869 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-11-24 08:44:25.146879 | controller | Monday 24 November 2025 08:44:24 +0000 (0:00:00.247) 0:02:18.481 ******* 2025-11-24 08:44:25.146891 | controller | changed: [instance] 2025-11-24 08:44:25.443007 | controller | 2025-11-24 08:44:25.443035 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-11-24 08:44:25.443043 | controller | Monday 24 November 2025 08:44:25 +0000 (0:00:00.226) 0:02:18.707 ******* 2025-11-24 08:44:25.443057 | controller | changed: [instance] 2025-11-24 08:44:25.472049 | controller | 2025-11-24 08:44:25.472069 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-11-24 08:44:25.472077 | controller | Monday 24 November 2025 08:44:25 +0000 (0:00:00.296) 0:02:19.003 ******* 2025-11-24 08:44:25.472086 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-11-24 08:44:25.517975 | controller | 2025-11-24 08:44:25.517993 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-11-24 08:44:25.518001 | controller | Monday 24 November 2025 08:44:25 +0000 (0:00:00.029) 0:02:19.033 ******* 2025-11-24 08:44:25.518010 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-11-24 08:44:25.752193 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-11-24 08:44:25.752224 | controller | 2025-11-24 08:44:25.752234 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-24 08:44:25.752242 | controller | Monday 24 November 2025 08:44:25 +0000 (0:00:00.045) 0:02:19.079 ******* 2025-11-24 08:44:25.752254 | controller | ok: [instance] 2025-11-24 08:44:25.798268 | controller | 2025-11-24 08:44:25.798295 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-24 08:44:25.798304 | controller | Monday 24 November 2025 08:44:25 +0000 (0:00:00.234) 0:02:19.313 ******* 2025-11-24 08:44:25.798316 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:44:25.798601 | controller | ok: [instance] => (item=cifmw-public) 2025-11-24 08:44:25.798619 | controller | 2025-11-24 08:44:26.031864 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-24 08:44:26.031895 | controller | Monday 24 November 2025 08:44:25 +0000 (0:00:00.046) 0:02:19.359 ******* 2025-11-24 08:44:26.031907 | controller | ok: [instance] 2025-11-24 08:44:26.233757 | controller | 2025-11-24 08:44:26.233798 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-24 08:44:26.233807 | controller | Monday 24 November 2025 08:44:26 +0000 (0:00:00.233) 0:02:19.592 ******* 2025-11-24 08:44:26.233817 | controller | ok: [instance] 2025-11-24 08:44:27.551751 | controller | 2025-11-24 08:44:27.551785 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-11-24 08:44:27.551795 | controller | Monday 24 November 2025 08:44:26 +0000 (0:00:00.201) 0:02:19.794 ******* 2025-11-24 08:44:27.551807 | controller | changed: [instance] 2025-11-24 08:44:27.776914 | controller | 2025-11-24 08:44:27.776945 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-24 08:44:27.776954 | controller | Monday 24 November 2025 08:44:27 +0000 (0:00:01.317) 0:02:21.112 ******* 2025-11-24 08:44:27.776964 | controller | ok: [instance] 2025-11-24 08:44:27.822186 | controller | 2025-11-24 08:44:27.822214 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-24 08:44:27.822222 | controller | Monday 24 November 2025 08:44:27 +0000 (0:00:00.225) 0:02:21.337 ******* 2025-11-24 08:44:27.822232 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-24 08:44:28.050736 | controller | ok: [instance] => (item=cifmw-public) 2025-11-24 08:44:28.050768 | controller | 2025-11-24 08:44:28.050776 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-24 08:44:28.050782 | controller | Monday 24 November 2025 08:44:27 +0000 (0:00:00.045) 0:02:21.383 ******* 2025-11-24 08:44:28.050791 | controller | ok: [instance] 2025-11-24 08:44:28.251603 | controller | 2025-11-24 08:44:28.251633 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-24 08:44:28.251642 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.228) 0:02:21.611 ******* 2025-11-24 08:44:28.251652 | controller | ok: [instance] 2025-11-24 08:44:28.536694 | controller | 2025-11-24 08:44:28.536727 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-11-24 08:44:28.536737 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.200) 0:02:21.812 ******* 2025-11-24 08:44:28.536748 | controller | changed: [instance] 2025-11-24 08:44:28.558197 | controller | 2025-11-24 08:44:28.558230 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-11-24 08:44:28.558238 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.285) 0:02:22.097 ******* 2025-11-24 08:44:28.558249 | controller | skipping: [instance] 2025-11-24 08:44:28.558272 | controller | 2025-11-24 08:44:28.558280 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-11-24 08:44:28.558366 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.021) 0:02:22.119 ******* 2025-11-24 08:44:28.586162 | controller | skipping: [instance] 2025-11-24 08:44:28.613727 | controller | 2025-11-24 08:44:28.613750 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-11-24 08:44:28.613766 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.027) 0:02:22.147 ******* 2025-11-24 08:44:28.613777 | controller | skipping: [instance] 2025-11-24 08:44:28.639805 | controller | 2025-11-24 08:44:28.639830 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-11-24 08:44:28.639844 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.027) 0:02:22.174 ******* 2025-11-24 08:44:28.639856 | controller | skipping: [instance] 2025-11-24 08:44:28.853831 | controller | 2025-11-24 08:44:28.853863 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-11-24 08:44:28.853871 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.026) 0:02:22.200 ******* 2025-11-24 08:44:28.853881 | controller | changed: [instance] 2025-11-24 08:44:28.890265 | controller | 2025-11-24 08:44:28.890302 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-11-24 08:44:28.890312 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.213) 0:02:22.414 ******* 2025-11-24 08:44:28.890325 | controller | ok: [instance] 2025-11-24 08:44:28.890357 | controller | 2025-11-24 08:44:28.890367 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-11-24 08:44:28.890480 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.036) 0:02:22.451 ******* 2025-11-24 08:44:28.917598 | controller | skipping: [instance] 2025-11-24 08:44:28.943840 | controller | 2025-11-24 08:44:28.943863 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-11-24 08:44:28.943872 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.027) 0:02:22.478 ******* 2025-11-24 08:44:28.943883 | controller | skipping: [instance] 2025-11-24 08:44:28.990893 | controller | 2025-11-24 08:44:28.990926 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-11-24 08:44:28.990934 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.026) 0:02:22.505 ******* 2025-11-24 08:44:28.990943 | controller | skipping: [instance] 2025-11-24 08:44:29.017259 | controller | 2025-11-24 08:44:29.017298 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2025-11-24 08:44:29.017307 | controller | Monday 24 November 2025 08:44:28 +0000 (0:00:00.047) 0:02:22.552 ******* 2025-11-24 08:44:29.017320 | controller | skipping: [instance] 2025-11-24 08:44:29.078754 | controller | 2025-11-24 08:44:29.078785 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-11-24 08:44:29.078795 | controller | Monday 24 November 2025 08:44:29 +0000 (0:00:00.026) 0:02:22.578 ******* 2025-11-24 08:44:29.078807 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-11-24 08:44:29.318278 | controller | 2025-11-24 08:44:29.318313 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-11-24 08:44:29.318322 | controller | Monday 24 November 2025 08:44:29 +0000 (0:00:00.061) 0:02:22.639 ******* 2025-11-24 08:44:29.318334 | controller | ok: [instance] => (item=crc) 2025-11-24 08:44:31.388801 | controller | 2025-11-24 08:44:31.388835 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-11-24 08:44:31.388843 | controller | Monday 24 November 2025 08:44:29 +0000 (0:00:00.239) 0:02:22.879 ******* 2025-11-24 08:44:31.388853 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-24 08:44:32.238048 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-24 08:44:32.238096 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-24 08:44:32.238124 | controller | 2025-11-24 08:44:32.238134 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-11-24 08:44:32.238140 | controller | Monday 24 November 2025 08:44:31 +0000 (0:00:02.070) 0:02:24.949 ******* 2025-11-24 08:44:32.238160 | controller | changed: [instance] 2025-11-24 08:44:32.993272 | controller | 2025-11-24 08:44:32.993303 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-11-24 08:44:32.993311 | controller | Monday 24 November 2025 08:44:32 +0000 (0:00:00.849) 0:02:25.798 ******* 2025-11-24 08:44:32.993321 | controller | changed: [instance] 2025-11-24 08:44:33.826086 | controller | 2025-11-24 08:44:33.826130 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-11-24 08:44:33.826141 | controller | Monday 24 November 2025 08:44:32 +0000 (0:00:00.755) 0:02:26.554 ******* 2025-11-24 08:44:33.826151 | controller | changed: [instance] 2025-11-24 08:44:34.572273 | controller | 2025-11-24 08:44:34.572306 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-11-24 08:44:34.572314 | controller | Monday 24 November 2025 08:44:33 +0000 (0:00:00.832) 0:02:27.387 ******* 2025-11-24 08:44:34.572324 | controller | changed: [instance] => (item=compute-0.utility) 2025-11-24 08:44:54.384740 | controller | changed: [instance] => (item=controller-0.utility) 2025-11-24 08:44:54.384773 | controller | changed: [instance] => (item=crc-0.utility) 2025-11-24 08:44:54.384781 | controller | 2025-11-24 08:44:54.384787 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-11-24 08:44:54.384793 | controller | Monday 24 November 2025 08:44:34 +0000 (0:00:00.745) 0:02:28.132 ******* 2025-11-24 08:44:54.384803 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-11-24 08:44:54.531505 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-11-24 08:44:54.531546 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-11-24 08:44:54.531553 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-11-24 08:44:54.531559 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-11-24 08:44:54.531564 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j374076604267.24073', 'results_file': '/home/zuul/.ansible_async/j374076604267.24073', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-11-24 08:44:54.531584 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j304248200626.24091', 'results_file': '/home/zuul/.ansible_async/j304248200626.24091', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-11-24 08:44:54.531589 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-11-24 08:44:54.531595 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j88230823478.24107', 'results_file': '/home/zuul/.ansible_async/j88230823478.24107', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-11-24 08:44:54.531600 | controller | 2025-11-24 08:44:54.531606 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-11-24 08:44:54.531611 | controller | Monday 24 November 2025 08:44:54 +0000 (0:00:19.811) 0:02:47.944 ******* 2025-11-24 08:44:54.531624 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-24 08:44:54.531642 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-24 08:44:54.531649 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-24 08:44:54.531654 | controller | 2025-11-24 08:44:54.531659 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-24 08:44:54.531667 | controller | Monday 24 November 2025 08:44:54 +0000 (0:00:00.147) 0:02:48.092 ******* 2025-11-24 08:44:54.553555 | controller | skipping: [instance] 2025-11-24 08:44:54.553620 | controller | 2025-11-24 08:44:54.553752 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-11-24 08:44:54.553858 | controller | Monday 24 November 2025 08:44:54 +0000 (0:00:00.022) 0:02:48.115 ******* 2025-11-24 08:44:54.591883 | controller | 2025-11-24 08:44:54.592183 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-11-24 08:44:54.673525 | controller | Monday 24 November 2025 08:44:54 +0000 (0:00:00.038) 0:02:48.153 ******* 2025-11-24 08:44:54.673577 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-11-24 08:44:54.673608 | controller | 2025-11-24 08:44:54.673814 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-11-24 08:44:54.900794 | controller | Monday 24 November 2025 08:44:54 +0000 (0:00:00.081) 0:02:48.234 ******* 2025-11-24 08:44:54.900836 | controller | changed: [instance] 2025-11-24 08:44:54.901085 | controller | 2025-11-24 08:44:55.120232 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-11-24 08:44:55.120277 | controller | Monday 24 November 2025 08:44:54 +0000 (0:00:00.226) 0:02:48.461 ******* 2025-11-24 08:44:55.120292 | controller | changed: [instance] 2025-11-24 08:44:55.511602 | controller | 2025-11-24 08:44:55.511634 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-11-24 08:44:55.511642 | controller | Monday 24 November 2025 08:44:55 +0000 (0:00:00.219) 0:02:48.681 ******* 2025-11-24 08:44:55.511652 | controller | changed: [instance] 2025-11-24 08:44:55.511786 | controller | 2025-11-24 08:44:55.511798 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-11-24 08:44:55.539822 | controller | Monday 24 November 2025 08:44:55 +0000 (0:00:00.390) 0:02:49.071 ******* 2025-11-24 08:44:55.539865 | controller | skipping: [instance] 2025-11-24 08:44:55.568754 | controller | 2025-11-24 08:44:55.568798 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-11-24 08:44:55.568807 | controller | Monday 24 November 2025 08:44:55 +0000 (0:00:00.029) 0:02:49.100 ******* 2025-11-24 08:44:55.568819 | controller | skipping: [instance] 2025-11-24 08:44:55.615953 | controller | 2025-11-24 08:44:55.615987 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-11-24 08:44:55.615995 | controller | Monday 24 November 2025 08:44:55 +0000 (0:00:00.028) 0:02:49.129 ******* 2025-11-24 08:44:55.616007 | controller | skipping: [instance] 2025-11-24 08:44:55.660532 | controller | 2025-11-24 08:44:55.660576 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-11-24 08:44:55.660585 | controller | Monday 24 November 2025 08:44:55 +0000 (0:00:00.047) 0:02:49.176 ******* 2025-11-24 08:44:55.660605 | controller | skipping: [instance] 2025-11-24 08:44:55.660760 | controller | 2025-11-24 08:44:55.660789 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-24 08:44:55.661021 | controller | Monday 24 November 2025 08:44:55 +0000 (0:00:00.044) 0:02:49.221 ******* 2025-11-24 08:44:55.682931 | controller | skipping: [instance] 2025-11-24 08:44:55.683069 | controller | 2025-11-24 08:44:55.683215 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-11-24 08:44:55.683379 | controller | Monday 24 November 2025 08:44:55 +0000 (0:00:00.022) 0:02:49.244 ******* 2025-11-24 08:44:55.718782 | controller | 2025-11-24 08:44:55.718929 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-11-24 08:44:55.719063 | controller | Monday 24 November 2025 08:44:55 +0000 (0:00:00.035) 0:02:49.280 ******* 2025-11-24 08:44:55.801270 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-11-24 08:44:55.801424 | controller | 2025-11-24 08:44:55.801563 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-11-24 08:44:55.801683 | controller | Monday 24 November 2025 08:44:55 +0000 (0:00:00.082) 0:02:49.362 ******* 2025-11-24 08:44:56.018500 | controller | ok: [instance] 2025-11-24 08:44:56.018630 | controller | 2025-11-24 08:44:56.018768 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-11-24 08:44:56.018914 | controller | Monday 24 November 2025 08:44:56 +0000 (0:00:00.217) 0:02:49.579 ******* 2025-11-24 08:44:56.227202 | controller | ok: [instance] 2025-11-24 08:44:56.227377 | controller | 2025-11-24 08:44:56.227506 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-11-24 08:44:56.227646 | controller | Monday 24 November 2025 08:44:56 +0000 (0:00:00.208) 0:02:49.788 ******* 2025-11-24 08:44:56.616806 | controller | changed: [instance] 2025-11-24 08:44:56.616946 | controller | 2025-11-24 08:44:56.617077 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-11-24 08:44:56.617233 | controller | Monday 24 November 2025 08:44:56 +0000 (0:00:00.389) 0:02:50.178 ******* 2025-11-24 08:44:56.644085 | controller | skipping: [instance] 2025-11-24 08:44:56.644233 | controller | 2025-11-24 08:44:56.644370 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-11-24 08:44:56.644490 | controller | Monday 24 November 2025 08:44:56 +0000 (0:00:00.027) 0:02:50.205 ******* 2025-11-24 08:44:56.671169 | controller | skipping: [instance] 2025-11-24 08:44:56.671285 | controller | 2025-11-24 08:44:56.671425 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-11-24 08:44:56.671561 | controller | Monday 24 November 2025 08:44:56 +0000 (0:00:00.027) 0:02:50.232 ******* 2025-11-24 08:44:58.226386 | controller | changed: [instance -> controller-0.instance] 2025-11-24 08:44:58.226450 | controller | 2025-11-24 08:44:58.226459 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-11-24 08:44:58.226467 | controller | Monday 24 November 2025 08:44:58 +0000 (0:00:01.554) 0:02:51.787 ******* 2025-11-24 08:44:59.322501 | controller | changed: [instance -> controller-0.instance] 2025-11-24 08:44:59.361947 | controller | 2025-11-24 08:44:59.361981 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-24 08:44:59.361989 | controller | Monday 24 November 2025 08:44:59 +0000 (0:00:01.095) 0:02:52.883 ******* 2025-11-24 08:44:59.361999 | controller | 2025-11-24 08:44:59.572706 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-11-24 08:44:59.572736 | controller | Monday 24 November 2025 08:44:59 +0000 (0:00:00.039) 0:02:52.923 ******* 2025-11-24 08:44:59.572747 | controller | ok: [instance] 2025-11-24 08:44:59.597261 | controller | 2025-11-24 08:44:59.597285 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-11-24 08:44:59.597292 | controller | Monday 24 November 2025 08:44:59 +0000 (0:00:00.210) 0:02:53.133 ******* 2025-11-24 08:44:59.597302 | controller | ok: [instance] 2025-11-24 08:44:59.633759 | controller | 2025-11-24 08:44:59.633821 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-11-24 08:44:59.633831 | controller | Monday 24 November 2025 08:44:59 +0000 (0:00:00.024) 0:02:53.158 ******* 2025-11-24 08:44:59.633846 | controller | skipping: [instance] 2025-11-24 08:44:59.697254 | controller | 2025-11-24 08:44:59.697314 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-11-24 08:44:59.697324 | controller | Monday 24 November 2025 08:44:59 +0000 (0:00:00.035) 0:02:53.193 ******* 2025-11-24 08:44:59.697338 | controller | 2025-11-24 08:44:59.792753 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-11-24 08:44:59.792807 | controller | Monday 24 November 2025 08:44:59 +0000 (0:00:00.063) 0:02:53.257 ******* 2025-11-24 08:44:59.792822 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-11-24 08:45:00.006267 | controller | 2025-11-24 08:45:00.006303 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-11-24 08:45:00.006311 | controller | Monday 24 November 2025 08:44:59 +0000 (0:00:00.095) 0:02:53.352 ******* 2025-11-24 08:45:00.006322 | controller | ok: [instance] 2025-11-24 08:45:00.216454 | controller | 2025-11-24 08:45:00.216486 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-11-24 08:45:00.216494 | controller | Monday 24 November 2025 08:45:00 +0000 (0:00:00.213) 0:02:53.566 ******* 2025-11-24 08:45:00.216505 | controller | ok: [instance] 2025-11-24 08:45:00.605298 | controller | 2025-11-24 08:45:00.605329 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-11-24 08:45:00.605337 | controller | Monday 24 November 2025 08:45:00 +0000 (0:00:00.210) 0:02:53.777 ******* 2025-11-24 08:45:00.605347 | controller | changed: [instance] 2025-11-24 08:45:01.376239 | controller | 2025-11-24 08:45:01.376274 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-11-24 08:45:01.376282 | controller | Monday 24 November 2025 08:45:00 +0000 (0:00:00.388) 0:02:54.166 ******* 2025-11-24 08:45:01.376292 | controller | changed: [instance] 2025-11-24 08:45:01.376317 | controller | 2025-11-24 08:45:01.376324 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-11-24 08:45:01.376331 | controller | Monday 24 November 2025 08:45:01 +0000 (0:00:00.770) 0:02:54.937 ******* 2025-11-24 08:45:01.401916 | controller | skipping: [instance] 2025-11-24 08:45:01.445165 | controller | 2025-11-24 08:45:01.445192 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-11-24 08:45:01.445200 | controller | Monday 24 November 2025 08:45:01 +0000 (0:00:00.025) 0:02:54.963 ******* 2025-11-24 08:45:01.445210 | controller | skipping: [instance] 2025-11-24 08:45:01.488566 | controller | 2025-11-24 08:45:01.488606 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-11-24 08:45:01.488614 | controller | Monday 24 November 2025 08:45:01 +0000 (0:00:00.043) 0:02:55.006 ******* 2025-11-24 08:45:01.488625 | controller | skipping: [instance] 2025-11-24 08:45:01.536948 | controller | 2025-11-24 08:45:01.536971 | controller | TASK [Create VBMC entity] ****************************************************** 2025-11-24 08:45:01.536979 | controller | Monday 24 November 2025 08:45:01 +0000 (0:00:00.043) 0:02:55.049 ******* 2025-11-24 08:45:01.536990 | controller | skipping: [instance] => (item=compute-0) 2025-11-24 08:45:01.793889 | controller | skipping: [instance] => (item=controller-0) 2025-11-24 08:45:01.793934 | controller | skipping: [instance] => (item=crc-0) 2025-11-24 08:45:01.793943 | controller | skipping: [instance] 2025-11-24 08:45:01.793949 | controller | 2025-11-24 08:45:01.793955 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-11-24 08:45:01.793961 | controller | Monday 24 November 2025 08:45:01 +0000 (0:00:00.048) 0:02:55.097 ******* 2025-11-24 08:45:01.793970 | controller | ok: [instance] 2025-11-24 08:45:02.150192 | controller | 2025-11-24 08:45:02.150226 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-11-24 08:45:02.150234 | controller | Monday 24 November 2025 08:45:01 +0000 (0:00:00.257) 0:02:55.354 ******* 2025-11-24 08:45:02.150244 | controller | changed: [instance] 2025-11-24 08:45:02.183249 | controller | 2025-11-24 08:45:02.183267 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-11-24 08:45:02.183275 | controller | Monday 24 November 2025 08:45:02 +0000 (0:00:00.356) 0:02:55.711 ******* 2025-11-24 08:45:02.183283 | controller | skipping: [instance] 2025-11-24 08:45:02.216337 | controller | 2025-11-24 08:45:02.216355 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-11-24 08:45:02.216363 | controller | Monday 24 November 2025 08:45:02 +0000 (0:00:00.033) 0:02:55.744 ******* 2025-11-24 08:45:02.216377 | controller | skipping: [instance] 2025-11-24 08:45:02.249329 | controller | 2025-11-24 08:45:02.249363 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-11-24 08:45:02.249371 | controller | Monday 24 November 2025 08:45:02 +0000 (0:00:00.032) 0:02:55.777 ******* 2025-11-24 08:45:02.249382 | controller | skipping: [instance] 2025-11-24 08:45:02.895393 | controller | 2025-11-24 08:45:02.895435 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-11-24 08:45:02.895444 | controller | Monday 24 November 2025 08:45:02 +0000 (0:00:00.033) 0:02:55.810 ******* 2025-11-24 08:45:02.895457 | controller | changed: [instance] 2025-11-24 08:45:03.448178 | controller | 2025-11-24 08:45:03.448216 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-11-24 08:45:03.448227 | controller | Monday 24 November 2025 08:45:02 +0000 (0:00:00.645) 0:02:56.456 ******* 2025-11-24 08:45:03.448240 | controller | changed: [instance] 2025-11-24 08:45:03.448472 | controller | 2025-11-24 08:45:03.448491 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-11-24 08:45:03.489131 | controller | Monday 24 November 2025 08:45:03 +0000 (0:00:00.553) 0:02:57.009 ******* 2025-11-24 08:45:03.489159 | controller | skipping: [instance] 2025-11-24 08:45:03.550259 | controller | 2025-11-24 08:45:03.550294 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-11-24 08:45:03.550304 | controller | Monday 24 November 2025 08:45:03 +0000 (0:00:00.040) 0:02:57.050 ******* 2025-11-24 08:45:03.550317 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-11-24 08:45:03.589979 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-11-24 08:45:03.590001 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-11-24 08:45:03.590009 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-11-24 08:45:03.590015 | controller | 2025-11-24 08:45:03.590021 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-11-24 08:45:03.590027 | controller | Monday 24 November 2025 08:45:03 +0000 (0:00:00.060) 0:02:57.110 ******* 2025-11-24 08:45:03.590035 | controller | skipping: [instance] 2025-11-24 08:45:03.625231 | controller | 2025-11-24 08:45:03.625262 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-11-24 08:45:03.625270 | controller | Monday 24 November 2025 08:45:03 +0000 (0:00:00.040) 0:02:57.151 ******* 2025-11-24 08:45:03.625282 | controller | skipping: [instance] 2025-11-24 08:45:03.625312 | controller | 2025-11-24 08:45:03.625322 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-11-24 08:45:03.625470 | controller | Monday 24 November 2025 08:45:03 +0000 (0:00:00.035) 0:02:57.186 ******* 2025-11-24 08:45:03.659525 | controller | skipping: [instance] 2025-11-24 08:45:03.692573 | controller | 2025-11-24 08:45:03.692598 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-11-24 08:45:03.692613 | controller | Monday 24 November 2025 08:45:03 +0000 (0:00:00.034) 0:02:57.220 ******* 2025-11-24 08:45:03.692624 | controller | skipping: [instance] 2025-11-24 08:45:03.693066 | controller | 2025-11-24 08:45:03.693255 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-11-24 08:45:03.693405 | controller | Monday 24 November 2025 08:45:03 +0000 (0:00:00.033) 0:02:57.254 ******* 2025-11-24 08:45:04.269800 | controller | changed: [instance] 2025-11-24 08:45:04.301795 | controller | 2025-11-24 08:45:04.301819 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-11-24 08:45:04.301827 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.576) 0:02:57.830 ******* 2025-11-24 08:45:04.301837 | controller | skipping: [instance] 2025-11-24 08:45:04.333067 | controller | 2025-11-24 08:45:04.333095 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-11-24 08:45:04.333147 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.031) 0:02:57.862 ******* 2025-11-24 08:45:04.333164 | controller | skipping: [instance] 2025-11-24 08:45:04.364275 | controller | 2025-11-24 08:45:04.364308 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-11-24 08:45:04.364317 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.031) 0:02:57.894 ******* 2025-11-24 08:45:04.364327 | controller | skipping: [instance] 2025-11-24 08:45:04.365129 | controller | 2025-11-24 08:45:04.365279 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-11-24 08:45:04.365301 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.031) 0:02:57.925 ******* 2025-11-24 08:45:04.395231 | controller | skipping: [instance] 2025-11-24 08:45:04.395447 | controller | 2025-11-24 08:45:04.395464 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-11-24 08:45:04.428485 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.030) 0:02:57.956 ******* 2025-11-24 08:45:04.428506 | controller | skipping: [instance] 2025-11-24 08:45:04.459935 | controller | 2025-11-24 08:45:04.459955 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-11-24 08:45:04.459964 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.033) 0:02:57.989 ******* 2025-11-24 08:45:04.459974 | controller | skipping: [instance] 2025-11-24 08:45:04.490558 | controller | 2025-11-24 08:45:04.490579 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-11-24 08:45:04.490588 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.031) 0:02:58.021 ******* 2025-11-24 08:45:04.490599 | controller | skipping: [instance] 2025-11-24 08:45:04.490793 | controller | 2025-11-24 08:45:04.490964 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-11-24 08:45:04.491156 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.030) 0:02:58.052 ******* 2025-11-24 08:45:04.521157 | controller | skipping: [instance] 2025-11-24 08:45:04.521432 | controller | 2025-11-24 08:45:04.521671 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-11-24 08:45:04.521918 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.030) 0:02:58.082 ******* 2025-11-24 08:45:04.552490 | controller | skipping: [instance] 2025-11-24 08:45:04.552673 | controller | 2025-11-24 08:45:04.552835 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-11-24 08:45:04.552971 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.031) 0:02:58.114 ******* 2025-11-24 08:45:04.634000 | controller | skipping: [instance] 2025-11-24 08:45:04.634188 | controller | 2025-11-24 08:45:04.634339 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-11-24 08:45:04.634475 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.081) 0:02:58.195 ******* 2025-11-24 08:45:04.664509 | controller | skipping: [instance] 2025-11-24 08:45:04.664660 | controller | 2025-11-24 08:45:04.664812 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-11-24 08:45:04.664948 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.030) 0:02:58.226 ******* 2025-11-24 08:45:04.820423 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-11-24 08:45:04.820609 | controller | 2025-11-24 08:45:04.820795 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-11-24 08:45:04.820961 | controller | Monday 24 November 2025 08:45:04 +0000 (0:00:00.155) 0:02:58.381 ******* 2025-11-24 08:45:06.042220 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-11-24 08:45:06.060195 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-11-24 08:45:06.060218 | controller | 2025-11-24 08:45:06.060226 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-11-24 08:45:06.060238 | controller | Monday 24 November 2025 08:45:06 +0000 (0:00:01.221) 0:02:59.603 ******* 2025-11-24 08:45:06.060247 | controller | skipping: [instance] 2025-11-24 08:45:06.060256 | controller | 2025-11-24 08:45:06.060261 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-11-24 08:45:06.060268 | controller | Monday 24 November 2025 08:45:06 +0000 (0:00:00.018) 0:02:59.621 ******* 2025-11-24 08:45:06.633022 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:06.666131 | controller | 2025-11-24 08:45:06.666176 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-11-24 08:45:06.666186 | controller | Monday 24 November 2025 08:45:06 +0000 (0:00:00.572) 0:03:00.194 ******* 2025-11-24 08:45:06.666199 | controller | skipping: [instance] 2025-11-24 08:45:06.666225 | controller | 2025-11-24 08:45:06.666235 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-11-24 08:45:06.666318 | controller | Monday 24 November 2025 08:45:06 +0000 (0:00:00.033) 0:03:00.227 ******* 2025-11-24 08:45:06.701061 | controller | skipping: [instance] 2025-11-24 08:45:06.736138 | controller | 2025-11-24 08:45:06.736173 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-11-24 08:45:06.736182 | controller | Monday 24 November 2025 08:45:06 +0000 (0:00:00.034) 0:03:00.262 ******* 2025-11-24 08:45:06.736192 | controller | skipping: [instance] 2025-11-24 08:45:08.355224 | controller | 2025-11-24 08:45:08.355270 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-11-24 08:45:08.355279 | controller | Monday 24 November 2025 08:45:06 +0000 (0:00:00.035) 0:03:00.297 ******* 2025-11-24 08:45:08.355291 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:08.355325 | controller | 2025-11-24 08:45:08.355333 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-11-24 08:45:08.355427 | controller | Monday 24 November 2025 08:45:08 +0000 (0:00:01.619) 0:03:01.916 ******* 2025-11-24 08:45:08.386979 | controller | skipping: [instance] 2025-11-24 08:45:08.387048 | controller | 2025-11-24 08:45:08.387078 | controller | TASK [reproducer : Install repos] ********************************************** 2025-11-24 08:45:08.387093 | controller | Monday 24 November 2025 08:45:08 +0000 (0:00:00.031) 0:03:01.948 ******* 2025-11-24 08:45:08.420586 | controller | skipping: [instance] 2025-11-24 08:45:08.420732 | controller | 2025-11-24 08:45:08.420889 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-11-24 08:45:08.454863 | controller | Monday 24 November 2025 08:45:08 +0000 (0:00:00.034) 0:03:01.982 ******* 2025-11-24 08:45:08.454887 | controller | skipping: [instance] 2025-11-24 08:45:08.488105 | controller | 2025-11-24 08:45:08.488150 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-11-24 08:45:08.488158 | controller | Monday 24 November 2025 08:45:08 +0000 (0:00:00.034) 0:03:02.016 ******* 2025-11-24 08:45:08.488174 | controller | skipping: [instance] 2025-11-24 08:45:08.488273 | controller | 2025-11-24 08:45:08.488287 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-11-24 08:45:09.565923 | controller | Monday 24 November 2025 08:45:08 +0000 (0:00:00.033) 0:03:02.049 ******* 2025-11-24 08:45:09.565962 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:10.753915 | controller | 2025-11-24 08:45:10.753948 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-11-24 08:45:10.753956 | controller | Monday 24 November 2025 08:45:09 +0000 (0:00:01.077) 0:03:03.126 ******* 2025-11-24 08:45:10.753967 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:10.753991 | controller | 2025-11-24 08:45:10.753998 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-11-24 08:45:10.754019 | controller | Monday 24 November 2025 08:45:10 +0000 (0:00:01.188) 0:03:04.315 ******* 2025-11-24 08:45:11.324094 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:12.342597 | controller | 2025-11-24 08:45:12.342626 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-11-24 08:45:12.342634 | controller | Monday 24 November 2025 08:45:11 +0000 (0:00:00.570) 0:03:04.885 ******* 2025-11-24 08:45:12.342644 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:13.446199 | controller | 2025-11-24 08:45:13.446243 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-11-24 08:45:13.446251 | controller | Monday 24 November 2025 08:45:12 +0000 (0:00:01.018) 0:03:05.903 ******* 2025-11-24 08:45:13.446264 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-11-24 08:45:13.446303 | controller | skipping: [instance] => (item=compute-0) 2025-11-24 08:45:13.446311 | controller | skipping: [instance] => (item=controller-0) 2025-11-24 08:45:13.446616 | controller | skipping: [instance] => (item=crc-0) 2025-11-24 08:45:13.446653 | controller | 2025-11-24 08:45:14.093444 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-11-24 08:45:14.093475 | controller | Monday 24 November 2025 08:45:13 +0000 (0:00:01.103) 0:03:07.007 ******* 2025-11-24 08:45:14.093491 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-11-24 08:45:15.865759 | controller | skipping: [instance] => (item=compute-0) 2025-11-24 08:45:15.865792 | controller | skipping: [instance] => (item=controller-0) 2025-11-24 08:45:15.865800 | controller | skipping: [instance] => (item=crc-0) 2025-11-24 08:45:15.865806 | controller | 2025-11-24 08:45:15.865811 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-11-24 08:45:15.865817 | controller | Monday 24 November 2025 08:45:14 +0000 (0:00:00.646) 0:03:07.654 ******* 2025-11-24 08:45:15.865827 | controller | skipping: [instance] => (item=instance) 2025-11-24 08:45:16.453058 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-11-24 08:45:16.453094 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-11-24 08:45:16.453101 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-11-24 08:45:16.453128 | controller | 2025-11-24 08:45:16.453138 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-11-24 08:45:16.453143 | controller | Monday 24 November 2025 08:45:15 +0000 (0:00:01.772) 0:03:09.426 ******* 2025-11-24 08:45:16.453154 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:17.410845 | controller | 2025-11-24 08:45:17.410877 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-11-24 08:45:17.410889 | controller | Monday 24 November 2025 08:45:16 +0000 (0:00:00.587) 0:03:10.013 ******* 2025-11-24 08:45:17.410899 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:18.372247 | controller | 2025-11-24 08:45:18.372288 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-11-24 08:45:18.372296 | controller | Monday 24 November 2025 08:45:17 +0000 (0:00:00.957) 0:03:10.971 ******* 2025-11-24 08:45:18.372308 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:18.372335 | controller | 2025-11-24 08:45:18.372343 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-11-24 08:45:18.372485 | controller | Monday 24 November 2025 08:45:18 +0000 (0:00:00.961) 0:03:11.933 ******* 2025-11-24 08:45:18.406032 | controller | skipping: [instance] 2025-11-24 08:45:19.010260 | controller | 2025-11-24 08:45:19.010296 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-11-24 08:45:19.010304 | controller | Monday 24 November 2025 08:45:18 +0000 (0:00:00.033) 0:03:11.967 ******* 2025-11-24 08:45:19.010315 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:19.647008 | controller | 2025-11-24 08:45:19.647041 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-11-24 08:45:19.647049 | controller | Monday 24 November 2025 08:45:19 +0000 (0:00:00.604) 0:03:12.571 ******* 2025-11-24 08:45:19.647059 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:19.687584 | controller | 2025-11-24 08:45:19.687609 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-11-24 08:45:19.687618 | controller | Monday 24 November 2025 08:45:19 +0000 (0:00:00.636) 0:03:13.207 ******* 2025-11-24 08:45:19.687629 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:19.750237 | controller | 2025-11-24 08:45:19.750277 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-11-24 08:45:19.750287 | controller | Monday 24 November 2025 08:45:19 +0000 (0:00:00.040) 0:03:13.248 ******* 2025-11-24 08:45:19.750300 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-11-24 08:45:19.750334 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-11-24 08:45:19.750620 | controller | 2025-11-24 08:45:19.803637 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-11-24 08:45:19.803661 | controller | Monday 24 November 2025 08:45:19 +0000 (0:00:00.062) 0:03:13.311 ******* 2025-11-24 08:45:19.803672 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-24 08:45:19.803786 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-11-24 08:45:19.803953 | controller | 2025-11-24 08:45:19.804155 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-11-24 08:45:19.804274 | controller | Monday 24 November 2025 08:45:19 +0000 (0:00:00.053) 0:03:13.364 ******* 2025-11-24 08:45:19.852633 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-24 08:45:19.900206 | controller | _secret_file: '' 2025-11-24 08:45:19.900250 | controller | 2025-11-24 08:45:19.900260 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-11-24 08:45:19.900268 | controller | Monday 24 November 2025 08:45:19 +0000 (0:00:00.048) 0:03:13.413 ******* 2025-11-24 08:45:19.900282 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-24 08:45:19.946244 | controller | _secret_content: my-default-location-place 2025-11-24 08:45:19.946278 | controller | 2025-11-24 08:45:19.946288 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-11-24 08:45:19.946296 | controller | Monday 24 November 2025 08:45:19 +0000 (0:00:00.047) 0:03:13.461 ******* 2025-11-24 08:45:19.946309 | controller | skipping: [instance] 2025-11-24 08:45:19.946385 | controller | 2025-11-24 08:45:19.946542 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-11-24 08:45:19.946688 | controller | Monday 24 November 2025 08:45:19 +0000 (0:00:00.046) 0:03:13.507 ******* 2025-11-24 08:45:19.997921 | controller | skipping: [instance] 2025-11-24 08:45:20.046245 | controller | 2025-11-24 08:45:20.046281 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-11-24 08:45:20.046290 | controller | Monday 24 November 2025 08:45:19 +0000 (0:00:00.051) 0:03:13.559 ******* 2025-11-24 08:45:20.046303 | controller | skipping: [instance] 2025-11-24 08:45:20.046336 | controller | 2025-11-24 08:45:20.046346 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-11-24 08:45:20.046474 | controller | Monday 24 November 2025 08:45:20 +0000 (0:00:00.048) 0:03:13.607 ******* 2025-11-24 08:45:21.038764 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:21.091547 | controller | 2025-11-24 08:45:21.091579 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-11-24 08:45:21.091588 | controller | Monday 24 November 2025 08:45:21 +0000 (0:00:00.992) 0:03:14.599 ******* 2025-11-24 08:45:21.091598 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-24 08:45:21.138446 | controller | _secret_dest: /home/zuul/ipmi-things 2025-11-24 08:45:21.138473 | controller | 2025-11-24 08:45:21.138482 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-11-24 08:45:21.138490 | controller | Monday 24 November 2025 08:45:21 +0000 (0:00:00.052) 0:03:14.652 ******* 2025-11-24 08:45:21.138501 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-24 08:45:21.231778 | controller | _secret_file: /tmp/ipmi-things 2025-11-24 08:45:21.231808 | controller | 2025-11-24 08:45:21.231816 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-11-24 08:45:21.231825 | controller | Monday 24 November 2025 08:45:21 +0000 (0:00:00.047) 0:03:14.699 ******* 2025-11-24 08:45:21.231834 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-24 08:45:21.286477 | controller | _secret_content: '' 2025-11-24 08:45:21.286497 | controller | 2025-11-24 08:45:21.286510 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-11-24 08:45:21.286517 | controller | Monday 24 November 2025 08:45:21 +0000 (0:00:00.093) 0:03:14.792 ******* 2025-11-24 08:45:21.286526 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-11-24 08:45:21.855986 | controller | msg: All assertions passed 2025-11-24 08:45:21.856028 | controller | 2025-11-24 08:45:21.856037 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-11-24 08:45:21.856043 | controller | Monday 24 November 2025 08:45:21 +0000 (0:00:00.054) 0:03:14.847 ******* 2025-11-24 08:45:21.856053 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:21.856246 | controller | 2025-11-24 08:45:21.856429 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-11-24 08:45:21.856580 | controller | Monday 24 November 2025 08:45:21 +0000 (0:00:00.569) 0:03:15.417 ******* 2025-11-24 08:45:22.853854 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:22.854086 | controller | 2025-11-24 08:45:22.854268 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-11-24 08:45:22.854421 | controller | Monday 24 November 2025 08:45:22 +0000 (0:00:00.997) 0:03:16.415 ******* 2025-11-24 08:45:22.906425 | controller | skipping: [instance] 2025-11-24 08:45:22.906579 | controller | 2025-11-24 08:45:22.906724 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-11-24 08:45:22.906865 | controller | Monday 24 November 2025 08:45:22 +0000 (0:00:00.052) 0:03:16.467 ******* 2025-11-24 08:45:23.454943 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:23.455154 | controller | 2025-11-24 08:45:23.455317 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-11-24 08:45:23.455461 | controller | Monday 24 November 2025 08:45:23 +0000 (0:00:00.548) 0:03:17.016 ******* 2025-11-24 08:45:24.032885 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:45:24.033078 | controller | 2025-11-24 08:45:24.033262 | controller | TASK [reproducer : Check package install status] ******************************* 2025-11-24 08:45:24.033417 | controller | Monday 24 November 2025 08:45:24 +0000 (0:00:00.577) 0:03:17.594 ******* 2025-11-24 08:46:25.121931 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-11-24 08:46:25.123174 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-11-24 08:46:25.123215 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-11-24 08:46:25.807433 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-11-24 08:46:25.807467 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-11-24 08:46:25.807475 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-11-24 08:46:25.807480 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-11-24 08:46:25.807485 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-11-24 08:46:25.807491 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-11-24 08:46:25.807496 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). 2025-11-24 08:46:25.807505 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). 2025-11-24 08:46:25.807512 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:25.807518 | controller | 2025-11-24 08:46:25.807524 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-11-24 08:46:25.807535 | controller | Monday 24 November 2025 08:46:25 +0000 (0:01:01.088) 0:04:18.682 ******* 2025-11-24 08:46:25.807545 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:28.362850 | controller | 2025-11-24 08:46:28.362887 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-11-24 08:46:28.362896 | controller | Monday 24 November 2025 08:46:25 +0000 (0:00:00.685) 0:04:19.368 ******* 2025-11-24 08:46:28.362907 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:28.409148 | controller | 2025-11-24 08:46:28.409178 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-11-24 08:46:28.409186 | controller | Monday 24 November 2025 08:46:28 +0000 (0:00:02.555) 0:04:21.923 ******* 2025-11-24 08:46:28.409197 | controller | skipping: [instance] 2025-11-24 08:46:28.454937 | controller | 2025-11-24 08:46:28.454968 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-11-24 08:46:28.454976 | controller | Monday 24 November 2025 08:46:28 +0000 (0:00:00.046) 0:04:21.970 ******* 2025-11-24 08:46:28.454986 | controller | skipping: [instance] 2025-11-24 08:46:29.095789 | controller | 2025-11-24 08:46:29.095824 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-11-24 08:46:29.095833 | controller | Monday 24 November 2025 08:46:28 +0000 (0:00:00.045) 0:04:22.016 ******* 2025-11-24 08:46:29.095843 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:29.679411 | controller | 2025-11-24 08:46:29.679446 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-11-24 08:46:29.679455 | controller | Monday 24 November 2025 08:46:29 +0000 (0:00:00.640) 0:04:22.656 ******* 2025-11-24 08:46:29.679466 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:29.992485 | controller | 2025-11-24 08:46:29.992523 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-11-24 08:46:29.992532 | controller | Monday 24 November 2025 08:46:29 +0000 (0:00:00.583) 0:04:23.240 ******* 2025-11-24 08:46:29.992542 | controller | changed: [instance] 2025-11-24 08:46:30.663661 | controller | 2025-11-24 08:46:30.663693 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-11-24 08:46:30.663702 | controller | Monday 24 November 2025 08:46:29 +0000 (0:00:00.312) 0:04:23.552 ******* 2025-11-24 08:46:30.663712 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:31.677712 | controller | 2025-11-24 08:46:31.677750 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-11-24 08:46:31.677760 | controller | Monday 24 November 2025 08:46:30 +0000 (0:00:00.671) 0:04:24.224 ******* 2025-11-24 08:46:31.677772 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:31.722473 | controller | 2025-11-24 08:46:31.722515 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-11-24 08:46:31.722524 | controller | Monday 24 November 2025 08:46:31 +0000 (0:00:01.013) 0:04:25.238 ******* 2025-11-24 08:46:31.722535 | controller | skipping: [instance] 2025-11-24 08:46:31.765626 | controller | 2025-11-24 08:46:31.765663 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-11-24 08:46:31.765672 | controller | Monday 24 November 2025 08:46:31 +0000 (0:00:00.044) 0:04:25.283 ******* 2025-11-24 08:46:31.765682 | controller | skipping: [instance] 2025-11-24 08:46:31.806791 | controller | 2025-11-24 08:46:31.806831 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-11-24 08:46:31.806840 | controller | Monday 24 November 2025 08:46:31 +0000 (0:00:00.043) 0:04:25.326 ******* 2025-11-24 08:46:31.806853 | controller | skipping: [instance] 2025-11-24 08:46:31.859560 | controller | 2025-11-24 08:46:31.859590 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-11-24 08:46:31.859598 | controller | Monday 24 November 2025 08:46:31 +0000 (0:00:00.041) 0:04:25.367 ******* 2025-11-24 08:46:31.859608 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:31.897376 | controller | 2025-11-24 08:46:31.897413 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-11-24 08:46:31.897421 | controller | Monday 24 November 2025 08:46:31 +0000 (0:00:00.052) 0:04:25.420 ******* 2025-11-24 08:46:31.897432 | controller | skipping: [instance] 2025-11-24 08:46:31.934516 | controller | 2025-11-24 08:46:31.934555 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-11-24 08:46:31.934564 | controller | Monday 24 November 2025 08:46:31 +0000 (0:00:00.037) 0:04:25.458 ******* 2025-11-24 08:46:31.934575 | controller | skipping: [instance] 2025-11-24 08:46:31.975092 | controller | 2025-11-24 08:46:31.975141 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-11-24 08:46:31.975150 | controller | Monday 24 November 2025 08:46:31 +0000 (0:00:00.037) 0:04:25.495 ******* 2025-11-24 08:46:31.975162 | controller | skipping: [instance] 2025-11-24 08:46:32.547201 | controller | 2025-11-24 08:46:32.547237 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-11-24 08:46:32.547250 | controller | Monday 24 November 2025 08:46:31 +0000 (0:00:00.040) 0:04:25.536 ******* 2025-11-24 08:46:32.547260 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:32.652537 | controller | 2025-11-24 08:46:32.652581 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-11-24 08:46:32.652589 | controller | Monday 24 November 2025 08:46:32 +0000 (0:00:00.572) 0:04:26.108 ******* 2025-11-24 08:46:32.652600 | controller | skipping: [instance] => (item=secret) 2025-11-24 08:46:33.702057 | controller | skipping: [instance] => (item=configmap) 2025-11-24 08:46:33.702097 | controller | skipping: [instance] => (item=pod) 2025-11-24 08:46:33.702105 | controller | skipping: [instance] => (item=service) 2025-11-24 08:46:33.702138 | controller | skipping: [instance] => (item=route) 2025-11-24 08:46:33.702144 | controller | skipping: [instance] 2025-11-24 08:46:33.702150 | controller | 2025-11-24 08:46:33.702156 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-11-24 08:46:33.702163 | controller | Monday 24 November 2025 08:46:32 +0000 (0:00:00.104) 0:04:26.212 ******* 2025-11-24 08:46:33.702173 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:34.758379 | controller | 2025-11-24 08:46:34.758422 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-11-24 08:46:34.758432 | controller | Monday 24 November 2025 08:46:33 +0000 (0:00:01.048) 0:04:27.261 ******* 2025-11-24 08:46:34.758443 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:34.799674 | controller | 2025-11-24 08:46:34.799714 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-11-24 08:46:34.799723 | controller | Monday 24 November 2025 08:46:34 +0000 (0:00:01.056) 0:04:28.318 ******* 2025-11-24 08:46:34.799734 | controller | skipping: [instance] 2025-11-24 08:46:34.840876 | controller | 2025-11-24 08:46:34.840915 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-11-24 08:46:34.840923 | controller | Monday 24 November 2025 08:46:34 +0000 (0:00:00.040) 0:04:28.359 ******* 2025-11-24 08:46:34.840939 | controller | skipping: [instance] 2025-11-24 08:46:34.921849 | controller | 2025-11-24 08:46:34.921887 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-11-24 08:46:34.921896 | controller | Monday 24 November 2025 08:46:34 +0000 (0:00:00.040) 0:04:28.400 ******* 2025-11-24 08:46:34.921907 | controller | skipping: [instance] => (item=secret) 2025-11-24 08:46:34.964745 | controller | skipping: [instance] => (item=configmap) 2025-11-24 08:46:34.964787 | controller | skipping: [instance] => (item=service) 2025-11-24 08:46:34.964794 | controller | skipping: [instance] => (item=route) 2025-11-24 08:46:34.964800 | controller | skipping: [instance] 2025-11-24 08:46:34.964807 | controller | 2025-11-24 08:46:34.964812 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-11-24 08:46:34.964819 | controller | Monday 24 November 2025 08:46:34 +0000 (0:00:00.081) 0:04:28.481 ******* 2025-11-24 08:46:34.964829 | controller | skipping: [instance] 2025-11-24 08:46:36.477314 | controller | 2025-11-24 08:46:36.477356 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-11-24 08:46:36.477365 | controller | Monday 24 November 2025 08:46:34 +0000 (0:00:00.043) 0:04:28.525 ******* 2025-11-24 08:46:36.477376 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:37.250688 | controller | 2025-11-24 08:46:37.250736 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-11-24 08:46:37.250745 | controller | Monday 24 November 2025 08:46:36 +0000 (0:00:01.512) 0:04:30.037 ******* 2025-11-24 08:46:37.250757 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:37.300493 | controller | 2025-11-24 08:46:37.300531 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-11-24 08:46:37.300541 | controller | Monday 24 November 2025 08:46:37 +0000 (0:00:00.772) 0:04:30.809 ******* 2025-11-24 08:46:37.300552 | controller | skipping: [instance] 2025-11-24 08:46:37.342720 | controller | 2025-11-24 08:46:37.342748 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-11-24 08:46:37.342756 | controller | Monday 24 November 2025 08:46:37 +0000 (0:00:00.051) 0:04:30.861 ******* 2025-11-24 08:46:37.342766 | controller | skipping: [instance] 2025-11-24 08:46:37.389263 | controller | 2025-11-24 08:46:37.389289 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-11-24 08:46:37.389297 | controller | Monday 24 November 2025 08:46:37 +0000 (0:00:00.042) 0:04:30.903 ******* 2025-11-24 08:46:37.389307 | controller | skipping: [instance] 2025-11-24 08:46:37.389484 | controller | 2025-11-24 08:46:37.389496 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-11-24 08:46:37.389506 | controller | Monday 24 November 2025 08:46:37 +0000 (0:00:00.046) 0:04:30.950 ******* 2025-11-24 08:46:47.614186 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:47.614239 | controller | 2025-11-24 08:46:47.614250 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-11-24 08:46:47.614363 | controller | Monday 24 November 2025 08:46:47 +0000 (0:00:10.224) 0:04:41.175 ******* 2025-11-24 08:46:49.036599 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:50.219118 | controller | 2025-11-24 08:46:50.219156 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-11-24 08:46:50.219165 | controller | Monday 24 November 2025 08:46:49 +0000 (0:00:01.421) 0:04:42.596 ******* 2025-11-24 08:46:50.219180 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-11-24 08:46:50.259380 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-11-24 08:46:50.259404 | controller | 2025-11-24 08:46:50.259411 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-11-24 08:46:50.259417 | controller | Monday 24 November 2025 08:46:50 +0000 (0:00:01.182) 0:04:43.779 ******* 2025-11-24 08:46:50.259427 | controller | skipping: [instance] 2025-11-24 08:46:50.839144 | controller | 2025-11-24 08:46:50.839176 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-11-24 08:46:50.839184 | controller | Monday 24 November 2025 08:46:50 +0000 (0:00:00.041) 0:04:43.820 ******* 2025-11-24 08:46:50.839194 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:50.877550 | controller | 2025-11-24 08:46:50.877581 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-11-24 08:46:50.877589 | controller | Monday 24 November 2025 08:46:50 +0000 (0:00:00.579) 0:04:44.400 ******* 2025-11-24 08:46:50.877600 | controller | skipping: [instance] 2025-11-24 08:46:50.922777 | controller | 2025-11-24 08:46:50.922807 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-11-24 08:46:50.922815 | controller | Monday 24 November 2025 08:46:50 +0000 (0:00:00.038) 0:04:44.438 ******* 2025-11-24 08:46:50.922825 | controller | skipping: [instance] 2025-11-24 08:46:50.966254 | controller | 2025-11-24 08:46:50.966283 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-11-24 08:46:50.966292 | controller | Monday 24 November 2025 08:46:50 +0000 (0:00:00.045) 0:04:44.483 ******* 2025-11-24 08:46:50.966308 | controller | skipping: [instance] 2025-11-24 08:46:51.002564 | controller | 2025-11-24 08:46:51.002592 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-11-24 08:46:51.002600 | controller | Monday 24 November 2025 08:46:50 +0000 (0:00:00.043) 0:04:44.527 ******* 2025-11-24 08:46:51.002611 | controller | skipping: [instance] 2025-11-24 08:46:51.135744 | controller | 2025-11-24 08:46:51.135774 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-11-24 08:46:51.135783 | controller | Monday 24 November 2025 08:46:50 +0000 (0:00:00.036) 0:04:44.563 ******* 2025-11-24 08:46:51.135794 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': 'd041abc1-1d17-4a9d-abec-87dc9325eae8'}) 2025-11-24 08:46:52.148345 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '23f673a9-2b71-4776-b3e2-918f0cf96dd7'}) 2025-11-24 08:46:52.148378 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': 'acfd06c8-8443-49e0-9882-aac2a7d81caa'}) 2025-11-24 08:46:52.148387 | controller | 2025-11-24 08:46:52.148395 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-11-24 08:46:52.148402 | controller | Monday 24 November 2025 08:46:51 +0000 (0:00:00.132) 0:04:44.696 ******* 2025-11-24 08:46:52.148414 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:52.187968 | controller | 2025-11-24 08:46:52.187996 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-11-24 08:46:52.188004 | controller | Monday 24 November 2025 08:46:52 +0000 (0:00:01.012) 0:04:45.709 ******* 2025-11-24 08:46:52.188014 | controller | skipping: [instance] 2025-11-24 08:46:52.325381 | controller | 2025-11-24 08:46:52.325411 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-11-24 08:46:52.325419 | controller | Monday 24 November 2025 08:46:52 +0000 (0:00:00.039) 0:04:45.748 ******* 2025-11-24 08:46:52.325429 | controller | 2025-11-24 08:46:52.373136 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-11-24 08:46:52.373162 | controller | Monday 24 November 2025 08:46:52 +0000 (0:00:00.137) 0:04:45.886 ******* 2025-11-24 08:46:52.373175 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:52.417664 | controller | 2025-11-24 08:46:52.417691 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-11-24 08:46:52.417699 | controller | Monday 24 November 2025 08:46:52 +0000 (0:00:00.048) 0:04:45.934 ******* 2025-11-24 08:46:52.417710 | controller | skipping: [instance] 2025-11-24 08:46:52.454345 | controller | 2025-11-24 08:46:52.454369 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-11-24 08:46:52.454377 | controller | Monday 24 November 2025 08:46:52 +0000 (0:00:00.044) 0:04:45.978 ******* 2025-11-24 08:46:52.454387 | controller | skipping: [instance] 2025-11-24 08:46:53.794907 | controller | 2025-11-24 08:46:53.794945 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-11-24 08:46:53.794953 | controller | Monday 24 November 2025 08:46:52 +0000 (0:00:00.036) 0:04:46.015 ******* 2025-11-24 08:46:53.794963 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:46:53.795125 | controller | 2025-11-24 08:46:53.795142 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-11-24 08:46:53.795151 | controller | Monday 24 November 2025 08:46:53 +0000 (0:00:01.340) 0:04:47.355 ******* 2025-11-24 08:46:58.420677 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=d041abc1-1d17-4a9d-abec-87dc9325eae8) 2025-11-24 08:46:58.420734 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=23f673a9-2b71-4776-b3e2-918f0cf96dd7) 2025-11-24 08:46:58.420848 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=acfd06c8-8443-49e0-9882-aac2a7d81caa) 2025-11-24 08:46:58.420946 | controller | 2025-11-24 08:46:58.421057 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-11-24 08:46:58.421157 | controller | Monday 24 November 2025 08:46:58 +0000 (0:00:04.624) 0:04:51.980 ******* 2025-11-24 08:46:58.518360 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-11-24 08:46:58.518433 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-11-24 08:46:58.518555 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-11-24 08:46:58.518653 | controller | 2025-11-24 08:46:58.518754 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-11-24 08:46:58.518857 | controller | Monday 24 November 2025 08:46:58 +0000 (0:00:00.099) 0:04:52.079 ******* 2025-11-24 08:46:58.726595 | controller | ok: [instance -> localhost] 2025-11-24 08:46:58.726653 | controller | 2025-11-24 08:46:58.726748 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-11-24 08:46:58.726850 | controller | Monday 24 November 2025 08:46:58 +0000 (0:00:00.208) 0:04:52.288 ******* 2025-11-24 08:47:01.068321 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-11-24 08:47:01.069592 | controller | 2025-11-24 08:47:01.743301 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-11-24 08:47:01.743352 | controller | Monday 24 November 2025 08:47:01 +0000 (0:00:02.341) 0:04:54.629 ******* 2025-11-24 08:47:01.743367 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:02.511594 | controller | 2025-11-24 08:47:02.511632 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-11-24 08:47:02.511640 | controller | Monday 24 November 2025 08:47:01 +0000 (0:00:00.674) 0:04:55.304 ******* 2025-11-24 08:47:02.511652 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:03.621267 | controller | 2025-11-24 08:47:03.621299 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-11-24 08:47:03.621307 | controller | Monday 24 November 2025 08:47:02 +0000 (0:00:00.765) 0:04:56.069 ******* 2025-11-24 08:47:03.621318 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:04.323076 | controller | 2025-11-24 08:47:04.323131 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-11-24 08:47:04.323143 | controller | Monday 24 November 2025 08:47:03 +0000 (0:00:01.112) 0:04:57.182 ******* 2025-11-24 08:47:04.323154 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:05.354991 | controller | 2025-11-24 08:47:05.355020 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-11-24 08:47:05.355028 | controller | Monday 24 November 2025 08:47:04 +0000 (0:00:00.702) 0:04:57.884 ******* 2025-11-24 08:47:05.355038 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:05.976382 | controller | 2025-11-24 08:47:05.976411 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-11-24 08:47:05.976420 | controller | Monday 24 November 2025 08:47:05 +0000 (0:00:01.031) 0:04:58.916 ******* 2025-11-24 08:47:05.976430 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:06.577655 | controller | 2025-11-24 08:47:06.577686 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-11-24 08:47:06.577694 | controller | Monday 24 November 2025 08:47:05 +0000 (0:00:00.621) 0:04:59.537 ******* 2025-11-24 08:47:06.577705 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:07.914760 | controller | 2025-11-24 08:47:07.914793 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-11-24 08:47:07.914802 | controller | Monday 24 November 2025 08:47:06 +0000 (0:00:00.601) 0:05:00.138 ******* 2025-11-24 08:47:07.914812 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-11-24 08:47:07.949782 | controller | 2025-11-24 08:47:07.949811 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-11-24 08:47:07.949819 | controller | Monday 24 November 2025 08:47:07 +0000 (0:00:01.337) 0:05:01.475 ******* 2025-11-24 08:47:07.949835 | controller | skipping: [instance] 2025-11-24 08:47:07.985941 | controller | 2025-11-24 08:47:07.985975 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-24 08:47:07.985983 | controller | Monday 24 November 2025 08:47:07 +0000 (0:00:00.035) 0:05:01.510 ******* 2025-11-24 08:47:07.986001 | controller | skipping: [instance] 2025-11-24 08:47:07.986020 | controller | 2025-11-24 08:47:07.986318 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-11-24 08:47:08.031654 | controller | Monday 24 November 2025 08:47:07 +0000 (0:00:00.036) 0:05:01.547 ******* 2025-11-24 08:47:08.031693 | controller | skipping: [instance] 2025-11-24 08:47:08.065791 | controller | 2025-11-24 08:47:08.065836 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-11-24 08:47:08.065846 | controller | Monday 24 November 2025 08:47:08 +0000 (0:00:00.045) 0:05:01.592 ******* 2025-11-24 08:47:08.065858 | controller | skipping: [instance] 2025-11-24 08:47:08.065876 | controller | 2025-11-24 08:47:08.065882 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-11-24 08:47:08.065889 | controller | Monday 24 November 2025 08:47:08 +0000 (0:00:00.034) 0:05:01.626 ******* 2025-11-24 08:47:08.102155 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:08.208654 | controller | 2025-11-24 08:47:08.208696 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-11-24 08:47:08.208705 | controller | Monday 24 November 2025 08:47:08 +0000 (0:00:00.036) 0:05:01.662 ******* 2025-11-24 08:47:08.208729 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-11-24 08:47:08.257770 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-11-24 08:47:08.257806 | controller | 2025-11-24 08:47:08.257823 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-11-24 08:47:08.257829 | controller | Monday 24 November 2025 08:47:08 +0000 (0:00:00.106) 0:05:01.769 ******* 2025-11-24 08:47:08.257839 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-11-24 08:47:08.257988 | controller | 2025-11-24 08:47:08.258153 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-11-24 08:47:08.258300 | controller | Monday 24 November 2025 08:47:08 +0000 (0:00:00.049) 0:05:01.819 ******* 2025-11-24 08:47:11.640193 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-11-24 08:47:11.640525 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-11-24 08:47:11.640539 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-11-24 08:47:11.640548 | controller | 2025-11-24 08:47:12.699217 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-11-24 08:47:12.699251 | controller | Monday 24 November 2025 08:47:11 +0000 (0:00:03.382) 0:05:05.201 ******* 2025-11-24 08:47:12.699284 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:13.238602 | controller | 2025-11-24 08:47:13.238635 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-11-24 08:47:13.238654 | controller | Monday 24 November 2025 08:47:12 +0000 (0:00:01.058) 0:05:06.260 ******* 2025-11-24 08:47:13.238665 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:14.290322 | controller | 2025-11-24 08:47:14.290353 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-11-24 08:47:14.290361 | controller | Monday 24 November 2025 08:47:13 +0000 (0:00:00.539) 0:05:06.799 ******* 2025-11-24 08:47:14.290372 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:14.369499 | controller | 2025-11-24 08:47:14.369531 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-11-24 08:47:14.369539 | controller | Monday 24 November 2025 08:47:14 +0000 (0:00:01.051) 0:05:07.850 ******* 2025-11-24 08:47:14.369549 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:14.423446 | controller | 2025-11-24 08:47:14.423477 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-11-24 08:47:14.423485 | controller | Monday 24 November 2025 08:47:14 +0000 (0:00:00.079) 0:05:07.930 ******* 2025-11-24 08:47:14.423495 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:15.408824 | controller | 2025-11-24 08:47:15.408856 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-11-24 08:47:15.408864 | controller | Monday 24 November 2025 08:47:14 +0000 (0:00:00.054) 0:05:07.984 ******* 2025-11-24 08:47:15.408875 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:16.372189 | controller | 2025-11-24 08:47:16.372222 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-11-24 08:47:16.372230 | controller | Monday 24 November 2025 08:47:15 +0000 (0:00:00.985) 0:05:08.969 ******* 2025-11-24 08:47:16.372240 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:22.310029 | controller | 2025-11-24 08:47:22.310061 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-11-24 08:47:22.310070 | controller | Monday 24 November 2025 08:47:16 +0000 (0:00:00.963) 0:05:09.933 ******* 2025-11-24 08:47:22.310080 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-11-24 08:47:22.532177 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:22.532209 | controller | 2025-11-24 08:47:22.532217 | controller | TASK [Configure ntp service] *************************************************** 2025-11-24 08:47:22.532223 | controller | Monday 24 November 2025 08:47:22 +0000 (0:00:05.937) 0:05:15.870 ******* 2025-11-24 08:47:22.532233 | controller | 2025-11-24 08:47:23.440298 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-11-24 08:47:23.440336 | controller | Monday 24 November 2025 08:47:22 +0000 (0:00:00.222) 0:05:16.093 ******* 2025-11-24 08:47:23.440348 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:24.393505 | controller | 2025-11-24 08:47:24.393539 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-11-24 08:47:24.393547 | controller | Monday 24 November 2025 08:47:23 +0000 (0:00:00.908) 0:05:17.001 ******* 2025-11-24 08:47:24.393557 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-11-24 08:47:25.284769 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-11-24 08:47:25.284799 | controller | 2025-11-24 08:47:25.284807 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-11-24 08:47:25.284813 | controller | Monday 24 November 2025 08:47:24 +0000 (0:00:00.953) 0:05:17.954 ******* 2025-11-24 08:47:25.284822 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:25.911056 | controller | 2025-11-24 08:47:25.911085 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-11-24 08:47:25.911093 | controller | Monday 24 November 2025 08:47:25 +0000 (0:00:00.891) 0:05:18.845 ******* 2025-11-24 08:47:25.911130 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:26.052212 | controller | 2025-11-24 08:47:26.052242 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-11-24 08:47:26.052255 | controller | Monday 24 November 2025 08:47:25 +0000 (0:00:00.626) 0:05:19.472 ******* 2025-11-24 08:47:26.052266 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-11-24 08:47:26.540704 | controller | 2025-11-24 08:47:26.540748 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-11-24 08:47:26.540758 | controller | Monday 24 November 2025 08:47:26 +0000 (0:00:00.141) 0:05:19.613 ******* 2025-11-24 08:47:26.540768 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:26.993039 | controller | 2025-11-24 08:47:26.993070 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-11-24 08:47:26.993078 | controller | Monday 24 November 2025 08:47:26 +0000 (0:00:00.488) 0:05:20.101 ******* 2025-11-24 08:47:26.993088 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-11-24 08:47:27.626984 | controller | 2025-11-24 08:47:27.627016 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-11-24 08:47:27.627024 | controller | Monday 24 November 2025 08:47:26 +0000 (0:00:00.452) 0:05:20.553 ******* 2025-11-24 08:47:27.627034 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-11-24 08:47:28.124812 | controller | 2025-11-24 08:47:28.124843 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-11-24 08:47:28.124851 | controller | Monday 24 November 2025 08:47:27 +0000 (0:00:00.634) 0:05:21.187 ******* 2025-11-24 08:47:28.124861 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-11-24 08:47:28.170783 | controller | 2025-11-24 08:47:28.170812 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-11-24 08:47:28.170820 | controller | Monday 24 November 2025 08:47:28 +0000 (0:00:00.497) 0:05:21.685 ******* 2025-11-24 08:47:28.170830 | controller | 2025-11-24 08:47:28.616686 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-11-24 08:47:28.616718 | controller | Monday 24 November 2025 08:47:28 +0000 (0:00:00.046) 0:05:21.732 ******* 2025-11-24 08:47:28.616730 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-11-24 08:47:29.338751 | controller | 2025-11-24 08:47:29.338798 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-11-24 08:47:29.338807 | controller | Monday 24 November 2025 08:47:28 +0000 (0:00:00.445) 0:05:22.177 ******* 2025-11-24 08:47:29.338818 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-11-24 08:47:29.364090 | controller | 2025-11-24 08:47:29.364131 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-11-24 08:47:29.364143 | controller | Monday 24 November 2025 08:47:29 +0000 (0:00:00.721) 0:05:22.899 ******* 2025-11-24 08:47:29.364152 | controller | skipping: [instance] 2025-11-24 08:47:29.396158 | controller | 2025-11-24 08:47:29.396178 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-11-24 08:47:29.396186 | controller | Monday 24 November 2025 08:47:29 +0000 (0:00:00.025) 0:05:22.925 ******* 2025-11-24 08:47:29.396194 | controller | skipping: [instance] 2025-11-24 08:47:29.396373 | controller | 2025-11-24 08:47:29.396387 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-11-24 08:47:29.605444 | controller | Monday 24 November 2025 08:47:29 +0000 (0:00:00.031) 0:05:22.957 ******* 2025-11-24 08:47:29.605478 | controller | changed: [instance] 2025-11-24 08:47:29.676411 | controller | 2025-11-24 08:47:29.676436 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-11-24 08:47:29.676444 | controller | Monday 24 November 2025 08:47:29 +0000 (0:00:00.209) 0:05:23.166 ******* 2025-11-24 08:47:29.676453 | controller | skipping: [instance] => (item=) 2025-11-24 08:47:29.709163 | controller | 2025-11-24 08:47:29.709188 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-11-24 08:47:29.709196 | controller | Monday 24 November 2025 08:47:29 +0000 (0:00:00.071) 0:05:23.237 ******* 2025-11-24 08:47:29.709206 | controller | ok: [instance] 2025-11-24 08:47:29.784635 | controller | 2025-11-24 08:47:29.784667 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-24 08:47:29.784675 | controller | Monday 24 November 2025 08:47:29 +0000 (0:00:00.032) 0:05:23.270 ******* 2025-11-24 08:47:29.784686 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-11-24 08:47:30.017048 | controller | 2025-11-24 08:47:30.017083 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-24 08:47:30.017092 | controller | Monday 24 November 2025 08:47:29 +0000 (0:00:00.073) 0:05:23.343 ******* 2025-11-24 08:47:30.017103 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-11-24 08:47:30.064022 | controller | 2025-11-24 08:47:30.064042 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-11-24 08:47:30.064049 | controller | Monday 24 November 2025 08:47:30 +0000 (0:00:00.234) 0:05:23.577 ******* 2025-11-24 08:47:30.064062 | controller | 2025-11-24 08:47:30.122247 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-11-24 08:47:30.122267 | controller | Monday 24 November 2025 08:47:30 +0000 (0:00:00.047) 0:05:23.625 ******* 2025-11-24 08:47:30.122277 | controller | ok: [instance] 2025-11-24 08:47:30.176804 | controller | 2025-11-24 08:47:30.176826 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-24 08:47:30.176833 | controller | Monday 24 November 2025 08:47:30 +0000 (0:00:00.058) 0:05:23.683 ******* 2025-11-24 08:47:30.176843 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-11-24 08:47:30.432491 | controller | 2025-11-24 08:47:30.432523 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-24 08:47:30.432531 | controller | Monday 24 November 2025 08:47:30 +0000 (0:00:00.054) 0:05:23.737 ******* 2025-11-24 08:47:30.432541 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-11-24 08:47:30.849078 | controller | 2025-11-24 08:47:30.849129 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-11-24 08:47:30.849141 | controller | Monday 24 November 2025 08:47:30 +0000 (0:00:00.255) 0:05:23.993 ******* 2025-11-24 08:47:30.849151 | controller | changed: [instance] 2025-11-24 08:47:31.512207 | controller | 2025-11-24 08:47:31.512241 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-11-24 08:47:31.512249 | controller | Monday 24 November 2025 08:47:30 +0000 (0:00:00.400) 0:05:24.394 ******* 2025-11-24 08:47:31.512260 | controller | 2025-11-24 08:47:31.512265 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-11-24 08:47:31.512271 | controller | Monday 24 November 2025 08:47:30 +0000 (0:00:00.015) 0:05:24.409 ******* 2025-11-24 08:47:31.512281 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:31.879016 | controller | 2025-11-24 08:47:31.879066 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-11-24 08:47:31.879077 | controller | Monday 24 November 2025 08:47:31 +0000 (0:00:00.663) 0:05:25.073 ******* 2025-11-24 08:47:31.879090 | controller | changed: [instance] 2025-11-24 08:47:31.879217 | controller | 2025-11-24 08:47:31.879234 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-11-24 08:47:31.879244 | controller | Monday 24 November 2025 08:47:31 +0000 (0:00:00.366) 0:05:25.440 ******* 2025-11-24 08:47:32.045175 | controller | skipping: [instance] => (item=controller-0) 2025-11-24 08:47:32.045283 | controller | skipping: [instance] => (item=crc-0) 2025-11-24 08:47:32.045442 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-11-24 08:47:32.045541 | controller | 2025-11-24 08:47:32.045640 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-11-24 08:47:32.045720 | controller | Monday 24 November 2025 08:47:32 +0000 (0:00:00.166) 0:05:25.606 ******* 2025-11-24 08:47:33.509430 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-11-24 08:47:33.509573 | controller | 2025-11-24 08:47:33.509606 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-11-24 08:47:33.509730 | controller | Monday 24 November 2025 08:47:33 +0000 (0:00:01.464) 0:05:27.070 ******* 2025-11-24 08:47:33.528840 | controller | skipping: [instance] 2025-11-24 08:47:33.990152 | controller | 2025-11-24 08:47:33.990183 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-11-24 08:47:33.990191 | controller | Monday 24 November 2025 08:47:33 +0000 (0:00:00.019) 0:05:27.090 ******* 2025-11-24 08:47:33.990201 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-11-24 08:47:34.022249 | controller | 2025-11-24 08:47:34.022288 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-11-24 08:47:34.022298 | controller | Monday 24 November 2025 08:47:33 +0000 (0:00:00.461) 0:05:27.551 ******* 2025-11-24 08:47:34.022311 | controller | skipping: [instance] 2025-11-24 08:47:34.022344 | controller | 2025-11-24 08:47:34.022354 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-11-24 08:47:34.022452 | controller | Monday 24 November 2025 08:47:34 +0000 (0:00:00.032) 0:05:27.583 ******* 2025-11-24 08:47:34.055874 | controller | skipping: [instance] 2025-11-24 08:47:34.055959 | controller | 2025-11-24 08:47:34.055975 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-11-24 08:47:34.056058 | controller | Monday 24 November 2025 08:47:34 +0000 (0:00:00.033) 0:05:27.617 ******* 2025-11-24 08:47:34.089051 | controller | skipping: [instance] 2025-11-24 08:47:34.089141 | controller | 2025-11-24 08:47:34.089273 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-11-24 08:47:34.089377 | controller | Monday 24 November 2025 08:47:34 +0000 (0:00:00.033) 0:05:27.650 ******* 2025-11-24 08:47:35.533697 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-11-24 08:47:35.533775 | controller | 2025-11-24 08:47:35.533898 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-11-24 08:47:35.534004 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:01.444) 0:05:29.094 ******* 2025-11-24 08:47:35.569078 | controller | skipping: [instance] 2025-11-24 08:47:35.569199 | controller | 2025-11-24 08:47:35.569308 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-11-24 08:47:35.569409 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:00.035) 0:05:29.130 ******* 2025-11-24 08:47:35.588266 | controller | skipping: [instance] 2025-11-24 08:47:35.588348 | controller | 2025-11-24 08:47:35.588448 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-11-24 08:47:35.588549 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:00.019) 0:05:29.149 ******* 2025-11-24 08:47:35.617775 | controller | skipping: [instance] 2025-11-24 08:47:35.617877 | controller | 2025-11-24 08:47:35.617990 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-11-24 08:47:35.618096 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:00.029) 0:05:29.179 ******* 2025-11-24 08:47:35.672528 | controller | ok: [instance] 2025-11-24 08:47:35.672624 | controller | 2025-11-24 08:47:35.672737 | controller | TASK [reproducer : Push local code] ******************************************** 2025-11-24 08:47:35.672855 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:00.054) 0:05:29.233 ******* 2025-11-24 08:47:35.769743 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-11-24 08:47:35.769878 | controller | 2025-11-24 08:47:35.770011 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-11-24 08:47:35.770188 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:00.097) 0:05:29.331 ******* 2025-11-24 08:47:35.809220 | controller | skipping: [instance] 2025-11-24 08:47:35.809318 | controller | 2025-11-24 08:47:35.809484 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-11-24 08:47:35.809555 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:00.039) 0:05:29.370 ******* 2025-11-24 08:47:35.846880 | controller | skipping: [instance] 2025-11-24 08:47:35.846970 | controller | 2025-11-24 08:47:35.847150 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-11-24 08:47:35.847226 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:00.037) 0:05:29.408 ******* 2025-11-24 08:47:35.884626 | controller | skipping: [instance] 2025-11-24 08:47:35.884726 | controller | 2025-11-24 08:47:35.884835 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-11-24 08:47:35.884948 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:00.037) 0:05:29.446 ******* 2025-11-24 08:47:35.920861 | controller | skipping: [instance] 2025-11-24 08:47:35.920952 | controller | 2025-11-24 08:47:35.921064 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-11-24 08:47:35.921187 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:00.036) 0:05:29.482 ******* 2025-11-24 08:47:35.958854 | controller | skipping: [instance] 2025-11-24 08:47:35.959543 | controller | 2025-11-24 08:47:36.405435 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-11-24 08:47:36.405477 | controller | Monday 24 November 2025 08:47:35 +0000 (0:00:00.037) 0:05:29.520 ******* 2025-11-24 08:47:36.405493 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-11-24 08:47:36.405516 | controller | 2025-11-24 08:47:36.405621 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-11-24 08:47:36.405716 | controller | Monday 24 November 2025 08:47:36 +0000 (0:00:00.446) 0:05:29.966 ******* 2025-11-24 08:47:36.960324 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-11-24 08:47:36.960687 | controller | 2025-11-24 08:47:37.000242 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-11-24 08:47:37.000279 | controller | Monday 24 November 2025 08:47:36 +0000 (0:00:00.554) 0:05:30.521 ******* 2025-11-24 08:47:37.000294 | controller | skipping: [instance] => (item=ci-framework) 2025-11-24 08:47:37.000328 | controller | skipping: [instance] 2025-11-24 08:47:37.000337 | controller | 2025-11-24 08:47:37.000346 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-11-24 08:47:37.000472 | controller | Monday 24 November 2025 08:47:36 +0000 (0:00:00.039) 0:05:30.561 ******* 2025-11-24 08:47:37.074911 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-11-24 08:47:37.074954 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-11-24 08:47:37.074966 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-11-24 08:47:37.074975 | controller | 2025-11-24 08:47:37.075160 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-11-24 08:47:37.075209 | controller | Monday 24 November 2025 08:47:37 +0000 (0:00:00.074) 0:05:30.636 ******* 2025-11-24 08:47:37.516245 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:37.516372 | controller | 2025-11-24 08:47:37.516403 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-11-24 08:47:37.516415 | controller | Monday 24 November 2025 08:47:37 +0000 (0:00:00.441) 0:05:31.077 ******* 2025-11-24 08:47:37.552096 | controller | skipping: [instance] 2025-11-24 08:47:38.013876 | controller | 2025-11-24 08:47:38.013914 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-11-24 08:47:38.013927 | controller | Monday 24 November 2025 08:47:37 +0000 (0:00:00.035) 0:05:31.113 ******* 2025-11-24 08:47:38.013938 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:38.014030 | controller | 2025-11-24 08:47:38.014094 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-11-24 08:47:38.014130 | controller | Monday 24 November 2025 08:47:38 +0000 (0:00:00.461) 0:05:31.575 ******* 2025-11-24 08:47:38.051133 | controller | skipping: [instance] 2025-11-24 08:47:38.484784 | controller | 2025-11-24 08:47:38.484821 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-11-24 08:47:38.484829 | controller | Monday 24 November 2025 08:47:38 +0000 (0:00:00.037) 0:05:31.612 ******* 2025-11-24 08:47:38.484839 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:47:38.484895 | controller | 2025-11-24 08:47:38.484924 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-11-24 08:47:38.484936 | controller | Monday 24 November 2025 08:47:38 +0000 (0:00:00.433) 0:05:32.045 ******* 2025-11-24 08:47:40.723151 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:00.121417 | controller | 2025-11-24 08:48:00.121457 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-11-24 08:48:00.121470 | controller | Monday 24 November 2025 08:47:40 +0000 (0:00:02.238) 0:05:34.284 ******* 2025-11-24 08:48:00.121480 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:00.121607 | controller | 2025-11-24 08:48:00.121629 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-11-24 08:48:01.104266 | controller | Monday 24 November 2025 08:48:00 +0000 (0:00:19.398) 0:05:53.682 ******* 2025-11-24 08:48:01.104311 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:01.104555 | controller | 2025-11-24 08:48:01.202832 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-11-24 08:48:01.202871 | controller | Monday 24 November 2025 08:48:01 +0000 (0:00:00.983) 0:05:54.665 ******* 2025-11-24 08:48:01.202884 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-11-24 08:48:01.202910 | controller | 2025-11-24 08:48:01.202918 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-11-24 08:48:01.203059 | controller | Monday 24 November 2025 08:48:01 +0000 (0:00:00.098) 0:05:54.764 ******* 2025-11-24 08:48:01.630543 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:01.630755 | controller | 2025-11-24 08:48:01.630798 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-11-24 08:48:01.665852 | controller | Monday 24 November 2025 08:48:01 +0000 (0:00:00.427) 0:05:55.191 ******* 2025-11-24 08:48:01.665889 | controller | skipping: [instance] 2025-11-24 08:48:01.708085 | controller | 2025-11-24 08:48:01.708131 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-11-24 08:48:01.708151 | controller | Monday 24 November 2025 08:48:01 +0000 (0:00:00.035) 0:05:55.226 ******* 2025-11-24 08:48:01.708163 | controller | skipping: [instance] 2025-11-24 08:48:01.708200 | controller | 2025-11-24 08:48:01.708218 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-11-24 08:48:01.708384 | controller | Monday 24 November 2025 08:48:01 +0000 (0:00:00.042) 0:05:55.269 ******* 2025-11-24 08:48:01.801755 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:02.281368 | controller | 2025-11-24 08:48:02.281402 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-11-24 08:48:02.281410 | controller | Monday 24 November 2025 08:48:01 +0000 (0:00:00.093) 0:05:55.362 ******* 2025-11-24 08:48:02.281420 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:02.281615 | controller | 2025-11-24 08:48:02.281652 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-11-24 08:48:02.319211 | controller | Monday 24 November 2025 08:48:02 +0000 (0:00:00.479) 0:05:55.842 ******* 2025-11-24 08:48:02.319244 | controller | skipping: [instance] 2025-11-24 08:48:02.319284 | controller | 2025-11-24 08:48:02.319293 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-11-24 08:48:02.319416 | controller | Monday 24 November 2025 08:48:02 +0000 (0:00:00.037) 0:05:55.880 ******* 2025-11-24 08:48:02.358507 | controller | skipping: [instance] 2025-11-24 08:48:02.358574 | controller | 2025-11-24 08:48:02.358809 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-11-24 08:48:02.396648 | controller | Monday 24 November 2025 08:48:02 +0000 (0:00:00.039) 0:05:55.919 ******* 2025-11-24 08:48:02.396677 | controller | skipping: [instance] 2025-11-24 08:48:02.396746 | controller | 2025-11-24 08:48:02.396849 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-11-24 08:48:02.396971 | controller | Monday 24 November 2025 08:48:02 +0000 (0:00:00.038) 0:05:55.958 ******* 2025-11-24 08:48:03.872139 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:05.250849 | controller | 2025-11-24 08:48:05.250885 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-11-24 08:48:05.250893 | controller | Monday 24 November 2025 08:48:03 +0000 (0:00:01.474) 0:05:57.433 ******* 2025-11-24 08:48:05.250904 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:48:05.250922 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:48:05.250933 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:48:05.250938 | controller | changed: [instance -> controller-0] 2025-11-24 08:48:05.250945 | controller | 2025-11-24 08:48:05.250961 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-11-24 08:48:05.251053 | controller | Monday 24 November 2025 08:48:05 +0000 (0:00:01.378) 0:05:58.811 ******* 2025-11-24 08:48:06.167600 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:06.167664 | controller | 2025-11-24 08:48:06.167790 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-11-24 08:48:06.167892 | controller | Monday 24 November 2025 08:48:06 +0000 (0:00:00.917) 0:05:59.728 ******* 2025-11-24 08:48:07.370372 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:07.370455 | controller | 2025-11-24 08:48:07.370558 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-11-24 08:48:07.370654 | controller | Monday 24 November 2025 08:48:07 +0000 (0:00:01.202) 0:06:00.931 ******* 2025-11-24 08:48:15.079919 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:15.079975 | controller | 2025-11-24 08:48:15.080231 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-11-24 08:48:15.080257 | controller | Monday 24 November 2025 08:48:15 +0000 (0:00:07.709) 0:06:08.640 ******* 2025-11-24 08:48:16.005373 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:16.005410 | controller | 2025-11-24 08:48:16.005506 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-11-24 08:48:16.005609 | controller | Monday 24 November 2025 08:48:16 +0000 (0:00:00.925) 0:06:09.566 ******* 2025-11-24 08:48:16.041976 | controller | skipping: [instance] 2025-11-24 08:48:16.042079 | controller | 2025-11-24 08:48:16.042219 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-11-24 08:48:16.042325 | controller | Monday 24 November 2025 08:48:16 +0000 (0:00:00.036) 0:06:09.603 ******* 2025-11-24 08:48:17.122394 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:17.122444 | controller | 2025-11-24 08:48:17.122546 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-11-24 08:48:17.122648 | controller | Monday 24 November 2025 08:48:17 +0000 (0:00:01.080) 0:06:10.683 ******* 2025-11-24 08:48:17.175207 | controller | skipping: [instance] 2025-11-24 08:48:17.175297 | controller | 2025-11-24 08:48:17.176318 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-11-24 08:48:17.226063 | controller | Monday 24 November 2025 08:48:17 +0000 (0:00:00.052) 0:06:10.736 ******* 2025-11-24 08:48:17.226120 | controller | skipping: [instance] 2025-11-24 08:48:17.226866 | controller | 2025-11-24 08:48:17.278377 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-11-24 08:48:17.278411 | controller | Monday 24 November 2025 08:48:17 +0000 (0:00:00.051) 0:06:10.787 ******* 2025-11-24 08:48:17.278424 | controller | skipping: [instance] 2025-11-24 08:48:17.279390 | controller | 2025-11-24 08:48:18.086071 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-11-24 08:48:18.086134 | controller | Monday 24 November 2025 08:48:17 +0000 (0:00:00.052) 0:06:10.839 ******* 2025-11-24 08:48:18.086152 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:18.086279 | controller | 2025-11-24 08:48:18.086297 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-11-24 08:48:18.086394 | controller | Monday 24 November 2025 08:48:18 +0000 (0:00:00.807) 0:06:11.647 ******* 2025-11-24 08:48:18.965896 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:18.965975 | controller | 2025-11-24 08:48:18.966083 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-11-24 08:48:18.966215 | controller | Monday 24 November 2025 08:48:18 +0000 (0:00:00.879) 0:06:12.527 ******* 2025-11-24 08:48:19.067405 | controller | skipping: [instance] 2025-11-24 08:48:19.067487 | controller | 2025-11-24 08:48:19.067601 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-11-24 08:48:19.067718 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.101) 0:06:12.628 ******* 2025-11-24 08:48:19.109720 | controller | skipping: [instance] 2025-11-24 08:48:19.109796 | controller | 2025-11-24 08:48:19.109913 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-11-24 08:48:19.110013 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.042) 0:06:12.670 ******* 2025-11-24 08:48:19.153435 | controller | skipping: [instance] 2025-11-24 08:48:19.212292 | controller | 2025-11-24 08:48:19.212345 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-11-24 08:48:19.212363 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.042) 0:06:12.713 ******* 2025-11-24 08:48:19.212386 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:19.212487 | controller | 2025-11-24 08:48:19.212504 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-11-24 08:48:19.212587 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.057) 0:06:12.771 ******* 2025-11-24 08:48:19.252531 | controller | skipping: [instance] 2025-11-24 08:48:19.252586 | controller | 2025-11-24 08:48:19.252715 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-11-24 08:48:19.252817 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.042) 0:06:12.813 ******* 2025-11-24 08:48:19.291019 | controller | skipping: [instance] 2025-11-24 08:48:19.291080 | controller | 2025-11-24 08:48:19.291225 | controller | TASK [Download the RPM] ******************************************************** 2025-11-24 08:48:19.291322 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.038) 0:06:12.852 ******* 2025-11-24 08:48:19.332488 | controller | skipping: [instance] 2025-11-24 08:48:19.332561 | controller | 2025-11-24 08:48:19.332683 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-11-24 08:48:19.332794 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.041) 0:06:12.893 ******* 2025-11-24 08:48:19.372449 | controller | skipping: [instance] 2025-11-24 08:48:19.372542 | controller | 2025-11-24 08:48:19.372645 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-11-24 08:48:19.372764 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.040) 0:06:12.933 ******* 2025-11-24 08:48:19.414121 | controller | skipping: [instance] 2025-11-24 08:48:19.414207 | controller | 2025-11-24 08:48:19.414317 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-11-24 08:48:19.414431 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.041) 0:06:12.975 ******* 2025-11-24 08:48:19.454780 | controller | skipping: [instance] 2025-11-24 08:48:19.454828 | controller | 2025-11-24 08:48:19.454964 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-11-24 08:48:19.455074 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.040) 0:06:13.016 ******* 2025-11-24 08:48:19.496069 | controller | skipping: [instance] 2025-11-24 08:48:19.496179 | controller | 2025-11-24 08:48:19.496293 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-11-24 08:48:19.496402 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.041) 0:06:13.057 ******* 2025-11-24 08:48:19.970899 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:19.970974 | controller | 2025-11-24 08:48:19.971084 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-11-24 08:48:19.971224 | controller | Monday 24 November 2025 08:48:19 +0000 (0:00:00.474) 0:06:13.532 ******* 2025-11-24 08:48:20.022961 | controller | skipping: [instance] 2025-11-24 08:48:20.023036 | controller | 2025-11-24 08:48:20.023299 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-11-24 08:48:20.074345 | controller | Monday 24 November 2025 08:48:20 +0000 (0:00:00.051) 0:06:13.584 ******* 2025-11-24 08:48:20.074389 | controller | skipping: [instance] 2025-11-24 08:48:20.074400 | controller | 2025-11-24 08:48:20.074556 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-11-24 08:48:20.074662 | controller | Monday 24 November 2025 08:48:20 +0000 (0:00:00.051) 0:06:13.635 ******* 2025-11-24 08:48:20.114148 | controller | skipping: [instance] 2025-11-24 08:48:20.114228 | controller | 2025-11-24 08:48:20.114350 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-11-24 08:48:20.114455 | controller | Monday 24 November 2025 08:48:20 +0000 (0:00:00.039) 0:06:13.675 ******* 2025-11-24 08:48:20.166766 | controller | skipping: [instance] 2025-11-24 08:48:20.166825 | controller | 2025-11-24 08:48:20.166946 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-11-24 08:48:20.167037 | controller | Monday 24 November 2025 08:48:20 +0000 (0:00:00.052) 0:06:13.727 ******* 2025-11-24 08:48:20.220535 | controller | skipping: [instance] 2025-11-24 08:48:20.220638 | controller | 2025-11-24 08:48:20.220759 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-11-24 08:48:20.220865 | controller | Monday 24 November 2025 08:48:20 +0000 (0:00:00.053) 0:06:13.781 ******* 2025-11-24 08:48:20.279305 | controller | skipping: [instance] 2025-11-24 08:48:20.279396 | controller | 2025-11-24 08:48:20.279506 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-11-24 08:48:20.279608 | controller | Monday 24 November 2025 08:48:20 +0000 (0:00:00.054) 0:06:13.836 ******* 2025-11-24 08:48:20.328568 | controller | skipping: [instance] 2025-11-24 08:48:20.328646 | controller | 2025-11-24 08:48:20.328811 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-11-24 08:48:20.328897 | controller | Monday 24 November 2025 08:48:20 +0000 (0:00:00.053) 0:06:13.889 ******* 2025-11-24 08:48:20.381366 | controller | skipping: [instance] 2025-11-24 08:48:20.381469 | controller | 2025-11-24 08:48:20.381561 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-11-24 08:48:20.381695 | controller | Monday 24 November 2025 08:48:20 +0000 (0:00:00.052) 0:06:13.942 ******* 2025-11-24 08:48:21.027525 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:21.027607 | controller | 2025-11-24 08:48:21.027746 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-11-24 08:48:21.027839 | controller | Monday 24 November 2025 08:48:21 +0000 (0:00:00.646) 0:06:14.588 ******* 2025-11-24 08:48:21.976446 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:48:21.976549 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:48:21.976669 | controller | changed: [instance -> controller-0] 2025-11-24 08:48:21.976792 | controller | 2025-11-24 08:48:21.976886 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-11-24 08:48:21.976984 | controller | Monday 24 November 2025 08:48:21 +0000 (0:00:00.949) 0:06:15.537 ******* 2025-11-24 08:48:22.677575 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:22.677634 | controller | 2025-11-24 08:48:22.677785 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-11-24 08:48:22.677868 | controller | Monday 24 November 2025 08:48:22 +0000 (0:00:00.701) 0:06:16.238 ******* 2025-11-24 08:48:23.168460 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:23.168523 | controller | 2025-11-24 08:48:23.168669 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-11-24 08:48:23.168765 | controller | Monday 24 November 2025 08:48:23 +0000 (0:00:00.489) 0:06:16.728 ******* 2025-11-24 08:48:23.227770 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:48:23.227889 | controller | ok: [instance -> controller-0] 2025-11-24 08:48:23.227988 | controller | 2025-11-24 08:48:23.228095 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-11-24 08:48:23.228222 | controller | Monday 24 November 2025 08:48:23 +0000 (0:00:00.060) 0:06:16.789 ******* 2025-11-24 08:48:23.269391 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:23.269493 | controller | 2025-11-24 08:48:23.269612 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-11-24 08:48:23.269722 | controller | Monday 24 November 2025 08:48:23 +0000 (0:00:00.041) 0:06:16.830 ******* 2025-11-24 08:48:53.482924 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:53.482976 | controller | 2025-11-24 08:48:53.483053 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-11-24 08:48:53.483175 | controller | Monday 24 November 2025 08:48:53 +0000 (0:00:30.213) 0:06:47.043 ******* 2025-11-24 08:48:53.946016 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:53.946083 | controller | 2025-11-24 08:48:53.946241 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-11-24 08:48:53.946342 | controller | Monday 24 November 2025 08:48:53 +0000 (0:00:00.463) 0:06:47.507 ******* 2025-11-24 08:48:54.413083 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:48:54.413210 | controller | 2025-11-24 08:48:54.413337 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-11-24 08:48:54.413448 | controller | Monday 24 November 2025 08:48:54 +0000 (0:00:00.466) 0:06:47.974 ******* 2025-11-24 08:49:00.288763 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:00.288802 | controller | 2025-11-24 08:49:00.288810 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-11-24 08:49:00.288819 | controller | Monday 24 November 2025 08:49:00 +0000 (0:00:05.875) 0:06:53.849 ******* 2025-11-24 08:49:00.337173 | controller | skipping: [instance] 2025-11-24 08:49:00.337265 | controller | 2025-11-24 08:49:00.337393 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-11-24 08:49:00.337511 | controller | Monday 24 November 2025 08:49:00 +0000 (0:00:00.048) 0:06:53.898 ******* 2025-11-24 08:49:00.903221 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:00.903288 | controller | 2025-11-24 08:49:00.903407 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-11-24 08:49:00.903511 | controller | Monday 24 November 2025 08:49:00 +0000 (0:00:00.565) 0:06:54.464 ******* 2025-11-24 08:49:01.354781 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:01.354838 | controller | 2025-11-24 08:49:01.354966 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-11-24 08:49:01.355069 | controller | Monday 24 November 2025 08:49:01 +0000 (0:00:00.451) 0:06:54.915 ******* 2025-11-24 08:49:01.391689 | controller | skipping: [instance] 2025-11-24 08:49:01.391738 | controller | 2025-11-24 08:49:01.391857 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-11-24 08:49:01.391959 | controller | Monday 24 November 2025 08:49:01 +0000 (0:00:00.037) 0:06:54.953 ******* 2025-11-24 08:49:01.430899 | controller | skipping: [instance] 2025-11-24 08:49:01.430976 | controller | 2025-11-24 08:49:01.431086 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-11-24 08:49:01.431229 | controller | Monday 24 November 2025 08:49:01 +0000 (0:00:00.039) 0:06:54.992 ******* 2025-11-24 08:49:01.469625 | controller | skipping: [instance] 2025-11-24 08:49:01.469743 | controller | 2025-11-24 08:49:01.469886 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-11-24 08:49:01.470010 | controller | Monday 24 November 2025 08:49:01 +0000 (0:00:00.038) 0:06:55.030 ******* 2025-11-24 08:49:01.506686 | controller | skipping: [instance] 2025-11-24 08:49:01.506754 | controller | 2025-11-24 08:49:01.506857 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-11-24 08:49:01.506979 | controller | Monday 24 November 2025 08:49:01 +0000 (0:00:00.037) 0:06:55.068 ******* 2025-11-24 08:49:01.545541 | controller | skipping: [instance] 2025-11-24 08:49:01.545641 | controller | 2025-11-24 08:49:01.545754 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-11-24 08:49:01.545861 | controller | Monday 24 November 2025 08:49:01 +0000 (0:00:00.038) 0:06:55.107 ******* 2025-11-24 08:49:01.583832 | controller | skipping: [instance] 2025-11-24 08:49:01.583933 | controller | 2025-11-24 08:49:01.584035 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-11-24 08:49:01.584133 | controller | Monday 24 November 2025 08:49:01 +0000 (0:00:00.038) 0:06:55.145 ******* 2025-11-24 08:49:04.045244 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:49:04.045316 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:49:04.045425 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:49:04.045526 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:49:04.045634 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:49:04.045731 | controller | changed: [instance -> controller-0] 2025-11-24 08:49:04.045805 | controller | 2025-11-24 08:49:04.045907 | controller | TASK [Prepare install_yamls make targets] ************************************** 2025-11-24 08:49:04.045989 | controller | Monday 24 November 2025 08:49:04 +0000 (0:00:02.461) 0:06:57.606 ******* 2025-11-24 08:49:04.199388 | controller | 2025-11-24 08:49:04.199495 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2025-11-24 08:49:04.199607 | controller | Monday 24 November 2025 08:49:04 +0000 (0:00:00.154) 0:06:57.760 ******* 2025-11-24 08:49:05.608999 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:49:05.609089 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:49:05.609218 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:49:05.609309 | controller | changed: [instance -> controller-0] 2025-11-24 08:49:05.609404 | controller | 2025-11-24 08:49:05.609498 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2025-11-24 08:49:05.609609 | controller | Monday 24 November 2025 08:49:05 +0000 (0:00:01.409) 0:06:59.170 ******* 2025-11-24 08:49:05.670955 | controller | 2025-11-24 08:49:05.671070 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2025-11-24 08:49:05.671201 | controller | Monday 24 November 2025 08:49:05 +0000 (0:00:00.062) 0:06:59.232 ******* 2025-11-24 08:49:05.714830 | controller | skipping: [instance] 2025-11-24 08:49:05.714894 | controller | 2025-11-24 08:49:05.715015 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2025-11-24 08:49:05.715134 | controller | Monday 24 November 2025 08:49:05 +0000 (0:00:00.043) 0:06:59.275 ******* 2025-11-24 08:49:05.763019 | controller | skipping: [instance] 2025-11-24 08:49:05.763083 | controller | 2025-11-24 08:49:05.763218 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2025-11-24 08:49:05.763321 | controller | Monday 24 November 2025 08:49:05 +0000 (0:00:00.048) 0:06:59.324 ******* 2025-11-24 08:49:05.826093 | controller | 2025-11-24 08:49:05.826194 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-24 08:49:05.826301 | controller | Monday 24 November 2025 08:49:05 +0000 (0:00:00.063) 0:06:59.387 ******* 2025-11-24 08:49:05.865700 | controller | skipping: [instance] 2025-11-24 08:49:05.865791 | controller | 2025-11-24 08:49:05.865893 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-24 08:49:05.865990 | controller | Monday 24 November 2025 08:49:05 +0000 (0:00:00.039) 0:06:59.427 ******* 2025-11-24 08:49:05.903700 | controller | skipping: [instance] 2025-11-24 08:49:05.903795 | controller | 2025-11-24 08:49:05.903903 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-24 08:49:05.904005 | controller | Monday 24 November 2025 08:49:05 +0000 (0:00:00.037) 0:06:59.465 ******* 2025-11-24 08:49:05.943685 | controller | skipping: [instance] 2025-11-24 08:49:05.943780 | controller | 2025-11-24 08:49:05.943885 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-24 08:49:05.943982 | controller | Monday 24 November 2025 08:49:05 +0000 (0:00:00.040) 0:06:59.505 ******* 2025-11-24 08:49:05.988672 | controller | skipping: [instance] 2025-11-24 08:49:05.988767 | controller | 2025-11-24 08:49:05.988868 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2025-11-24 08:49:05.988968 | controller | Monday 24 November 2025 08:49:05 +0000 (0:00:00.044) 0:06:59.550 ******* 2025-11-24 08:49:06.135611 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-24 08:49:06.135693 | controller | ok: [instance -> controller-0] 2025-11-24 08:49:06.135799 | controller | 2025-11-24 08:49:06.135903 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2025-11-24 08:49:06.136009 | controller | Monday 24 November 2025 08:49:06 +0000 (0:00:00.146) 0:06:59.696 ******* 2025-11-24 08:49:06.200671 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:06.200745 | controller | 2025-11-24 08:49:06.200861 | controller | TASK [install_yamls : Get environment structure] ******************************* 2025-11-24 08:49:06.200939 | controller | Monday 24 November 2025 08:49:06 +0000 (0:00:00.065) 0:06:59.762 ******* 2025-11-24 08:49:07.156343 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:07.156407 | controller | 2025-11-24 08:49:07.156523 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2025-11-24 08:49:07.156620 | controller | Monday 24 November 2025 08:49:07 +0000 (0:00:00.955) 0:07:00.717 ******* 2025-11-24 08:49:07.194418 | controller | skipping: [instance] 2025-11-24 08:49:07.194525 | controller | 2025-11-24 08:49:07.194641 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2025-11-24 08:49:07.194747 | controller | Monday 24 November 2025 08:49:07 +0000 (0:00:00.037) 0:07:00.755 ******* 2025-11-24 08:49:07.241306 | controller | skipping: [instance] 2025-11-24 08:49:07.241348 | controller | 2025-11-24 08:49:07.241455 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2025-11-24 08:49:07.241608 | controller | Monday 24 November 2025 08:49:07 +0000 (0:00:00.046) 0:07:00.802 ******* 2025-11-24 08:49:07.280709 | controller | skipping: [instance] 2025-11-24 08:49:07.280794 | controller | 2025-11-24 08:49:07.280912 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2025-11-24 08:49:07.281011 | controller | Monday 24 November 2025 08:49:07 +0000 (0:00:00.039) 0:07:00.841 ******* 2025-11-24 08:49:07.343945 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:07.344059 | controller | 2025-11-24 08:49:07.344180 | controller | TASK [install_yamls : Show the env structure] ********************************** 2025-11-24 08:49:07.344291 | controller | Monday 24 November 2025 08:49:07 +0000 (0:00:00.063) 0:07:00.905 ******* 2025-11-24 08:49:07.389085 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:07.389135 | controller | 2025-11-24 08:49:07.389303 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2025-11-24 08:49:07.389385 | controller | Monday 24 November 2025 08:49:07 +0000 (0:00:00.045) 0:07:00.950 ******* 2025-11-24 08:49:07.442590 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:07.442694 | controller | 2025-11-24 08:49:07.442805 | controller | TASK [install_yamls : Generate make targets] *********************************** 2025-11-24 08:49:07.442899 | controller | Monday 24 November 2025 08:49:07 +0000 (0:00:00.053) 0:07:01.004 ******* 2025-11-24 08:49:08.008655 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:08.008718 | controller | 2025-11-24 08:49:08.008835 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2025-11-24 08:49:08.008941 | controller | Monday 24 November 2025 08:49:08 +0000 (0:00:00.565) 0:07:01.569 ******* 2025-11-24 08:49:08.057345 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:08.057435 | controller | 2025-11-24 08:49:08.057557 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2025-11-24 08:49:08.057656 | controller | Monday 24 November 2025 08:49:08 +0000 (0:00:00.048) 0:07:01.618 ******* 2025-11-24 08:49:08.940275 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:08.940437 | controller | 2025-11-24 08:49:08.940563 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2025-11-24 08:49:08.940575 | controller | Monday 24 November 2025 08:49:08 +0000 (0:00:00.883) 0:07:02.501 ******* 2025-11-24 08:49:08.984807 | controller | skipping: [instance] 2025-11-24 08:49:08.984890 | controller | 2025-11-24 08:49:08.985013 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-11-24 08:49:08.985118 | controller | Monday 24 November 2025 08:49:08 +0000 (0:00:00.044) 0:07:02.546 ******* 2025-11-24 08:49:09.748965 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:09.749050 | controller | 2025-11-24 08:49:09.749165 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-11-24 08:49:09.749282 | controller | Monday 24 November 2025 08:49:09 +0000 (0:00:00.763) 0:07:03.310 ******* 2025-11-24 08:49:09.799274 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:09.799382 | controller | 2025-11-24 08:49:09.799470 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2025-11-24 08:49:09.799588 | controller | Monday 24 November 2025 08:49:09 +0000 (0:00:00.050) 0:07:03.360 ******* 2025-11-24 08:49:10.678687 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:10.678750 | controller | 2025-11-24 08:49:10.678879 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2025-11-24 08:49:10.678987 | controller | Monday 24 November 2025 08:49:10 +0000 (0:00:00.879) 0:07:04.239 ******* 2025-11-24 08:49:11.137092 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:11.137289 | controller | 2025-11-24 08:49:11.137416 | controller | TASK [Configure CRC network if needed] ***************************************** 2025-11-24 08:49:11.137439 | controller | Monday 24 November 2025 08:49:11 +0000 (0:00:00.458) 0:07:04.698 ******* 2025-11-24 08:49:11.284931 | controller | 2025-11-24 08:49:11.285029 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2025-11-24 08:49:11.285139 | controller | Monday 24 November 2025 08:49:11 +0000 (0:00:00.147) 0:07:04.846 ******* 2025-11-24 08:49:12.419842 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:12.420172 | controller | 2025-11-24 08:49:13.568993 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2025-11-24 08:49:13.569033 | controller | Monday 24 November 2025 08:49:12 +0000 (0:00:01.134) 0:07:05.981 ******* 2025-11-24 08:49:13.569045 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:13.569215 | controller | 2025-11-24 08:49:13.569243 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2025-11-24 08:49:13.596337 | controller | Monday 24 November 2025 08:49:13 +0000 (0:00:01.149) 0:07:07.130 ******* 2025-11-24 08:49:13.596364 | controller | skipping: [instance] 2025-11-24 08:49:13.596414 | controller | 2025-11-24 08:49:13.596522 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2025-11-24 08:49:13.596630 | controller | Monday 24 November 2025 08:49:13 +0000 (0:00:00.027) 0:07:07.157 ******* 2025-11-24 08:49:13.632605 | controller | skipping: [instance] 2025-11-24 08:49:13.632705 | controller | 2025-11-24 08:49:13.632817 | controller | TASK [reproducer : Prepare architecture-based deployment] ********************** 2025-11-24 08:49:13.632921 | controller | Monday 24 November 2025 08:49:13 +0000 (0:00:00.036) 0:07:07.194 ******* 2025-11-24 08:49:13.667381 | controller | skipping: [instance] 2025-11-24 08:49:13.667474 | controller | 2025-11-24 08:49:13.667581 | controller | TASK [reproducer : Prepare architecture-based post deployment] ***************** 2025-11-24 08:49:13.667703 | controller | Monday 24 November 2025 08:49:13 +0000 (0:00:00.034) 0:07:07.228 ******* 2025-11-24 08:49:13.701684 | controller | skipping: [instance] 2025-11-24 08:49:13.701780 | controller | 2025-11-24 08:49:13.701906 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** 2025-11-24 08:49:13.702010 | controller | Monday 24 November 2025 08:49:13 +0000 (0:00:00.034) 0:07:07.263 ******* 2025-11-24 08:49:14.617002 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:14.617117 | controller | 2025-11-24 08:49:14.617244 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** 2025-11-24 08:49:14.617348 | controller | Monday 24 November 2025 08:49:14 +0000 (0:00:00.915) 0:07:08.178 ******* 2025-11-24 08:49:15.051853 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:15.051911 | controller | 2025-11-24 08:49:15.052012 | controller | TASK [Ensure we have needed inventory files] *********************************** 2025-11-24 08:49:15.052138 | controller | Monday 24 November 2025 08:49:15 +0000 (0:00:00.434) 0:07:08.613 ******* 2025-11-24 08:49:15.490155 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:15.490243 | controller | 2025-11-24 08:49:15.490340 | controller | TASK [Ensure we have CRC ssh key] ********************************************** 2025-11-24 08:49:15.490441 | controller | Monday 24 November 2025 08:49:15 +0000 (0:00:00.438) 0:07:09.051 ******* 2025-11-24 08:49:15.947722 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:16.412428 | controller | 2025-11-24 08:49:16.412468 | controller | TASK [Ensure we have the MAC mapping file] ************************************* 2025-11-24 08:49:16.412477 | controller | Monday 24 November 2025 08:49:15 +0000 (0:00:00.457) 0:07:09.508 ******* 2025-11-24 08:49:16.412487 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:16.412592 | controller | 2025-11-24 08:49:16.412612 | controller | TASK [Load crc inventory] ****************************************************** 2025-11-24 08:49:16.412727 | controller | Monday 24 November 2025 08:49:16 +0000 (0:00:00.465) 0:07:09.973 ******* 2025-11-24 08:49:16.843645 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:16.843693 | controller | 2025-11-24 08:49:16.843806 | controller | TASK [Load compute inventory] ************************************************** 2025-11-24 08:49:16.843906 | controller | Monday 24 November 2025 08:49:16 +0000 (0:00:00.431) 0:07:10.404 ******* 2025-11-24 08:49:17.263507 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:17.263587 | controller | 2025-11-24 08:49:17.263702 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** 2025-11-24 08:49:17.263800 | controller | Monday 24 November 2025 08:49:17 +0000 (0:00:00.419) 0:07:10.824 ******* 2025-11-24 08:49:17.717703 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:17.717805 | controller | 2025-11-24 08:49:17.717916 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* 2025-11-24 08:49:17.718010 | controller | Monday 24 November 2025 08:49:17 +0000 (0:00:00.454) 0:07:11.278 ******* 2025-11-24 08:49:18.168372 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:18.168441 | controller | 2025-11-24 08:49:18.168559 | controller | TASK [Check default location secret file] ************************************** 2025-11-24 08:49:18.168658 | controller | Monday 24 November 2025 08:49:18 +0000 (0:00:00.450) 0:07:11.729 ******* 2025-11-24 08:49:18.623012 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:18.623239 | controller | 2025-11-24 08:49:18.623322 | controller | TASK [Check non-default location secret] *************************************** 2025-11-24 08:49:18.623346 | controller | Monday 24 November 2025 08:49:18 +0000 (0:00:00.454) 0:07:12.184 ******* 2025-11-24 08:49:19.098870 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-24 08:49:19.099037 | controller | 2025-11-24 08:49:19.099071 | controller | TASK [Assert all of the tests] ************************************************* 2025-11-24 08:49:19.136015 | controller | Monday 24 November 2025 08:49:19 +0000 (0:00:00.475) 0:07:12.660 ******* 2025-11-24 08:49:19.136064 | controller | ok: [instance] 2025-11-24 08:49:19.136090 | controller | 2025-11-24 08:49:19.136351 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-11-24 08:49:19.331878 | controller | Monday 24 November 2025 08:49:19 +0000 (0:00:00.037) 0:07:12.697 ******* 2025-11-24 08:49:19.331913 | controller | changed: [instance] 2025-11-24 08:49:19.550974 | controller | 2025-11-24 08:49:19.551008 | controller | TASK [Get journalctl in a file] ************************************************ 2025-11-24 08:49:19.551016 | controller | Monday 24 November 2025 08:49:19 +0000 (0:00:00.195) 0:07:12.892 ******* 2025-11-24 08:49:19.551026 | controller | changed: [instance] 2025-11-24 08:49:19.939961 | controller | 2025-11-24 08:49:19.939996 | controller | TASK [Dump journalctl output] ************************************************** 2025-11-24 08:49:19.940004 | controller | Monday 24 November 2025 08:49:19 +0000 (0:00:00.219) 0:07:13.111 ******* 2025-11-24 08:49:19.940015 | controller | changed: [instance] 2025-11-24 08:49:20.429687 | controller | 2025-11-24 08:49:20.429717 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-11-24 08:49:20.429726 | controller | Monday 24 November 2025 08:49:19 +0000 (0:00:00.388) 0:07:13.500 ******* 2025-11-24 08:49:20.429736 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-11-24 08:49:20.629424 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-11-24 08:49:20.629456 | controller | 2025-11-24 08:49:20.629469 | controller | TASK [Create log directory] **************************************************** 2025-11-24 08:49:20.629476 | controller | Monday 24 November 2025 08:49:20 +0000 (0:00:00.489) 0:07:13.990 ******* 2025-11-24 08:49:20.629486 | controller | changed: [instance] 2025-11-24 08:49:20.629737 | controller | 2025-11-24 08:49:20.629879 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-11-24 08:49:20.629892 | controller | Monday 24 November 2025 08:49:20 +0000 (0:00:00.200) 0:07:14.190 ******* 2025-11-24 08:49:21.505949 | controller | changed: [instance] 2025-11-24 08:49:21.506653 | controller | 2025-11-24 08:49:21.506689 | controller | PLAY RECAP ********************************************************************* 2025-11-24 08:49:21.506764 | controller | instance : ok=540 changed=203 unreachable=0 failed=0 skipped=226 rescued=0 ignored=0 2025-11-24 08:49:21.506775 | controller | 2025-11-24 08:49:21.506781 | controller | Monday 24 November 2025 08:49:21 +0000 (0:00:00.874) 0:07:15.065 ******* 2025-11-24 08:49:21.506787 | controller | =============================================================================== 2025-11-24 08:49:21.506798 | controller | reproducer : Check package install status ------------------------------ 61.09s 2025-11-24 08:49:21.506804 | controller | ci_setup : Install needed packages ------------------------------------- 30.21s 2025-11-24 08:49:21.506812 | controller | libvirt_manager : Download base image ---------------------------------- 21.15s 2025-11-24 08:49:21.506857 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.81s 2025-11-24 08:49:21.506940 | controller | reproducer : Install collections on controller-0 ----------------------- 19.40s 2025-11-24 08:49:21.507033 | controller | libvirt_manager : Install packages required for using KVM -------------- 16.20s 2025-11-24 08:49:21.507123 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.22s 2025-11-24 08:49:21.507249 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.71s 2025-11-24 08:49:21.507329 | controller | ci_nmstate : Install required packages on localhost --------------------- 7.67s 2025-11-24 08:49:21.507421 | controller | reproducer : Ensure we have all dependencies installed ------------------ 5.94s 2025-11-24 08:49:21.507536 | controller | ci_setup : Install openshift client ------------------------------------- 5.88s 2025-11-24 08:49:21.507614 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 4.62s 2025-11-24 08:49:21.507715 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.73s 2025-11-24 08:49:21.507822 | controller | networking_mapper : Gather the facts ------------------------------------ 3.38s 2025-11-24 08:49:21.507917 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.27s 2025-11-24 08:49:21.508017 | controller | sushy_emulator : Install required packages ------------------------------ 2.56s 2025-11-24 08:49:21.508124 | controller | ci_setup : Manage directories ------------------------------------------- 2.46s 2025-11-24 08:49:21.508198 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.34s 2025-11-24 08:49:21.508305 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.24s 2025-11-24 08:49:21.508401 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.07s 2025-11-24 08:49:21.637742 | controller | INFO Running crc_layout > cleanup 2025-11-24 08:49:21.638200 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-24 08:49:21.645713 | controller | INFO Running job_uri > prepare 2025-11-24 08:49:21.646128 | controller | WARNING Skipping, prepare playbook not configured. 2025-11-24 08:49:21.654136 | controller | INFO Running job_uri > converge 2025-11-24 08:49:22.092247 | controller | 2025-11-24 08:49:22.092392 | controller | PLAY [Prepare] ***************************************************************** 2025-11-24 08:49:22.092444 | controller | 2025-11-24 08:49:22.092550 | controller | TASK [Call task file in loop] ************************************************** 2025-11-24 08:49:22.092657 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.033) 0:00:00.033 ******* 2025-11-24 08:49:22.164792 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) 2025-11-24 08:49:22.164912 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-11-24 08:49:22.165048 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-11-24 08:49:22.165194 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) 2025-11-24 08:49:22.165330 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-11-24 08:49:22.165430 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-11-24 08:49:22.165536 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) 2025-11-24 08:49:22.165653 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) 2025-11-24 08:49:22.165770 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) 2025-11-24 08:49:22.165882 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) 2025-11-24 08:49:22.165976 | controller | 2025-11-24 08:49:22.166086 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** 2025-11-24 08:49:22.166219 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.072) 0:00:00.106 ******* 2025-11-24 08:49:22.206756 | controller | 2025-11-24 08:49:22.206816 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-24 08:49:22.206943 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.042) 0:00:00.148 ******* 2025-11-24 08:49:22.241887 | controller | ok: [instance] 2025-11-24 08:49:22.241962 | controller | 2025-11-24 08:49:22.242066 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-24 08:49:22.242198 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.035) 0:00:00.183 ******* 2025-11-24 08:49:22.280045 | controller | ok: [instance] 2025-11-24 08:49:22.280181 | controller | 2025-11-24 08:49:22.280312 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-24 08:49:22.280433 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.038) 0:00:00.221 ******* 2025-11-24 08:49:22.325867 | controller | ok: [instance] 2025-11-24 08:49:22.325956 | controller | 2025-11-24 08:49:22.326078 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-24 08:49:22.326225 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.045) 0:00:00.267 ******* 2025-11-24 08:49:22.350657 | controller | skipping: [instance] 2025-11-24 08:49:22.350752 | controller | 2025-11-24 08:49:22.350863 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-24 08:49:22.350964 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.024) 0:00:00.292 ******* 2025-11-24 08:49:22.402582 | controller | ok: [instance] => changed=false 2025-11-24 08:49:22.402676 | controller | msg: All assertions passed 2025-11-24 08:49:22.402771 | controller | 2025-11-24 08:49:22.402895 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-11-24 08:49:22.402988 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.051) 0:00:00.344 ******* 2025-11-24 08:49:22.438820 | controller | 2025-11-24 08:49:22.438892 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-24 08:49:22.439016 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.036) 0:00:00.380 ******* 2025-11-24 08:49:22.472155 | controller | ok: [instance] 2025-11-24 08:49:22.472249 | controller | 2025-11-24 08:49:22.472354 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-24 08:49:22.472463 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.033) 0:00:00.414 ******* 2025-11-24 08:49:22.510569 | controller | ok: [instance] 2025-11-24 08:49:22.510658 | controller | 2025-11-24 08:49:22.510766 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-24 08:49:22.510864 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.038) 0:00:00.452 ******* 2025-11-24 08:49:22.543828 | controller | ok: [instance] 2025-11-24 08:49:22.543919 | controller | 2025-11-24 08:49:22.544055 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-24 08:49:22.544153 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.033) 0:00:00.485 ******* 2025-11-24 08:49:22.574552 | controller | skipping: [instance] 2025-11-24 08:49:22.574618 | controller | 2025-11-24 08:49:22.574755 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-24 08:49:22.574843 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.030) 0:00:00.516 ******* 2025-11-24 08:49:22.609945 | controller | ok: [instance] => changed=false 2025-11-24 08:49:22.610034 | controller | msg: All assertions passed 2025-11-24 08:49:22.610146 | controller | 2025-11-24 08:49:22.610281 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-11-24 08:49:22.610391 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.035) 0:00:00.552 ******* 2025-11-24 08:49:22.646946 | controller | 2025-11-24 08:49:22.647041 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-24 08:49:22.647157 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.036) 0:00:00.588 ******* 2025-11-24 08:49:22.680942 | controller | ok: [instance] 2025-11-24 08:49:22.681021 | controller | 2025-11-24 08:49:22.681142 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-24 08:49:22.681273 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.034) 0:00:00.622 ******* 2025-11-24 08:49:22.716933 | controller | ok: [instance] 2025-11-24 08:49:22.717023 | controller | 2025-11-24 08:49:22.717151 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-24 08:49:22.717277 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.036) 0:00:00.659 ******* 2025-11-24 08:49:22.750428 | controller | ok: [instance] 2025-11-24 08:49:22.750512 | controller | 2025-11-24 08:49:22.750613 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-24 08:49:22.750749 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.033) 0:00:00.692 ******* 2025-11-24 08:49:22.774301 | controller | skipping: [instance] 2025-11-24 08:49:22.774404 | controller | 2025-11-24 08:49:22.774527 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-24 08:49:22.774629 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.023) 0:00:00.716 ******* 2025-11-24 08:49:22.808827 | controller | ok: [instance] => changed=false 2025-11-24 08:49:22.808946 | controller | msg: All assertions passed 2025-11-24 08:49:22.809054 | controller | 2025-11-24 08:49:22.809217 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** 2025-11-24 08:49:22.809321 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.034) 0:00:00.750 ******* 2025-11-24 08:49:22.844457 | controller | 2025-11-24 08:49:22.844560 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-24 08:49:22.844662 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.035) 0:00:00.786 ******* 2025-11-24 08:49:22.878862 | controller | ok: [instance] 2025-11-24 08:49:22.878976 | controller | 2025-11-24 08:49:22.879098 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-24 08:49:22.879260 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.034) 0:00:00.820 ******* 2025-11-24 08:49:22.917487 | controller | ok: [instance] 2025-11-24 08:49:22.917582 | controller | 2025-11-24 08:49:22.917702 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-24 08:49:22.917848 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.038) 0:00:00.859 ******* 2025-11-24 08:49:22.953486 | controller | ok: [instance] 2025-11-24 08:49:22.953600 | controller | 2025-11-24 08:49:22.953766 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-24 08:49:22.953926 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.035) 0:00:00.895 ******* 2025-11-24 08:49:22.982031 | controller | skipping: [instance] 2025-11-24 08:49:22.982147 | controller | 2025-11-24 08:49:22.982305 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-24 08:49:22.982429 | controller | Monday 24 November 2025 08:49:22 +0000 (0:00:00.028) 0:00:00.924 ******* 2025-11-24 08:49:23.018155 | controller | ok: [instance] => changed=false 2025-11-24 08:49:23.018543 | controller | msg: All assertions passed 2025-11-24 08:49:23.018863 | controller | 2025-11-24 08:49:23.018883 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-11-24 08:49:23.018895 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.036) 0:00:00.960 ******* 2025-11-24 08:49:23.075018 | controller | 2025-11-24 08:49:23.075117 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-24 08:49:23.075247 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.056) 0:00:01.017 ******* 2025-11-24 08:49:23.108007 | controller | ok: [instance] 2025-11-24 08:49:23.108136 | controller | 2025-11-24 08:49:23.108283 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-24 08:49:23.108413 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.032) 0:00:01.050 ******* 2025-11-24 08:49:23.134063 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:23.134179 | controller | assertion: _matched_url | default('') | length > 0 2025-11-24 08:49:23.134297 | controller | evaluated_to: false 2025-11-24 08:49:23.134411 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-24 08:49:23.160571 | controller | 2025-11-24 08:49:23.160696 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-24 08:49:23.160812 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.035) 0:00:01.085 ******* 2025-11-24 08:49:23.160904 | controller | 2025-11-24 08:49:23.161002 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-24 08:49:23.161092 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.016) 0:00:01.102 ******* 2025-11-24 08:49:23.193789 | controller | skipping: [instance] 2025-11-24 08:49:23.193821 | controller | 2025-11-24 08:49:23.193831 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-24 08:49:23.193842 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.032) 0:00:01.134 ******* 2025-11-24 08:49:23.226038 | controller | skipping: [instance] 2025-11-24 08:49:23.226140 | controller | 2025-11-24 08:49:23.226277 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-11-24 08:49:23.226396 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.168 ******* 2025-11-24 08:49:23.262330 | controller | 2025-11-24 08:49:23.262429 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-24 08:49:23.262538 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.036) 0:00:01.204 ******* 2025-11-24 08:49:23.295991 | controller | ok: [instance] 2025-11-24 08:49:23.296080 | controller | 2025-11-24 08:49:23.296216 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-24 08:49:23.296323 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.238 ******* 2025-11-24 08:49:23.324789 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:23.324882 | controller | assertion: _matched_url | default('') | length > 0 2025-11-24 08:49:23.324977 | controller | evaluated_to: false 2025-11-24 08:49:23.325140 | controller | msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-24 08:49:23.352281 | controller | 2025-11-24 08:49:23.352379 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-24 08:49:23.352483 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.040) 0:00:01.278 ******* 2025-11-24 08:49:23.352573 | controller | 2025-11-24 08:49:23.352666 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-24 08:49:23.352779 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.016) 0:00:01.294 ******* 2025-11-24 08:49:23.385583 | controller | skipping: [instance] 2025-11-24 08:49:23.385686 | controller | 2025-11-24 08:49:23.385866 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-24 08:49:23.385969 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.327 ******* 2025-11-24 08:49:23.418995 | controller | skipping: [instance] 2025-11-24 08:49:23.419129 | controller | 2025-11-24 08:49:23.419293 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** 2025-11-24 08:49:23.419374 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.361 ******* 2025-11-24 08:49:23.461091 | controller | 2025-11-24 08:49:23.461503 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-24 08:49:23.461618 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.042) 0:00:01.403 ******* 2025-11-24 08:49:23.497728 | controller | ok: [instance] 2025-11-24 08:49:23.497872 | controller | 2025-11-24 08:49:23.498132 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-24 08:49:23.535356 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.036) 0:00:01.439 ******* 2025-11-24 08:49:23.535385 | controller | ok: [instance] 2025-11-24 08:49:23.535475 | controller | 2025-11-24 08:49:23.535598 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-24 08:49:23.535700 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.037) 0:00:01.477 ******* 2025-11-24 08:49:23.571092 | controller | ok: [instance] 2025-11-24 08:49:23.571206 | controller | 2025-11-24 08:49:23.571316 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-24 08:49:23.571417 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.035) 0:00:01.512 ******* 2025-11-24 08:49:23.597295 | controller | skipping: [instance] 2025-11-24 08:49:23.597387 | controller | 2025-11-24 08:49:23.597489 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-24 08:49:23.597618 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.026) 0:00:01.539 ******* 2025-11-24 08:49:23.634772 | controller | ok: [instance] => changed=false 2025-11-24 08:49:23.634806 | controller | msg: All assertions passed 2025-11-24 08:49:23.634893 | controller | 2025-11-24 08:49:23.634997 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** 2025-11-24 08:49:23.635091 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.037) 0:00:01.576 ******* 2025-11-24 08:49:23.695029 | controller | 2025-11-24 08:49:23.695125 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-24 08:49:23.695273 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.060) 0:00:01.637 ******* 2025-11-24 08:49:23.728512 | controller | ok: [instance] 2025-11-24 08:49:23.728606 | controller | 2025-11-24 08:49:23.728741 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-24 08:49:23.728865 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.670 ******* 2025-11-24 08:49:23.765287 | controller | ok: [instance] 2025-11-24 08:49:23.765355 | controller | 2025-11-24 08:49:23.765458 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-24 08:49:23.765581 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.036) 0:00:01.707 ******* 2025-11-24 08:49:23.802781 | controller | ok: [instance] 2025-11-24 08:49:23.802882 | controller | 2025-11-24 08:49:23.803002 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-24 08:49:23.803132 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.037) 0:00:01.744 ******* 2025-11-24 08:49:23.829013 | controller | skipping: [instance] 2025-11-24 08:49:23.829099 | controller | 2025-11-24 08:49:23.829242 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-24 08:49:23.829340 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.026) 0:00:01.771 ******* 2025-11-24 08:49:23.863587 | controller | ok: [instance] => changed=false 2025-11-24 08:49:23.863702 | controller | msg: All assertions passed 2025-11-24 08:49:23.863821 | controller | 2025-11-24 08:49:23.863963 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** 2025-11-24 08:49:23.864084 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.034) 0:00:01.805 ******* 2025-11-24 08:49:23.900208 | controller | 2025-11-24 08:49:23.900299 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-24 08:49:23.900396 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.036) 0:00:01.842 ******* 2025-11-24 08:49:23.933652 | controller | ok: [instance] 2025-11-24 08:49:23.933782 | controller | 2025-11-24 08:49:23.933887 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-24 08:49:23.933973 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.033) 0:00:01.875 ******* 2025-11-24 08:49:23.961550 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:23.961654 | controller | assertion: _matched_url | default('') | length > 0 2025-11-24 08:49:23.961772 | controller | evaluated_to: false 2025-11-24 08:49:23.961896 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-24 08:49:23.988707 | controller | 2025-11-24 08:49:23.988849 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-24 08:49:23.988961 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.038) 0:00:01.914 ******* 2025-11-24 08:49:23.989047 | controller | 2025-11-24 08:49:23.989172 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-24 08:49:23.989291 | controller | Monday 24 November 2025 08:49:23 +0000 (0:00:00.016) 0:00:01.930 ******* 2025-11-24 08:49:24.022380 | controller | skipping: [instance] 2025-11-24 08:49:24.022472 | controller | 2025-11-24 08:49:24.022573 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-24 08:49:24.022686 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.033) 0:00:01.964 ******* 2025-11-24 08:49:24.056132 | controller | skipping: [instance] 2025-11-24 08:49:24.056283 | controller | 2025-11-24 08:49:24.056386 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** 2025-11-24 08:49:24.056484 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.033) 0:00:01.998 ******* 2025-11-24 08:49:24.091556 | controller | 2025-11-24 08:49:24.091694 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-24 08:49:24.091824 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.035) 0:00:02.033 ******* 2025-11-24 08:49:24.123912 | controller | ok: [instance] 2025-11-24 08:49:24.124007 | controller | 2025-11-24 08:49:24.124132 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-24 08:49:24.124264 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.032) 0:00:02.065 ******* 2025-11-24 08:49:24.149657 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:24.149850 | controller | assertion: _matched_url | default('') | length > 0 2025-11-24 08:49:24.149868 | controller | evaluated_to: false 2025-11-24 08:49:24.150003 | controller | msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-24 08:49:24.176091 | controller | 2025-11-24 08:49:24.176246 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-24 08:49:24.176384 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.035) 0:00:02.101 ******* 2025-11-24 08:49:24.176494 | controller | 2025-11-24 08:49:24.176615 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-24 08:49:24.176717 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.016) 0:00:02.118 ******* 2025-11-24 08:49:24.209421 | controller | skipping: [instance] 2025-11-24 08:49:24.209544 | controller | 2025-11-24 08:49:24.209691 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-24 08:49:24.209789 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.033) 0:00:02.151 ******* 2025-11-24 08:49:24.243301 | controller | skipping: [instance] 2025-11-24 08:49:24.243384 | controller | 2025-11-24 08:49:24.243498 | controller | TASK [Print success message] *************************************************** 2025-11-24 08:49:24.243598 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.033) 0:00:02.185 ******* 2025-11-24 08:49:24.316756 | controller | ok: [instance] => 2025-11-24 08:49:24.316809 | controller | msg: All strings passed! 2025-11-24 08:49:24.316952 | controller | 2025-11-24 08:49:24.316992 | controller | PLAY RECAP ********************************************************************* 2025-11-24 08:49:24.317130 | controller | instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 2025-11-24 08:49:24.317241 | controller | 2025-11-24 08:49:24.317345 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.073) 0:00:02.258 ******* 2025-11-24 08:49:24.317433 | controller | =============================================================================== 2025-11-24 08:49:24.317584 | controller | Print success message --------------------------------------------------- 0.07s 2025-11-24 08:49:24.317693 | controller | Call task file in loop -------------------------------------------------- 0.07s 2025-11-24 08:49:24.317733 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.06s 2025-11-24 08:49:24.317836 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.06s 2025-11-24 08:49:24.317928 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.05s 2025-11-24 08:49:24.318219 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2025-11-24 08:49:24.318253 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log --- 0.04s 2025-11-24 08:49:24.318262 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything///// --- 0.04s 2025-11-24 08:49:24.318353 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-24 08:49:24.318445 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-24 08:49:24.318546 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-24 08:49:24.318729 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-24 08:49:24.318814 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-24 08:49:24.318821 | controller | reproducer : Extract job id for later reference ------------------------- 0.04s 2025-11-24 08:49:24.318908 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-24 08:49:24.319000 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.04s 2025-11-24 08:49:24.319120 | controller | Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7 --- 0.04s 2025-11-24 08:49:24.319248 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 --- 0.04s 2025-11-24 08:49:24.319373 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-24 08:49:24.319455 | controller | reproducer : Apply regex match filter ----------------------------------- 0.04s 2025-11-24 08:49:24.371567 | controller | INFO Running job_uri > cleanup 2025-11-24 08:49:24.371942 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-24 08:49:24.379443 | controller | INFO Running network_validations > prepare 2025-11-24 08:49:24.379827 | controller | WARNING Skipping, prepare playbook not configured. 2025-11-24 08:49:24.388872 | controller | INFO Running network_validations > converge 2025-11-24 08:49:24.835142 | controller | 2025-11-24 08:49:24.835274 | controller | PLAY [Prepare] ***************************************************************** 2025-11-24 08:49:24.835375 | controller | 2025-11-24 08:49:24.835471 | controller | TASK [Set failed fact] ********************************************************* 2025-11-24 08:49:24.835574 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.033) 0:00:00.033 ******* 2025-11-24 08:49:24.855881 | controller | ok: [instance] 2025-11-24 08:49:24.855958 | controller | 2025-11-24 08:49:24.856121 | controller | TASK [Load scenarios] ********************************************************** 2025-11-24 08:49:24.856201 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.021) 0:00:00.054 ******* 2025-11-24 08:49:24.878766 | controller | ok: [instance] 2025-11-24 08:49:24.878841 | controller | 2025-11-24 08:49:24.878945 | controller | TASK [Test network validations] ************************************************ 2025-11-24 08:49:24.879045 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.022) 0:00:00.077 ******* 2025-11-24 08:49:24.938530 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) 2025-11-24 08:49:24.958875 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) 2025-11-24 08:49:24.958909 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) 2025-11-24 08:49:24.958919 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) 2025-11-24 08:49:24.958927 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) 2025-11-24 08:49:24.958933 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) 2025-11-24 08:49:24.958946 | controller | 2025-11-24 08:49:24.958954 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:24.958961 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.058) 0:00:00.136 ******* 2025-11-24 08:49:24.958972 | controller | ok: [instance] 2025-11-24 08:49:24.984429 | controller | 2025-11-24 08:49:24.984470 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:24.984480 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.021) 0:00:00.157 ******* 2025-11-24 08:49:24.984494 | controller | ok: [instance] 2025-11-24 08:49:24.984582 | controller | 2025-11-24 08:49:24.984596 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:24.984711 | controller | Monday 24 November 2025 08:49:24 +0000 (0:00:00.025) 0:00:00.183 ******* 2025-11-24 08:49:25.008130 | controller | ok: [instance] => 2025-11-24 08:49:25.008256 | controller | msg: 'Running: Default nets only' 2025-11-24 08:49:25.008353 | controller | 2025-11-24 08:49:25.008449 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:25.008549 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.023) 0:00:00.207 ******* 2025-11-24 08:49:25.049285 | controller | 2025-11-24 08:49:25.049384 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-24 08:49:25.049484 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.041) 0:00:00.248 ******* 2025-11-24 08:49:25.073184 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-24 08:49:25.073301 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-24 08:49:25.073356 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-24 08:49:25.073471 | controller | collisions and unexpected behavior. 2025-11-24 08:49:25.126193 | controller | ok: [instance] => (item=controller) 2025-11-24 08:49:25.126235 | controller | 2025-11-24 08:49:25.126373 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-24 08:49:25.126472 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.076) 0:00:00.325 ******* 2025-11-24 08:49:25.179789 | controller | ok: [instance] 2025-11-24 08:49:25.179883 | controller | 2025-11-24 08:49:25.179987 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-24 08:49:25.180161 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.053) 0:00:00.378 ******* 2025-11-24 08:49:25.242800 | controller | ok: [instance] => changed=false 2025-11-24 08:49:25.242842 | controller | msg: All assertions passed 2025-11-24 08:49:25.242959 | controller | 2025-11-24 08:49:25.243065 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:25.243174 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.063) 0:00:00.441 ******* 2025-11-24 08:49:25.279469 | controller | skipping: [instance] 2025-11-24 08:49:25.279557 | controller | 2025-11-24 08:49:25.279710 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:25.279777 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.036) 0:00:00.478 ******* 2025-11-24 08:49:25.310284 | controller | skipping: [instance] 2025-11-24 08:49:25.310368 | controller | 2025-11-24 08:49:25.310469 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:25.310584 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.030) 0:00:00.509 ******* 2025-11-24 08:49:25.343879 | controller | skipping: [instance] 2025-11-24 08:49:25.343969 | controller | 2025-11-24 08:49:25.344076 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:25.344197 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.033) 0:00:00.542 ******* 2025-11-24 08:49:25.365707 | controller | ok: [instance] 2025-11-24 08:49:25.365732 | controller | 2025-11-24 08:49:25.365831 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:25.365936 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.021) 0:00:00.564 ******* 2025-11-24 08:49:25.391363 | controller | ok: [instance] 2025-11-24 08:49:25.391449 | controller | 2025-11-24 08:49:25.392015 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:25.418470 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.025) 0:00:00.590 ******* 2025-11-24 08:49:25.418498 | controller | ok: [instance] => 2025-11-24 08:49:25.418570 | controller | msg: 'Running: Default nets and spine/leaf' 2025-11-24 08:49:25.418671 | controller | 2025-11-24 08:49:25.418765 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:25.418870 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.026) 0:00:00.617 ******* 2025-11-24 08:49:25.457066 | controller | 2025-11-24 08:49:25.457223 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-24 08:49:25.457347 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.038) 0:00:00.656 ******* 2025-11-24 08:49:25.481451 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-24 08:49:25.481572 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-24 08:49:25.481686 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-24 08:49:25.481868 | controller | collisions and unexpected behavior. 2025-11-24 08:49:25.503047 | controller | ok: [instance] => (item=controller) 2025-11-24 08:49:25.503163 | controller | 2025-11-24 08:49:25.503280 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-24 08:49:25.503378 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.045) 0:00:00.702 ******* 2025-11-24 08:49:25.557640 | controller | ok: [instance] 2025-11-24 08:49:25.557726 | controller | 2025-11-24 08:49:25.557849 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-24 08:49:25.557948 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.054) 0:00:00.756 ******* 2025-11-24 08:49:25.621675 | controller | ok: [instance] => changed=false 2025-11-24 08:49:25.621782 | controller | msg: All assertions passed 2025-11-24 08:49:25.621870 | controller | 2025-11-24 08:49:25.621968 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:25.622054 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.063) 0:00:00.820 ******* 2025-11-24 08:49:25.657420 | controller | skipping: [instance] 2025-11-24 08:49:25.657506 | controller | 2025-11-24 08:49:25.657636 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:25.657709 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.035) 0:00:00.856 ******* 2025-11-24 08:49:25.689235 | controller | skipping: [instance] 2025-11-24 08:49:25.689332 | controller | 2025-11-24 08:49:25.689428 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:25.689524 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.032) 0:00:00.888 ******* 2025-11-24 08:49:25.720690 | controller | skipping: [instance] 2025-11-24 08:49:25.720780 | controller | 2025-11-24 08:49:25.720884 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:25.720985 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.031) 0:00:00.919 ******* 2025-11-24 08:49:25.741519 | controller | ok: [instance] 2025-11-24 08:49:25.741620 | controller | 2025-11-24 08:49:25.741727 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:25.741825 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.020) 0:00:00.940 ******* 2025-11-24 08:49:25.767288 | controller | ok: [instance] 2025-11-24 08:49:25.767386 | controller | 2025-11-24 08:49:25.767477 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:25.767620 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.025) 0:00:00.966 ******* 2025-11-24 08:49:25.791853 | controller | ok: [instance] => 2025-11-24 08:49:25.791972 | controller | msg: 'Running: Default nets with extra defined net' 2025-11-24 08:49:25.792046 | controller | 2025-11-24 08:49:25.792218 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:25.792261 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.024) 0:00:00.990 ******* 2025-11-24 08:49:25.833051 | controller | 2025-11-24 08:49:25.833203 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-24 08:49:25.833325 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.041) 0:00:01.032 ******* 2025-11-24 08:49:25.857249 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-24 08:49:25.857374 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-24 08:49:25.857497 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-24 08:49:25.857943 | controller | collisions and unexpected behavior. 2025-11-24 08:49:25.899298 | controller | ok: [instance] => (item=controller) 2025-11-24 08:49:25.899380 | controller | 2025-11-24 08:49:25.899478 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-24 08:49:25.899587 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.066) 0:00:01.098 ******* 2025-11-24 08:49:25.954772 | controller | ok: [instance] 2025-11-24 08:49:25.954858 | controller | 2025-11-24 08:49:25.954966 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-24 08:49:25.955071 | controller | Monday 24 November 2025 08:49:25 +0000 (0:00:00.055) 0:00:01.153 ******* 2025-11-24 08:49:25.998666 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:25.998691 | controller | assertion: _defined | difference(_all_nets) | length == 0 2025-11-24 08:49:25.998860 | controller | evaluated_to: false 2025-11-24 08:49:25.998913 | controller | msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' 2025-11-24 08:49:26.009818 | controller | 2025-11-24 08:49:26.009907 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-24 08:49:26.010005 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.055) 0:00:01.208 ******* 2025-11-24 08:49:26.041687 | controller | ok: [instance] => 2025-11-24 08:49:26.041787 | controller | cifmw_libvirt_manager_configuration: 2025-11-24 08:49:26.042122 | controller | networks: 2025-11-24 08:49:26.042209 | controller | public: defined 2025-11-24 08:49:26.042219 | controller | vms: 2025-11-24 08:49:26.042229 | controller | controller: 2025-11-24 08:49:26.042297 | controller | nets: 2025-11-24 08:49:26.042466 | controller | - public 2025-11-24 08:49:26.042482 | controller | 2025-11-24 08:49:26.042622 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-24 08:49:26.042678 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.031) 0:00:01.240 ******* 2025-11-24 08:49:26.071936 | controller | skipping: [instance] 2025-11-24 08:49:26.072053 | controller | 2025-11-24 08:49:26.072201 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-24 08:49:26.072311 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.030) 0:00:01.270 ******* 2025-11-24 08:49:26.139881 | controller | skipping: [instance] 2025-11-24 08:49:26.139959 | controller | 2025-11-24 08:49:26.140078 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-24 08:49:26.140207 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.068) 0:00:01.338 ******* 2025-11-24 08:49:26.177252 | controller | ok: [instance] => 2025-11-24 08:49:26.177310 | controller | _cifmw_libvirt_manager_layout: 2025-11-24 08:49:26.177419 | controller | networks: 2025-11-24 08:49:26.177514 | controller | extra_net_1: defined 2025-11-24 08:49:26.177630 | controller | public: defined 2025-11-24 08:49:26.177737 | controller | vms: 2025-11-24 08:49:26.177811 | controller | controller: 2025-11-24 08:49:26.177900 | controller | nets: 2025-11-24 08:49:26.177989 | controller | - public 2025-11-24 08:49:26.178090 | controller | 2025-11-24 08:49:26.178214 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-24 08:49:26.178298 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.037) 0:00:01.376 ******* 2025-11-24 08:49:26.188731 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:26.188823 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-24 08:49:26.216352 | controller | 2025-11-24 08:49:26.216456 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:26.216636 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.022) 0:00:01.398 ******* 2025-11-24 08:49:26.216682 | controller | 2025-11-24 08:49:26.216799 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:26.216934 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.016) 0:00:01.415 ******* 2025-11-24 08:49:26.238886 | controller | ok: [instance] 2025-11-24 08:49:26.238970 | controller | 2025-11-24 08:49:26.239099 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:26.239216 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.022) 0:00:01.437 ******* 2025-11-24 08:49:26.275190 | controller | skipping: [instance] 2025-11-24 08:49:26.275286 | controller | 2025-11-24 08:49:26.275389 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:26.275499 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.036) 0:00:01.474 ******* 2025-11-24 08:49:26.305793 | controller | skipping: [instance] 2025-11-24 08:49:26.305876 | controller | 2025-11-24 08:49:26.305969 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:26.306088 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.030) 0:00:01.504 ******* 2025-11-24 08:49:26.335746 | controller | skipping: [instance] 2025-11-24 08:49:26.335828 | controller | 2025-11-24 08:49:26.335934 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:26.336042 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.029) 0:00:01.534 ******* 2025-11-24 08:49:26.355963 | controller | ok: [instance] 2025-11-24 08:49:26.356060 | controller | 2025-11-24 08:49:26.356172 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:26.356393 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.020) 0:00:01.555 ******* 2025-11-24 08:49:26.378486 | controller | ok: [instance] 2025-11-24 08:49:26.378598 | controller | 2025-11-24 08:49:26.378718 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:26.378827 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.022) 0:00:01.577 ******* 2025-11-24 08:49:26.405476 | controller | ok: [instance] => 2025-11-24 08:49:26.405605 | controller | msg: 'Running: Missing default net definition' 2025-11-24 08:49:26.405695 | controller | 2025-11-24 08:49:26.405712 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:26.405802 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.026) 0:00:01.604 ******* 2025-11-24 08:49:26.448245 | controller | 2025-11-24 08:49:26.448350 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-24 08:49:26.448459 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.042) 0:00:01.647 ******* 2025-11-24 08:49:26.471444 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-24 08:49:26.471531 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-24 08:49:26.471618 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-24 08:49:26.471963 | controller | collisions and unexpected behavior. 2025-11-24 08:49:26.491258 | controller | ok: [instance] => (item=controller) 2025-11-24 08:49:26.491362 | controller | 2025-11-24 08:49:26.491481 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-24 08:49:26.491616 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.042) 0:00:01.690 ******* 2025-11-24 08:49:26.534852 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:26.534965 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-11-24 08:49:26.535081 | controller | evaluated_to: false 2025-11-24 08:49:26.535231 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' 2025-11-24 08:49:26.545970 | controller | 2025-11-24 08:49:26.546102 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-24 08:49:26.546261 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.054) 0:00:01.745 ******* 2025-11-24 08:49:26.576312 | controller | ok: [instance] => 2025-11-24 08:49:26.576427 | controller | cifmw_libvirt_manager_configuration: 2025-11-24 08:49:26.576549 | controller | networks: 2025-11-24 08:49:26.576666 | controller | public: defined 2025-11-24 08:49:26.576779 | controller | vms: 2025-11-24 08:49:26.576882 | controller | controller: 2025-11-24 08:49:26.577003 | controller | nets: 2025-11-24 08:49:26.577122 | controller | - public 2025-11-24 08:49:26.577243 | controller | 2025-11-24 08:49:26.577340 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-24 08:49:26.577435 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.030) 0:00:01.775 ******* 2025-11-24 08:49:26.602492 | controller | skipping: [instance] 2025-11-24 08:49:26.696256 | controller | 2025-11-24 08:49:26.696281 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-24 08:49:26.696289 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.025) 0:00:01.801 ******* 2025-11-24 08:49:26.696299 | controller | skipping: [instance] 2025-11-24 08:49:26.696341 | controller | 2025-11-24 08:49:26.696450 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-24 08:49:26.696562 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.093) 0:00:01.895 ******* 2025-11-24 08:49:26.732965 | controller | ok: [instance] => 2025-11-24 08:49:26.733120 | controller | _cifmw_libvirt_manager_layout: 2025-11-24 08:49:26.733227 | controller | networks: 2025-11-24 08:49:26.733349 | controller | public: defined 2025-11-24 08:49:26.733438 | controller | vms: 2025-11-24 08:49:26.733546 | controller | controller: 2025-11-24 08:49:26.733625 | controller | nets: 2025-11-24 08:49:26.733725 | controller | - public 2025-11-24 08:49:26.733799 | controller | - foo 2025-11-24 08:49:26.733890 | controller | 2025-11-24 08:49:26.733994 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-24 08:49:26.734103 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.036) 0:00:01.931 ******* 2025-11-24 08:49:26.772087 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:26.772191 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-24 08:49:26.797161 | controller | 2025-11-24 08:49:26.797261 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:26.797363 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.048) 0:00:01.980 ******* 2025-11-24 08:49:26.797454 | controller | 2025-11-24 08:49:26.797565 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:26.797660 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.015) 0:00:01.996 ******* 2025-11-24 08:49:26.817032 | controller | ok: [instance] 2025-11-24 08:49:26.817308 | controller | 2025-11-24 08:49:26.817408 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:26.817425 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.019) 0:00:02.016 ******* 2025-11-24 08:49:26.852156 | controller | skipping: [instance] 2025-11-24 08:49:26.852260 | controller | 2025-11-24 08:49:26.852358 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:26.852460 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.034) 0:00:02.051 ******* 2025-11-24 08:49:26.882899 | controller | skipping: [instance] 2025-11-24 08:49:26.883026 | controller | 2025-11-24 08:49:26.883124 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:26.883255 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.030) 0:00:02.081 ******* 2025-11-24 08:49:26.913302 | controller | skipping: [instance] 2025-11-24 08:49:26.913390 | controller | 2025-11-24 08:49:26.913501 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:26.913595 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.030) 0:00:02.112 ******* 2025-11-24 08:49:26.935146 | controller | ok: [instance] 2025-11-24 08:49:26.935245 | controller | 2025-11-24 08:49:26.935347 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:26.935447 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.021) 0:00:02.134 ******* 2025-11-24 08:49:26.959994 | controller | ok: [instance] 2025-11-24 08:49:26.960117 | controller | 2025-11-24 08:49:26.960259 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:26.960389 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.024) 0:00:02.158 ******* 2025-11-24 08:49:26.985695 | controller | ok: [instance] => 2025-11-24 08:49:27.023876 | controller | msg: 'Running: Missing spine/leaf net definition' 2025-11-24 08:49:27.023900 | controller | 2025-11-24 08:49:27.023908 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:27.023915 | controller | Monday 24 November 2025 08:49:26 +0000 (0:00:00.024) 0:00:02.183 ******* 2025-11-24 08:49:27.023924 | controller | 2025-11-24 08:49:27.023982 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-24 08:49:27.024095 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.038) 0:00:02.222 ******* 2025-11-24 08:49:27.062508 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-24 08:49:27.067970 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-24 08:49:27.067992 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-24 08:49:27.068000 | controller | collisions and unexpected behavior. 2025-11-24 08:49:27.068010 | controller | ok: [instance] => (item=controller) 2025-11-24 08:49:27.068407 | controller | 2025-11-24 08:49:27.068684 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-24 08:49:27.069704 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.043) 0:00:02.266 ******* 2025-11-24 08:49:27.111830 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:27.111924 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-11-24 08:49:27.112040 | controller | evaluated_to: false 2025-11-24 08:49:27.112161 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' 2025-11-24 08:49:27.123502 | controller | 2025-11-24 08:49:27.123597 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-24 08:49:27.123697 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.055) 0:00:02.322 ******* 2025-11-24 08:49:27.154174 | controller | ok: [instance] => 2025-11-24 08:49:27.154292 | controller | cifmw_libvirt_manager_configuration: 2025-11-24 08:49:27.154419 | controller | networks: 2025-11-24 08:49:27.154561 | controller | l00-s0: defined 2025-11-24 08:49:27.154683 | controller | public: defined 2025-11-24 08:49:27.154798 | controller | vms: 2025-11-24 08:49:27.154909 | controller | controller: 2025-11-24 08:49:27.155032 | controller | nets: 2025-11-24 08:49:27.155190 | controller | - public 2025-11-24 08:49:27.155286 | controller | spineleafnets: 2025-11-24 08:49:27.155371 | controller | - l00-s0 2025-11-24 08:49:27.155467 | controller | 2025-11-24 08:49:27.155566 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-24 08:49:27.155668 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.030) 0:00:02.353 ******* 2025-11-24 08:49:27.180584 | controller | skipping: [instance] 2025-11-24 08:49:27.180674 | controller | 2025-11-24 08:49:27.180796 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-24 08:49:27.180904 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.026) 0:00:02.379 ******* 2025-11-24 08:49:27.247998 | controller | skipping: [instance] 2025-11-24 08:49:27.248094 | controller | 2025-11-24 08:49:27.248227 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-24 08:49:27.248334 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.067) 0:00:02.446 ******* 2025-11-24 08:49:27.286156 | controller | ok: [instance] => 2025-11-24 08:49:27.286302 | controller | _cifmw_libvirt_manager_layout: 2025-11-24 08:49:27.286417 | controller | networks: 2025-11-24 08:49:27.286522 | controller | l00-s0: defined 2025-11-24 08:49:27.286622 | controller | public: defined 2025-11-24 08:49:27.286720 | controller | vms: 2025-11-24 08:49:27.286809 | controller | controller: 2025-11-24 08:49:27.286904 | controller | nets: 2025-11-24 08:49:27.287012 | controller | - public 2025-11-24 08:49:27.287126 | controller | spineleafnets: 2025-11-24 08:49:27.287251 | controller | - l00-s0 2025-11-24 08:49:27.287487 | controller | - l00-s1 2025-11-24 08:49:27.287519 | controller | 2025-11-24 08:49:27.287529 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-24 08:49:27.287628 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.038) 0:00:02.485 ******* 2025-11-24 08:49:27.302561 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:27.302681 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-24 08:49:27.328142 | controller | 2025-11-24 08:49:27.328272 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:27.328391 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.026) 0:00:02.511 ******* 2025-11-24 08:49:27.328503 | controller | 2025-11-24 08:49:27.328607 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:27.328696 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.015) 0:00:02.527 ******* 2025-11-24 08:49:27.349301 | controller | ok: [instance] 2025-11-24 08:49:27.349383 | controller | 2025-11-24 08:49:27.349537 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:27.349587 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.021) 0:00:02.548 ******* 2025-11-24 08:49:27.384900 | controller | skipping: [instance] 2025-11-24 08:49:27.385027 | controller | 2025-11-24 08:49:27.385143 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:27.385299 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.035) 0:00:02.583 ******* 2025-11-24 08:49:27.415526 | controller | skipping: [instance] 2025-11-24 08:49:27.415598 | controller | 2025-11-24 08:49:27.415708 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:27.415812 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.030) 0:00:02.614 ******* 2025-11-24 08:49:27.447364 | controller | skipping: [instance] 2025-11-24 08:49:27.447465 | controller | 2025-11-24 08:49:27.447621 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:27.447719 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.031) 0:00:02.646 ******* 2025-11-24 08:49:27.492778 | controller | ok: [instance] 2025-11-24 08:49:27.492859 | controller | 2025-11-24 08:49:27.492968 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:27.493086 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.045) 0:00:02.691 ******* 2025-11-24 08:49:27.516758 | controller | ok: [instance] 2025-11-24 08:49:27.516838 | controller | 2025-11-24 08:49:27.516954 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:27.517093 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.023) 0:00:02.715 ******* 2025-11-24 08:49:27.541821 | controller | ok: [instance] => 2025-11-24 08:49:27.541976 | controller | msg: 'Running: No network for a VM' 2025-11-24 08:49:27.542011 | controller | 2025-11-24 08:49:27.542121 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:27.542242 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.024) 0:00:02.740 ******* 2025-11-24 08:49:27.580405 | controller | 2025-11-24 08:49:27.580468 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-24 08:49:27.580603 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.038) 0:00:02.779 ******* 2025-11-24 08:49:27.603604 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-24 08:49:27.603631 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-24 08:49:27.603781 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-24 08:49:27.603885 | controller | collisions and unexpected behavior. 2025-11-24 08:49:27.616726 | controller | failed: [instance] (item=foo) => changed=false 2025-11-24 08:49:27.616873 | controller | ansible_loop_var: item 2025-11-24 08:49:27.616950 | controller | assertion: item.value.nets is defined 2025-11-24 08:49:27.617049 | controller | evaluated_to: false 2025-11-24 08:49:27.617156 | controller | item: 2025-11-24 08:49:27.617252 | controller | key: foo 2025-11-24 08:49:27.617558 | controller | value: 2025-11-24 08:49:27.617577 | controller | disksize: 10 2025-11-24 08:49:27.617587 | controller | msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' 2025-11-24 08:49:27.627485 | controller | ok: [instance] => (item=controller) 2025-11-24 08:49:27.627583 | controller | 2025-11-24 08:49:27.627692 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-24 08:49:27.627792 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.047) 0:00:02.826 ******* 2025-11-24 08:49:27.659682 | controller | ok: [instance] => 2025-11-24 08:49:27.659764 | controller | cifmw_libvirt_manager_configuration: 2025-11-24 08:49:27.659867 | controller | networks: 2025-11-24 08:49:27.659984 | controller | public: defined 2025-11-24 08:49:27.660069 | controller | vms: 2025-11-24 08:49:27.660184 | controller | controller: 2025-11-24 08:49:27.660268 | controller | nets: 2025-11-24 08:49:27.660359 | controller | - public 2025-11-24 08:49:27.660455 | controller | 2025-11-24 08:49:27.660564 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-24 08:49:27.660642 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.032) 0:00:02.858 ******* 2025-11-24 08:49:27.685266 | controller | skipping: [instance] 2025-11-24 08:49:27.685389 | controller | 2025-11-24 08:49:27.685508 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-24 08:49:27.685613 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.025) 0:00:02.884 ******* 2025-11-24 08:49:27.752655 | controller | skipping: [instance] 2025-11-24 08:49:27.752750 | controller | 2025-11-24 08:49:27.752869 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-24 08:49:27.752977 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.067) 0:00:02.951 ******* 2025-11-24 08:49:27.790388 | controller | ok: [instance] => 2025-11-24 08:49:27.790479 | controller | _cifmw_libvirt_manager_layout: 2025-11-24 08:49:27.790587 | controller | networks: 2025-11-24 08:49:27.790695 | controller | public: defined 2025-11-24 08:49:27.790784 | controller | vms: 2025-11-24 08:49:27.790878 | controller | controller: 2025-11-24 08:49:27.790966 | controller | nets: 2025-11-24 08:49:27.791056 | controller | - public 2025-11-24 08:49:27.791172 | controller | foo: 2025-11-24 08:49:27.791295 | controller | disksize: 10 2025-11-24 08:49:27.791348 | controller | 2025-11-24 08:49:27.791508 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-24 08:49:27.791553 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.037) 0:00:02.989 ******* 2025-11-24 08:49:27.802599 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:27.802678 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-24 08:49:27.829287 | controller | 2025-11-24 08:49:27.829339 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:27.829446 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.022) 0:00:03.011 ******* 2025-11-24 08:49:27.829551 | controller | 2025-11-24 08:49:27.829630 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:27.829730 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.016) 0:00:03.028 ******* 2025-11-24 08:49:27.850852 | controller | ok: [instance] 2025-11-24 08:49:27.850942 | controller | 2025-11-24 08:49:27.851048 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:27.851172 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.021) 0:00:03.049 ******* 2025-11-24 08:49:27.887633 | controller | skipping: [instance] 2025-11-24 08:49:27.887734 | controller | 2025-11-24 08:49:27.887854 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:27.887996 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.036) 0:00:03.086 ******* 2025-11-24 08:49:27.919824 | controller | skipping: [instance] 2025-11-24 08:49:27.919923 | controller | 2025-11-24 08:49:27.920135 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:27.920251 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.032) 0:00:03.118 ******* 2025-11-24 08:49:27.955341 | controller | skipping: [instance] 2025-11-24 08:49:27.955444 | controller | 2025-11-24 08:49:27.955578 | controller | TASK [Fail if needed] ********************************************************** 2025-11-24 08:49:27.955675 | controller | Monday 24 November 2025 08:49:27 +0000 (0:00:00.035) 0:00:03.154 ******* 2025-11-24 08:49:28.011496 | controller | skipping: [instance] 2025-11-24 08:49:28.011576 | controller | 2025-11-24 08:49:28.011682 | controller | PLAY RECAP ********************************************************************* 2025-11-24 08:49:28.011799 | controller | instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 2025-11-24 08:49:28.011888 | controller | 2025-11-24 08:49:28.011994 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.056) 0:00:03.210 ******* 2025-11-24 08:49:28.012099 | controller | =============================================================================== 2025-11-24 08:49:28.012207 | controller | reproducer : Dump layout patches ---------------------------------------- 0.09s 2025-11-24 08:49:28.012295 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.08s 2025-11-24 08:49:28.012385 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-11-24 08:49:28.012484 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-11-24 08:49:28.012575 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-11-24 08:49:28.012696 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.07s 2025-11-24 08:49:28.012777 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-11-24 08:49:28.012861 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-11-24 08:49:28.012950 | controller | Test network validations ------------------------------------------------ 0.06s 2025-11-24 08:49:28.013040 | controller | Fail if needed ---------------------------------------------------------- 0.06s 2025-11-24 08:49:28.013164 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-11-24 08:49:28.013252 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-11-24 08:49:28.013344 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-11-24 08:49:28.013435 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2025-11-24 08:49:28.013542 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2025-11-24 08:49:28.013627 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2025-11-24 08:49:28.013719 | controller | reproducer : Fail for good ---------------------------------------------- 0.05s 2025-11-24 08:49:28.013810 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s 2025-11-24 08:49:28.013921 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s 2025-11-24 08:49:28.014017 | controller | Mark run as failed ------------------------------------------------------ 0.05s 2025-11-24 08:49:28.076750 | controller | INFO Running network_validations > cleanup 2025-11-24 08:49:28.077205 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-24 08:49:28.084728 | controller | INFO Running ocp_validations > prepare 2025-11-24 08:49:28.085148 | controller | WARNING Skipping, prepare playbook not configured. 2025-11-24 08:49:28.093137 | controller | INFO Running ocp_validations > converge 2025-11-24 08:49:28.524419 | controller | 2025-11-24 08:49:28.524543 | controller | PLAY [Prepare] ***************************************************************** 2025-11-24 08:49:28.524637 | controller | 2025-11-24 08:49:28.524741 | controller | TASK [Set failed fact] ********************************************************* 2025-11-24 08:49:28.524853 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.033) 0:00:00.033 ******* 2025-11-24 08:49:28.545601 | controller | ok: [instance] 2025-11-24 08:49:28.545637 | controller | 2025-11-24 08:49:28.545986 | controller | TASK [Load scenarios] ********************************************************** 2025-11-24 08:49:28.570018 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.021) 0:00:00.055 ******* 2025-11-24 08:49:28.570046 | controller | ok: [instance] 2025-11-24 08:49:28.570127 | controller | 2025-11-24 08:49:28.570246 | controller | TASK [Test no volumes] ********************************************************* 2025-11-24 08:49:28.570358 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.024) 0:00:00.079 ******* 2025-11-24 08:49:28.667122 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) 2025-11-24 08:49:28.667239 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) 2025-11-24 08:49:28.667348 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) 2025-11-24 08:49:28.667466 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) 2025-11-24 08:49:28.667564 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) 2025-11-24 08:49:28.667666 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) 2025-11-24 08:49:28.667774 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) 2025-11-24 08:49:28.667891 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) 2025-11-24 08:49:28.668002 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) 2025-11-24 08:49:28.668120 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) 2025-11-24 08:49:28.668237 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) 2025-11-24 08:49:28.668340 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) 2025-11-24 08:49:28.668438 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) 2025-11-24 08:49:28.668542 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) 2025-11-24 08:49:28.668626 | controller | 2025-11-24 08:49:28.668721 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:28.668819 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.097) 0:00:00.176 ******* 2025-11-24 08:49:28.689902 | controller | ok: [instance] 2025-11-24 08:49:28.689996 | controller | 2025-11-24 08:49:28.690102 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:28.690236 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.022) 0:00:00.199 ******* 2025-11-24 08:49:28.715495 | controller | ok: [instance] 2025-11-24 08:49:28.715563 | controller | 2025-11-24 08:49:28.715685 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:28.715788 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.025) 0:00:00.225 ******* 2025-11-24 08:49:28.743144 | controller | ok: [instance] => 2025-11-24 08:49:28.743281 | controller | msg: 'Running: No volume, no worker' 2025-11-24 08:49:28.743485 | controller | 2025-11-24 08:49:28.743520 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:28.743652 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.027) 0:00:00.252 ******* 2025-11-24 08:49:28.807346 | controller | 2025-11-24 08:49:28.807466 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:28.807568 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.064) 0:00:00.317 ******* 2025-11-24 08:49:28.863693 | controller | ok: [instance] 2025-11-24 08:49:28.863818 | controller | 2025-11-24 08:49:28.863887 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:28.863997 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.056) 0:00:00.373 ******* 2025-11-24 08:49:28.905629 | controller | ok: [instance] 2025-11-24 08:49:28.905718 | controller | 2025-11-24 08:49:28.905838 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:28.905934 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.041) 0:00:00.415 ******* 2025-11-24 08:49:28.973356 | controller | ok: [instance] 2025-11-24 08:49:28.973484 | controller | 2025-11-24 08:49:28.973600 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:28.973708 | controller | Monday 24 November 2025 08:49:28 +0000 (0:00:00.067) 0:00:00.483 ******* 2025-11-24 08:49:29.012265 | controller | skipping: [instance] 2025-11-24 08:49:29.012369 | controller | 2025-11-24 08:49:29.012477 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:29.012565 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.038) 0:00:00.522 ******* 2025-11-24 08:49:29.060732 | controller | ok: [instance] 2025-11-24 08:49:29.060817 | controller | 2025-11-24 08:49:29.060935 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-24 08:49:29.061043 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.048) 0:00:00.570 ******* 2025-11-24 08:49:29.102214 | controller | skipping: [instance] 2025-11-24 08:49:29.102285 | controller | 2025-11-24 08:49:29.102296 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-24 08:49:29.102305 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.040) 0:00:00.611 ******* 2025-11-24 08:49:29.141264 | controller | skipping: [instance] 2025-11-24 08:49:29.141351 | controller | 2025-11-24 08:49:29.141466 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-24 08:49:29.141567 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.039) 0:00:00.650 ******* 2025-11-24 08:49:29.193880 | controller | skipping: [instance] 2025-11-24 08:49:29.193970 | controller | 2025-11-24 08:49:29.194079 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-24 08:49:29.194207 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.052) 0:00:00.703 ******* 2025-11-24 08:49:29.235324 | controller | skipping: [instance] 2025-11-24 08:49:29.235406 | controller | 2025-11-24 08:49:29.235534 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-24 08:49:29.235622 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.041) 0:00:00.745 ******* 2025-11-24 08:49:29.276574 | controller | skipping: [instance] 2025-11-24 08:49:29.276648 | controller | 2025-11-24 08:49:29.276760 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-24 08:49:29.276869 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.041) 0:00:00.786 ******* 2025-11-24 08:49:29.323940 | controller | skipping: [instance] 2025-11-24 08:49:29.324036 | controller | 2025-11-24 08:49:29.324183 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:29.324288 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.047) 0:00:00.833 ******* 2025-11-24 08:49:29.358207 | controller | skipping: [instance] 2025-11-24 08:49:29.358266 | controller | 2025-11-24 08:49:29.358419 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:29.358533 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.034) 0:00:00.868 ******* 2025-11-24 08:49:29.388321 | controller | skipping: [instance] 2025-11-24 08:49:29.388440 | controller | 2025-11-24 08:49:29.388546 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:29.388647 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.030) 0:00:00.898 ******* 2025-11-24 08:49:29.420799 | controller | skipping: [instance] 2025-11-24 08:49:29.420902 | controller | 2025-11-24 08:49:29.421007 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:29.421139 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.032) 0:00:00.930 ******* 2025-11-24 08:49:29.442048 | controller | ok: [instance] 2025-11-24 08:49:29.442150 | controller | 2025-11-24 08:49:29.442256 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:29.442484 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.021) 0:00:00.952 ******* 2025-11-24 08:49:29.468963 | controller | ok: [instance] 2025-11-24 08:49:29.469047 | controller | 2025-11-24 08:49:29.469162 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:29.469269 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.026) 0:00:00.978 ******* 2025-11-24 08:49:29.492457 | controller | ok: [instance] => 2025-11-24 08:49:29.492559 | controller | msg: 'Running: No volume, with worker' 2025-11-24 08:49:29.492656 | controller | 2025-11-24 08:49:29.492754 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:29.492862 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.024) 0:00:01.002 ******* 2025-11-24 08:49:29.538295 | controller | 2025-11-24 08:49:29.538429 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:29.538555 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.045) 0:00:01.048 ******* 2025-11-24 08:49:29.595432 | controller | ok: [instance] 2025-11-24 08:49:29.595527 | controller | 2025-11-24 08:49:29.595641 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:29.595736 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.057) 0:00:01.105 ******* 2025-11-24 08:49:29.636321 | controller | ok: [instance] 2025-11-24 08:49:29.636426 | controller | 2025-11-24 08:49:29.636528 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:29.636635 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.040) 0:00:01.146 ******* 2025-11-24 08:49:29.727463 | controller | ok: [instance] 2025-11-24 08:49:29.727546 | controller | 2025-11-24 08:49:29.727655 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:29.727748 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.091) 0:00:01.237 ******* 2025-11-24 08:49:29.795327 | controller | ok: [instance] 2025-11-24 08:49:29.795439 | controller | 2025-11-24 08:49:29.795578 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:29.795694 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.067) 0:00:01.305 ******* 2025-11-24 08:49:29.845448 | controller | ok: [instance] 2025-11-24 08:49:29.845581 | controller | 2025-11-24 08:49:29.845712 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-24 08:49:29.845837 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.050) 0:00:01.355 ******* 2025-11-24 08:49:29.882939 | controller | skipping: [instance] 2025-11-24 08:49:29.883030 | controller | 2025-11-24 08:49:29.883136 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-24 08:49:29.883256 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.037) 0:00:01.392 ******* 2025-11-24 08:49:29.922474 | controller | skipping: [instance] 2025-11-24 08:49:29.922582 | controller | 2025-11-24 08:49:29.922688 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-24 08:49:29.922800 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.039) 0:00:01.432 ******* 2025-11-24 08:49:29.963922 | controller | skipping: [instance] 2025-11-24 08:49:29.964008 | controller | 2025-11-24 08:49:29.964122 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-24 08:49:29.964233 | controller | Monday 24 November 2025 08:49:29 +0000 (0:00:00.041) 0:00:01.473 ******* 2025-11-24 08:49:30.004974 | controller | skipping: [instance] 2025-11-24 08:49:30.005063 | controller | 2025-11-24 08:49:30.005183 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-24 08:49:30.005291 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.041) 0:00:01.514 ******* 2025-11-24 08:49:30.045040 | controller | skipping: [instance] 2025-11-24 08:49:30.045168 | controller | 2025-11-24 08:49:30.045308 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-24 08:49:30.045443 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.039) 0:00:01.554 ******* 2025-11-24 08:49:30.095298 | controller | skipping: [instance] 2025-11-24 08:49:30.095405 | controller | 2025-11-24 08:49:30.095503 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:30.095604 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.050) 0:00:01.605 ******* 2025-11-24 08:49:30.129864 | controller | skipping: [instance] 2025-11-24 08:49:30.129977 | controller | 2025-11-24 08:49:30.130122 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:30.130260 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.034) 0:00:01.639 ******* 2025-11-24 08:49:30.163650 | controller | skipping: [instance] 2025-11-24 08:49:30.163737 | controller | 2025-11-24 08:49:30.163846 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:30.163954 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.033) 0:00:01.673 ******* 2025-11-24 08:49:30.197101 | controller | skipping: [instance] 2025-11-24 08:49:30.197550 | controller | 2025-11-24 08:49:30.197678 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:30.197795 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.033) 0:00:01.707 ******* 2025-11-24 08:49:30.219787 | controller | ok: [instance] 2025-11-24 08:49:30.219881 | controller | 2025-11-24 08:49:30.219979 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:30.220122 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.022) 0:00:01.729 ******* 2025-11-24 08:49:30.245667 | controller | ok: [instance] 2025-11-24 08:49:30.245754 | controller | 2025-11-24 08:49:30.245866 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:30.245966 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.025) 0:00:01.755 ******* 2025-11-24 08:49:30.271329 | controller | ok: [instance] => 2025-11-24 08:49:30.271438 | controller | msg: 'Running: Volume, no worker' 2025-11-24 08:49:30.271542 | controller | 2025-11-24 08:49:30.271645 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:30.271745 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.025) 0:00:01.781 ******* 2025-11-24 08:49:30.316244 | controller | 2025-11-24 08:49:30.316389 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:30.316446 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.044) 0:00:01.826 ******* 2025-11-24 08:49:30.373925 | controller | ok: [instance] 2025-11-24 08:49:30.374005 | controller | 2025-11-24 08:49:30.374118 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:30.374235 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.057) 0:00:01.883 ******* 2025-11-24 08:49:30.414492 | controller | ok: [instance] 2025-11-24 08:49:30.414577 | controller | 2025-11-24 08:49:30.414679 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:30.414778 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.040) 0:00:01.924 ******* 2025-11-24 08:49:30.484306 | controller | ok: [instance] 2025-11-24 08:49:30.484377 | controller | 2025-11-24 08:49:30.484486 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:30.484598 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.069) 0:00:01.993 ******* 2025-11-24 08:49:30.523250 | controller | skipping: [instance] 2025-11-24 08:49:30.523363 | controller | 2025-11-24 08:49:30.523472 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:30.523563 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.039) 0:00:02.033 ******* 2025-11-24 08:49:30.566470 | controller | skipping: [instance] 2025-11-24 08:49:30.613169 | controller | 2025-11-24 08:49:30.613209 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-24 08:49:30.613218 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.042) 0:00:02.075 ******* 2025-11-24 08:49:30.613229 | controller | ok: [instance] 2025-11-24 08:49:30.613260 | controller | 2025-11-24 08:49:30.613408 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-24 08:49:30.613509 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.046) 0:00:02.122 ******* 2025-11-24 08:49:30.703868 | controller | skipping: [instance] 2025-11-24 08:49:30.703933 | controller | 2025-11-24 08:49:30.704064 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-24 08:49:30.704176 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.090) 0:00:02.213 ******* 2025-11-24 08:49:30.768939 | controller | ok: [instance] 2025-11-24 08:49:30.769182 | controller | 2025-11-24 08:49:30.769423 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-24 08:49:30.769445 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.065) 0:00:02.278 ******* 2025-11-24 08:49:30.834526 | controller | ok: [instance] 2025-11-24 08:49:30.834612 | controller | 2025-11-24 08:49:30.834716 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-24 08:49:30.834834 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.065) 0:00:02.344 ******* 2025-11-24 08:49:30.902527 | controller | ok: [instance] => changed=false 2025-11-24 08:49:30.902639 | controller | msg: All assertions passed 2025-11-24 08:49:30.902724 | controller | 2025-11-24 08:49:30.902837 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-24 08:49:30.902933 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.067) 0:00:02.412 ******* 2025-11-24 08:49:30.982244 | controller | ok: [instance] => changed=false 2025-11-24 08:49:30.982359 | controller | msg: All assertions passed 2025-11-24 08:49:30.982463 | controller | 2025-11-24 08:49:30.982554 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:30.982653 | controller | Monday 24 November 2025 08:49:30 +0000 (0:00:00.079) 0:00:02.491 ******* 2025-11-24 08:49:31.020091 | controller | skipping: [instance] 2025-11-24 08:49:31.020203 | controller | 2025-11-24 08:49:31.020308 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:31.020442 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.038) 0:00:02.529 ******* 2025-11-24 08:49:31.052071 | controller | skipping: [instance] 2025-11-24 08:49:31.052178 | controller | 2025-11-24 08:49:31.052308 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:31.052408 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.031) 0:00:02.561 ******* 2025-11-24 08:49:31.085669 | controller | skipping: [instance] 2025-11-24 08:49:31.085950 | controller | 2025-11-24 08:49:31.086061 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:31.086178 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.033) 0:00:02.595 ******* 2025-11-24 08:49:31.108267 | controller | ok: [instance] 2025-11-24 08:49:31.108370 | controller | 2025-11-24 08:49:31.108475 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:31.108593 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.022) 0:00:02.618 ******* 2025-11-24 08:49:31.135308 | controller | ok: [instance] 2025-11-24 08:49:31.135473 | controller | 2025-11-24 08:49:31.135543 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:31.135642 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.026) 0:00:02.645 ******* 2025-11-24 08:49:31.159976 | controller | ok: [instance] => 2025-11-24 08:49:31.160085 | controller | msg: 'Running: Volume, with worker' 2025-11-24 08:49:31.160215 | controller | 2025-11-24 08:49:31.160310 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:31.160426 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.024) 0:00:02.669 ******* 2025-11-24 08:49:31.201737 | controller | 2025-11-24 08:49:31.201894 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:31.202010 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.041) 0:00:02.711 ******* 2025-11-24 08:49:31.262882 | controller | ok: [instance] 2025-11-24 08:49:31.262982 | controller | 2025-11-24 08:49:31.263085 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:31.263213 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.060) 0:00:02.772 ******* 2025-11-24 08:49:31.306415 | controller | ok: [instance] 2025-11-24 08:49:31.306524 | controller | 2025-11-24 08:49:31.306633 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:31.306733 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.043) 0:00:02.816 ******* 2025-11-24 08:49:31.378298 | controller | ok: [instance] 2025-11-24 08:49:31.378408 | controller | 2025-11-24 08:49:31.378524 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:31.378631 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.071) 0:00:02.888 ******* 2025-11-24 08:49:31.446920 | controller | ok: [instance] 2025-11-24 08:49:31.447002 | controller | 2025-11-24 08:49:31.447120 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:31.447226 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.068) 0:00:02.956 ******* 2025-11-24 08:49:31.489412 | controller | skipping: [instance] 2025-11-24 08:49:31.489513 | controller | 2025-11-24 08:49:31.489609 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-24 08:49:31.489722 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.042) 0:00:02.999 ******* 2025-11-24 08:49:31.534988 | controller | ok: [instance] 2025-11-24 08:49:31.589338 | controller | 2025-11-24 08:49:31.589360 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-24 08:49:31.589368 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.045) 0:00:03.044 ******* 2025-11-24 08:49:31.589378 | controller | ok: [instance] 2025-11-24 08:49:31.589448 | controller | 2025-11-24 08:49:31.589455 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-24 08:49:31.589463 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.054) 0:00:03.098 ******* 2025-11-24 08:49:31.656807 | controller | ok: [instance] 2025-11-24 08:49:31.656938 | controller | 2025-11-24 08:49:31.657141 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-24 08:49:31.747737 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.067) 0:00:03.166 ******* 2025-11-24 08:49:31.747790 | controller | ok: [instance] 2025-11-24 08:49:31.747801 | controller | 2025-11-24 08:49:31.747923 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-24 08:49:31.748033 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.090) 0:00:03.257 ******* 2025-11-24 08:49:31.816732 | controller | ok: [instance] => changed=false 2025-11-24 08:49:31.816850 | controller | msg: All assertions passed 2025-11-24 08:49:31.816924 | controller | 2025-11-24 08:49:31.817034 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-24 08:49:31.817151 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.068) 0:00:03.326 ******* 2025-11-24 08:49:31.898531 | controller | ok: [instance] => changed=false 2025-11-24 08:49:31.898684 | controller | msg: All assertions passed 2025-11-24 08:49:31.898792 | controller | 2025-11-24 08:49:31.898924 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:31.899033 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.081) 0:00:03.408 ******* 2025-11-24 08:49:31.935858 | controller | skipping: [instance] 2025-11-24 08:49:31.935949 | controller | 2025-11-24 08:49:31.936050 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:31.936201 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.037) 0:00:03.445 ******* 2025-11-24 08:49:31.971594 | controller | skipping: [instance] 2025-11-24 08:49:31.971680 | controller | 2025-11-24 08:49:31.971803 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:31.971896 | controller | Monday 24 November 2025 08:49:31 +0000 (0:00:00.035) 0:00:03.481 ******* 2025-11-24 08:49:32.004241 | controller | skipping: [instance] 2025-11-24 08:49:32.004329 | controller | 2025-11-24 08:49:32.004423 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:32.004529 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.032) 0:00:03.514 ******* 2025-11-24 08:49:32.026765 | controller | ok: [instance] 2025-11-24 08:49:32.026860 | controller | 2025-11-24 08:49:32.026973 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:32.027075 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.022) 0:00:03.536 ******* 2025-11-24 08:49:32.051355 | controller | ok: [instance] 2025-11-24 08:49:32.051443 | controller | 2025-11-24 08:49:32.051669 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:32.078614 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.024) 0:00:03.561 ******* 2025-11-24 08:49:32.078641 | controller | ok: [instance] => 2025-11-24 08:49:32.078753 | controller | msg: 'Running: Too many allocated volumes' 2025-11-24 08:49:32.078871 | controller | 2025-11-24 08:49:32.078997 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:32.079119 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.027) 0:00:03.588 ******* 2025-11-24 08:49:32.123734 | controller | 2025-11-24 08:49:32.123886 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:32.124006 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.045) 0:00:03.633 ******* 2025-11-24 08:49:32.181794 | controller | ok: [instance] 2025-11-24 08:49:32.181978 | controller | 2025-11-24 08:49:32.182102 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:32.182157 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.057) 0:00:03.691 ******* 2025-11-24 08:49:32.224689 | controller | ok: [instance] 2025-11-24 08:49:32.224776 | controller | 2025-11-24 08:49:32.224877 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:32.224977 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.042) 0:00:03.734 ******* 2025-11-24 08:49:32.294851 | controller | ok: [instance] 2025-11-24 08:49:32.294936 | controller | 2025-11-24 08:49:32.295048 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:32.295166 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.070) 0:00:03.804 ******* 2025-11-24 08:49:32.336476 | controller | skipping: [instance] 2025-11-24 08:49:32.336579 | controller | 2025-11-24 08:49:32.336801 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:32.379714 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.041) 0:00:03.846 ******* 2025-11-24 08:49:32.379748 | controller | skipping: [instance] 2025-11-24 08:49:32.379831 | controller | 2025-11-24 08:49:32.379932 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-24 08:49:32.380070 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.043) 0:00:03.889 ******* 2025-11-24 08:49:32.424625 | controller | ok: [instance] 2025-11-24 08:49:32.424726 | controller | 2025-11-24 08:49:32.424889 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-24 08:49:32.425018 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.044) 0:00:03.934 ******* 2025-11-24 08:49:32.467375 | controller | skipping: [instance] 2025-11-24 08:49:32.467574 | controller | 2025-11-24 08:49:32.467847 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-24 08:49:32.467868 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.042) 0:00:03.977 ******* 2025-11-24 08:49:32.523709 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:32.523810 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-11-24 08:49:32.523916 | controller | evaluated_to: false 2025-11-24 08:49:32.524033 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' 2025-11-24 08:49:32.554279 | controller | 2025-11-24 08:49:32.554395 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:32.554486 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.068) 0:00:04.045 ******* 2025-11-24 08:49:32.554570 | controller | 2025-11-24 08:49:32.554666 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:32.554781 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.018) 0:00:04.064 ******* 2025-11-24 08:49:32.577933 | controller | ok: [instance] 2025-11-24 08:49:32.578046 | controller | 2025-11-24 08:49:32.578171 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:32.578285 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.023) 0:00:04.087 ******* 2025-11-24 08:49:32.613598 | controller | skipping: [instance] 2025-11-24 08:49:32.613720 | controller | 2025-11-24 08:49:32.613871 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:32.613985 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.035) 0:00:04.123 ******* 2025-11-24 08:49:32.671531 | controller | skipping: [instance] 2025-11-24 08:49:32.671611 | controller | 2025-11-24 08:49:32.671767 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:32.671876 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.057) 0:00:04.180 ******* 2025-11-24 08:49:32.703412 | controller | skipping: [instance] 2025-11-24 08:49:32.703510 | controller | 2025-11-24 08:49:32.703605 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:32.703738 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.032) 0:00:04.213 ******* 2025-11-24 08:49:32.725406 | controller | ok: [instance] 2025-11-24 08:49:32.725493 | controller | 2025-11-24 08:49:32.725594 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:32.725706 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.021) 0:00:04.235 ******* 2025-11-24 08:49:32.755237 | controller | ok: [instance] 2025-11-24 08:49:32.755333 | controller | 2025-11-24 08:49:32.755428 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:32.755532 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.029) 0:00:04.265 ******* 2025-11-24 08:49:32.780869 | controller | ok: [instance] => 2025-11-24 08:49:32.780970 | controller | msg: 'Running: Different volume amount' 2025-11-24 08:49:32.781052 | controller | 2025-11-24 08:49:32.781187 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:32.781306 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.025) 0:00:04.290 ******* 2025-11-24 08:49:32.821751 | controller | 2025-11-24 08:49:32.821854 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:32.821960 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.040) 0:00:04.331 ******* 2025-11-24 08:49:32.880463 | controller | ok: [instance] 2025-11-24 08:49:32.880555 | controller | 2025-11-24 08:49:32.880686 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:32.880806 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.058) 0:00:04.390 ******* 2025-11-24 08:49:32.921545 | controller | ok: [instance] 2025-11-24 08:49:32.921596 | controller | 2025-11-24 08:49:32.921713 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:32.921815 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.041) 0:00:04.431 ******* 2025-11-24 08:49:32.993566 | controller | ok: [instance] 2025-11-24 08:49:32.993623 | controller | 2025-11-24 08:49:32.993756 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:32.993859 | controller | Monday 24 November 2025 08:49:32 +0000 (0:00:00.071) 0:00:04.503 ******* 2025-11-24 08:49:33.062522 | controller | ok: [instance] 2025-11-24 08:49:33.062574 | controller | 2025-11-24 08:49:33.062701 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:33.062823 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.068) 0:00:04.572 ******* 2025-11-24 08:49:33.106003 | controller | skipping: [instance] 2025-11-24 08:49:33.106078 | controller | 2025-11-24 08:49:33.106253 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-24 08:49:33.106349 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.043) 0:00:04.615 ******* 2025-11-24 08:49:33.149555 | controller | ok: [instance] 2025-11-24 08:49:33.149644 | controller | 2025-11-24 08:49:33.149760 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-24 08:49:33.149879 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.043) 0:00:04.659 ******* 2025-11-24 08:49:33.193761 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:33.193880 | controller | assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 2025-11-24 08:49:33.193984 | controller | evaluated_to: false 2025-11-24 08:49:33.194103 | controller | msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' 2025-11-24 08:49:33.221826 | controller | 2025-11-24 08:49:33.221920 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:33.222024 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.056) 0:00:04.715 ******* 2025-11-24 08:49:33.222140 | controller | 2025-11-24 08:49:33.222261 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:33.222362 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.016) 0:00:04.731 ******* 2025-11-24 08:49:33.243506 | controller | ok: [instance] 2025-11-24 08:49:33.243614 | controller | 2025-11-24 08:49:33.247656 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:33.247783 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.021) 0:00:04.753 ******* 2025-11-24 08:49:33.284620 | controller | skipping: [instance] 2025-11-24 08:49:33.284694 | controller | 2025-11-24 08:49:33.284820 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:33.284912 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.041) 0:00:04.794 ******* 2025-11-24 08:49:33.319119 | controller | skipping: [instance] 2025-11-24 08:49:33.319420 | controller | 2025-11-24 08:49:33.319436 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:33.350626 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.034) 0:00:04.828 ******* 2025-11-24 08:49:33.350674 | controller | skipping: [instance] 2025-11-24 08:49:33.350709 | controller | 2025-11-24 08:49:33.350815 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:33.350932 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.031) 0:00:04.860 ******* 2025-11-24 08:49:33.373597 | controller | ok: [instance] 2025-11-24 08:49:33.373693 | controller | 2025-11-24 08:49:33.373797 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:33.373901 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.023) 0:00:04.883 ******* 2025-11-24 08:49:33.399438 | controller | ok: [instance] 2025-11-24 08:49:33.399505 | controller | 2025-11-24 08:49:33.399615 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:33.399741 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.025) 0:00:04.909 ******* 2025-11-24 08:49:33.424101 | controller | ok: [instance] => 2025-11-24 08:49:33.424236 | controller | msg: 'Running: Create LVM without volume' 2025-11-24 08:49:33.424333 | controller | 2025-11-24 08:49:33.424442 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:33.424528 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.024) 0:00:04.934 ******* 2025-11-24 08:49:33.487922 | controller | 2025-11-24 08:49:33.488037 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:33.488158 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.063) 0:00:04.997 ******* 2025-11-24 08:49:33.544153 | controller | ok: [instance] 2025-11-24 08:49:33.544205 | controller | 2025-11-24 08:49:33.544349 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:33.544432 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.056) 0:00:05.054 ******* 2025-11-24 08:49:33.586598 | controller | ok: [instance] 2025-11-24 08:49:33.586686 | controller | 2025-11-24 08:49:33.586789 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:33.586893 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.042) 0:00:05.096 ******* 2025-11-24 08:49:33.656988 | controller | ok: [instance] 2025-11-24 08:49:33.657085 | controller | 2025-11-24 08:49:33.657242 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:33.657344 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.070) 0:00:05.166 ******* 2025-11-24 08:49:33.697705 | controller | skipping: [instance] 2025-11-24 08:49:33.697776 | controller | 2025-11-24 08:49:33.697894 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:33.698006 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.040) 0:00:05.207 ******* 2025-11-24 08:49:33.733434 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:33.733507 | controller | assertion: not cifmw_devscripts_create_logical_volume | bool 2025-11-24 08:49:33.733635 | controller | evaluated_to: false 2025-11-24 08:49:33.733736 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-11-24 08:49:33.760206 | controller | 2025-11-24 08:49:33.760295 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:33.760425 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.046) 0:00:05.253 ******* 2025-11-24 08:49:33.760501 | controller | 2025-11-24 08:49:33.760600 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:33.760717 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.016) 0:00:05.269 ******* 2025-11-24 08:49:33.781031 | controller | ok: [instance] 2025-11-24 08:49:33.781124 | controller | 2025-11-24 08:49:33.781253 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:33.781356 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.021) 0:00:05.291 ******* 2025-11-24 08:49:33.816011 | controller | skipping: [instance] 2025-11-24 08:49:33.816081 | controller | 2025-11-24 08:49:33.816241 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:33.816339 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.034) 0:00:05.325 ******* 2025-11-24 08:49:33.846924 | controller | skipping: [instance] 2025-11-24 08:49:33.846984 | controller | 2025-11-24 08:49:33.847090 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:33.847215 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.031) 0:00:05.356 ******* 2025-11-24 08:49:33.881992 | controller | skipping: [instance] 2025-11-24 08:49:33.882101 | controller | 2025-11-24 08:49:33.882187 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:33.882336 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.034) 0:00:05.391 ******* 2025-11-24 08:49:33.905015 | controller | ok: [instance] 2025-11-24 08:49:33.929798 | controller | 2025-11-24 08:49:33.929830 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:33.929838 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.022) 0:00:05.414 ******* 2025-11-24 08:49:33.929849 | controller | ok: [instance] 2025-11-24 08:49:33.956752 | controller | 2025-11-24 08:49:33.956815 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:33.956824 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.025) 0:00:05.439 ******* 2025-11-24 08:49:33.956839 | controller | ok: [instance] => 2025-11-24 08:49:33.999177 | controller | msg: 'Running: Create LVMS without volume' 2025-11-24 08:49:33.999209 | controller | 2025-11-24 08:49:33.999217 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:33.999223 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.026) 0:00:05.466 ******* 2025-11-24 08:49:33.999233 | controller | 2025-11-24 08:49:33.999339 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:33.999353 | controller | Monday 24 November 2025 08:49:33 +0000 (0:00:00.042) 0:00:05.508 ******* 2025-11-24 08:49:34.055694 | controller | ok: [instance] 2025-11-24 08:49:34.055783 | controller | 2025-11-24 08:49:34.055894 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:34.055998 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.056) 0:00:05.565 ******* 2025-11-24 08:49:34.102303 | controller | ok: [instance] 2025-11-24 08:49:34.102416 | controller | 2025-11-24 08:49:34.102521 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:34.102642 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.046) 0:00:05.611 ******* 2025-11-24 08:49:34.170812 | controller | ok: [instance] 2025-11-24 08:49:34.170940 | controller | 2025-11-24 08:49:34.171063 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:34.171196 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.068) 0:00:05.680 ******* 2025-11-24 08:49:34.212326 | controller | skipping: [instance] 2025-11-24 08:49:34.212429 | controller | 2025-11-24 08:49:34.212542 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:34.212653 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.041) 0:00:05.721 ******* 2025-11-24 08:49:34.254146 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:34.254267 | controller | assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 2025-11-24 08:49:34.254391 | controller | evaluated_to: false 2025-11-24 08:49:34.254489 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-11-24 08:49:34.283403 | controller | 2025-11-24 08:49:34.283599 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:34.283759 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.052) 0:00:05.774 ******* 2025-11-24 08:49:34.283811 | controller | 2025-11-24 08:49:34.283820 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:34.283922 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.018) 0:00:05.792 ******* 2025-11-24 08:49:34.306720 | controller | ok: [instance] 2025-11-24 08:49:34.306808 | controller | 2025-11-24 08:49:34.307032 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:34.376678 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.024) 0:00:05.816 ******* 2025-11-24 08:49:34.376729 | controller | skipping: [instance] 2025-11-24 08:49:34.376741 | controller | 2025-11-24 08:49:34.376869 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:34.376963 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.069) 0:00:05.886 ******* 2025-11-24 08:49:34.409515 | controller | skipping: [instance] 2025-11-24 08:49:34.409602 | controller | 2025-11-24 08:49:34.409706 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:34.409806 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.032) 0:00:05.919 ******* 2025-11-24 08:49:34.446973 | controller | skipping: [instance] 2025-11-24 08:49:34.447053 | controller | 2025-11-24 08:49:34.447348 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:34.469372 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.037) 0:00:05.956 ******* 2025-11-24 08:49:34.469401 | controller | ok: [instance] 2025-11-24 08:49:34.469457 | controller | 2025-11-24 08:49:34.469560 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:34.469676 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.022) 0:00:05.979 ******* 2025-11-24 08:49:34.496268 | controller | ok: [instance] 2025-11-24 08:49:34.496352 | controller | 2025-11-24 08:49:34.496452 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:34.496577 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.026) 0:00:06.005 ******* 2025-11-24 08:49:34.520594 | controller | ok: [instance] => 2025-11-24 08:49:34.520705 | controller | msg: 'Running: Allocate same volume twice' 2025-11-24 08:49:34.520803 | controller | 2025-11-24 08:49:34.520908 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:34.521017 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.024) 0:00:06.030 ******* 2025-11-24 08:49:34.562201 | controller | 2025-11-24 08:49:34.562318 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:34.562421 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.041) 0:00:06.072 ******* 2025-11-24 08:49:34.621471 | controller | ok: [instance] 2025-11-24 08:49:34.621528 | controller | 2025-11-24 08:49:34.621644 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:34.621745 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.059) 0:00:06.131 ******* 2025-11-24 08:49:34.661698 | controller | ok: [instance] 2025-11-24 08:49:34.661780 | controller | 2025-11-24 08:49:34.661884 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:34.661984 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.040) 0:00:06.171 ******* 2025-11-24 08:49:34.733323 | controller | ok: [instance] 2025-11-24 08:49:34.733419 | controller | 2025-11-24 08:49:34.733534 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:34.733652 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.071) 0:00:06.242 ******* 2025-11-24 08:49:34.772650 | controller | skipping: [instance] 2025-11-24 08:49:34.772747 | controller | 2025-11-24 08:49:34.772853 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:34.772970 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.039) 0:00:06.282 ******* 2025-11-24 08:49:34.818668 | controller | skipping: [instance] 2025-11-24 08:49:34.818724 | controller | 2025-11-24 08:49:34.818835 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-24 08:49:34.818947 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.045) 0:00:06.328 ******* 2025-11-24 08:49:34.863936 | controller | ok: [instance] 2025-11-24 08:49:34.863994 | controller | 2025-11-24 08:49:34.864142 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-24 08:49:34.864240 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.045) 0:00:06.373 ******* 2025-11-24 08:49:34.905091 | controller | skipping: [instance] 2025-11-24 08:49:34.905209 | controller | 2025-11-24 08:49:34.905319 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-24 08:49:34.905424 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.041) 0:00:06.414 ******* 2025-11-24 08:49:34.963888 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:34.964046 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-11-24 08:49:34.964270 | controller | evaluated_to: false 2025-11-24 08:49:34.964303 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' 2025-11-24 08:49:34.990717 | controller | 2025-11-24 08:49:34.990806 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:34.990940 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.069) 0:00:06.484 ******* 2025-11-24 08:49:34.991045 | controller | 2025-11-24 08:49:34.991195 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:34.991335 | controller | Monday 24 November 2025 08:49:34 +0000 (0:00:00.016) 0:00:06.500 ******* 2025-11-24 08:49:35.012712 | controller | ok: [instance] 2025-11-24 08:49:35.012806 | controller | 2025-11-24 08:49:35.012910 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:35.013013 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.022) 0:00:06.522 ******* 2025-11-24 08:49:35.049402 | controller | skipping: [instance] 2025-11-24 08:49:35.049767 | controller | 2025-11-24 08:49:35.049908 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:35.050014 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.036) 0:00:06.559 ******* 2025-11-24 08:49:35.081966 | controller | skipping: [instance] 2025-11-24 08:49:35.082051 | controller | 2025-11-24 08:49:35.082192 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:35.082292 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.032) 0:00:06.591 ******* 2025-11-24 08:49:35.116420 | controller | skipping: [instance] 2025-11-24 08:49:35.116488 | controller | 2025-11-24 08:49:35.116605 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:35.116707 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.034) 0:00:06.626 ******* 2025-11-24 08:49:35.138799 | controller | ok: [instance] 2025-11-24 08:49:35.138881 | controller | 2025-11-24 08:49:35.138984 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:35.139131 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.022) 0:00:06.648 ******* 2025-11-24 08:49:35.167050 | controller | ok: [instance] 2025-11-24 08:49:35.167157 | controller | 2025-11-24 08:49:35.167263 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:35.167374 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.028) 0:00:06.676 ******* 2025-11-24 08:49:35.227100 | controller | ok: [instance] => 2025-11-24 08:49:35.227215 | controller | msg: 'Running: Allocate same volume twice - no LVMS' 2025-11-24 08:49:35.227311 | controller | 2025-11-24 08:49:35.227412 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:35.227514 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.059) 0:00:06.736 ******* 2025-11-24 08:49:35.269272 | controller | 2025-11-24 08:49:35.269362 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:35.269469 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.042) 0:00:06.779 ******* 2025-11-24 08:49:35.328172 | controller | ok: [instance] 2025-11-24 08:49:35.328227 | controller | 2025-11-24 08:49:35.328354 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:35.328449 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.058) 0:00:06.837 ******* 2025-11-24 08:49:35.374666 | controller | ok: [instance] 2025-11-24 08:49:35.374720 | controller | 2025-11-24 08:49:35.374847 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:35.374936 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.046) 0:00:06.884 ******* 2025-11-24 08:49:35.447390 | controller | ok: [instance] 2025-11-24 08:49:35.447472 | controller | 2025-11-24 08:49:35.447616 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:35.447726 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.072) 0:00:06.957 ******* 2025-11-24 08:49:35.491719 | controller | skipping: [instance] 2025-11-24 08:49:35.491802 | controller | 2025-11-24 08:49:35.491909 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:35.492042 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.044) 0:00:07.001 ******* 2025-11-24 08:49:35.533938 | controller | skipping: [instance] 2025-11-24 08:49:35.533999 | controller | 2025-11-24 08:49:35.534120 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-24 08:49:35.534241 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.042) 0:00:07.043 ******* 2025-11-24 08:49:35.582205 | controller | ok: [instance] 2025-11-24 08:49:35.582286 | controller | 2025-11-24 08:49:35.582396 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-24 08:49:35.582499 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.048) 0:00:07.091 ******* 2025-11-24 08:49:35.628181 | controller | skipping: [instance] 2025-11-24 08:49:35.628285 | controller | 2025-11-24 08:49:35.628403 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-24 08:49:35.628508 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.046) 0:00:07.137 ******* 2025-11-24 08:49:35.696408 | controller | ok: [instance] 2025-11-24 08:49:35.696485 | controller | 2025-11-24 08:49:35.696606 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-24 08:49:35.696726 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.068) 0:00:07.206 ******* 2025-11-24 08:49:35.748240 | controller | skipping: [instance] 2025-11-24 08:49:35.748345 | controller | 2025-11-24 08:49:35.748416 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-24 08:49:35.748530 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.051) 0:00:07.257 ******* 2025-11-24 08:49:35.820535 | controller | ok: [instance] => changed=false 2025-11-24 08:49:35.820624 | controller | msg: All assertions passed 2025-11-24 08:49:35.820730 | controller | 2025-11-24 08:49:35.820830 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-24 08:49:35.820945 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.072) 0:00:07.330 ******* 2025-11-24 08:49:35.902008 | controller | ok: [instance] => changed=false 2025-11-24 08:49:35.902083 | controller | msg: All assertions passed 2025-11-24 08:49:35.902222 | controller | 2025-11-24 08:49:35.902332 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:35.902428 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.081) 0:00:07.411 ******* 2025-11-24 08:49:35.938350 | controller | skipping: [instance] 2025-11-24 08:49:35.938414 | controller | 2025-11-24 08:49:35.938550 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:35.938649 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.036) 0:00:07.448 ******* 2025-11-24 08:49:35.971865 | controller | skipping: [instance] 2025-11-24 08:49:35.971950 | controller | 2025-11-24 08:49:35.972071 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:35.972223 | controller | Monday 24 November 2025 08:49:35 +0000 (0:00:00.033) 0:00:07.481 ******* 2025-11-24 08:49:36.005571 | controller | skipping: [instance] 2025-11-24 08:49:36.005650 | controller | 2025-11-24 08:49:36.005754 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:36.005857 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.033) 0:00:07.515 ******* 2025-11-24 08:49:36.027907 | controller | ok: [instance] 2025-11-24 08:49:36.028344 | controller | 2025-11-24 08:49:36.055480 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:36.055509 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.022) 0:00:07.537 ******* 2025-11-24 08:49:36.055521 | controller | ok: [instance] 2025-11-24 08:49:36.055585 | controller | 2025-11-24 08:49:36.055700 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:36.055796 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.027) 0:00:07.565 ******* 2025-11-24 08:49:36.081848 | controller | ok: [instance] => 2025-11-24 08:49:36.081946 | controller | msg: 'Running: Allocate same volume twice - no cinder_lvm' 2025-11-24 08:49:36.082044 | controller | 2025-11-24 08:49:36.082198 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:36.082300 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.026) 0:00:07.591 ******* 2025-11-24 08:49:36.123991 | controller | 2025-11-24 08:49:36.124141 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:36.124265 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.042) 0:00:07.633 ******* 2025-11-24 08:49:36.208290 | controller | ok: [instance] 2025-11-24 08:49:36.208344 | controller | 2025-11-24 08:49:36.208426 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:36.208516 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.084) 0:00:07.717 ******* 2025-11-24 08:49:36.250358 | controller | ok: [instance] 2025-11-24 08:49:36.250420 | controller | 2025-11-24 08:49:36.250487 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:36.250629 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.042) 0:00:07.760 ******* 2025-11-24 08:49:36.323470 | controller | ok: [instance] 2025-11-24 08:49:36.323549 | controller | 2025-11-24 08:49:36.323661 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:36.323768 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.073) 0:00:07.833 ******* 2025-11-24 08:49:36.364561 | controller | skipping: [instance] 2025-11-24 08:49:36.364654 | controller | 2025-11-24 08:49:36.364769 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:36.364885 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.041) 0:00:07.874 ******* 2025-11-24 08:49:36.410196 | controller | skipping: [instance] 2025-11-24 08:49:36.410310 | controller | 2025-11-24 08:49:36.410467 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-24 08:49:36.410527 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.045) 0:00:07.919 ******* 2025-11-24 08:49:36.457829 | controller | ok: [instance] 2025-11-24 08:49:36.457924 | controller | 2025-11-24 08:49:36.458064 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-24 08:49:36.458195 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.047) 0:00:07.967 ******* 2025-11-24 08:49:36.500758 | controller | skipping: [instance] 2025-11-24 08:49:36.500891 | controller | 2025-11-24 08:49:36.501001 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-24 08:49:36.501119 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.042) 0:00:08.010 ******* 2025-11-24 08:49:36.567061 | controller | ok: [instance] 2025-11-24 08:49:36.567193 | controller | 2025-11-24 08:49:36.567306 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-24 08:49:36.567400 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.066) 0:00:08.076 ******* 2025-11-24 08:49:36.617947 | controller | skipping: [instance] 2025-11-24 08:49:36.618071 | controller | 2025-11-24 08:49:36.618210 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-24 08:49:36.618314 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.050) 0:00:08.127 ******* 2025-11-24 08:49:36.690762 | controller | ok: [instance] => changed=false 2025-11-24 08:49:36.691527 | controller | msg: All assertions passed 2025-11-24 08:49:36.751405 | controller | 2025-11-24 08:49:36.751436 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-24 08:49:36.751444 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.072) 0:00:08.200 ******* 2025-11-24 08:49:36.751456 | controller | skipping: [instance] 2025-11-24 08:49:36.751494 | controller | 2025-11-24 08:49:36.751627 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:36.751733 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.060) 0:00:08.261 ******* 2025-11-24 08:49:36.790852 | controller | skipping: [instance] 2025-11-24 08:49:36.790943 | controller | 2025-11-24 08:49:36.791099 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:36.791210 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.039) 0:00:08.300 ******* 2025-11-24 08:49:36.827193 | controller | skipping: [instance] 2025-11-24 08:49:36.827290 | controller | 2025-11-24 08:49:36.827426 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:36.827515 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.036) 0:00:08.336 ******* 2025-11-24 08:49:36.861736 | controller | skipping: [instance] 2025-11-24 08:49:36.861849 | controller | 2025-11-24 08:49:36.861956 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:36.862098 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.034) 0:00:08.371 ******* 2025-11-24 08:49:36.887202 | controller | ok: [instance] 2025-11-24 08:49:36.887316 | controller | 2025-11-24 08:49:36.887432 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:36.887560 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.025) 0:00:08.396 ******* 2025-11-24 08:49:36.913004 | controller | ok: [instance] 2025-11-24 08:49:36.913087 | controller | 2025-11-24 08:49:36.913215 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:36.913323 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.026) 0:00:08.422 ******* 2025-11-24 08:49:36.938848 | controller | ok: [instance] => 2025-11-24 08:49:36.938955 | controller | msg: 'Running: Config overrides via devscripts' 2025-11-24 08:49:36.939079 | controller | 2025-11-24 08:49:36.939198 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:36.939288 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.025) 0:00:08.448 ******* 2025-11-24 08:49:36.980675 | controller | 2025-11-24 08:49:36.980793 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:36.980919 | controller | Monday 24 November 2025 08:49:36 +0000 (0:00:00.041) 0:00:08.490 ******* 2025-11-24 08:49:37.015389 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:37.015516 | controller | assertion: cifmw_devscripts_config.master_memory is undefined 2025-11-24 08:49:37.015631 | controller | evaluated_to: false 2025-11-24 08:49:37.015746 | controller | msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' 2025-11-24 08:49:37.042354 | controller | 2025-11-24 08:49:37.042482 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:37.042588 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.045) 0:00:08.535 ******* 2025-11-24 08:49:37.042684 | controller | 2025-11-24 08:49:37.042780 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:37.042879 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.016) 0:00:08.551 ******* 2025-11-24 08:49:37.063774 | controller | ok: [instance] 2025-11-24 08:49:37.063883 | controller | 2025-11-24 08:49:37.064022 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:37.064153 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.021) 0:00:08.573 ******* 2025-11-24 08:49:37.127464 | controller | skipping: [instance] 2025-11-24 08:49:37.127571 | controller | 2025-11-24 08:49:37.127691 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:37.127789 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.063) 0:00:08.637 ******* 2025-11-24 08:49:37.161922 | controller | skipping: [instance] 2025-11-24 08:49:37.162040 | controller | 2025-11-24 08:49:37.162152 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:37.162288 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.034) 0:00:08.671 ******* 2025-11-24 08:49:37.201490 | controller | skipping: [instance] 2025-11-24 08:49:37.201584 | controller | 2025-11-24 08:49:37.201688 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:37.201788 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.039) 0:00:08.711 ******* 2025-11-24 08:49:37.223145 | controller | ok: [instance] 2025-11-24 08:49:37.223242 | controller | 2025-11-24 08:49:37.223346 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:37.223454 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.021) 0:00:08.733 ******* 2025-11-24 08:49:37.248211 | controller | ok: [instance] 2025-11-24 08:49:37.248320 | controller | 2025-11-24 08:49:37.248453 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:37.248555 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.025) 0:00:08.758 ******* 2025-11-24 08:49:37.274936 | controller | ok: [instance] => 2025-11-24 08:49:37.275103 | controller | msg: 'Running: Inject 10 dev-scripts extra_worker' 2025-11-24 08:49:37.275174 | controller | 2025-11-24 08:49:37.275294 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:37.275397 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.026) 0:00:08.784 ******* 2025-11-24 08:49:37.317191 | controller | 2025-11-24 08:49:37.317318 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:37.317431 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.042) 0:00:08.826 ******* 2025-11-24 08:49:37.376412 | controller | ok: [instance] 2025-11-24 08:49:37.376517 | controller | 2025-11-24 08:49:37.376626 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:37.376789 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.059) 0:00:08.886 ******* 2025-11-24 08:49:37.409991 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-24 08:49:37.410131 | controller | assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 2025-11-24 08:49:37.410242 | controller | evaluated_to: false 2025-11-24 08:49:37.410353 | controller | msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' 2025-11-24 08:49:37.436343 | controller | 2025-11-24 08:49:37.436421 | controller | TASK [Clear host errors] ******************************************************* 2025-11-24 08:49:37.436544 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.043) 0:00:08.929 ******* 2025-11-24 08:49:37.436645 | controller | 2025-11-24 08:49:37.436746 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:37.436865 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.016) 0:00:08.946 ******* 2025-11-24 08:49:37.458623 | controller | ok: [instance] 2025-11-24 08:49:37.458724 | controller | 2025-11-24 08:49:37.458870 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:37.458991 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.022) 0:00:08.968 ******* 2025-11-24 08:49:37.525669 | controller | skipping: [instance] 2025-11-24 08:49:37.525751 | controller | 2025-11-24 08:49:37.525869 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:37.526000 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.066) 0:00:09.035 ******* 2025-11-24 08:49:37.556726 | controller | skipping: [instance] 2025-11-24 08:49:37.556818 | controller | 2025-11-24 08:49:37.556921 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:37.557056 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.031) 0:00:09.066 ******* 2025-11-24 08:49:37.588297 | controller | skipping: [instance] 2025-11-24 08:49:37.588415 | controller | 2025-11-24 08:49:37.588532 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-24 08:49:37.588649 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.031) 0:00:09.098 ******* 2025-11-24 08:49:37.609130 | controller | ok: [instance] 2025-11-24 08:49:37.609271 | controller | 2025-11-24 08:49:37.609377 | controller | TASK [Load environment file] *************************************************** 2025-11-24 08:49:37.609501 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.020) 0:00:09.118 ******* 2025-11-24 08:49:37.634156 | controller | ok: [instance] 2025-11-24 08:49:37.634279 | controller | 2025-11-24 08:49:37.634385 | controller | TASK [Output scenario name] **************************************************** 2025-11-24 08:49:37.634491 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.024) 0:00:09.143 ******* 2025-11-24 08:49:37.661029 | controller | ok: [instance] => 2025-11-24 08:49:37.661127 | controller | msg: 'Running: Inject 0 dev-scripts extra_worker' 2025-11-24 08:49:37.661236 | controller | 2025-11-24 08:49:37.661334 | controller | TASK [Validate data] *********************************************************** 2025-11-24 08:49:37.661451 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.026) 0:00:09.170 ******* 2025-11-24 08:49:37.706315 | controller | 2025-11-24 08:49:37.706414 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-24 08:49:37.706533 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.045) 0:00:09.215 ******* 2025-11-24 08:49:37.766981 | controller | ok: [instance] 2025-11-24 08:49:37.767079 | controller | 2025-11-24 08:49:37.767201 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-24 08:49:37.767305 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.060) 0:00:09.276 ******* 2025-11-24 08:49:37.811952 | controller | ok: [instance] 2025-11-24 08:49:37.812062 | controller | 2025-11-24 08:49:37.812217 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-24 08:49:37.812361 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.045) 0:00:09.321 ******* 2025-11-24 08:49:37.882323 | controller | ok: [instance] 2025-11-24 08:49:37.882423 | controller | 2025-11-24 08:49:37.882550 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-24 08:49:37.882655 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.070) 0:00:09.391 ******* 2025-11-24 08:49:37.958336 | controller | skipping: [instance] 2025-11-24 08:49:37.958448 | controller | 2025-11-24 08:49:37.958571 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-24 08:49:37.958680 | controller | Monday 24 November 2025 08:49:37 +0000 (0:00:00.075) 0:00:09.467 ******* 2025-11-24 08:49:38.009418 | controller | ok: [instance] 2025-11-24 08:49:38.009575 | controller | 2025-11-24 08:49:38.009648 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-24 08:49:38.009877 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.051) 0:00:09.519 ******* 2025-11-24 08:49:38.051408 | controller | skipping: [instance] 2025-11-24 08:49:38.051496 | controller | 2025-11-24 08:49:38.051621 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-24 08:49:38.051716 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.042) 0:00:09.561 ******* 2025-11-24 08:49:38.090875 | controller | skipping: [instance] 2025-11-24 08:49:38.090980 | controller | 2025-11-24 08:49:38.091087 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-24 08:49:38.091213 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.039) 0:00:09.600 ******* 2025-11-24 08:49:38.134881 | controller | skipping: [instance] 2025-11-24 08:49:38.135072 | controller | 2025-11-24 08:49:38.135212 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-24 08:49:38.135234 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.043) 0:00:09.644 ******* 2025-11-24 08:49:38.177668 | controller | skipping: [instance] 2025-11-24 08:49:38.177763 | controller | 2025-11-24 08:49:38.177873 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-24 08:49:38.177993 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.042) 0:00:09.687 ******* 2025-11-24 08:49:38.219558 | controller | skipping: [instance] 2025-11-24 08:49:38.219654 | controller | 2025-11-24 08:49:38.219767 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-24 08:49:38.219878 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.041) 0:00:09.729 ******* 2025-11-24 08:49:38.269436 | controller | skipping: [instance] 2025-11-24 08:49:38.269539 | controller | 2025-11-24 08:49:38.269667 | controller | TASK [Mark failure] ************************************************************ 2025-11-24 08:49:38.269766 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.049) 0:00:09.779 ******* 2025-11-24 08:49:38.308212 | controller | skipping: [instance] 2025-11-24 08:49:38.308337 | controller | 2025-11-24 08:49:38.308495 | controller | TASK [Display error message] *************************************************** 2025-11-24 08:49:38.308588 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.038) 0:00:09.817 ******* 2025-11-24 08:49:38.340766 | controller | skipping: [instance] 2025-11-24 08:49:38.340858 | controller | 2025-11-24 08:49:38.340990 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-24 08:49:38.341142 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.032) 0:00:09.850 ******* 2025-11-24 08:49:38.378062 | controller | skipping: [instance] 2025-11-24 08:49:38.378188 | controller | 2025-11-24 08:49:38.378292 | controller | TASK [Fail if needed] ********************************************************** 2025-11-24 08:49:38.378398 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.037) 0:00:09.887 ******* 2025-11-24 08:49:38.435775 | controller | skipping: [instance] 2025-11-24 08:49:38.435874 | controller | 2025-11-24 08:49:38.435989 | controller | PLAY RECAP ********************************************************************* 2025-11-24 08:49:38.436146 | controller | instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 2025-11-24 08:49:38.436236 | controller | 2025-11-24 08:49:38.436322 | controller | Monday 24 November 2025 08:49:38 +0000 (0:00:00.057) 0:00:09.945 ******* 2025-11-24 08:49:38.436440 | controller | =============================================================================== 2025-11-24 08:49:38.436520 | controller | Test no volumes --------------------------------------------------------- 0.10s 2025-11-24 08:49:38.437288 | controller | reproducer : Ensure we get required data in the layout description ------ 0.09s 2025-11-24 08:49:38.437417 | controller | reproducer : Ensure no allocation overlap ------------------------------- 0.09s 2025-11-24 08:49:38.437427 | controller | reproducer : Ensure same amount of disks are created -------------------- 0.09s 2025-11-24 08:49:38.437433 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.08s 2025-11-24 08:49:38.437444 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-11-24 08:49:38.437450 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-11-24 08:49:38.437455 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-11-24 08:49:38.437463 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.08s 2025-11-24 08:49:38.437469 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-24 08:49:38.437476 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.07s 2025-11-24 08:49:38.437593 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-24 08:49:38.437664 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.07s 2025-11-24 08:49:38.437756 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-24 08:49:38.437848 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-24 08:49:38.437978 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-24 08:49:38.438056 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-24 08:49:38.438173 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-24 08:49:38.438274 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-24 08:49:38.438366 | controller | Mark failure ------------------------------------------------------------ 0.07s 2025-11-24 08:49:38.510787 | controller | INFO Running ocp_validations > cleanup 2025-11-24 08:49:38.511241 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-24 08:49:38.511826 | controller | INFO Writing /tmp/report.html report. 2025-11-24 08:49:38.841150 | [controller] Waiting on logger 2025-11-24 08:49:43.968963 | [controller] Waiting on logger 2025-11-24 08:49:54.400924 | [controller] Waiting on logger 2025-11-24 08:50:04.832923 | [controller] Waiting on logger 2025-11-24 08:50:08.624206 | [Zuul] Log Stream did not terminate 2025-11-24 08:50:08.625772 | controller | changed 2025-11-24 08:50:08.691449 | 2025-11-24 08:50:08.691515 | PLAY RECAP 2025-11-24 08:50:08.691555 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-11-24 08:50:08.691584 | 2025-11-24 08:50:08.757838 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-11-24 08:50:08.758623 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-11-24 08:50:09.280931 | 2025-11-24 08:50:09.281107 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-11-24 08:50:09.301501 | 2025-11-24 08:50:09.301576 | TASK [Filter out host if needed] 2025-11-24 08:50:09.309875 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-11-24 08:50:09.314257 | 2025-11-24 08:50:09.314323 | TASK [Ensure file is present] 2025-11-24 08:50:09.688462 | controller | ok 2025-11-24 08:50:09.694029 | 2025-11-24 08:50:09.694099 | TASK [Manage molecule report file] 2025-11-24 08:50:09.714543 | [controller] Waiting on logger 2025-11-24 08:50:19.041972 | [controller] Waiting on logger 2025-11-24 08:50:29.472850 | [controller] Waiting on logger 2025-11-24 08:50:38.853373 | [controller] Waiting on logger 2025-11-24 08:50:40.086971 | [Zuul] Log Stream did not terminate 2025-11-24 08:50:40.087175 | controller | changed 2025-11-24 08:50:40.092517 | 2025-11-24 08:50:40.092582 | TASK [Check if we get ci-framework-data basedir] 2025-11-24 08:50:40.385180 | controller | ok 2025-11-24 08:50:40.390328 | 2025-11-24 08:50:40.390407 | TASK [Create ci-framework-data log directory for zuul] 2025-11-24 08:50:40.774537 | controller | changed 2025-11-24 08:50:40.780116 | 2025-11-24 08:50:40.780180 | TASK [Copy ci-framework interesting files] 2025-11-24 08:50:43.872926 | [controller] Waiting on logger 2025-11-24 08:50:54.304967 | [controller] Waiting on logger 2025-11-24 08:51:04.736828 | [controller] Waiting on logger 2025-11-24 08:51:11.071447 | [Zuul] Log Stream did not terminate 2025-11-24 08:51:11.071663 | controller | changed 2025-11-24 08:51:11.077110 | 2025-11-24 08:51:11.077177 | TASK [Get SELinux listing] 2025-11-24 08:51:11.098929 | [controller] Waiting on logger 2025-11-24 08:51:21.504914 | [controller] Waiting on logger 2025-11-24 08:51:30.885564 | [controller] Waiting on logger 2025-11-24 08:51:41.280875 | [controller] Waiting on logger 2025-11-24 08:51:41.369847 | [Zuul] Log Stream did not terminate 2025-11-24 08:51:41.370053 | controller | changed 2025-11-24 08:51:41.375927 | 2025-11-24 08:51:41.375999 | TASK [Generate log index] 2025-11-24 08:51:42.468459 | controller | changed 2025-11-24 08:51:42.473566 | 2025-11-24 08:51:42.473654 | TASK [Get some env related data] 2025-11-24 08:51:43.520942 | [controller] Waiting on logger 2025-11-24 08:51:59.904891 | [controller] Waiting on logger 2025-11-24 08:52:03.232950 | [controller] Waiting on logger 2025-11-24 08:52:12.690841 | controller | changed 2025-11-24 08:52:12.696347 | 2025-11-24 08:52:12.696453 | TASK [Generate list of logs to collect in home directory] 2025-11-24 08:52:13.064938 | controller | ok: All paths examined 2025-11-24 08:52:13.070571 | 2025-11-24 08:52:13.070640 | LOOP [Copy logs from home directory] 2025-11-24 08:52:13.616911 | controller | changed: 2025-11-24 08:52:13.617140 | controller | { 2025-11-24 08:52:13.617169 | controller | "atime": 1743544925.4788878, 2025-11-24 08:52:13.617190 | controller | "ctime": 1743545329.1409318, 2025-11-24 08:52:13.617206 | controller | "dev": 64513, 2025-11-24 08:52:13.617222 | controller | "gid": 1000, 2025-11-24 08:52:13.617242 | controller | "gr_name": "zuul", 2025-11-24 08:52:13.617258 | controller | "inode": 4518807, 2025-11-24 08:52:13.617273 | controller | "isblk": false, 2025-11-24 08:52:13.617290 | controller | "ischr": false, 2025-11-24 08:52:13.617305 | controller | "isdir": false, 2025-11-24 08:52:13.617319 | controller | "isfifo": false, 2025-11-24 08:52:13.617333 | controller | "isgid": false, 2025-11-24 08:52:13.617347 | controller | "islnk": false, 2025-11-24 08:52:13.617363 | controller | "isreg": true, 2025-11-24 08:52:13.617376 | controller | "issock": false, 2025-11-24 08:52:13.617417 | controller | "isuid": false, 2025-11-24 08:52:13.617434 | controller | "mode": "0644", 2025-11-24 08:52:13.617447 | controller | "mtime": 1743545329.1409318, 2025-11-24 08:52:13.617461 | controller | "nlink": 1, 2025-11-24 08:52:13.617473 | controller | "path": "/home/zuul/crc-setup.log", 2025-11-24 08:52:13.617486 | controller | "pw_name": "zuul", 2025-11-24 08:52:13.617500 | controller | "rgrp": true, 2025-11-24 08:52:13.617513 | controller | "roth": true, 2025-11-24 08:52:13.617527 | controller | "rusr": true, 2025-11-24 08:52:13.617540 | controller | "size": 4108, 2025-11-24 08:52:13.617552 | controller | "uid": 1000, 2025-11-24 08:52:13.617565 | controller | "wgrp": false, 2025-11-24 08:52:13.617578 | controller | "woth": false, 2025-11-24 08:52:13.617591 | controller | "wusr": true, 2025-11-24 08:52:13.617603 | controller | "xgrp": false, 2025-11-24 08:52:13.617616 | controller | "xoth": false, 2025-11-24 08:52:13.617628 | controller | "xusr": false 2025-11-24 08:52:13.617640 | controller | } 2025-11-24 08:52:14.132886 | controller | changed: 2025-11-24 08:52:14.132976 | controller | { 2025-11-24 08:52:14.133003 | controller | "atime": 1743545331.0429637, 2025-11-24 08:52:14.133032 | controller | "ctime": 1743545842.0111232, 2025-11-24 08:52:14.133052 | controller | "dev": 64513, 2025-11-24 08:52:14.133069 | controller | "gid": 1000, 2025-11-24 08:52:14.133084 | controller | "gr_name": "zuul", 2025-11-24 08:52:14.133099 | controller | "inode": 4194437, 2025-11-24 08:52:14.133113 | controller | "isblk": false, 2025-11-24 08:52:14.133137 | controller | "ischr": false, 2025-11-24 08:52:14.133150 | controller | "isdir": false, 2025-11-24 08:52:14.133164 | controller | "isfifo": false, 2025-11-24 08:52:14.133176 | controller | "isgid": false, 2025-11-24 08:52:14.133189 | controller | "islnk": false, 2025-11-24 08:52:14.133222 | controller | "isreg": true, 2025-11-24 08:52:14.133238 | controller | "issock": false, 2025-11-24 08:52:14.133253 | controller | "isuid": false, 2025-11-24 08:52:14.133267 | controller | "mode": "0644", 2025-11-24 08:52:14.133281 | controller | "mtime": 1743545842.0111232, 2025-11-24 08:52:14.133294 | controller | "nlink": 1, 2025-11-24 08:52:14.133308 | controller | "path": "/home/zuul/crc-start.log", 2025-11-24 08:52:14.133322 | controller | "pw_name": "zuul", 2025-11-24 08:52:14.133335 | controller | "rgrp": true, 2025-11-24 08:52:14.133348 | controller | "roth": true, 2025-11-24 08:52:14.133361 | controller | "rusr": true, 2025-11-24 08:52:14.133373 | controller | "size": 4023, 2025-11-24 08:52:14.133402 | controller | "uid": 1000, 2025-11-24 08:52:14.133419 | controller | "wgrp": false, 2025-11-24 08:52:14.133432 | controller | "woth": false, 2025-11-24 08:52:14.133445 | controller | "wusr": true, 2025-11-24 08:52:14.133459 | controller | "xgrp": false, 2025-11-24 08:52:14.133473 | controller | "xoth": false, 2025-11-24 08:52:14.133486 | controller | "xusr": false 2025-11-24 08:52:14.133499 | controller | } 2025-11-24 08:52:14.432861 | [controller] Waiting on logger 2025-11-24 08:52:14.647153 | controller | changed: 2025-11-24 08:52:14.647221 | controller | { 2025-11-24 08:52:14.647247 | controller | "atime": 1763973604.4196975, 2025-11-24 08:52:14.647265 | controller | "ctime": 1763973619.6490815, 2025-11-24 08:52:14.647281 | controller | "dev": 64513, 2025-11-24 08:52:14.647296 | controller | "gid": 1000, 2025-11-24 08:52:14.647311 | controller | "gr_name": "zuul", 2025-11-24 08:52:14.647326 | controller | "inode": 4685813, 2025-11-24 08:52:14.647343 | controller | "isblk": false, 2025-11-24 08:52:14.647357 | controller | "ischr": false, 2025-11-24 08:52:14.647371 | controller | "isdir": false, 2025-11-24 08:52:14.647405 | controller | "isfifo": false, 2025-11-24 08:52:14.647426 | controller | "isgid": false, 2025-11-24 08:52:14.647441 | controller | "islnk": false, 2025-11-24 08:52:14.647454 | controller | "isreg": true, 2025-11-24 08:52:14.647468 | controller | "issock": false, 2025-11-24 08:52:14.647482 | controller | "isuid": false, 2025-11-24 08:52:14.647497 | controller | "mode": "0644", 2025-11-24 08:52:14.647511 | controller | "mtime": 1763973619.6490815, 2025-11-24 08:52:14.647525 | controller | "nlink": 1, 2025-11-24 08:52:14.647539 | controller | "path": "/home/zuul/ansible.log", 2025-11-24 08:52:14.647553 | controller | "pw_name": "zuul", 2025-11-24 08:52:14.647567 | controller | "rgrp": true, 2025-11-24 08:52:14.647580 | controller | "roth": true, 2025-11-24 08:52:14.647593 | controller | "rusr": true, 2025-11-24 08:52:14.647607 | controller | "size": 6749, 2025-11-24 08:52:14.647619 | controller | "uid": 1000, 2025-11-24 08:52:14.647632 | controller | "wgrp": false, 2025-11-24 08:52:14.647644 | controller | "woth": false, 2025-11-24 08:52:14.647656 | controller | "wusr": true, 2025-11-24 08:52:14.647668 | controller | "xgrp": false, 2025-11-24 08:52:14.647680 | controller | "xoth": false, 2025-11-24 08:52:14.647693 | controller | "xusr": false 2025-11-24 08:52:14.647705 | controller | } 2025-11-24 08:52:14.663067 | 2025-11-24 08:52:14.663180 | TASK [Copy crio stats log file] 2025-11-24 08:52:14.677948 | controller | skipping: Conditional result was False 2025-11-24 08:52:14.683808 | 2025-11-24 08:52:14.683873 | TASK [Get SELinux related data] 2025-11-24 08:52:17.760991 | [controller] Waiting on logger 2025-11-24 08:52:33.056939 | [controller] Waiting on logger 2025-11-24 08:52:36.384767 | [controller] Waiting on logger 2025-11-24 08:52:44.977336 | [Zuul] Log Stream did not terminate 2025-11-24 08:52:44.978899 | controller | ERROR 2025-11-24 08:52:44.979009 | controller | { 2025-11-24 08:52:44.979050 | controller | "delta": "0:00:00.008632", 2025-11-24 08:52:44.979071 | controller | "end": "2025-11-24 08:52:14.954765", 2025-11-24 08:52:44.979088 | controller | "msg": "non-zero return code", 2025-11-24 08:52:44.979103 | controller | "rc": 1, 2025-11-24 08:52:44.979117 | controller | "start": "2025-11-24 08:52:14.946133" 2025-11-24 08:52:44.979131 | controller | } 2025-11-24 08:52:44.979153 | controller | ERROR: Ignoring Errors 2025-11-24 08:52:44.984988 | 2025-11-24 08:52:44.985066 | TASK [Create system configuration directory] 2025-11-24 08:52:45.258111 | controller | changed 2025-11-24 08:52:45.262892 | 2025-11-24 08:52:45.262956 | TASK [Get some of the system configurations] 2025-11-24 08:52:50.289653 | controller | changed 2025-11-24 08:52:50.294984 | 2025-11-24 08:52:50.295057 | TASK [Copy generated documentation if available] 2025-11-24 08:52:50.318688 | controller | skipping: Conditional result was False 2025-11-24 08:52:50.323962 | 2025-11-24 08:52:50.324036 | TASK [Copy generated AsciiDoc documentation if available] 2025-11-24 08:52:50.337506 | controller | skipping: Conditional result was False 2025-11-24 08:52:50.342646 | 2025-11-24 08:52:50.342708 | TASK [Compress logs bigger than 2MB] 2025-11-24 08:52:50.365963 | [controller] Waiting on logger 2025-11-24 08:53:00.768921 | [controller] Waiting on logger 2025-11-24 08:53:10.112995 | [controller] Waiting on logger 2025-11-24 08:53:20.544819 | [controller] Waiting on logger 2025-11-24 08:53:20.613841 | [Zuul] Log Stream did not terminate 2025-11-24 08:53:20.614011 | controller | changed 2025-11-24 08:53:20.619303 | 2025-11-24 08:53:20.619368 | TASK [Copy files from workspace on node] 2025-11-24 08:53:20.637532 | controller | ok 2025-11-24 08:53:20.659852 | 2025-11-24 08:53:20.659951 | TASK [fetch-output : Set log path for multiple nodes] 2025-11-24 08:53:20.673308 | controller | skipping: Conditional result was False 2025-11-24 08:53:20.680092 | 2025-11-24 08:53:20.680168 | TASK [fetch-output : Set log path for single node] 2025-11-24 08:53:20.708095 | controller | ok 2025-11-24 08:53:20.712954 | 2025-11-24 08:53:20.713022 | LOOP [fetch-output : Ensure local output dirs] 2025-11-24 08:53:20.903643 | controller -> localhost | ok: "/var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/logs" 2025-11-24 08:53:20.903858 | controller -> localhost | changed: All items complete 2025-11-24 08:53:20.903888 | 2025-11-24 08:53:21.105239 | controller -> localhost | changed: "/var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/artifacts" 2025-11-24 08:53:21.283294 | controller -> localhost | changed: "/var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/docs" 2025-11-24 08:53:21.297676 | 2025-11-24 08:53:21.297745 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-11-24 08:53:21.943105 | controller | changed: 2025-11-24 08:53:21.943276 | controller | .d..t...... ./ 2025-11-24 08:53:21.943305 | controller | >f+++++++++ README.html 2025-11-24 08:53:21.943326 | controller | >f+++++++++ ansible-execution.log 2025-11-24 08:53:21.943345 | controller | >f+++++++++ ansible.log 2025-11-24 08:53:21.943363 | controller | >f+++++++++ crc-setup.log 2025-11-24 08:53:21.943403 | controller | >f+++++++++ crc-start.log 2025-11-24 08:53:21.943431 | controller | >f+++++++++ dmesg.log 2025-11-24 08:53:21.943451 | controller | >f+++++++++ installed-pkgs.log 2025-11-24 08:53:21.943469 | controller | >f+++++++++ python.log 2025-11-24 08:53:21.943485 | controller | >f+++++++++ registries.conf 2025-11-24 08:53:21.943501 | controller | >f+++++++++ report.html 2025-11-24 08:53:21.943525 | controller | >f+++++++++ selinux-denials.log 2025-11-24 08:53:21.943541 | controller | >f+++++++++ selinux-listing.log 2025-11-24 08:53:21.943557 | controller | cd+++++++++ ci-framework-data/ 2025-11-24 08:53:21.943572 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-11-24 08:53:21.943587 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-11-24 08:53:21.943602 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-11-24 08:53:21.943617 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-11-24 08:53:21.943632 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-11-24 08:53:21.943648 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-11-24 08:53:21.943663 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-11-24 08:53:21.943678 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-11-24 08:53:21.943692 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-11-24 08:53:21.943706 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-11-24 08:53:21.943721 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-11-24 08:53:21.943736 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-11-24 08:53:21.943749 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-11-24 08:53:21.943763 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-11-24 08:53:21.943777 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:d3:a6:9d 2025-11-24 08:53:21.943791 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:74:9d:d0 2025-11-24 08:53:21.943811 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:b1:5b:24 2025-11-24 08:53:21.943826 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:c4:56:fa 2025-11-24 08:53:21.943841 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:68:a0:ec 2025-11-24 08:53:21.943854 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:7a:e2:40 2025-11-24 08:53:21.943868 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-11-24 08:53:21.943881 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-11-24 08:53:21.943895 | controller | cd+++++++++ ci-framework-data/logs/ 2025-11-24 08:53:21.943908 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-11-24 08:53:21.943921 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-11-24 08:53:21.943935 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-11-24 08:53:21.943948 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-11-24 08:53:21.943962 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-11-24 08:53:21.943976 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-11-24 08:53:21.943991 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-11-24 08:53:21.944008 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2025-11-24 08:53:21.944023 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2025-11-24 08:53:21.944051 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2025-11-24 08:53:21.944065 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2025-11-24 08:53:21.944079 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2025-11-24 08:53:21.944094 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2025-11-24 08:53:21.944108 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2025-11-24 08:53:21.944122 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2025-11-24 08:53:21.944137 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2025-11-24 08:53:21.944151 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2025-11-24 08:53:21.944165 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2025-11-24 08:53:21.944178 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2025-11-24 08:53:21.944191 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2025-11-24 08:53:21.944205 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2025-11-24 08:53:21.944220 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2025-11-24 08:53:21.944239 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-11-24 08:53:21.944253 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-11-24 08:53:21.944269 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-11-24 08:53:21.944284 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-11-24 08:53:21.944297 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2025-11-24 08:53:21.944311 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-11-24 08:53:21.944325 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-11-24 08:53:21.944339 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-11-24 08:53:21.944353 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-11-24 08:53:21.944367 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-11-24 08:53:21.944396 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-11-24 08:53:21.944418 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-11-24 08:53:21.944435 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2025-11-24 08:53:21.944451 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-11-24 08:53:21.944466 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-11-24 08:53:21.944480 | controller | cd+++++++++ registries.conf.d/ 2025-11-24 08:53:21.944495 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-11-24 08:53:21.944509 | controller | cd+++++++++ system-config/ 2025-11-24 08:53:21.944522 | controller | cd+++++++++ system-config/libvirt/ 2025-11-24 08:53:21.944536 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-11-24 08:53:21.944549 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-11-24 08:53:21.944563 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-11-24 08:53:21.944576 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-11-24 08:53:21.944590 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-11-24 08:53:21.944604 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-11-24 08:53:21.944618 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-11-24 08:53:21.944631 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-11-24 08:53:21.944645 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-11-24 08:53:21.944658 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-11-24 08:53:21.944671 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-11-24 08:53:21.944685 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-11-24 08:53:21.944699 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-11-24 08:53:21.944713 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-11-24 08:53:21.944727 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-11-24 08:53:21.944740 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-11-24 08:53:22.407655 | controller | changed: .d..t...... ./ 2025-11-24 08:53:22.843541 | controller | changed: .d..t...... ./ 2025-11-24 08:53:22.862488 | 2025-11-24 08:53:22.862623 | TASK [Return artifact to Zuul] 2025-11-24 08:53:22.891365 | controller | ok 2025-11-24 08:53:22.909404 | 2025-11-24 08:53:22.909462 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-11-24 08:53:22.909559 | 2025-11-24 08:53:22.909589 | PLAY RECAP 2025-11-24 08:53:22.909630 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-11-24 08:53:22.909653 | 2025-11-24 08:53:22.985615 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-11-24 08:53:22.986329 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-11-24 08:53:23.489154 | 2025-11-24 08:53:23.489249 | PLAY [all] 2025-11-24 08:53:23.507201 | 2025-11-24 08:53:23.507271 | TASK [include_role : fetch-output] 2025-11-24 08:53:23.535372 | controller | ok 2025-11-24 08:53:23.551753 | 2025-11-24 08:53:23.551830 | TASK [fetch-output : Set log path for multiple nodes] 2025-11-24 08:53:23.588977 | controller | skipping: Conditional result was False 2025-11-24 08:53:23.594653 | 2025-11-24 08:53:23.594721 | TASK [fetch-output : Set log path for single node] 2025-11-24 08:53:23.622520 | controller | ok 2025-11-24 08:53:23.627336 | 2025-11-24 08:53:23.627431 | LOOP [fetch-output : Ensure local output dirs] 2025-11-24 08:53:23.947979 | controller -> localhost | ok: "/var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/logs" 2025-11-24 08:53:24.155542 | controller -> localhost | ok: "/var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/artifacts" 2025-11-24 08:53:24.335763 | controller -> localhost | ok: "/var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/docs" 2025-11-24 08:53:24.346526 | 2025-11-24 08:53:24.346626 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-11-24 08:53:24.929847 | controller | ok 2025-11-24 08:53:24.930046 | controller | ok: All items complete 2025-11-24 08:53:24.930078 | 2025-11-24 08:53:25.374429 | controller | ok 2025-11-24 08:53:25.804798 | controller | ok 2025-11-24 08:53:25.819504 | 2025-11-24 08:53:25.819571 | TASK [include_role : fetch-output-openshift] 2025-11-24 08:53:25.833220 | controller | skipping: Conditional result was False 2025-11-24 08:53:25.838692 | 2025-11-24 08:53:25.838758 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-11-24 08:53:26.170142 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006171 2025-11-24 08:53:26.364443 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006037 2025-11-24 08:53:26.393239 | 2025-11-24 08:53:26.393304 | PLAY [all] 2025-11-24 08:53:26.406914 | 2025-11-24 08:53:26.406982 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-11-24 08:53:26.852230 | controller | changed 2025-11-24 08:53:26.873728 | 2025-11-24 08:53:26.873781 | PLAY RECAP 2025-11-24 08:53:26.873825 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-11-24 08:53:26.873849 | 2025-11-24 08:53:26.938403 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-11-24 08:53:26.939101 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-11-24 08:53:27.484658 | 2025-11-24 08:53:27.484797 | PLAY [localhost] 2025-11-24 08:53:27.503883 | 2025-11-24 08:53:27.504008 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-11-24 08:53:27.804790 | localhost | changed 2025-11-24 08:53:27.809276 | 2025-11-24 08:53:27.809352 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-11-24 08:53:27.826865 | localhost | ok 2025-11-24 08:53:27.834485 | 2025-11-24 08:53:27.834553 | TASK [add-fileserver : Create SSH private key tempfile] 2025-11-24 08:53:28.125712 | localhost | changed 2025-11-24 08:53:28.131142 | 2025-11-24 08:53:28.131210 | TASK [add-fileserver : Create SSH private key from secret] 2025-11-24 08:53:28.664011 | localhost | changed 2025-11-24 08:53:28.668835 | 2025-11-24 08:53:28.668901 | TASK [add-fileserver : Add fileserver ssh key] 2025-11-24 08:53:28.990823 | localhost | Identity added: /var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/tmp/ansible.f6bknudz (/var/lib/zuul/builds/2f211890a52f4c8593fc0ced0988b7a8/work/tmp/ansible.f6bknudz) 2025-11-24 08:53:28.990985 | localhost | ok: Runtime: 0:00:00.005942 2025-11-24 08:53:28.995135 | 2025-11-24 08:53:28.995203 | TASK [add-fileserver : Remove SSH private key from disk] 2025-11-24 08:53:29.204699 | localhost | ok: Runtime: 0:00:00.004069 2025-11-24 08:53:29.209166 | 2025-11-24 08:53:29.209231 | TASK [add-fileserver : Add fileserver to inventory] 2025-11-24 08:53:29.256450 | localhost | changed 2025-11-24 08:53:29.261354 | 2025-11-24 08:53:29.261437 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-11-24 08:53:29.563684 | localhost | changed 2025-11-24 08:53:29.582577 | 2025-11-24 08:53:29.582634 | PLAY [localhost] 2025-11-24 08:53:29.593650 | 2025-11-24 08:53:29.593712 | TASK [Generate bulk log download script] 2025-11-24 08:53:29.611442 | localhost | ok 2025-11-24 08:53:29.622329 | 2025-11-24 08:53:29.622411 | TASK [local-log-download : Check API endpoint is defined] 2025-11-24 08:53:29.649322 | localhost | ok: All assertions passed 2025-11-24 08:53:29.653588 | 2025-11-24 08:53:29.653652 | TASK [local-log-download : Create download script] 2025-11-24 08:53:29.992574 | localhost -> localhost | changed 2025-11-24 08:53:30.000888 | 2025-11-24 08:53:30.000951 | TASK [Register quick-download link] 2025-11-24 08:53:30.016989 | localhost | ok 2025-11-24 08:53:30.047370 | 2025-11-24 08:53:30.047450 | PLAY [logserver.rdoproject.org] 2025-11-24 08:53:30.056665 | 2025-11-24 08:53:30.056722 | TASK [Set zuul-log-path fact] 2025-11-24 08:53:30.071673 | logserver.rdoproject.org | ok 2025-11-24 08:53:30.080208 | 2025-11-24 08:53:30.080276 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-11-24 08:53:30.105882 | logserver.rdoproject.org | ok 2025-11-24 08:53:30.111006 | 2025-11-24 08:53:30.111080 | TASK [upload-logs : Create log directories] 2025-11-24 08:53:32.042195 | logserver.rdoproject.org | changed 2025-11-24 08:53:32.045298 | 2025-11-24 08:53:32.045365 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-11-24 08:53:32.260892 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004880 2025-11-24 08:53:32.266378 | 2025-11-24 08:53:32.266482 | TASK [upload-logs : Upload logs to log server] 2025-11-24 08:53:33.995628 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-11-24 08:53:33.998479 | 2025-11-24 08:53:33.998543 | LOOP [upload-logs : Compress console log and json output] 2025-11-24 08:53:34.034316 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-24 08:53:34.043175 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-24 08:53:34.055072 | 2025-11-24 08:53:34.055140 | LOOP [upload-logs : Upload compressed console log and json output] 2025-11-24 08:53:34.089192 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-24 08:53:34.089498 | 2025-11-24 08:53:34.092803 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-24 08:53:34.101990 | 2025-11-24 08:53:34.102074 | LOOP [upload-logs : Upload console log and json output]