2025-12-03 11:16:48.928562 | Job console starting... 2025-12-03 11:16:49.152975 | Updating repositories 2025-12-03 11:16:50.043182 | Preparing job workspace 2025-12-03 11:17:10.497561 | Running Ansible setup... 2025-12-03 11:17:20.370781 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-03 11:17:23.411647 | 2025-12-03 11:17:23.411802 | PLAY [localhost] 2025-12-03 11:17:23.481947 | 2025-12-03 11:17:23.482068 | TASK [Gathering Facts] 2025-12-03 11:17:26.914111 | localhost | ok 2025-12-03 11:17:26.949075 | 2025-12-03 11:17:26.949224 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-12-03 11:17:28.605274 | localhost -> localhost | changed 2025-12-03 11:17:28.616644 | 2025-12-03 11:17:28.616764 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-12-03 11:17:31.121908 | localhost -> localhost | changed 2025-12-03 11:17:31.137287 | 2025-12-03 11:17:31.137442 | TASK [Setup log path fact] 2025-12-03 11:17:31.179459 | localhost | ok 2025-12-03 11:17:31.204882 | 2025-12-03 11:17:31.204968 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-03 11:17:31.283384 | localhost | ok 2025-12-03 11:17:31.314581 | 2025-12-03 11:17:31.314672 | TASK [emit-job-header : Print job information] 2025-12-03 11:17:31.421165 | # Job Information 2025-12-03 11:17:31.421355 | Ansible Version: 2.15.12 2025-12-03 11:17:31.421387 | Job: cifmw-molecule-reproducer 2025-12-03 11:17:31.421410 | Pipeline: github-check 2025-12-03 11:17:31.421430 | Executor: ibm-bm3-ze.softwarefactory-project.io 2025-12-03 11:17:31.421450 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3451 2025-12-03 11:17:31.421471 | Log URL (when completed): https://logserver.rdoproject.org/f39/rdoproject.org/f3934d13a4b54a848e5c6ab9f4d622ee/ 2025-12-03 11:17:31.421491 | Event ID: 4ab514e0-d039-11f0-81e0-fb882bdc02c6 2025-12-03 11:17:31.425168 | 2025-12-03 11:17:31.425234 | LOOP [emit-job-header : Print node information] 2025-12-03 11:17:31.628251 | localhost | ok: 2025-12-03 11:17:31.628525 | localhost | # Node Information 2025-12-03 11:17:31.628557 | localhost | Inventory Hostname: controller 2025-12-03 11:17:31.628581 | localhost | Hostname: np0005543747 2025-12-03 11:17:31.628602 | localhost | Username: zuul 2025-12-03 11:17:31.628622 | localhost | Distro: CentOS 9 2025-12-03 11:17:31.628641 | localhost | Provider: ibm-bm3-nodepool 2025-12-03 11:17:31.628659 | localhost | Region: regionOne 2025-12-03 11:17:31.628686 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-12-03 11:17:31.628739 | localhost | Product Name: OpenStack Compute 2025-12-03 11:17:31.628762 | localhost | Interface IP: 192.168.25.216 2025-12-03 11:17:31.672352 | 2025-12-03 11:17:31.672455 | PLAY [all] 2025-12-03 11:17:31.691854 | 2025-12-03 11:17:31.691927 | TASK [Gather network facts] 2025-12-03 11:17:32.166653 | controller | ok 2025-12-03 11:17:32.209624 | 2025-12-03 11:17:32.209739 | TASK [include_role : start-zuul-console] 2025-12-03 11:17:32.272807 | controller | ok 2025-12-03 11:17:32.301877 | 2025-12-03 11:17:32.301979 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-12-03 11:17:32.824996 | controller | ok 2025-12-03 11:17:32.844626 | 2025-12-03 11:17:32.844741 | TASK [include_role : add-build-sshkey] 2025-12-03 11:17:32.911039 | controller | ok 2025-12-03 11:17:32.936605 | 2025-12-03 11:17:32.936728 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-12-03 11:17:33.526513 | controller -> localhost | ok 2025-12-03 11:17:33.532617 | 2025-12-03 11:17:33.532685 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-12-03 11:17:33.591824 | controller | ok 2025-12-03 11:17:33.631392 | controller | included: /var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-12-03 11:17:33.648505 | 2025-12-03 11:17:33.648595 | TASK [add-build-sshkey : Create Temp SSH key] 2025-12-03 11:17:35.079183 | controller -> localhost | Generating public/private rsa key pair. 2025-12-03 11:17:35.079398 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/f3934d13a4b54a848e5c6ab9f4d622ee_id_rsa. 2025-12-03 11:17:35.079433 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/f3934d13a4b54a848e5c6ab9f4d622ee_id_rsa.pub. 2025-12-03 11:17:35.079458 | controller -> localhost | The key fingerprint is: 2025-12-03 11:17:35.079481 | controller -> localhost | SHA256:ek3MH8R8BC8BJLlKe869IpK/CxPHJyCIDFVKrnBaGgc zuul-build-sshkey 2025-12-03 11:17:35.079502 | controller -> localhost | The key's randomart image is: 2025-12-03 11:17:35.079522 | controller -> localhost | +---[RSA 3072]----+ 2025-12-03 11:17:35.079541 | controller -> localhost | |E.o.. .oo.o.. | 2025-12-03 11:17:35.079562 | controller -> localhost | |+= . .. o + | 2025-12-03 11:17:35.079582 | controller -> localhost | |=.B . . = o | 2025-12-03 11:17:35.079602 | controller -> localhost | |.O . o. .o . o | 2025-12-03 11:17:35.079621 | controller -> localhost | |+ ..+oS + . | 2025-12-03 11:17:35.079640 | controller -> localhost | | oo+.o . . | 2025-12-03 11:17:35.079661 | controller -> localhost | | o..+... . | 2025-12-03 11:17:35.079709 | controller -> localhost | | oo..+ . | 2025-12-03 11:17:35.079740 | controller -> localhost | | o++ ... | 2025-12-03 11:17:35.079762 | controller -> localhost | +----[SHA256]-----+ 2025-12-03 11:17:35.079811 | controller -> localhost | ok: Runtime: 0:00:00.335596 2025-12-03 11:17:35.087621 | 2025-12-03 11:17:35.087686 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-12-03 11:17:35.140096 | controller | ok 2025-12-03 11:17:35.159033 | controller | included: /var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-12-03 11:17:35.219117 | 2025-12-03 11:17:35.219224 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-12-03 11:17:35.255412 | controller | skipping: Conditional result was False 2025-12-03 11:17:35.261597 | 2025-12-03 11:17:35.261667 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-12-03 11:17:36.050134 | controller | changed 2025-12-03 11:17:36.055525 | 2025-12-03 11:17:36.055600 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-12-03 11:17:36.378201 | controller | ok 2025-12-03 11:17:36.384139 | 2025-12-03 11:17:36.384214 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-12-03 11:17:37.698444 | controller | changed 2025-12-03 11:17:37.705029 | 2025-12-03 11:17:37.705102 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-12-03 11:17:38.972290 | controller | changed 2025-12-03 11:17:38.977209 | 2025-12-03 11:17:38.977272 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-12-03 11:17:39.067505 | controller | skipping: Conditional result was False 2025-12-03 11:17:39.074468 | 2025-12-03 11:17:39.074559 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-12-03 11:17:40.366922 | controller -> localhost | changed 2025-12-03 11:17:40.377426 | 2025-12-03 11:17:40.377494 | TASK [add-build-sshkey : Add back temp key] 2025-12-03 11:17:41.236097 | controller -> localhost | Identity added: /var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/f3934d13a4b54a848e5c6ab9f4d622ee_id_rsa (zuul-build-sshkey) 2025-12-03 11:17:41.236761 | controller -> localhost | ok: Runtime: 0:00:00.029640 2025-12-03 11:17:41.242707 | 2025-12-03 11:17:41.242774 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-12-03 11:17:41.811906 | controller | ok 2025-12-03 11:17:41.822079 | 2025-12-03 11:17:41.822155 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-12-03 11:17:41.905502 | controller | skipping: Conditional result was False 2025-12-03 11:17:41.915541 | 2025-12-03 11:17:41.915608 | TASK [include_role : validate-host] 2025-12-03 11:17:41.970253 | controller | ok 2025-12-03 11:17:42.017588 | 2025-12-03 11:17:42.017734 | TASK [validate-host : Define zuul_info_dir fact] 2025-12-03 11:17:42.056615 | controller | ok 2025-12-03 11:17:42.062232 | 2025-12-03 11:17:42.062298 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-12-03 11:17:42.385580 | controller -> localhost | ok 2025-12-03 11:17:42.392145 | 2025-12-03 11:17:42.392234 | TASK [validate-host : Collect information about the host] 2025-12-03 11:17:43.099192 | controller | ok 2025-12-03 11:17:43.140492 | 2025-12-03 11:17:43.140619 | TASK [validate-host : Sanitize hostname] 2025-12-03 11:17:43.199898 | controller | ok 2025-12-03 11:17:43.204921 | 2025-12-03 11:17:43.204984 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-12-03 11:17:43.863511 | controller -> localhost | changed 2025-12-03 11:17:43.869413 | 2025-12-03 11:17:43.869487 | TASK [validate-host : Collect information about zuul worker] 2025-12-03 11:17:44.365209 | controller | ok 2025-12-03 11:17:44.370625 | 2025-12-03 11:17:44.370737 | TASK [validate-host : Write out all zuul information for each host] 2025-12-03 11:17:45.136474 | controller -> localhost | changed 2025-12-03 11:17:45.145830 | 2025-12-03 11:17:45.145901 | TASK [include_role : prepare-workspace-openshift] 2025-12-03 11:17:45.196853 | controller | skipping: Conditional result was False 2025-12-03 11:17:45.202599 | 2025-12-03 11:17:45.202680 | TASK [include_role : remove-zuul-sshkey] 2025-12-03 11:17:45.256571 | controller | skipping: Conditional result was False 2025-12-03 11:17:45.262830 | 2025-12-03 11:17:45.262917 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-12-03 11:17:45.602090 | controller | ok: "logs" 2025-12-03 11:17:45.602320 | controller | ok: All items complete 2025-12-03 11:17:45.602367 | 2025-12-03 11:17:45.860624 | controller | ok: "artifacts" 2025-12-03 11:17:46.120831 | controller | ok: "docs" 2025-12-03 11:17:46.129507 | 2025-12-03 11:17:46.129629 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-12-03 11:17:46.472826 | controller | changed: "logs" 2025-12-03 11:17:46.717634 | controller | changed: "artifacts" 2025-12-03 11:17:46.967563 | controller | changed: "docs" 2025-12-03 11:17:47.021164 | 2025-12-03 11:17:47.021246 | PLAY RECAP 2025-12-03 11:17:47.021292 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-03 11:17:47.021323 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-03 11:17:47.021358 | 2025-12-03 11:17:47.259567 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-03 11:17:47.260282 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-03 11:17:48.214508 | 2025-12-03 11:17:48.214610 | PLAY [all] 2025-12-03 11:17:48.241113 | 2025-12-03 11:17:48.241220 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-03 11:17:48.341645 | controller | ok 2025-12-03 11:17:48.347776 | 2025-12-03 11:17:48.347883 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-03 11:17:48.824398 | controller | changed 2025-12-03 11:17:48.829919 | 2025-12-03 11:17:48.829996 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-03 11:17:50.644574 | controller | changed 2025-12-03 11:17:50.655004 | 2025-12-03 11:17:50.655083 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-12-03 11:17:51.152216 | controller | changed: 2025-12-03 11:17:51.152588 | controller | { 2025-12-03 11:17:51.152631 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-12-03 11:17:51.152666 | controller | } 2025-12-03 11:17:51.446475 | controller | changed: 2025-12-03 11:17:51.446918 | controller | { 2025-12-03 11:17:51.446966 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-12-03 11:17:51.446993 | controller | } 2025-12-03 11:17:51.745151 | controller | changed: 2025-12-03 11:17:51.745232 | controller | { 2025-12-03 11:17:51.745265 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-12-03 11:17:51.745288 | controller | } 2025-12-03 11:17:52.072032 | controller | changed: 2025-12-03 11:17:52.072129 | controller | { 2025-12-03 11:17:52.072158 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-12-03 11:17:52.072180 | controller | } 2025-12-03 11:17:52.342521 | controller | changed: 2025-12-03 11:17:52.342893 | controller | { 2025-12-03 11:17:52.342940 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-12-03 11:17:52.342962 | controller | } 2025-12-03 11:17:52.641584 | controller | changed: 2025-12-03 11:17:52.641670 | controller | { 2025-12-03 11:17:52.641722 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-12-03 11:17:52.641750 | controller | } 2025-12-03 11:17:52.932788 | controller | changed: 2025-12-03 11:17:52.932877 | controller | { 2025-12-03 11:17:52.932906 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-12-03 11:17:52.932929 | controller | } 2025-12-03 11:17:53.243428 | controller | changed: 2025-12-03 11:17:53.243515 | controller | { 2025-12-03 11:17:53.243544 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-12-03 11:17:53.243566 | controller | } 2025-12-03 11:17:53.589937 | controller | changed: 2025-12-03 11:17:53.590184 | controller | { 2025-12-03 11:17:53.590250 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-12-03 11:17:53.590282 | controller | } 2025-12-03 11:17:53.824393 | controller | changed: 2025-12-03 11:17:53.824585 | controller | { 2025-12-03 11:17:53.824626 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-12-03 11:17:53.824650 | controller | } 2025-12-03 11:17:54.122043 | controller | changed: 2025-12-03 11:17:54.122134 | controller | { 2025-12-03 11:17:54.122161 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-12-03 11:17:54.122181 | controller | } 2025-12-03 11:17:54.434809 | controller | changed: 2025-12-03 11:17:54.434925 | controller | { 2025-12-03 11:17:54.434956 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-12-03 11:17:54.434984 | controller | } 2025-12-03 11:17:54.722659 | controller | changed: 2025-12-03 11:17:54.722773 | controller | { 2025-12-03 11:17:54.722802 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-12-03 11:17:54.722823 | controller | } 2025-12-03 11:17:55.034756 | controller | changed: 2025-12-03 11:17:55.034838 | controller | { 2025-12-03 11:17:55.034868 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-12-03 11:17:55.034889 | controller | } 2025-12-03 11:17:55.321115 | controller | changed: 2025-12-03 11:17:55.321224 | controller | { 2025-12-03 11:17:55.321254 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-12-03 11:17:55.321277 | controller | } 2025-12-03 11:17:55.630624 | controller | changed: 2025-12-03 11:17:55.630750 | controller | { 2025-12-03 11:17:55.630781 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-12-03 11:17:55.630802 | controller | } 2025-12-03 11:17:55.919417 | controller | changed: 2025-12-03 11:17:55.919528 | controller | { 2025-12-03 11:17:55.919557 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-12-03 11:17:55.919581 | controller | } 2025-12-03 11:17:56.196324 | controller | changed: 2025-12-03 11:17:56.196437 | controller | { 2025-12-03 11:17:56.196466 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-12-03 11:17:56.196586 | controller | } 2025-12-03 11:17:56.484158 | controller | changed: 2025-12-03 11:17:56.484258 | controller | { 2025-12-03 11:17:56.484285 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-12-03 11:17:56.484305 | controller | } 2025-12-03 11:17:56.775547 | controller | changed: 2025-12-03 11:17:56.775641 | controller | { 2025-12-03 11:17:56.775668 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-12-03 11:17:56.775689 | controller | } 2025-12-03 11:17:57.088868 | controller | changed: 2025-12-03 11:17:57.088962 | controller | { 2025-12-03 11:17:57.088991 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-12-03 11:17:57.089013 | controller | } 2025-12-03 11:17:57.377578 | controller | changed: 2025-12-03 11:17:57.377678 | controller | { 2025-12-03 11:17:57.377785 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-12-03 11:17:57.377812 | controller | } 2025-12-03 11:17:57.676208 | controller | changed: 2025-12-03 11:17:57.676299 | controller | { 2025-12-03 11:17:57.676337 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-12-03 11:17:57.676364 | controller | } 2025-12-03 11:17:57.986454 | controller | changed: 2025-12-03 11:17:57.986547 | controller | { 2025-12-03 11:17:57.986576 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-12-03 11:17:57.986678 | controller | } 2025-12-03 11:17:58.272208 | controller | changed: 2025-12-03 11:17:58.272309 | controller | { 2025-12-03 11:17:58.272367 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-12-03 11:17:58.272390 | controller | } 2025-12-03 11:17:58.560068 | controller | changed: 2025-12-03 11:17:58.560166 | controller | { 2025-12-03 11:17:58.560194 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-12-03 11:17:58.560216 | controller | } 2025-12-03 11:17:58.580802 | 2025-12-03 11:17:58.580891 | TASK [Set timezone to UTC] 2025-12-03 11:17:59.098800 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-12-03 11:17:59.104932 | 2025-12-03 11:17:59.105029 | TASK [Create nodepool directory] 2025-12-03 11:17:59.371103 | controller | changed 2025-12-03 11:17:59.378678 | 2025-12-03 11:17:59.378789 | TASK [Create nodepool sub_nodes file] 2025-12-03 11:18:00.321845 | controller | changed 2025-12-03 11:18:00.327686 | 2025-12-03 11:18:00.327795 | TASK [Create nodepool sub_nodes_private file] 2025-12-03 11:18:01.307221 | controller | changed 2025-12-03 11:18:01.313527 | 2025-12-03 11:18:01.313963 | LOOP [Populate nodepool sub_nodes file] 2025-12-03 11:18:01.356664 | 2025-12-03 11:18:01.356830 | LOOP [Populate nodepool sub_nodes_private file] 2025-12-03 11:18:01.386538 | 2025-12-03 11:18:01.386811 | TASK [Create nodepool primary file] 2025-12-03 11:18:01.411224 | controller | skipping: Conditional result was False 2025-12-03 11:18:01.417174 | 2025-12-03 11:18:01.417253 | TASK [Create nodepool node_private for this node] 2025-12-03 11:18:02.550774 | controller | changed 2025-12-03 11:18:02.556538 | 2025-12-03 11:18:02.556602 | LOOP [Copy ssh keys to nodepool directory] 2025-12-03 11:18:02.989448 | controller | ok: Item: id_rsa Runtime: 0:00:00.005435 2025-12-03 11:18:02.989651 | 2025-12-03 11:18:03.224790 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004883 2025-12-03 11:18:03.246041 | 2025-12-03 11:18:03.246121 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-12-03 11:18:04.321514 | controller | changed 2025-12-03 11:18:04.326947 | 2025-12-03 11:18:04.327041 | TASK [Validate sudoers config after edits] 2025-12-03 11:18:04.614096 | controller | /etc/sudoers: parsed OK 2025-12-03 11:18:04.614176 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-12-03 11:18:04.614187 | controller | /etc/sudoers.d/zuul: parsed OK 2025-12-03 11:18:04.614193 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-12-03 11:18:04.856002 | controller | ok: Runtime: 0:00:00.005558 2025-12-03 11:18:04.862084 | 2025-12-03 11:18:04.862157 | TASK [Show the environment passed in to job shell scripts] 2025-12-03 11:18:05.128601 | controller | SHELL=/bin/bash 2025-12-03 11:18:05.128656 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-12-03 11:18:05.128677 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-12-03 11:18:05.128723 | controller | ZUUL_CHANGES=rdo-jobs:master:refs/changes/88/58488/1^openstack-k8s-operators/ci-framework:main:refs/changes/51/3451/2261ed433b240c3ce81443dcd27657d36bfed699 2025-12-03 11:18:05.128735 | controller | PWD=/home/zuul 2025-12-03 11:18:05.128753 | controller | ZUUL_PIPELINE=github-check 2025-12-03 11:18:05.128758 | controller | LOGNAME=zuul 2025-12-03 11:18:05.128764 | controller | XDG_SESSION_TYPE=tty 2025-12-03 11:18:05.128769 | controller | _=/usr/bin/env 2025-12-03 11:18:05.128774 | controller | MOTD_SHOWN=pam 2025-12-03 11:18:05.128780 | controller | HOME=/home/zuul 2025-12-03 11:18:05.128785 | controller | LANG=en_US.UTF-8 2025-12-03 11:18:05.128790 | controller | SSH_CONNECTION=192.168.25.12 45264 192.168.25.216 22 2025-12-03 11:18:05.128796 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-12-03 11:18:05.128803 | controller | ZUUL_CHANGE_IDS=58488,1 3451,2261ed433b240c3ce81443dcd27657d36bfed699 2025-12-03 11:18:05.128809 | controller | WORKSPACE=/home/zuul/workspace 2025-12-03 11:18:05.128815 | controller | XDG_SESSION_CLASS=user 2025-12-03 11:18:05.128820 | controller | SELINUX_ROLE_REQUESTED= 2025-12-03 11:18:05.128825 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-12-03 11:18:05.128831 | controller | USER=zuul 2025-12-03 11:18:05.128836 | controller | ZUUL_VOTING=True 2025-12-03 11:18:05.128842 | controller | BUILD_TIMEOUT=5400000 2025-12-03 11:18:05.128847 | controller | SELINUX_USE_CURRENT_RANGE= 2025-12-03 11:18:05.128852 | controller | SHLVL=1 2025-12-03 11:18:05.128858 | controller | ZUUL_PATCHSET=2261ed433b240c3ce81443dcd27657d36bfed699 2025-12-03 11:18:05.128863 | controller | XDG_SESSION_ID=1 2025-12-03 11:18:05.128869 | controller | ZUUL_BRANCH=main 2025-12-03 11:18:05.128874 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-12-03 11:18:05.128879 | controller | SSH_CLIENT=192.168.25.12 45264 22 2025-12-03 11:18:05.128886 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-12-03 11:18:05.128891 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-12-03 11:18:05.128898 | controller | which_declare=declare -f 2025-12-03 11:18:05.128905 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-12-03 11:18:05.128910 | controller | SELINUX_LEVEL_REQUESTED= 2025-12-03 11:18:05.128915 | controller | ZUUL_CHANGE=3451 2025-12-03 11:18:05.128921 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-12-03 11:18:05.128926 | controller | ZUUL_UUID=f3934d13a4b54a848e5c6ab9f4d622ee 2025-12-03 11:18:05.128931 | controller | BASH_FUNC_which%%=() { ( alias; 2025-12-03 11:18:05.128937 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-12-03 11:18:05.128942 | controller | } 2025-12-03 11:18:05.390449 | controller | ok: Runtime: 0:00:00.005725 2025-12-03 11:18:05.396839 | 2025-12-03 11:18:05.396951 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-12-03 11:18:05.421433 | controller | skipping: Conditional result was False 2025-12-03 11:18:05.427689 | 2025-12-03 11:18:05.427807 | TASK [Symlink /home/zuul-worker/workspace] 2025-12-03 11:18:05.991159 | controller | skipping: Conditional result was False 2025-12-03 11:18:05.997356 | 2025-12-03 11:18:05.997434 | TASK [Ensure legacy workspace directory] 2025-12-03 11:18:06.290397 | controller | changed 2025-12-03 11:18:06.308960 | 2025-12-03 11:18:06.309056 | PLAY RECAP 2025-12-03 11:18:06.309107 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-03 11:18:06.309129 | 2025-12-03 11:18:06.417021 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-03 11:18:06.417743 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-03 11:18:06.958075 | 2025-12-03 11:18:06.958173 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-12-03 11:18:06.979744 | 2025-12-03 11:18:06.979822 | TASK [Create zuul-output directory] 2025-12-03 11:18:07.435171 | controller | changed 2025-12-03 11:18:07.441638 | 2025-12-03 11:18:07.441854 | TASK [Slurp Zuul inventory test] 2025-12-03 11:18:07.790643 | controller -> localhost | ok 2025-12-03 11:18:07.798106 | 2025-12-03 11:18:07.798189 | TASK [Save zuul inventory] 2025-12-03 11:18:08.994825 | controller | changed 2025-12-03 11:18:09.001211 | 2025-12-03 11:18:09.001280 | TASK [Save zuul vars without the change_message] 2025-12-03 11:18:10.024583 | controller | changed 2025-12-03 11:18:10.043300 | 2025-12-03 11:18:10.043386 | PLAY RECAP 2025-12-03 11:18:10.043498 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-03 11:18:10.043611 | 2025-12-03 11:18:10.130519 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-03 11:18:10.131255 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-03 11:18:10.693480 | 2025-12-03 11:18:10.693569 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-12-03 11:18:10.713963 | 2025-12-03 11:18:10.714035 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-12-03 11:18:10.743059 | controller | ok 2025-12-03 11:18:10.759710 | 2025-12-03 11:18:10.759800 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-03 11:18:10.783298 | controller | skipping: Conditional result was False 2025-12-03 11:18:10.789563 | 2025-12-03 11:18:10.789640 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-03 11:18:11.209891 | controller | ok 2025-12-03 11:18:11.216010 | 2025-12-03 11:18:11.216129 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-03 11:18:12.184627 | controller | ok 2025-12-03 11:18:12.194643 | 2025-12-03 11:18:12.194751 | TASK [Prepare workspace] 2025-12-03 11:18:12.214278 | controller | ok 2025-12-03 11:18:12.231545 | 2025-12-03 11:18:12.231617 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-12-03 11:18:12.673477 | controller | ok 2025-12-03 11:18:12.681092 | 2025-12-03 11:18:12.681209 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-12-03 11:18:15.373276 | controller | Output suppressed because no_log was given 2025-12-03 11:18:15.382019 | 2025-12-03 11:18:15.382080 | LOOP [Create zuul-output directory] 2025-12-03 11:18:15.633620 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-12-03 11:18:15.849785 | controller | ok: "/home/zuul/zuul-output/logs" 2025-12-03 11:18:15.859322 | 2025-12-03 11:18:15.859457 | TASK [Install required packages] 2025-12-03 11:18:49.038324 | controller | ok: Nothing to do 2025-12-03 11:18:49.044468 | 2025-12-03 11:18:49.044561 | TASK [Install venv] 2025-12-03 11:19:57.896778 | controller | changed 2025-12-03 11:19:57.948571 | 2025-12-03 11:19:57.948662 | PLAY RECAP 2025-12-03 11:19:57.948739 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-03 11:19:57.948769 | 2025-12-03 11:19:58.034518 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-03 11:19:58.035318 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-03 11:19:58.590368 | 2025-12-03 11:19:58.590468 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-12-03 11:19:58.612142 | 2025-12-03 11:19:58.612227 | TASK [Gather required facts] 2025-12-03 11:19:59.180269 | controller | ok 2025-12-03 11:19:59.186028 | 2025-12-03 11:19:59.186125 | TASK [Load environment var if instructed to] 2025-12-03 11:19:59.210188 | controller | skipping: Conditional result was False 2025-12-03 11:19:59.216037 | 2025-12-03 11:19:59.216114 | TASK [Ensure group_vars dir exists] 2025-12-03 11:19:59.580769 | controller | ok 2025-12-03 11:19:59.585967 | 2025-12-03 11:19:59.586046 | TASK [Print related variables] 2025-12-03 11:19:59.614560 | controller | ok: 2025-12-03 11:19:59.614676 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2025-12-03 11:19:59.614735 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2025-12-03 11:19:59.619773 | 2025-12-03 11:19:59.619837 | TASK [Run molecule] 2025-12-03 11:20:00.642307 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-12-03 11:20:00.931486 | controller | INFO Performing prerun with role_name_check=0... 2025-12-03 11:20:17.387225 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.387708 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.388161 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.388648 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.389123 | controller | WARNING Another version of 'cifmw.general' 1.0.0+2261ed43 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+2261ed43 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.389602 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.390043 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.390474 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.390958 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.391394 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.391891 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.392330 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.392804 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.393232 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.393719 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 11:20:17.403321 | controller | INFO Running crc_layout > prepare 2025-12-03 11:20:18.087482 | controller | 2025-12-03 11:20:18.087587 | controller | PLAY [Prepare] ***************************************************************** 2025-12-03 11:20:18.087693 | controller | 2025-12-03 11:20:18.087799 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-03 11:20:18.087918 | controller | Wednesday 03 December 2025 11:20:18 +0000 (0:00:00.019) 0:00:00.019 **** 2025-12-03 11:20:18.917003 | controller | ok: [instance] 2025-12-03 11:20:18.917095 | controller | 2025-12-03 11:20:18.917226 | controller | TASK [Create custom basedir] *************************************************** 2025-12-03 11:20:18.917353 | controller | Wednesday 03 December 2025 11:20:18 +0000 (0:00:00.830) 0:00:00.849 **** 2025-12-03 11:20:19.222658 | controller | changed: [instance] 2025-12-03 11:20:19.222730 | controller | 2025-12-03 11:20:19.222836 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-12-03 11:20:19.222957 | controller | Wednesday 03 December 2025 11:20:19 +0000 (0:00:00.305) 0:00:01.155 **** 2025-12-03 11:20:19.239257 | controller | skipping: [instance] 2025-12-03 11:20:19.239367 | controller | 2025-12-03 11:20:19.239494 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-12-03 11:20:19.239657 | controller | Wednesday 03 December 2025 11:20:19 +0000 (0:00:00.016) 0:00:01.171 **** 2025-12-03 11:20:19.280834 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-12-03 11:20:19.280946 | controller | 2025-12-03 11:20:19.281097 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-12-03 11:20:19.281203 | controller | Wednesday 03 December 2025 11:20:19 +0000 (0:00:00.041) 0:00:01.213 **** 2025-12-03 11:20:19.557494 | controller | ok: [instance] 2025-12-03 11:20:19.557561 | controller | 2025-12-03 11:20:19.557684 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-12-03 11:20:19.557783 | controller | Wednesday 03 December 2025 11:20:19 +0000 (0:00:00.276) 0:00:01.490 **** 2025-12-03 11:20:19.761947 | controller | ok: [instance] 2025-12-03 11:20:19.761988 | controller | 2025-12-03 11:20:19.762099 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-12-03 11:20:19.762195 | controller | Wednesday 03 December 2025 11:20:19 +0000 (0:00:00.204) 0:00:01.694 **** 2025-12-03 11:20:20.457770 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-12-03 11:20:20.457826 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-12-03 11:20:20.458218 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-12-03 11:20:20.515466 | controller | 2025-12-03 11:20:20.515487 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-12-03 11:20:20.515497 | controller | Wednesday 03 December 2025 11:20:20 +0000 (0:00:00.695) 0:00:02.390 **** 2025-12-03 11:20:20.515508 | controller | 2025-12-03 11:20:21.037636 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-03 11:20:21.037666 | controller | Wednesday 03 December 2025 11:20:20 +0000 (0:00:00.057) 0:00:02.447 **** 2025-12-03 11:20:21.037678 | controller | changed: [instance] => (item=tmp) 2025-12-03 11:20:21.867002 | controller | changed: [instance] => (item=artifacts/repositories) 2025-12-03 11:20:21.867033 | controller | changed: [instance] => (item=venv/repo_setup) 2025-12-03 11:20:21.867041 | controller | 2025-12-03 11:20:21.867047 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-03 11:20:21.867053 | controller | Wednesday 03 December 2025 11:20:21 +0000 (0:00:00.521) 0:00:02.969 **** 2025-12-03 11:20:21.867062 | controller | ok: [instance] 2025-12-03 11:20:22.887067 | controller | 2025-12-03 11:20:22.887103 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-03 11:20:22.887114 | controller | Wednesday 03 December 2025 11:20:21 +0000 (0:00:00.829) 0:00:03.799 **** 2025-12-03 11:20:22.887123 | controller | changed: [instance] 2025-12-03 11:20:30.867678 | controller | 2025-12-03 11:20:30.867718 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-03 11:20:30.867727 | controller | Wednesday 03 December 2025 11:20:22 +0000 (0:00:01.020) 0:00:04.819 **** 2025-12-03 11:20:30.867738 | controller | changed: [instance] 2025-12-03 11:20:31.548239 | controller | 2025-12-03 11:20:31.548273 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-03 11:20:31.548282 | controller | Wednesday 03 December 2025 11:20:30 +0000 (0:00:07.980) 0:00:12.799 **** 2025-12-03 11:20:31.548294 | controller | changed: [instance] 2025-12-03 11:20:31.567729 | controller | 2025-12-03 11:20:31.567775 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-03 11:20:31.567784 | controller | Wednesday 03 December 2025 11:20:31 +0000 (0:00:00.680) 0:00:13.480 **** 2025-12-03 11:20:31.567798 | controller | skipping: [instance] 2025-12-03 11:20:32.369422 | controller | 2025-12-03 11:20:32.369451 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-03 11:20:32.369459 | controller | Wednesday 03 December 2025 11:20:31 +0000 (0:00:00.019) 0:00:13.500 **** 2025-12-03 11:20:32.369469 | controller | changed: [instance] 2025-12-03 11:20:32.405632 | controller | 2025-12-03 11:20:32.405687 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-03 11:20:32.405698 | controller | Wednesday 03 December 2025 11:20:32 +0000 (0:00:00.801) 0:00:14.301 **** 2025-12-03 11:20:32.405712 | controller | skipping: [instance] 2025-12-03 11:20:32.406138 | controller | 2025-12-03 11:20:32.406169 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-03 11:20:32.442033 | controller | Wednesday 03 December 2025 11:20:32 +0000 (0:00:00.036) 0:00:14.338 **** 2025-12-03 11:20:32.442067 | controller | skipping: [instance] 2025-12-03 11:20:32.477023 | controller | 2025-12-03 11:20:32.477048 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-03 11:20:32.477057 | controller | Wednesday 03 December 2025 11:20:32 +0000 (0:00:00.036) 0:00:14.374 **** 2025-12-03 11:20:32.477068 | controller | skipping: [instance] 2025-12-03 11:20:33.003651 | controller | 2025-12-03 11:20:33.003680 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-03 11:20:33.003688 | controller | Wednesday 03 December 2025 11:20:32 +0000 (0:00:00.035) 0:00:14.409 **** 2025-12-03 11:20:33.003698 | controller | changed: [instance] 2025-12-03 11:20:33.434607 | controller | 2025-12-03 11:20:33.434638 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-03 11:20:33.434646 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.526) 0:00:14.935 **** 2025-12-03 11:20:33.434656 | controller | changed: [instance] 2025-12-03 11:20:33.434700 | controller | 2025-12-03 11:20:33.434720 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-03 11:20:33.434732 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.430) 0:00:15.366 **** 2025-12-03 11:20:33.462659 | controller | skipping: [instance] 2025-12-03 11:20:33.462766 | controller | 2025-12-03 11:20:33.462782 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-03 11:20:33.462792 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.028) 0:00:15.395 **** 2025-12-03 11:20:33.491635 | controller | skipping: [instance] 2025-12-03 11:20:33.491686 | controller | 2025-12-03 11:20:33.491702 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-03 11:20:33.491714 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.028) 0:00:15.424 **** 2025-12-03 11:20:33.520208 | controller | skipping: [instance] 2025-12-03 11:20:33.557196 | controller | 2025-12-03 11:20:33.557215 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-03 11:20:33.557224 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.028) 0:00:15.452 **** 2025-12-03 11:20:33.557234 | controller | ok: [instance] 2025-12-03 11:20:33.583585 | controller | 2025-12-03 11:20:33.583608 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-03 11:20:33.583616 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.036) 0:00:15.489 **** 2025-12-03 11:20:33.583637 | controller | skipping: [instance] 2025-12-03 11:20:33.583836 | controller | 2025-12-03 11:20:33.583859 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-03 11:20:33.610248 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.026) 0:00:15.516 **** 2025-12-03 11:20:33.610273 | controller | skipping: [instance] 2025-12-03 11:20:33.636339 | controller | 2025-12-03 11:20:33.636364 | controller | TASK [Download the RPM] ******************************************************** 2025-12-03 11:20:33.636373 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.026) 0:00:15.542 **** 2025-12-03 11:20:33.636384 | controller | skipping: [instance] 2025-12-03 11:20:33.636586 | controller | 2025-12-03 11:20:33.636738 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-03 11:20:33.636876 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.026) 0:00:15.568 **** 2025-12-03 11:20:33.662171 | controller | skipping: [instance] 2025-12-03 11:20:33.662354 | controller | 2025-12-03 11:20:33.662558 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-03 11:20:33.662725 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.025) 0:00:15.594 **** 2025-12-03 11:20:33.688836 | controller | skipping: [instance] 2025-12-03 11:20:33.689034 | controller | 2025-12-03 11:20:33.689210 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-03 11:20:33.689375 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.026) 0:00:15.621 **** 2025-12-03 11:20:33.719504 | controller | skipping: [instance] 2025-12-03 11:20:33.719733 | controller | 2025-12-03 11:20:33.719892 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-03 11:20:33.720033 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.030) 0:00:15.652 **** 2025-12-03 11:20:33.744981 | controller | skipping: [instance] 2025-12-03 11:20:33.745186 | controller | 2025-12-03 11:20:33.745373 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-03 11:20:33.745584 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.025) 0:00:15.677 **** 2025-12-03 11:20:33.927325 | controller | ok: [instance] 2025-12-03 11:20:34.134388 | controller | 2025-12-03 11:20:34.134419 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-03 11:20:34.134429 | controller | Wednesday 03 December 2025 11:20:33 +0000 (0:00:00.181) 0:00:15.859 **** 2025-12-03 11:20:34.134439 | controller | changed: [instance] 2025-12-03 11:20:34.369674 | controller | 2025-12-03 11:20:34.369705 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-03 11:20:34.369715 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.207) 0:00:16.066 **** 2025-12-03 11:20:34.369727 | controller | changed: [instance] 2025-12-03 11:20:34.391073 | controller | 2025-12-03 11:20:34.391102 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-03 11:20:34.391110 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.235) 0:00:16.301 **** 2025-12-03 11:20:34.391120 | controller | skipping: [instance] 2025-12-03 11:20:34.413043 | controller | 2025-12-03 11:20:34.413066 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-03 11:20:34.413073 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.021) 0:00:16.323 **** 2025-12-03 11:20:34.413083 | controller | skipping: [instance] 2025-12-03 11:20:34.434358 | controller | 2025-12-03 11:20:34.434382 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-03 11:20:34.434391 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.021) 0:00:16.345 **** 2025-12-03 11:20:34.434409 | controller | skipping: [instance] 2025-12-03 11:20:34.458010 | controller | 2025-12-03 11:20:34.458033 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-03 11:20:34.458042 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.021) 0:00:16.366 **** 2025-12-03 11:20:34.458050 | controller | skipping: [instance] 2025-12-03 11:20:34.479665 | controller | 2025-12-03 11:20:34.479687 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-03 11:20:34.479704 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.023) 0:00:16.390 **** 2025-12-03 11:20:34.479715 | controller | skipping: [instance] 2025-12-03 11:20:34.479925 | controller | 2025-12-03 11:20:34.479948 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-03 11:20:34.502142 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.021) 0:00:16.412 **** 2025-12-03 11:20:34.502167 | controller | skipping: [instance] 2025-12-03 11:20:34.502341 | controller | 2025-12-03 11:20:34.502514 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-03 11:20:34.502737 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.022) 0:00:16.434 **** 2025-12-03 11:20:34.518837 | controller | skipping: [instance] 2025-12-03 11:20:34.519021 | controller | 2025-12-03 11:20:34.519192 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-03 11:20:34.519327 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.016) 0:00:16.451 **** 2025-12-03 11:20:34.547584 | controller | skipping: [instance] 2025-12-03 11:20:34.547710 | controller | 2025-12-03 11:20:34.547842 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-03 11:20:34.547960 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.028) 0:00:16.480 **** 2025-12-03 11:20:34.564238 | controller | skipping: [instance] 2025-12-03 11:20:34.564398 | controller | 2025-12-03 11:20:34.564557 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-03 11:20:34.564758 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.016) 0:00:16.497 **** 2025-12-03 11:20:34.585103 | controller | skipping: [instance] 2025-12-03 11:20:34.585250 | controller | 2025-12-03 11:20:34.585391 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-12-03 11:20:34.585515 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.020) 0:00:16.517 **** 2025-12-03 11:20:34.615681 | controller | skipping: [instance] 2025-12-03 11:20:34.615848 | controller | 2025-12-03 11:20:34.616000 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-12-03 11:20:34.616154 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.030) 0:00:16.548 **** 2025-12-03 11:20:34.644939 | controller | skipping: [instance] 2025-12-03 11:20:34.645104 | controller | 2025-12-03 11:20:34.645261 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-12-03 11:20:34.645402 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.029) 0:00:16.577 **** 2025-12-03 11:20:34.673559 | controller | skipping: [instance] 2025-12-03 11:20:34.673736 | controller | 2025-12-03 11:20:34.673903 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-12-03 11:20:34.674062 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.028) 0:00:16.606 **** 2025-12-03 11:20:34.705359 | controller | skipping: [instance] 2025-12-03 11:20:34.705486 | controller | 2025-12-03 11:20:34.705677 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-12-03 11:20:34.705780 | controller | Wednesday 03 December 2025 11:20:34 +0000 (0:00:00.031) 0:00:16.638 **** 2025-12-03 11:21:21.088312 | controller | ok: [instance] 2025-12-03 11:21:22.321303 | controller | 2025-12-03 11:21:22.321333 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-12-03 11:21:22.321341 | controller | Wednesday 03 December 2025 11:21:21 +0000 (0:00:46.382) 0:01:03.020 **** 2025-12-03 11:21:22.321352 | controller | ok: [instance] 2025-12-03 11:21:22.354340 | controller | 2025-12-03 11:21:22.354369 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-12-03 11:21:22.354377 | controller | Wednesday 03 December 2025 11:21:22 +0000 (0:00:01.233) 0:01:04.253 **** 2025-12-03 11:21:22.354387 | controller | skipping: [instance] 2025-12-03 11:21:22.396306 | controller | 2025-12-03 11:21:22.396337 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-03 11:21:22.396346 | controller | Wednesday 03 December 2025 11:21:22 +0000 (0:00:00.033) 0:01:04.286 **** 2025-12-03 11:21:22.396358 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-12-03 11:21:22.415652 | controller | 2025-12-03 11:21:22.415684 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-03 11:21:22.415692 | controller | Wednesday 03 December 2025 11:21:22 +0000 (0:00:00.041) 0:01:04.328 **** 2025-12-03 11:21:22.415702 | controller | ok: [instance] => 2025-12-03 11:21:22.415749 | controller | cifmw_ci_setup_packages: 2025-12-03 11:21:22.415758 | controller | - bash-completion 2025-12-03 11:21:22.416607 | controller | - ca-certificates 2025-12-03 11:21:26.276275 | controller | - git-core 2025-12-03 11:21:26.276309 | controller | - make 2025-12-03 11:21:26.276317 | controller | - tar 2025-12-03 11:21:26.276322 | controller | - tmux 2025-12-03 11:21:26.276328 | controller | - python3-pip 2025-12-03 11:21:26.276333 | controller | 2025-12-03 11:21:26.276339 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-03 11:21:26.276350 | controller | Wednesday 03 December 2025 11:21:22 +0000 (0:00:00.019) 0:01:04.348 **** 2025-12-03 11:21:26.276360 | controller | changed: [instance] 2025-12-03 11:21:26.838384 | controller | 2025-12-03 11:21:26.838414 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-03 11:21:26.838422 | controller | Wednesday 03 December 2025 11:21:26 +0000 (0:00:03.860) 0:01:08.208 **** 2025-12-03 11:21:26.838432 | controller | ok: [instance] 2025-12-03 11:21:27.035524 | controller | 2025-12-03 11:21:27.035564 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-03 11:21:27.035572 | controller | Wednesday 03 December 2025 11:21:26 +0000 (0:00:00.561) 0:01:08.770 **** 2025-12-03 11:21:27.035582 | controller | changed: [instance] 2025-12-03 11:21:33.014674 | controller | 2025-12-03 11:21:33.014710 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-03 11:21:33.014720 | controller | Wednesday 03 December 2025 11:21:27 +0000 (0:00:00.196) 0:01:08.967 **** 2025-12-03 11:21:33.014732 | controller | changed: [instance] 2025-12-03 11:21:33.050043 | controller | 2025-12-03 11:21:33.050062 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-03 11:21:33.050070 | controller | Wednesday 03 December 2025 11:21:33 +0000 (0:00:05.979) 0:01:14.946 **** 2025-12-03 11:21:33.050078 | controller | ok: [instance] 2025-12-03 11:21:33.308626 | controller | 2025-12-03 11:21:33.308659 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-03 11:21:33.308668 | controller | Wednesday 03 December 2025 11:21:33 +0000 (0:00:00.035) 0:01:14.982 **** 2025-12-03 11:21:33.308678 | controller | changed: [instance] 2025-12-03 11:21:33.308726 | controller | 2025-12-03 11:21:33.308743 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-03 11:21:33.308754 | controller | Wednesday 03 December 2025 11:21:33 +0000 (0:00:00.258) 0:01:15.240 **** 2025-12-03 11:21:33.593701 | controller | changed: [instance] 2025-12-03 11:21:33.593760 | controller | 2025-12-03 11:21:33.593773 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-03 11:21:33.593870 | controller | Wednesday 03 December 2025 11:21:33 +0000 (0:00:00.285) 0:01:15.525 **** 2025-12-03 11:21:33.611683 | controller | skipping: [instance] 2025-12-03 11:21:33.611742 | controller | 2025-12-03 11:21:33.611755 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-03 11:21:33.611889 | controller | Wednesday 03 December 2025 11:21:33 +0000 (0:00:00.018) 0:01:15.544 **** 2025-12-03 11:21:33.628589 | controller | skipping: [instance] 2025-12-03 11:21:33.646432 | controller | 2025-12-03 11:21:33.646458 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-03 11:21:33.646467 | controller | Wednesday 03 December 2025 11:21:33 +0000 (0:00:00.016) 0:01:15.560 **** 2025-12-03 11:21:33.646478 | controller | skipping: [instance] 2025-12-03 11:21:33.663014 | controller | 2025-12-03 11:21:33.663036 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-03 11:21:33.663043 | controller | Wednesday 03 December 2025 11:21:33 +0000 (0:00:00.017) 0:01:15.578 **** 2025-12-03 11:21:33.663052 | controller | skipping: [instance] 2025-12-03 11:21:33.679406 | controller | 2025-12-03 11:21:33.679436 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-03 11:21:33.679455 | controller | Wednesday 03 December 2025 11:21:33 +0000 (0:00:00.016) 0:01:15.595 **** 2025-12-03 11:21:33.679467 | controller | skipping: [instance] 2025-12-03 11:21:33.679495 | controller | 2025-12-03 11:21:33.679505 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-03 11:21:33.679696 | controller | Wednesday 03 December 2025 11:21:33 +0000 (0:00:00.016) 0:01:15.612 **** 2025-12-03 11:21:33.700635 | controller | skipping: [instance] 2025-12-03 11:21:33.700723 | controller | 2025-12-03 11:21:33.700737 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-03 11:21:33.700747 | controller | Wednesday 03 December 2025 11:21:33 +0000 (0:00:00.021) 0:01:15.633 **** 2025-12-03 11:21:34.692654 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-12-03 11:21:34.692711 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-12-03 11:21:34.692722 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-12-03 11:21:34.692729 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-12-03 11:21:34.692738 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-12-03 11:21:34.692764 | controller | 2025-12-03 11:21:34.693018 | controller | TASK [Create secret file] ****************************************************** 2025-12-03 11:21:35.030679 | controller | Wednesday 03 December 2025 11:21:34 +0000 (0:00:00.991) 0:01:16.624 **** 2025-12-03 11:21:35.030725 | controller | changed: [instance] 2025-12-03 11:21:35.030751 | controller | 2025-12-03 11:21:35.030759 | controller | PLAY RECAP ********************************************************************* 2025-12-03 11:21:35.030765 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-12-03 11:21:35.030771 | controller | 2025-12-03 11:21:35.030776 | controller | Wednesday 03 December 2025 11:21:35 +0000 (0:00:00.337) 0:01:16.962 **** 2025-12-03 11:21:35.030793 | controller | =============================================================================== 2025-12-03 11:21:35.030800 | controller | test_deps : Install selinux python libs -------------------------------- 46.38s 2025-12-03 11:21:35.030822 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.98s 2025-12-03 11:21:35.031656 | controller | ci_setup : Install openshift client ------------------------------------- 5.98s 2025-12-03 11:21:35.031704 | controller | ci_setup : Install needed packages -------------------------------------- 3.86s 2025-12-03 11:21:35.031713 | controller | test_deps : Install python yaml libs ------------------------------------ 1.23s 2025-12-03 11:21:35.031719 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.02s 2025-12-03 11:21:35.031724 | controller | ci_setup : Manage directories ------------------------------------------- 0.99s 2025-12-03 11:21:35.031729 | controller | Gathering Facts --------------------------------------------------------- 0.83s 2025-12-03 11:21:35.031734 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.83s 2025-12-03 11:21:35.031740 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.80s 2025-12-03 11:21:35.031747 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.70s 2025-12-03 11:21:35.031771 | controller | repo_setup : Install repo-setup package --------------------------------- 0.68s 2025-12-03 11:21:35.032554 | controller | ci_setup : Gather version of openshift client --------------------------- 0.56s 2025-12-03 11:21:35.080944 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s 2025-12-03 11:21:35.080971 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s 2025-12-03 11:21:35.080979 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s 2025-12-03 11:21:35.080984 | controller | Create secret file ------------------------------------------------------ 0.34s 2025-12-03 11:21:35.080990 | controller | Create custom basedir --------------------------------------------------- 0.31s 2025-12-03 11:21:35.080995 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.29s 2025-12-03 11:21:35.081005 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.28s 2025-12-03 11:21:35.081015 | controller | INFO Running crc_layout > converge 2025-12-03 11:21:35.674639 | controller | 2025-12-03 11:21:35.674864 | controller | PLAY [Converge] **************************************************************** 2025-12-03 11:21:35.675014 | controller | 2025-12-03 11:21:35.675156 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-03 11:21:35.675306 | controller | Wednesday 03 December 2025 11:21:35 +0000 (0:00:00.026) 0:00:00.026 **** 2025-12-03 11:21:36.501458 | controller | ok: [instance] 2025-12-03 11:21:36.524695 | controller | 2025-12-03 11:21:36.524730 | controller | TASK [Load networking definition from scenario file] *************************** 2025-12-03 11:21:36.524739 | controller | Wednesday 03 December 2025 11:21:36 +0000 (0:00:00.826) 0:00:00.853 **** 2025-12-03 11:21:36.524750 | controller | ok: [instance] 2025-12-03 11:21:38.020627 | controller | 2025-12-03 11:21:38.020658 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-03 11:21:38.020666 | controller | Wednesday 03 December 2025 11:21:36 +0000 (0:00:00.023) 0:00:00.876 **** 2025-12-03 11:21:38.020676 | controller | changed: [instance] 2025-12-03 11:21:38.048118 | controller | 2025-12-03 11:21:38.048147 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-03 11:21:38.048154 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:01.495) 0:00:02.372 **** 2025-12-03 11:21:38.048164 | controller | ok: [instance] 2025-12-03 11:21:38.069685 | controller | 2025-12-03 11:21:38.069723 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-12-03 11:21:38.069741 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:00.027) 0:00:02.400 **** 2025-12-03 11:21:38.069753 | controller | skipping: [instance] 2025-12-03 11:21:38.069785 | controller | 2025-12-03 11:21:38.070017 | controller | TASK [Build final libvirt layout] ********************************************** 2025-12-03 11:21:38.138270 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:00.021) 0:00:02.422 **** 2025-12-03 11:21:38.138310 | controller | 2025-12-03 11:21:38.219672 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-12-03 11:21:38.219708 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:00.068) 0:00:02.490 **** 2025-12-03 11:21:38.219721 | controller | ok: [instance] 2025-12-03 11:21:38.219748 | controller | 2025-12-03 11:21:38.219757 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-12-03 11:21:38.219905 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:00.081) 0:00:02.571 **** 2025-12-03 11:21:38.281202 | controller | skipping: [instance] 2025-12-03 11:21:38.281370 | controller | 2025-12-03 11:21:38.281518 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-12-03 11:21:38.281721 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:00.061) 0:00:02.633 **** 2025-12-03 11:21:38.307831 | controller | ok: [instance] 2025-12-03 11:21:38.307993 | controller | 2025-12-03 11:21:38.308152 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-12-03 11:21:38.308290 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:00.026) 0:00:02.660 **** 2025-12-03 11:21:38.332288 | controller | ok: [instance] => changed=false 2025-12-03 11:21:38.332489 | controller | msg: All assertions passed 2025-12-03 11:21:38.332677 | controller | 2025-12-03 11:21:38.332829 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-12-03 11:21:38.332968 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:00.024) 0:00:02.684 **** 2025-12-03 11:21:38.377826 | controller | ok: [instance] 2025-12-03 11:21:38.378016 | controller | 2025-12-03 11:21:38.378170 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-12-03 11:21:38.378315 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:00.045) 0:00:02.730 **** 2025-12-03 11:21:38.817382 | controller | ok: [instance] => (item=artifacts) 2025-12-03 11:21:38.894155 | controller | ok: [instance] => (item=logs) 2025-12-03 11:21:38.894185 | controller | 2025-12-03 11:21:38.894193 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-12-03 11:21:38.894206 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:00.439) 0:00:03.169 **** 2025-12-03 11:21:38.894216 | controller | 2025-12-03 11:21:39.075089 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-12-03 11:21:39.075119 | controller | Wednesday 03 December 2025 11:21:38 +0000 (0:00:00.077) 0:00:03.246 **** 2025-12-03 11:21:39.075130 | controller | ok: [instance] 2025-12-03 11:21:39.336603 | controller | 2025-12-03 11:21:39.336633 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-12-03 11:21:39.336641 | controller | Wednesday 03 December 2025 11:21:39 +0000 (0:00:00.180) 0:00:03.427 **** 2025-12-03 11:21:39.336651 | controller | changed: [instance] 2025-12-03 11:21:39.336768 | controller | 2025-12-03 11:21:39.336785 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-12-03 11:21:39.336795 | controller | Wednesday 03 December 2025 11:21:39 +0000 (0:00:00.261) 0:00:03.688 **** 2025-12-03 11:21:39.622203 | controller | ok: [instance] 2025-12-03 11:21:39.651153 | controller | 2025-12-03 11:21:39.651178 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-12-03 11:21:39.651187 | controller | Wednesday 03 December 2025 11:21:39 +0000 (0:00:00.285) 0:00:03.974 **** 2025-12-03 11:21:39.651196 | controller | skipping: [instance] 2025-12-03 11:21:39.669350 | controller | 2025-12-03 11:21:39.669372 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-12-03 11:21:39.669378 | controller | Wednesday 03 December 2025 11:21:39 +0000 (0:00:00.029) 0:00:04.003 **** 2025-12-03 11:21:39.669388 | controller | skipping: [instance] 2025-12-03 11:21:39.689698 | controller | 2025-12-03 11:21:39.689735 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-12-03 11:21:39.689745 | controller | Wednesday 03 December 2025 11:21:39 +0000 (0:00:00.018) 0:00:04.021 **** 2025-12-03 11:21:39.689757 | controller | ok: [instance] 2025-12-03 11:21:39.689787 | controller | 2025-12-03 11:21:39.689798 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-12-03 11:21:39.689908 | controller | Wednesday 03 December 2025 11:21:39 +0000 (0:00:00.020) 0:00:04.042 **** 2025-12-03 11:21:39.717654 | controller | skipping: [instance] 2025-12-03 11:21:39.717723 | controller | 2025-12-03 11:21:39.717741 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-12-03 11:21:39.717759 | controller | Wednesday 03 December 2025 11:21:39 +0000 (0:00:00.027) 0:00:04.070 **** 2025-12-03 11:21:47.800645 | controller | changed: [instance] 2025-12-03 11:21:48.005739 | controller | 2025-12-03 11:21:48.005769 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-12-03 11:21:48.005777 | controller | Wednesday 03 December 2025 11:21:47 +0000 (0:00:08.082) 0:00:12.152 **** 2025-12-03 11:21:48.005787 | controller | changed: [instance] 2025-12-03 11:21:48.487512 | controller | 2025-12-03 11:21:48.487559 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-12-03 11:21:48.487567 | controller | Wednesday 03 December 2025 11:21:48 +0000 (0:00:00.205) 0:00:12.357 **** 2025-12-03 11:21:48.487577 | controller | changed: [instance] 2025-12-03 11:21:49.069446 | controller | 2025-12-03 11:21:49.069476 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-12-03 11:21:49.069484 | controller | Wednesday 03 December 2025 11:21:48 +0000 (0:00:00.481) 0:00:12.839 **** 2025-12-03 11:21:49.069494 | controller | changed: [instance] 2025-12-03 11:21:49.260140 | controller | 2025-12-03 11:21:49.260168 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-12-03 11:21:49.260176 | controller | Wednesday 03 December 2025 11:21:49 +0000 (0:00:00.581) 0:00:13.421 **** 2025-12-03 11:21:49.260186 | controller | ok: [instance] 2025-12-03 11:21:49.916127 | controller | 2025-12-03 11:21:49.916158 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-12-03 11:21:49.916165 | controller | Wednesday 03 December 2025 11:21:49 +0000 (0:00:00.190) 0:00:13.612 **** 2025-12-03 11:21:49.916175 | controller | ok: [instance] 2025-12-03 11:21:50.769229 | controller | 2025-12-03 11:21:50.769259 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-12-03 11:21:50.769274 | controller | Wednesday 03 December 2025 11:21:49 +0000 (0:00:00.655) 0:00:14.268 **** 2025-12-03 11:21:50.769284 | controller | changed: [instance] 2025-12-03 11:21:50.852689 | controller | 2025-12-03 11:21:50.852721 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-12-03 11:21:50.852731 | controller | Wednesday 03 December 2025 11:21:50 +0000 (0:00:00.853) 0:00:15.121 **** 2025-12-03 11:21:50.852743 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-12-03 11:21:50.852774 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-12-03 11:21:50.853629 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-12-03 11:21:51.170300 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-12-03 11:21:51.170329 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-12-03 11:21:51.170336 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-12-03 11:21:51.170342 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-12-03 11:21:51.170347 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-12-03 11:21:51.170353 | controller | 2025-12-03 11:21:51.170359 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-12-03 11:21:51.170364 | controller | Wednesday 03 December 2025 11:21:50 +0000 (0:00:00.083) 0:00:15.205 **** 2025-12-03 11:21:51.170374 | controller | ok: [instance] 2025-12-03 11:21:51.486103 | controller | 2025-12-03 11:21:51.486132 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-12-03 11:21:51.486140 | controller | Wednesday 03 December 2025 11:21:51 +0000 (0:00:00.317) 0:00:15.522 **** 2025-12-03 11:21:51.486149 | controller | ok: [instance] 2025-12-03 11:21:51.802290 | controller | 2025-12-03 11:21:51.802319 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-12-03 11:21:51.802327 | controller | Wednesday 03 December 2025 11:21:51 +0000 (0:00:00.315) 0:00:15.838 **** 2025-12-03 11:21:51.802337 | controller | ok: [instance] 2025-12-03 11:21:52.112244 | controller | 2025-12-03 11:21:52.112273 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-12-03 11:21:52.112281 | controller | Wednesday 03 December 2025 11:21:51 +0000 (0:00:00.316) 0:00:16.154 **** 2025-12-03 11:21:52.112291 | controller | ok: [instance] 2025-12-03 11:21:52.424299 | controller | 2025-12-03 11:21:52.424332 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-12-03 11:21:52.424342 | controller | Wednesday 03 December 2025 11:21:52 +0000 (0:00:00.309) 0:00:16.464 **** 2025-12-03 11:21:52.424353 | controller | ok: [instance] 2025-12-03 11:21:52.741474 | controller | 2025-12-03 11:21:52.741506 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-12-03 11:21:52.741514 | controller | Wednesday 03 December 2025 11:21:52 +0000 (0:00:00.311) 0:00:16.776 **** 2025-12-03 11:21:52.741540 | controller | ok: [instance] 2025-12-03 11:21:53.053086 | controller | 2025-12-03 11:21:53.053116 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-12-03 11:21:53.053124 | controller | Wednesday 03 December 2025 11:21:52 +0000 (0:00:00.317) 0:00:17.093 **** 2025-12-03 11:21:53.053134 | controller | ok: [instance] 2025-12-03 11:21:53.371651 | controller | 2025-12-03 11:21:53.371682 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-12-03 11:21:53.371690 | controller | Wednesday 03 December 2025 11:21:53 +0000 (0:00:00.311) 0:00:17.405 **** 2025-12-03 11:21:53.371711 | controller | ok: [instance] 2025-12-03 11:21:53.690456 | controller | 2025-12-03 11:21:53.690486 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-12-03 11:21:53.690494 | controller | Wednesday 03 December 2025 11:21:53 +0000 (0:00:00.318) 0:00:17.723 **** 2025-12-03 11:21:53.690504 | controller | ok: [instance] 2025-12-03 11:21:54.005669 | controller | 2025-12-03 11:21:54.005704 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-12-03 11:21:54.005714 | controller | Wednesday 03 December 2025 11:21:53 +0000 (0:00:00.318) 0:00:18.042 **** 2025-12-03 11:21:54.005726 | controller | ok: [instance] 2025-12-03 11:21:54.005756 | controller | 2025-12-03 11:21:54.005764 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-12-03 11:21:54.005772 | controller | Wednesday 03 December 2025 11:21:54 +0000 (0:00:00.315) 0:00:18.357 **** 2025-12-03 11:21:54.324743 | controller | ok: [instance] 2025-12-03 11:21:54.324879 | controller | 2025-12-03 11:21:54.324915 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-12-03 11:21:54.324930 | controller | Wednesday 03 December 2025 11:21:54 +0000 (0:00:00.319) 0:00:18.676 **** 2025-12-03 11:21:54.642270 | controller | ok: [instance] 2025-12-03 11:21:54.960439 | controller | 2025-12-03 11:21:54.960468 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-12-03 11:21:54.960476 | controller | Wednesday 03 December 2025 11:21:54 +0000 (0:00:00.317) 0:00:18.994 **** 2025-12-03 11:21:54.960486 | controller | ok: [instance] 2025-12-03 11:21:55.278433 | controller | 2025-12-03 11:21:55.278464 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-12-03 11:21:55.278472 | controller | Wednesday 03 December 2025 11:21:54 +0000 (0:00:00.318) 0:00:19.312 **** 2025-12-03 11:21:55.278481 | controller | ok: [instance] 2025-12-03 11:21:55.594323 | controller | 2025-12-03 11:21:55.594354 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-12-03 11:21:55.594362 | controller | Wednesday 03 December 2025 11:21:55 +0000 (0:00:00.318) 0:00:19.630 **** 2025-12-03 11:21:55.594372 | controller | ok: [instance] 2025-12-03 11:21:55.910442 | controller | 2025-12-03 11:21:55.910472 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-12-03 11:21:55.910480 | controller | Wednesday 03 December 2025 11:21:55 +0000 (0:00:00.315) 0:00:19.946 **** 2025-12-03 11:21:55.910490 | controller | ok: [instance] 2025-12-03 11:21:56.232479 | controller | 2025-12-03 11:21:56.232550 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-12-03 11:21:56.232562 | controller | Wednesday 03 December 2025 11:21:55 +0000 (0:00:00.316) 0:00:20.262 **** 2025-12-03 11:21:56.232575 | controller | ok: [instance] 2025-12-03 11:21:56.572637 | controller | 2025-12-03 11:21:56.572682 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-12-03 11:21:56.572691 | controller | Wednesday 03 December 2025 11:21:56 +0000 (0:00:00.321) 0:00:20.584 **** 2025-12-03 11:21:56.572701 | controller | ok: [instance] 2025-12-03 11:21:56.572726 | controller | 2025-12-03 11:21:56.572983 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-12-03 11:21:56.898429 | controller | Wednesday 03 December 2025 11:21:56 +0000 (0:00:00.340) 0:00:20.924 **** 2025-12-03 11:21:56.898464 | controller | ok: [instance] 2025-12-03 11:21:57.218458 | controller | 2025-12-03 11:21:57.218489 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-12-03 11:21:57.218497 | controller | Wednesday 03 December 2025 11:21:56 +0000 (0:00:00.325) 0:00:21.250 **** 2025-12-03 11:21:57.218507 | controller | ok: [instance] 2025-12-03 11:21:57.542483 | controller | 2025-12-03 11:21:57.542514 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-12-03 11:21:57.542522 | controller | Wednesday 03 December 2025 11:21:57 +0000 (0:00:00.319) 0:00:21.570 **** 2025-12-03 11:21:57.542551 | controller | ok: [instance] 2025-12-03 11:21:57.864498 | controller | 2025-12-03 11:21:57.864543 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-12-03 11:21:57.864555 | controller | Wednesday 03 December 2025 11:21:57 +0000 (0:00:00.324) 0:00:21.894 **** 2025-12-03 11:21:57.864572 | controller | ok: [instance] 2025-12-03 11:21:58.182388 | controller | 2025-12-03 11:21:58.182420 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-12-03 11:21:58.182428 | controller | Wednesday 03 December 2025 11:21:57 +0000 (0:00:00.322) 0:00:22.216 **** 2025-12-03 11:21:58.182438 | controller | ok: [instance] 2025-12-03 11:21:58.499063 | controller | 2025-12-03 11:21:58.499094 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-12-03 11:21:58.499107 | controller | Wednesday 03 December 2025 11:21:58 +0000 (0:00:00.317) 0:00:22.534 **** 2025-12-03 11:21:58.499118 | controller | ok: [instance] 2025-12-03 11:21:58.518628 | controller | 2025-12-03 11:21:58.518663 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-12-03 11:21:58.518690 | controller | Wednesday 03 December 2025 11:21:58 +0000 (0:00:00.316) 0:00:22.851 **** 2025-12-03 11:21:58.518702 | controller | skipping: [instance] 2025-12-03 11:21:58.798050 | controller | 2025-12-03 11:21:58.798079 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-12-03 11:21:58.798087 | controller | Wednesday 03 December 2025 11:21:58 +0000 (0:00:00.019) 0:00:22.870 **** 2025-12-03 11:21:58.798097 | controller | ok: [instance] 2025-12-03 11:21:59.175018 | controller | 2025-12-03 11:21:59.175049 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-12-03 11:21:59.175057 | controller | Wednesday 03 December 2025 11:21:58 +0000 (0:00:00.279) 0:00:23.150 **** 2025-12-03 11:21:59.175067 | controller | ok: [instance] 2025-12-03 11:21:59.476974 | controller | 2025-12-03 11:21:59.477004 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-12-03 11:21:59.477013 | controller | Wednesday 03 December 2025 11:21:59 +0000 (0:00:00.376) 0:00:23.527 **** 2025-12-03 11:21:59.477023 | controller | changed: [instance] 2025-12-03 11:21:59.759332 | controller | 2025-12-03 11:21:59.759366 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-12-03 11:21:59.759376 | controller | Wednesday 03 December 2025 11:21:59 +0000 (0:00:00.301) 0:00:23.829 **** 2025-12-03 11:21:59.759389 | controller | [WARNING]: Reset is not implemented for this connection 2025-12-03 11:21:59.769618 | controller | changed: [instance] 2025-12-03 11:21:59.842346 | controller | 2025-12-03 11:21:59.842368 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-12-03 11:21:59.842377 | controller | Wednesday 03 December 2025 11:21:59 +0000 (0:00:00.276) 0:00:24.105 **** 2025-12-03 11:21:59.842384 | controller | 2025-12-03 11:21:59.842391 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-12-03 11:21:59.842397 | controller | Wednesday 03 December 2025 11:21:59 +0000 (0:00:00.016) 0:00:24.121 **** 2025-12-03 11:21:59.842407 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-12-03 11:21:59.882605 | controller | 2025-12-03 11:21:59.882631 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-12-03 11:21:59.882638 | controller | Wednesday 03 December 2025 11:21:59 +0000 (0:00:00.073) 0:00:24.194 **** 2025-12-03 11:21:59.882648 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-12-03 11:21:59.928110 | controller | 2025-12-03 11:21:59.928128 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 11:21:59.928136 | controller | Wednesday 03 December 2025 11:21:59 +0000 (0:00:00.040) 0:00:24.234 **** 2025-12-03 11:21:59.928145 | controller | ok: [instance] => (item=compute) 2025-12-03 11:21:59.968606 | controller | ok: [instance] => (item=controller) 2025-12-03 11:21:59.968638 | controller | ok: [instance] => (item=crc) 2025-12-03 11:21:59.968647 | controller | 2025-12-03 11:21:59.968654 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 11:21:59.968661 | controller | Wednesday 03 December 2025 11:21:59 +0000 (0:00:00.045) 0:00:24.280 **** 2025-12-03 11:21:59.968673 | controller | ok: [instance] 2025-12-03 11:22:00.010166 | controller | 2025-12-03 11:22:00.010193 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-03 11:22:00.010211 | controller | Wednesday 03 December 2025 11:21:59 +0000 (0:00:00.040) 0:00:24.320 **** 2025-12-03 11:22:00.010223 | controller | ok: [instance] => changed=false 2025-12-03 11:22:00.010312 | controller | msg: All assertions passed 2025-12-03 11:22:00.010497 | controller | 2025-12-03 11:22:00.010692 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-12-03 11:22:00.010825 | controller | Wednesday 03 December 2025 11:22:00 +0000 (0:00:00.042) 0:00:24.362 **** 2025-12-03 11:22:00.052721 | controller | 2025-12-03 11:22:00.052870 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-12-03 11:22:00.053055 | controller | Wednesday 03 December 2025 11:22:00 +0000 (0:00:00.042) 0:00:24.405 **** 2025-12-03 11:22:00.146805 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-12-03 11:22:00.146992 | controller | ok: [instance] => (item={}) 2025-12-03 11:22:00.147102 | controller | 2025-12-03 11:22:00.147266 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-12-03 11:22:00.147348 | controller | Wednesday 03 December 2025 11:22:00 +0000 (0:00:00.093) 0:00:24.499 **** 2025-12-03 11:22:00.163153 | controller | skipping: [instance] 2025-12-03 11:22:00.163272 | controller | 2025-12-03 11:22:00.163430 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-12-03 11:22:00.163553 | controller | Wednesday 03 December 2025 11:22:00 +0000 (0:00:00.016) 0:00:24.515 **** 2025-12-03 11:22:00.378717 | controller | ok: [instance] 2025-12-03 11:22:00.720602 | controller | 2025-12-03 11:22:00.720635 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-12-03 11:22:00.720644 | controller | Wednesday 03 December 2025 11:22:00 +0000 (0:00:00.215) 0:00:24.730 **** 2025-12-03 11:22:00.720654 | controller | changed: [instance] 2025-12-03 11:22:00.720679 | controller | 2025-12-03 11:22:00.720696 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-12-03 11:22:00.720808 | controller | Wednesday 03 December 2025 11:22:00 +0000 (0:00:00.341) 0:00:25.072 **** 2025-12-03 11:22:01.458420 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-12-03 11:22:01.484131 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-12-03 11:22:01.484166 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-12-03 11:22:01.484174 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-12-03 11:22:01.484180 | controller | 2025-12-03 11:22:01.484185 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-12-03 11:22:01.484191 | controller | Wednesday 03 December 2025 11:22:01 +0000 (0:00:00.737) 0:00:25.810 **** 2025-12-03 11:22:01.484200 | controller | skipping: [instance] 2025-12-03 11:22:01.854613 | controller | 2025-12-03 11:22:01.854652 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-12-03 11:22:01.854660 | controller | Wednesday 03 December 2025 11:22:01 +0000 (0:00:00.026) 0:00:25.836 **** 2025-12-03 11:22:01.854673 | controller | changed: [instance] 2025-12-03 11:22:02.285036 | controller | 2025-12-03 11:22:02.285068 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-12-03 11:22:02.285076 | controller | Wednesday 03 December 2025 11:22:01 +0000 (0:00:00.360) 0:00:26.197 **** 2025-12-03 11:22:02.285082 | controller | 2025-12-03 11:22:02.285088 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-03 11:22:02.285093 | controller | Wednesday 03 December 2025 11:22:01 +0000 (0:00:00.009) 0:00:26.206 **** 2025-12-03 11:22:02.285111 | controller | changed: [instance] 2025-12-03 11:22:02.359951 | controller | 2025-12-03 11:22:02.359986 | controller | TASK [Ensure no default networks exists] *************************************** 2025-12-03 11:22:02.359995 | controller | Wednesday 03 December 2025 11:22:02 +0000 (0:00:00.430) 0:00:26.637 **** 2025-12-03 11:22:02.360007 | controller | 2025-12-03 11:22:03.510615 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-12-03 11:22:03.510661 | controller | Wednesday 03 December 2025 11:22:02 +0000 (0:00:00.074) 0:00:26.712 **** 2025-12-03 11:22:03.510677 | controller | ok: [instance] 2025-12-03 11:22:03.744510 | controller | 2025-12-03 11:22:03.744558 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-12-03 11:22:03.744567 | controller | Wednesday 03 December 2025 11:22:03 +0000 (0:00:01.150) 0:00:27.862 **** 2025-12-03 11:22:03.744577 | controller | ok: [instance] 2025-12-03 11:22:04.236657 | controller | 2025-12-03 11:22:04.236693 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-12-03 11:22:04.236714 | controller | Wednesday 03 December 2025 11:22:03 +0000 (0:00:00.233) 0:00:28.096 **** 2025-12-03 11:22:04.236726 | controller | ok: [instance] 2025-12-03 11:22:04.465265 | controller | 2025-12-03 11:22:04.465302 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-12-03 11:22:04.465310 | controller | Wednesday 03 December 2025 11:22:04 +0000 (0:00:00.492) 0:00:28.588 **** 2025-12-03 11:22:04.465321 | controller | ok: [instance] 2025-12-03 11:22:04.465338 | controller | 2025-12-03 11:22:04.465614 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-12-03 11:22:05.673220 | controller | Wednesday 03 December 2025 11:22:04 +0000 (0:00:00.229) 0:00:28.817 **** 2025-12-03 11:22:05.673257 | controller | ok: [instance] 2025-12-03 11:22:05.984979 | controller | 2025-12-03 11:22:05.985010 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-12-03 11:22:05.985018 | controller | Wednesday 03 December 2025 11:22:05 +0000 (0:00:01.207) 0:00:30.025 **** 2025-12-03 11:22:05.985028 | controller | ok: [instance] 2025-12-03 11:22:06.288598 | controller | 2025-12-03 11:22:06.288628 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-12-03 11:22:06.288636 | controller | Wednesday 03 December 2025 11:22:05 +0000 (0:00:00.311) 0:00:30.337 **** 2025-12-03 11:22:06.288654 | controller | changed: [instance] 2025-12-03 11:22:06.288680 | controller | 2025-12-03 11:22:06.288905 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-12-03 11:22:06.595626 | controller | Wednesday 03 December 2025 11:22:06 +0000 (0:00:00.303) 0:00:30.641 **** 2025-12-03 11:22:06.595660 | controller | changed: [instance] 2025-12-03 11:22:06.595686 | controller | 2025-12-03 11:22:06.595693 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-12-03 11:22:06.595700 | controller | Wednesday 03 December 2025 11:22:06 +0000 (0:00:00.306) 0:00:30.947 **** 2025-12-03 11:22:07.160583 | controller | changed: [instance] => (item=arptables) 2025-12-03 11:22:07.482956 | controller | changed: [instance] => (item=iptables) 2025-12-03 11:22:07.482990 | controller | changed: [instance] => (item=ip6tables) 2025-12-03 11:22:07.482997 | controller | 2025-12-03 11:22:07.483004 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-12-03 11:22:07.483010 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.564) 0:00:31.512 **** 2025-12-03 11:22:07.483019 | controller | ok: [instance] 2025-12-03 11:22:07.573182 | controller | 2025-12-03 11:22:07.573210 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-12-03 11:22:07.573220 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.322) 0:00:31.835 **** 2025-12-03 11:22:07.573232 | controller | ok: [instance] 2025-12-03 11:22:07.614675 | controller | 2025-12-03 11:22:07.614705 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-12-03 11:22:07.614715 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.090) 0:00:31.925 **** 2025-12-03 11:22:07.614740 | controller | 2025-12-03 11:22:07.635433 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-12-03 11:22:07.635462 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.041) 0:00:31.967 **** 2025-12-03 11:22:07.635473 | controller | skipping: [instance] 2025-12-03 11:22:07.655653 | controller | 2025-12-03 11:22:07.655688 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-12-03 11:22:07.655698 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.020) 0:00:31.987 **** 2025-12-03 11:22:07.655710 | controller | skipping: [instance] 2025-12-03 11:22:07.675623 | controller | 2025-12-03 11:22:07.675648 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 11:22:07.675657 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.020) 0:00:32.008 **** 2025-12-03 11:22:07.675668 | controller | skipping: [instance] 2025-12-03 11:22:07.675711 | controller | 2025-12-03 11:22:07.675745 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-12-03 11:22:07.675756 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.020) 0:00:32.028 **** 2025-12-03 11:22:07.700096 | controller | skipping: [instance] 2025-12-03 11:22:07.700281 | controller | 2025-12-03 11:22:07.700452 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-12-03 11:22:07.700615 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.024) 0:00:32.052 **** 2025-12-03 11:22:07.735961 | controller | ok: [instance] 2025-12-03 11:22:07.736144 | controller | 2025-12-03 11:22:07.736324 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-12-03 11:22:07.736491 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.036) 0:00:32.088 **** 2025-12-03 11:22:07.767138 | controller | skipping: [instance] 2025-12-03 11:22:07.767322 | controller | 2025-12-03 11:22:07.767493 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-12-03 11:22:07.767674 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.031) 0:00:32.119 **** 2025-12-03 11:22:07.787504 | controller | skipping: [instance] 2025-12-03 11:22:07.787709 | controller | 2025-12-03 11:22:07.787880 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-12-03 11:22:07.788022 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.020) 0:00:32.140 **** 2025-12-03 11:22:07.842565 | controller | ok: [instance] 2025-12-03 11:22:07.842782 | controller | 2025-12-03 11:22:07.842941 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-12-03 11:22:07.843078 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.054) 0:00:32.195 **** 2025-12-03 11:22:07.864909 | controller | skipping: [instance] 2025-12-03 11:22:07.865091 | controller | 2025-12-03 11:22:07.865265 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-12-03 11:22:07.865433 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.022) 0:00:32.217 **** 2025-12-03 11:22:07.912665 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-12-03 11:22:07.912880 | controller | 2025-12-03 11:22:07.913024 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-03 11:22:07.913170 | controller | Wednesday 03 December 2025 11:22:07 +0000 (0:00:00.047) 0:00:32.265 **** 2025-12-03 11:22:08.233472 | controller | ok: [instance -> localhost] 2025-12-03 11:22:16.335266 | controller | 2025-12-03 11:22:16.335298 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-12-03 11:22:16.335306 | controller | Wednesday 03 December 2025 11:22:08 +0000 (0:00:00.320) 0:00:32.585 **** 2025-12-03 11:22:16.335316 | controller | changed: [instance -> localhost] 2025-12-03 11:22:16.526350 | controller | 2025-12-03 11:22:16.526380 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-03 11:22:16.526388 | controller | Wednesday 03 December 2025 11:22:16 +0000 (0:00:08.101) 0:00:40.687 **** 2025-12-03 11:22:16.526398 | controller | changed: [instance] 2025-12-03 11:22:16.869109 | controller | 2025-12-03 11:22:16.869138 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-12-03 11:22:16.869146 | controller | Wednesday 03 December 2025 11:22:16 +0000 (0:00:00.191) 0:00:40.878 **** 2025-12-03 11:22:16.869162 | controller | changed: [instance] 2025-12-03 11:22:18.451256 | controller | 2025-12-03 11:22:18.451285 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-12-03 11:22:18.451293 | controller | Wednesday 03 December 2025 11:22:16 +0000 (0:00:00.342) 0:00:41.221 **** 2025-12-03 11:22:18.451303 | controller | changed: [instance -> localhost] 2025-12-03 11:22:18.804634 | controller | 2025-12-03 11:22:18.804670 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-12-03 11:22:18.804678 | controller | Wednesday 03 December 2025 11:22:18 +0000 (0:00:01.582) 0:00:42.803 **** 2025-12-03 11:22:18.804689 | controller | changed: [instance] 2025-12-03 11:22:18.804713 | controller | 2025-12-03 11:22:18.804721 | controller | TASK [reproducer : Select right domain] **************************************** 2025-12-03 11:22:18.804852 | controller | Wednesday 03 December 2025 11:22:18 +0000 (0:00:00.353) 0:00:43.157 **** 2025-12-03 11:22:18.835123 | controller | ok: [instance] 2025-12-03 11:22:18.950745 | controller | 2025-12-03 11:22:18.950779 | controller | TASK [Create the virtual networks] ********************************************* 2025-12-03 11:22:18.950788 | controller | Wednesday 03 December 2025 11:22:18 +0000 (0:00:00.030) 0:00:43.187 **** 2025-12-03 11:22:18.950807 | controller | 2025-12-03 11:22:18.968253 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-12-03 11:22:18.968275 | controller | Wednesday 03 December 2025 11:22:18 +0000 (0:00:00.115) 0:00:43.303 **** 2025-12-03 11:22:18.968288 | controller | ok: [instance] 2025-12-03 11:22:19.151635 | controller | 2025-12-03 11:22:19.151668 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-12-03 11:22:19.151676 | controller | Wednesday 03 December 2025 11:22:18 +0000 (0:00:00.017) 0:00:43.320 **** 2025-12-03 11:22:19.151687 | controller | ok: [instance] 2025-12-03 11:22:19.151706 | controller | 2025-12-03 11:22:19.151975 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-12-03 11:22:19.179620 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.183) 0:00:43.504 **** 2025-12-03 11:22:19.179656 | controller | skipping: [instance] 2025-12-03 11:22:19.179737 | controller | 2025-12-03 11:22:19.179757 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-12-03 11:22:19.179770 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.028) 0:00:43.532 **** 2025-12-03 11:22:19.207654 | controller | skipping: [instance] 2025-12-03 11:22:19.207699 | controller | 2025-12-03 11:22:19.207707 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-12-03 11:22:19.207716 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.027) 0:00:43.560 **** 2025-12-03 11:22:19.260587 | controller | ok: [instance] 2025-12-03 11:22:19.383223 | controller | 2025-12-03 11:22:19.383253 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-12-03 11:22:19.383261 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.052) 0:00:43.613 **** 2025-12-03 11:22:19.383272 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 11:22:19.416512 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 11:22:19.416563 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 11:22:19.416573 | controller | 2025-12-03 11:22:19.416580 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-12-03 11:22:19.416587 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.122) 0:00:43.735 **** 2025-12-03 11:22:19.416598 | controller | skipping: [instance] 2025-12-03 11:22:19.757631 | controller | 2025-12-03 11:22:19.757666 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-12-03 11:22:19.757676 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.033) 0:00:43.768 **** 2025-12-03 11:22:19.757696 | controller | changed: [instance] 2025-12-03 11:22:19.757734 | controller | 2025-12-03 11:22:19.757762 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-12-03 11:22:19.757927 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.341) 0:00:44.110 **** 2025-12-03 11:22:19.874724 | controller | changed: [instance] => (item=Adding compute-0 to computes) 2025-12-03 11:22:19.874789 | controller | changed: [instance] => (item=Adding controller-0 to controllers) 2025-12-03 11:22:19.874816 | controller | changed: [instance] => (item=Adding crc-0 to ocps) 2025-12-03 11:22:19.875143 | controller | 2025-12-03 11:22:19.898079 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-03 11:22:19.898106 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.117) 0:00:44.227 **** 2025-12-03 11:22:19.898120 | controller | skipping: [instance] 2025-12-03 11:22:19.921717 | controller | 2025-12-03 11:22:19.921747 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 11:22:19.921756 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.023) 0:00:44.250 **** 2025-12-03 11:22:19.921765 | controller | skipping: [instance] 2025-12-03 11:22:19.944659 | controller | 2025-12-03 11:22:19.944689 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-03 11:22:19.944699 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.023) 0:00:44.274 **** 2025-12-03 11:22:19.944710 | controller | skipping: [instance] 2025-12-03 11:22:19.944740 | controller | 2025-12-03 11:22:19.944750 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-03 11:22:19.944829 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.023) 0:00:44.297 **** 2025-12-03 11:22:19.968489 | controller | skipping: [instance] 2025-12-03 11:22:19.985631 | controller | 2025-12-03 11:22:19.985645 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-03 11:22:19.985652 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.023) 0:00:44.320 **** 2025-12-03 11:22:19.985662 | controller | ok: [instance] 2025-12-03 11:22:19.985712 | controller | 2025-12-03 11:22:19.985725 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-03 11:22:19.985973 | controller | Wednesday 03 December 2025 11:22:19 +0000 (0:00:00.017) 0:00:44.338 **** 2025-12-03 11:22:20.082320 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-03 11:22:20.082401 | controller | 2025-12-03 11:22:20.082569 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-03 11:22:20.082745 | controller | Wednesday 03 December 2025 11:22:20 +0000 (0:00:00.096) 0:00:44.434 **** 2025-12-03 11:22:20.099614 | controller | skipping: [instance] 2025-12-03 11:22:20.099811 | controller | 2025-12-03 11:22:20.099981 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-03 11:22:20.100078 | controller | Wednesday 03 December 2025 11:22:20 +0000 (0:00:00.017) 0:00:44.452 **** 2025-12-03 11:22:20.304007 | controller | changed: [instance] 2025-12-03 11:22:20.699512 | controller | 2025-12-03 11:22:20.699560 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-03 11:22:20.699569 | controller | Wednesday 03 December 2025 11:22:20 +0000 (0:00:00.203) 0:00:44.656 **** 2025-12-03 11:22:20.699579 | controller | changed: [instance] 2025-12-03 11:22:20.760286 | controller | 2025-12-03 11:22:20.760310 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-03 11:22:20.760318 | controller | Wednesday 03 December 2025 11:22:20 +0000 (0:00:00.395) 0:00:45.051 **** 2025-12-03 11:22:20.760327 | controller | ok: [instance] 2025-12-03 11:22:20.791303 | controller | 2025-12-03 11:22:20.791324 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-03 11:22:20.791331 | controller | Wednesday 03 December 2025 11:22:20 +0000 (0:00:00.060) 0:00:45.112 **** 2025-12-03 11:22:20.791340 | controller | ok: [instance] 2025-12-03 11:22:21.199141 | controller | 2025-12-03 11:22:21.199171 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-03 11:22:21.199179 | controller | Wednesday 03 December 2025 11:22:20 +0000 (0:00:00.031) 0:00:45.143 **** 2025-12-03 11:22:21.199189 | controller | changed: [instance] 2025-12-03 11:22:21.277253 | controller | 2025-12-03 11:22:21.277280 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-12-03 11:22:21.277289 | controller | Wednesday 03 December 2025 11:22:21 +0000 (0:00:00.407) 0:00:45.551 **** 2025-12-03 11:22:21.277298 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-12-03 11:22:21.326677 | controller | 2025-12-03 11:22:21.326712 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-12-03 11:22:21.326720 | controller | Wednesday 03 December 2025 11:22:21 +0000 (0:00:00.078) 0:00:45.629 **** 2025-12-03 11:22:21.326731 | controller | ok: [instance] => (item=public) 2025-12-03 11:22:21.765611 | controller | ok: [instance] => (item=osp_trunk) 2025-12-03 11:22:21.765649 | controller | 2025-12-03 11:22:21.765658 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-12-03 11:22:21.765671 | controller | Wednesday 03 December 2025 11:22:21 +0000 (0:00:00.049) 0:00:45.678 **** 2025-12-03 11:22:21.765688 | controller | changed: [instance] => (item=cifmw-public) 2025-12-03 11:22:21.765962 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:22:22.338616 | controller | 2025-12-03 11:22:22.338646 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-12-03 11:22:22.338654 | controller | Wednesday 03 December 2025 11:22:21 +0000 (0:00:00.439) 0:00:46.117 **** 2025-12-03 11:22:22.338664 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 11:22:22.338686 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:22:22.338694 | controller | 2025-12-03 11:22:22.338903 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-12-03 11:22:22.768237 | controller | Wednesday 03 December 2025 11:22:22 +0000 (0:00:00.573) 0:00:46.691 **** 2025-12-03 11:22:22.768272 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 11:22:23.199298 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:22:23.199329 | controller | 2025-12-03 11:22:23.199337 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-12-03 11:22:23.199343 | controller | Wednesday 03 December 2025 11:22:22 +0000 (0:00:00.429) 0:00:47.120 **** 2025-12-03 11:22:23.199359 | controller | changed: [instance] => (item=cifmw-public) 2025-12-03 11:22:23.256653 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:22:23.256719 | controller | 2025-12-03 11:22:23.256730 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-12-03 11:22:23.256737 | controller | Wednesday 03 December 2025 11:22:23 +0000 (0:00:00.431) 0:00:47.551 **** 2025-12-03 11:22:23.256749 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-12-03 11:22:23.438464 | controller | 2025-12-03 11:22:23.438502 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-12-03 11:22:23.438510 | controller | Wednesday 03 December 2025 11:22:23 +0000 (0:00:00.057) 0:00:47.608 **** 2025-12-03 11:22:23.438520 | controller | ok: [instance] 2025-12-03 11:22:23.824326 | controller | 2025-12-03 11:22:23.824356 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-12-03 11:22:23.824364 | controller | Wednesday 03 December 2025 11:22:23 +0000 (0:00:00.181) 0:00:47.790 **** 2025-12-03 11:22:23.824373 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 11:22:23.893713 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:22:23.893751 | controller | 2025-12-03 11:22:23.893761 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-12-03 11:22:23.893769 | controller | Wednesday 03 December 2025 11:22:23 +0000 (0:00:00.385) 0:00:48.176 **** 2025-12-03 11:22:23.893780 | controller | 2025-12-03 11:22:23.929702 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-03 11:22:23.929733 | controller | Wednesday 03 December 2025 11:22:23 +0000 (0:00:00.069) 0:00:48.246 **** 2025-12-03 11:22:23.929746 | controller | skipping: [instance] 2025-12-03 11:22:23.929988 | controller | 2025-12-03 11:22:23.930017 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-12-03 11:22:25.183338 | controller | Wednesday 03 December 2025 11:22:23 +0000 (0:00:00.036) 0:00:48.282 **** 2025-12-03 11:22:25.183376 | controller | ok: [instance] 2025-12-03 11:22:25.371510 | controller | 2025-12-03 11:22:25.371564 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-03 11:22:25.371573 | controller | Wednesday 03 December 2025 11:22:25 +0000 (0:00:01.253) 0:00:49.535 **** 2025-12-03 11:22:25.371583 | controller | ok: [instance] 2025-12-03 11:22:25.733125 | controller | 2025-12-03 11:22:25.733157 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-12-03 11:22:25.733165 | controller | Wednesday 03 December 2025 11:22:25 +0000 (0:00:00.188) 0:00:49.723 **** 2025-12-03 11:22:25.733175 | controller | changed: [instance] 2025-12-03 11:22:27.353129 | controller | 2025-12-03 11:22:27.353158 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-12-03 11:22:27.353167 | controller | Wednesday 03 December 2025 11:22:25 +0000 (0:00:00.361) 0:00:50.085 **** 2025-12-03 11:22:27.353177 | controller | changed: [instance] 2025-12-03 11:22:27.698053 | controller | 2025-12-03 11:22:27.698091 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-12-03 11:22:27.698099 | controller | Wednesday 03 December 2025 11:22:27 +0000 (0:00:01.620) 0:00:51.705 **** 2025-12-03 11:22:27.698109 | controller | changed: [instance] 2025-12-03 11:22:27.728303 | controller | 2025-12-03 11:22:27.728335 | controller | TASK [Create extra network configuration] ************************************** 2025-12-03 11:22:27.728344 | controller | Wednesday 03 December 2025 11:22:27 +0000 (0:00:00.344) 0:00:52.050 **** 2025-12-03 11:22:27.728355 | controller | skipping: [instance] 2025-12-03 11:22:27.755433 | controller | 2025-12-03 11:22:27.755460 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-12-03 11:22:27.755468 | controller | Wednesday 03 December 2025 11:22:27 +0000 (0:00:00.030) 0:00:52.080 **** 2025-12-03 11:22:27.755482 | controller | skipping: [instance] 2025-12-03 11:22:28.178449 | controller | 2025-12-03 11:22:28.178483 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-12-03 11:22:28.178498 | controller | Wednesday 03 December 2025 11:22:27 +0000 (0:00:00.027) 0:00:52.107 **** 2025-12-03 11:22:28.178508 | controller | ok: [instance] 2025-12-03 11:22:28.352170 | controller | 2025-12-03 11:22:28.352202 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-12-03 11:22:28.352210 | controller | Wednesday 03 December 2025 11:22:28 +0000 (0:00:00.422) 0:00:52.530 **** 2025-12-03 11:22:28.352220 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 11:22:29.585705 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:22:29.585737 | controller | 2025-12-03 11:22:29.585744 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-12-03 11:22:29.585750 | controller | Wednesday 03 December 2025 11:22:28 +0000 (0:00:00.173) 0:00:52.704 **** 2025-12-03 11:22:29.585760 | controller | ok: [instance] 2025-12-03 11:22:33.277481 | controller | 2025-12-03 11:22:33.277514 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-12-03 11:22:33.277522 | controller | Wednesday 03 December 2025 11:22:29 +0000 (0:00:01.233) 0:00:53.937 **** 2025-12-03 11:22:33.277557 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-12-03 11:22:33.493651 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-12-03 11:22:33.493699 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-12-03 11:22:33.493708 | controller | 2025-12-03 11:22:33.493714 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-12-03 11:22:33.493720 | controller | Wednesday 03 December 2025 11:22:33 +0000 (0:00:03.691) 0:00:57.629 **** 2025-12-03 11:22:33.493736 | controller | changed: [instance] 2025-12-03 11:22:33.493775 | controller | 2025-12-03 11:22:33.493783 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-12-03 11:22:33.493806 | controller | Wednesday 03 December 2025 11:22:33 +0000 (0:00:00.216) 0:00:57.845 **** 2025-12-03 11:22:33.870678 | controller | changed: [instance] 2025-12-03 11:22:34.269395 | controller | 2025-12-03 11:22:34.269430 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-12-03 11:22:34.269438 | controller | Wednesday 03 December 2025 11:22:33 +0000 (0:00:00.376) 0:00:58.222 **** 2025-12-03 11:22:34.269448 | controller | changed: [instance] 2025-12-03 11:22:34.301660 | controller | 2025-12-03 11:22:34.301695 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-12-03 11:22:34.301705 | controller | Wednesday 03 December 2025 11:22:34 +0000 (0:00:00.398) 0:00:58.621 **** 2025-12-03 11:22:34.301718 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-12-03 11:22:34.705013 | controller | 2025-12-03 11:22:34.705043 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-12-03 11:22:34.705051 | controller | Wednesday 03 December 2025 11:22:34 +0000 (0:00:00.032) 0:00:58.653 **** 2025-12-03 11:22:34.705061 | controller | changed: [instance] 2025-12-03 11:22:34.725131 | controller | 2025-12-03 11:22:34.725151 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-12-03 11:22:34.725158 | controller | Wednesday 03 December 2025 11:22:34 +0000 (0:00:00.403) 0:00:59.057 **** 2025-12-03 11:22:34.725167 | controller | skipping: [instance] 2025-12-03 11:22:34.760645 | controller | 2025-12-03 11:22:34.760673 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-12-03 11:22:34.760683 | controller | Wednesday 03 December 2025 11:22:34 +0000 (0:00:00.020) 0:00:59.077 **** 2025-12-03 11:22:34.760695 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-12-03 11:22:35.150630 | controller | 2025-12-03 11:22:35.150662 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-12-03 11:22:35.150672 | controller | Wednesday 03 December 2025 11:22:34 +0000 (0:00:00.035) 0:00:59.112 **** 2025-12-03 11:22:35.150684 | controller | changed: [instance] 2025-12-03 11:22:35.150713 | controller | 2025-12-03 11:22:35.150727 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-12-03 11:22:35.150737 | controller | Wednesday 03 December 2025 11:22:35 +0000 (0:00:00.390) 0:00:59.502 **** 2025-12-03 11:22:35.169591 | controller | skipping: [instance] 2025-12-03 11:22:35.378268 | controller | 2025-12-03 11:22:35.378296 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-12-03 11:22:35.378304 | controller | Wednesday 03 December 2025 11:22:35 +0000 (0:00:00.018) 0:00:59.521 **** 2025-12-03 11:22:35.378314 | controller | ok: [instance] => (item=127.0.0.2) 2025-12-03 11:22:36.058410 | controller | 2025-12-03 11:22:36.058441 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-12-03 11:22:36.058449 | controller | Wednesday 03 December 2025 11:22:35 +0000 (0:00:00.208) 0:00:59.730 **** 2025-12-03 11:22:36.058459 | controller | changed: [instance] 2025-12-03 11:22:36.078022 | controller | 2025-12-03 11:22:36.078049 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-12-03 11:22:36.078063 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.679) 0:01:00.410 **** 2025-12-03 11:22:36.078073 | controller | skipping: [instance] 2025-12-03 11:22:36.097328 | controller | 2025-12-03 11:22:36.097352 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-12-03 11:22:36.097359 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.019) 0:01:00.430 **** 2025-12-03 11:22:36.097368 | controller | skipping: [instance] 2025-12-03 11:22:36.126671 | controller | 2025-12-03 11:22:36.126700 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-12-03 11:22:36.126710 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.019) 0:01:00.449 **** 2025-12-03 11:22:36.126722 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-03 11:22:36.126751 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-12-03 11:22:36.126761 | controller | skipping: [instance] 2025-12-03 11:22:36.127043 | controller | 2025-12-03 11:22:36.249096 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-12-03 11:22:36.249128 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.029) 0:01:00.479 **** 2025-12-03 11:22:36.249140 | controller | 2025-12-03 11:22:36.278976 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-03 11:22:36.279005 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.122) 0:01:00.601 **** 2025-12-03 11:22:36.279017 | controller | ok: [instance] => changed=false 2025-12-03 11:22:36.279174 | controller | msg: All assertions passed 2025-12-03 11:22:36.279312 | controller | 2025-12-03 11:22:36.279462 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-03 11:22:36.279629 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.030) 0:01:00.631 **** 2025-12-03 11:22:36.317599 | controller | ok: [instance] => changed=false 2025-12-03 11:22:36.318055 | controller | msg: All assertions passed 2025-12-03 11:22:36.318204 | controller | 2025-12-03 11:22:36.318309 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-03 11:22:36.318450 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.038) 0:01:00.670 **** 2025-12-03 11:22:36.757634 | controller | changed: [instance] 2025-12-03 11:22:36.757758 | controller | 2025-12-03 11:22:36.757923 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-03 11:22:36.758059 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.439) 0:01:01.110 **** 2025-12-03 11:22:36.777596 | controller | skipping: [instance] 2025-12-03 11:22:36.777742 | controller | 2025-12-03 11:22:36.777875 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-03 11:22:36.778024 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.020) 0:01:01.130 **** 2025-12-03 11:22:36.802553 | controller | skipping: [instance] 2025-12-03 11:22:36.802732 | controller | 2025-12-03 11:22:36.802861 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-03 11:22:36.803000 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.024) 0:01:01.155 **** 2025-12-03 11:22:36.832258 | controller | ok: [instance] => changed=false 2025-12-03 11:22:36.832389 | controller | msg: All assertions passed 2025-12-03 11:22:36.832505 | controller | 2025-12-03 11:22:36.832649 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-03 11:22:36.832770 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.029) 0:01:01.184 **** 2025-12-03 11:22:36.870901 | controller | ok: [instance] => changed=false 2025-12-03 11:22:36.871050 | controller | msg: All assertions passed 2025-12-03 11:22:36.871164 | controller | 2025-12-03 11:22:36.871282 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-03 11:22:36.871405 | controller | Wednesday 03 December 2025 11:22:36 +0000 (0:00:00.038) 0:01:01.223 **** 2025-12-03 11:22:37.323079 | controller | changed: [instance] 2025-12-03 11:22:37.323220 | controller | 2025-12-03 11:22:37.323373 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-03 11:22:37.323519 | controller | Wednesday 03 December 2025 11:22:37 +0000 (0:00:00.452) 0:01:01.675 **** 2025-12-03 11:22:37.342349 | controller | skipping: [instance] 2025-12-03 11:22:37.342474 | controller | 2025-12-03 11:22:37.342638 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-03 11:22:37.342769 | controller | Wednesday 03 December 2025 11:22:37 +0000 (0:00:00.019) 0:01:01.695 **** 2025-12-03 11:22:37.367121 | controller | skipping: [instance] 2025-12-03 11:22:37.367288 | controller | 2025-12-03 11:22:37.367455 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2025-12-03 11:22:37.367626 | controller | Wednesday 03 December 2025 11:22:37 +0000 (0:00:00.024) 0:01:01.719 **** 2025-12-03 11:22:37.396064 | controller | skipping: [instance] 2025-12-03 11:22:37.396211 | controller | 2025-12-03 11:22:37.396358 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-12-03 11:22:37.396502 | controller | Wednesday 03 December 2025 11:22:37 +0000 (0:00:00.028) 0:01:01.748 **** 2025-12-03 11:22:37.889690 | controller | changed: [instance] => (item=cifmw-public) 2025-12-03 11:22:37.926933 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:22:37.926955 | controller | 2025-12-03 11:22:37.926963 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-03 11:22:37.926970 | controller | Wednesday 03 December 2025 11:22:37 +0000 (0:00:00.493) 0:01:02.241 **** 2025-12-03 11:22:37.926979 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-12-03 11:22:38.272601 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-12-03 11:22:38.272632 | controller | 2025-12-03 11:22:38.272640 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-03 11:22:38.272647 | controller | Wednesday 03 December 2025 11:22:37 +0000 (0:00:00.037) 0:01:02.279 **** 2025-12-03 11:22:38.272657 | controller | ok: [instance] 2025-12-03 11:22:38.272682 | controller | 2025-12-03 11:22:38.272690 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-03 11:22:38.272808 | controller | Wednesday 03 December 2025 11:22:38 +0000 (0:00:00.345) 0:01:02.624 **** 2025-12-03 11:22:38.307085 | controller | ok: [instance] 2025-12-03 11:22:38.515554 | controller | 2025-12-03 11:22:38.515583 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-03 11:22:38.515591 | controller | Wednesday 03 December 2025 11:22:38 +0000 (0:00:00.034) 0:01:02.659 **** 2025-12-03 11:22:38.515601 | controller | ok: [instance] 2025-12-03 11:22:38.548641 | controller | 2025-12-03 11:22:38.548674 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-03 11:22:38.548682 | controller | Wednesday 03 December 2025 11:22:38 +0000 (0:00:00.208) 0:01:02.867 **** 2025-12-03 11:22:38.548701 | controller | ok: [instance] 2025-12-03 11:22:38.548730 | controller | 2025-12-03 11:22:38.549003 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-12-03 11:22:38.921174 | controller | Wednesday 03 December 2025 11:22:38 +0000 (0:00:00.033) 0:01:02.901 **** 2025-12-03 11:22:38.921216 | controller | changed: [instance] 2025-12-03 11:22:39.267613 | controller | 2025-12-03 11:22:39.267645 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-12-03 11:22:39.267655 | controller | Wednesday 03 December 2025 11:22:38 +0000 (0:00:00.372) 0:01:03.273 **** 2025-12-03 11:22:39.267666 | controller | changed: [instance] 2025-12-03 11:22:39.267693 | controller | 2025-12-03 11:22:39.267703 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-12-03 11:22:39.267829 | controller | Wednesday 03 December 2025 11:22:39 +0000 (0:00:00.346) 0:01:03.620 **** 2025-12-03 11:22:39.617588 | controller | changed: [instance] 2025-12-03 11:22:39.718624 | controller | 2025-12-03 11:22:39.718662 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-12-03 11:22:39.718673 | controller | Wednesday 03 December 2025 11:22:39 +0000 (0:00:00.349) 0:01:03.969 **** 2025-12-03 11:22:39.718685 | controller | ok: [instance] 2025-12-03 11:22:39.718716 | controller | 2025-12-03 11:22:39.718935 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-12-03 11:22:40.061552 | controller | Wednesday 03 December 2025 11:22:39 +0000 (0:00:00.101) 0:01:04.071 **** 2025-12-03 11:22:40.061594 | controller | changed: [instance] 2025-12-03 11:22:40.087447 | controller | 2025-12-03 11:22:40.087482 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-03 11:22:40.087491 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.342) 0:01:04.413 **** 2025-12-03 11:22:40.087503 | controller | skipping: [instance] 2025-12-03 11:22:40.112263 | controller | 2025-12-03 11:22:40.112293 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 11:22:40.112301 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.026) 0:01:04.439 **** 2025-12-03 11:22:40.112311 | controller | skipping: [instance] 2025-12-03 11:22:40.137324 | controller | 2025-12-03 11:22:40.137349 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-03 11:22:40.137356 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.024) 0:01:04.464 **** 2025-12-03 11:22:40.137366 | controller | skipping: [instance] 2025-12-03 11:22:40.165669 | controller | 2025-12-03 11:22:40.165702 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-03 11:22:40.165710 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.025) 0:01:04.489 **** 2025-12-03 11:22:40.165721 | controller | skipping: [instance] 2025-12-03 11:22:40.186457 | controller | 2025-12-03 11:22:40.186487 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-03 11:22:40.186495 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.028) 0:01:04.517 **** 2025-12-03 11:22:40.186505 | controller | ok: [instance] 2025-12-03 11:22:40.277798 | controller | 2025-12-03 11:22:40.277834 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-03 11:22:40.277850 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.020) 0:01:04.538 **** 2025-12-03 11:22:40.277865 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-03 11:22:40.278096 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-03 11:22:40.278269 | controller | 2025-12-03 11:22:40.278418 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-03 11:22:40.278587 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.091) 0:01:04.630 **** 2025-12-03 11:22:40.297423 | controller | skipping: [instance] 2025-12-03 11:22:40.297632 | controller | 2025-12-03 11:22:40.297813 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-03 11:22:40.298002 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.019) 0:01:04.650 **** 2025-12-03 11:22:40.503098 | controller | ok: [instance] 2025-12-03 11:22:40.503297 | controller | 2025-12-03 11:22:40.503473 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-03 11:22:40.503674 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.205) 0:01:04.855 **** 2025-12-03 11:22:40.900606 | controller | changed: [instance] 2025-12-03 11:22:40.900982 | controller | 2025-12-03 11:22:40.963640 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-03 11:22:40.963680 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.397) 0:01:05.253 **** 2025-12-03 11:22:40.963692 | controller | ok: [instance] 2025-12-03 11:22:40.963718 | controller | 2025-12-03 11:22:40.963903 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-03 11:22:40.998699 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.063) 0:01:05.316 **** 2025-12-03 11:22:40.998742 | controller | ok: [instance] 2025-12-03 11:22:41.405277 | controller | 2025-12-03 11:22:41.405309 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-03 11:22:41.405317 | controller | Wednesday 03 December 2025 11:22:40 +0000 (0:00:00.034) 0:01:05.350 **** 2025-12-03 11:22:41.405328 | controller | changed: [instance] 2025-12-03 11:22:41.434168 | controller | 2025-12-03 11:22:41.434190 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-12-03 11:22:41.434198 | controller | Wednesday 03 December 2025 11:22:41 +0000 (0:00:00.406) 0:01:05.757 **** 2025-12-03 11:22:41.434209 | controller | ok: [instance] 2025-12-03 11:22:41.453678 | controller | 2025-12-03 11:22:41.453715 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-12-03 11:22:41.453724 | controller | Wednesday 03 December 2025 11:22:41 +0000 (0:00:00.029) 0:01:05.786 **** 2025-12-03 11:22:41.453737 | controller | ok: [instance] 2025-12-03 11:22:41.474063 | controller | 2025-12-03 11:22:41.474097 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-12-03 11:22:41.474106 | controller | Wednesday 03 December 2025 11:22:41 +0000 (0:00:00.019) 0:01:05.806 **** 2025-12-03 11:22:41.474119 | controller | ok: [instance] 2025-12-03 11:22:41.552675 | controller | 2025-12-03 11:22:41.552733 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-12-03 11:22:41.552743 | controller | Wednesday 03 December 2025 11:22:41 +0000 (0:00:00.020) 0:01:05.826 **** 2025-12-03 11:22:41.552759 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-12-03 11:22:41.691255 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-12-03 11:22:41.691287 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-12-03 11:22:41.691295 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-12-03 11:22:41.691301 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-12-03 11:22:41.691306 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-12-03 11:22:41.691312 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-12-03 11:22:41.691317 | controller | 2025-12-03 11:22:41.691323 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 11:22:41.691329 | controller | Wednesday 03 December 2025 11:22:41 +0000 (0:00:00.077) 0:01:05.904 **** 2025-12-03 11:22:41.691340 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-12-03 11:22:41.776677 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-12-03 11:22:41.776712 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-12-03 11:22:41.776722 | controller | 2025-12-03 11:22:41.776730 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 11:22:41.776737 | controller | Wednesday 03 December 2025 11:22:41 +0000 (0:00:00.138) 0:01:06.043 **** 2025-12-03 11:22:41.776749 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-12-03 11:22:41.776779 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-12-03 11:22:41.776787 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-12-03 11:22:41.776793 | controller | skipping: [instance] 2025-12-03 11:22:41.776800 | controller | 2025-12-03 11:22:41.776809 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 11:22:41.776836 | controller | Wednesday 03 December 2025 11:22:41 +0000 (0:00:00.085) 0:01:06.128 **** 2025-12-03 11:22:41.859503 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-12-03 11:22:41.943543 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-12-03 11:22:41.943571 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-12-03 11:22:41.943579 | controller | skipping: [instance] 2025-12-03 11:22:41.943585 | controller | 2025-12-03 11:22:41.943591 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 11:22:41.943597 | controller | Wednesday 03 December 2025 11:22:41 +0000 (0:00:00.082) 0:01:06.211 **** 2025-12-03 11:22:41.943606 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-12-03 11:22:42.027388 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-12-03 11:22:42.027414 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-12-03 11:22:42.027422 | controller | skipping: [instance] 2025-12-03 11:22:42.027428 | controller | 2025-12-03 11:22:42.027433 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 11:22:42.027439 | controller | Wednesday 03 December 2025 11:22:41 +0000 (0:00:00.083) 0:01:06.295 **** 2025-12-03 11:22:42.027455 | controller | skipping: [instance] => (item=compute-0 - external) 2025-12-03 11:22:42.109417 | controller | skipping: [instance] => (item=controller-0 - external) 2025-12-03 11:22:42.109449 | controller | skipping: [instance] => (item=crc-0 - external) 2025-12-03 11:22:42.109458 | controller | skipping: [instance] 2025-12-03 11:22:42.109465 | controller | 2025-12-03 11:22:42.109472 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 11:22:42.109479 | controller | Wednesday 03 December 2025 11:22:42 +0000 (0:00:00.083) 0:01:06.379 **** 2025-12-03 11:22:42.109490 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-12-03 11:22:42.109737 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-12-03 11:22:42.109892 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-12-03 11:22:42.110047 | controller | skipping: [instance] 2025-12-03 11:22:42.110181 | controller | 2025-12-03 11:22:42.110315 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 11:22:42.110448 | controller | Wednesday 03 December 2025 11:22:42 +0000 (0:00:00.082) 0:01:06.462 **** 2025-12-03 11:22:42.251915 | controller | ok: [instance] => (item=compute-0 - public) 2025-12-03 11:22:42.252105 | controller | ok: [instance] => (item=controller-0 - public) 2025-12-03 11:22:42.252245 | controller | ok: [instance] => (item=crc-0 - public) 2025-12-03 11:22:42.252372 | controller | 2025-12-03 11:22:42.252506 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-12-03 11:22:42.252665 | controller | Wednesday 03 December 2025 11:22:42 +0000 (0:00:00.142) 0:01:06.604 **** 2025-12-03 11:22:42.367463 | controller | 2025-12-03 11:22:42.367703 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-12-03 11:22:42.367880 | controller | Wednesday 03 December 2025 11:22:42 +0000 (0:00:00.115) 0:01:06.720 **** 2025-12-03 11:22:42.409342 | controller | ok: [instance] 2025-12-03 11:22:42.409550 | controller | 2025-12-03 11:22:42.409752 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-12-03 11:22:42.409923 | controller | Wednesday 03 December 2025 11:22:42 +0000 (0:00:00.041) 0:01:06.762 **** 2025-12-03 11:22:42.511367 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:37:1b:b6', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-03 11:22:42.511600 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:c2:3b:f4', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-03 11:22:42.511765 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:b9:de:ee', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-03 11:22:42.511922 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:9a:6f:d7', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-03 11:22:42.512104 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:e5:46:76', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-03 11:22:42.512252 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:61:97:18', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-03 11:22:42.512387 | controller | 2025-12-03 11:22:42.512545 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-12-03 11:22:42.512702 | controller | Wednesday 03 December 2025 11:22:42 +0000 (0:00:00.101) 0:01:06.863 **** 2025-12-03 11:22:42.563421 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-12-03 11:22:42.563636 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-12-03 11:22:42.563776 | controller | 2025-12-03 11:22:42.563914 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-03 11:22:42.564064 | controller | Wednesday 03 December 2025 11:22:42 +0000 (0:00:00.052) 0:01:06.915 **** 2025-12-03 11:22:42.743188 | controller | ok: [instance] 2025-12-03 11:22:42.743390 | controller | 2025-12-03 11:22:42.743593 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-03 11:22:42.743793 | controller | Wednesday 03 December 2025 11:22:42 +0000 (0:00:00.179) 0:01:07.095 **** 2025-12-03 11:22:42.766388 | controller | ok: [instance] 2025-12-03 11:22:42.766607 | controller | 2025-12-03 11:22:42.766792 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-03 11:22:42.766961 | controller | Wednesday 03 December 2025 11:22:42 +0000 (0:00:00.023) 0:01:07.119 **** 2025-12-03 11:22:42.947739 | controller | ok: [instance] 2025-12-03 11:22:42.947903 | controller | 2025-12-03 11:22:42.948064 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-03 11:22:42.948203 | controller | Wednesday 03 December 2025 11:22:42 +0000 (0:00:00.181) 0:01:07.300 **** 2025-12-03 11:22:43.001626 | controller | ok: [instance] 2025-12-03 11:22:43.001751 | controller | 2025-12-03 11:22:43.001906 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-12-03 11:22:43.002063 | controller | Wednesday 03 December 2025 11:22:43 +0000 (0:00:00.054) 0:01:07.354 **** 2025-12-03 11:22:43.022721 | controller | ok: [instance] 2025-12-03 11:22:43.022895 | controller | 2025-12-03 11:22:43.023059 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-12-03 11:22:43.023204 | controller | Wednesday 03 December 2025 11:22:43 +0000 (0:00:00.021) 0:01:07.375 **** 2025-12-03 11:22:43.204578 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:37:1b:b6', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-03 11:22:43.204706 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:c2:3b:f4', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-03 11:22:43.204868 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:b9:de:ee', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-03 11:22:43.204968 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:9a:6f:d7', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-03 11:22:43.205110 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:e5:46:76', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-03 11:22:43.205220 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:61:97:18', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-03 11:22:43.205326 | controller | 2025-12-03 11:22:43.205448 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-12-03 11:22:43.205570 | controller | Wednesday 03 December 2025 11:22:43 +0000 (0:00:00.181) 0:01:07.557 **** 2025-12-03 11:22:43.246088 | controller | ok: [instance] 2025-12-03 11:22:43.246218 | controller | 2025-12-03 11:22:43.246373 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-12-03 11:22:43.246516 | controller | Wednesday 03 December 2025 11:22:43 +0000 (0:00:00.041) 0:01:07.598 **** 2025-12-03 11:22:45.326660 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:37:1b:b6', 'entry': 'set:compute,52:54:00:37:1b:b6,192.168.140.100,compute-0', 'state': 'present'}) 2025-12-03 11:22:45.326717 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:c2:3b:f4', 'entry': 'set:controller,52:54:01:c2:3b:f4,192.168.140.9,controller-0', 'state': 'present'}) 2025-12-03 11:22:45.326728 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:b9:de:ee', 'entry': 'set:ocp,52:54:02:b9:de:ee,192.168.140.10,crc-0', 'state': 'present'}) 2025-12-03 11:22:45.326736 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:9a:6f:d7', 'entry': 'set:compute,52:54:00:9a:6f:d7,192.168.101.100,compute-0', 'state': 'present'}) 2025-12-03 11:22:45.326745 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:e5:46:76', 'entry': 'set:controller,52:54:01:e5:46:76,192.168.101.9,controller-0', 'state': 'present'}) 2025-12-03 11:22:45.326772 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:61:97:18', 'entry': 'set:ocp,52:54:02:61:97:18,192.168.101.10,crc-0', 'state': 'present'}) 2025-12-03 11:22:45.327094 | controller | 2025-12-03 11:22:45.349657 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-12-03 11:22:45.349685 | controller | Wednesday 03 December 2025 11:22:45 +0000 (0:00:02.080) 0:01:09.678 **** 2025-12-03 11:22:45.349698 | controller | skipping: [instance] 2025-12-03 11:22:45.349732 | controller | 2025-12-03 11:22:45.349953 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-12-03 11:22:45.577709 | controller | Wednesday 03 December 2025 11:22:45 +0000 (0:00:00.023) 0:01:09.702 **** 2025-12-03 11:22:45.577754 | controller | ok: [instance] => (item=compute-0) 2025-12-03 11:22:45.577787 | controller | ok: [instance] => (item=controller-0) 2025-12-03 11:22:45.577796 | controller | ok: [instance] => (item=crc-0) 2025-12-03 11:22:45.577803 | controller | 2025-12-03 11:22:45.577813 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-12-03 11:22:45.577891 | controller | Wednesday 03 December 2025 11:22:45 +0000 (0:00:00.227) 0:01:09.929 **** 2025-12-03 11:22:45.703182 | controller | 2025-12-03 11:22:45.748283 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-03 11:22:45.748305 | controller | Wednesday 03 December 2025 11:22:45 +0000 (0:00:00.125) 0:01:10.055 **** 2025-12-03 11:22:45.748317 | controller | ok: [instance] 2025-12-03 11:22:45.959680 | controller | 2025-12-03 11:22:45.959717 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 11:22:45.959727 | controller | Wednesday 03 December 2025 11:22:45 +0000 (0:00:00.045) 0:01:10.100 **** 2025-12-03 11:22:45.959740 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 11:22:45.959771 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 11:22:45.959779 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-03 11:22:45.959786 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-03 11:22:45.959793 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-03 11:22:45.959800 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-03 11:22:45.959807 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-03 11:22:45.959823 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 11:22:45.959851 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 11:22:45.960625 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-03 11:22:45.960800 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 11:22:45.960817 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 11:22:45.960824 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-03 11:22:45.960830 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-03 11:22:45.960840 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-03 11:22:45.960846 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-03 11:22:45.960852 | controller | 2025-12-03 11:22:45.960860 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 11:22:49.188648 | controller | Wednesday 03 December 2025 11:22:45 +0000 (0:00:00.210) 0:01:10.311 **** 2025-12-03 11:22:49.188690 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 11:22:49.188719 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 11:22:49.188726 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-03 11:22:49.188732 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-03 11:22:49.188738 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-03 11:22:49.188743 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-03 11:22:49.188749 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-03 11:22:49.188754 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 11:22:49.188761 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 11:22:49.189777 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-03 11:22:49.207346 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 11:22:49.207372 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 11:22:49.207380 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-03 11:22:49.207386 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-03 11:22:49.207392 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-03 11:22:49.207398 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-03 11:22:49.207404 | controller | 2025-12-03 11:22:49.207410 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2025-12-03 11:22:49.207416 | controller | Wednesday 03 December 2025 11:22:49 +0000 (0:00:03.229) 0:01:13.540 **** 2025-12-03 11:22:49.207425 | controller | ok: [instance] 2025-12-03 11:22:49.207920 | controller | 2025-12-03 11:22:49.208100 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2025-12-03 11:22:49.208395 | controller | Wednesday 03 December 2025 11:22:49 +0000 (0:00:00.019) 0:01:13.560 **** 2025-12-03 11:22:49.249612 | controller | skipping: [instance] => (item=compute) 2025-12-03 11:22:49.250165 | controller | skipping: [instance] => (item=controller) 2025-12-03 11:22:49.250198 | controller | skipping: [instance] => (item=crc) 2025-12-03 11:22:49.279865 | controller | skipping: [instance] 2025-12-03 11:22:49.279890 | controller | 2025-12-03 11:22:49.279899 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2025-12-03 11:22:49.279907 | controller | Wednesday 03 December 2025 11:22:49 +0000 (0:00:00.042) 0:01:13.602 **** 2025-12-03 11:22:49.279918 | controller | skipping: [instance] 2025-12-03 11:22:49.280106 | controller | 2025-12-03 11:22:49.280278 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-12-03 11:22:49.280441 | controller | Wednesday 03 December 2025 11:22:49 +0000 (0:00:00.030) 0:01:13.632 **** 2025-12-03 11:22:49.655415 | controller | changed: [instance] 2025-12-03 11:22:50.473640 | controller | 2025-12-03 11:22:50.473674 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-12-03 11:22:50.473684 | controller | Wednesday 03 December 2025 11:22:49 +0000 (0:00:00.363) 0:01:13.996 **** 2025-12-03 11:22:50.473691 | controller | 2025-12-03 11:22:50.473699 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-03 11:22:50.473705 | controller | Wednesday 03 December 2025 11:22:49 +0000 (0:00:00.011) 0:01:14.007 **** 2025-12-03 11:22:50.473717 | controller | changed: [instance] 2025-12-03 11:22:50.823090 | controller | 2025-12-03 11:22:50.823119 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-03 11:22:50.823127 | controller | Wednesday 03 December 2025 11:22:50 +0000 (0:00:00.818) 0:01:14.825 **** 2025-12-03 11:22:50.823137 | controller | changed: [instance] 2025-12-03 11:22:51.166503 | controller | 2025-12-03 11:22:51.166548 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-12-03 11:22:51.166559 | controller | Wednesday 03 December 2025 11:22:50 +0000 (0:00:00.349) 0:01:15.175 **** 2025-12-03 11:22:51.166570 | controller | changed: [instance] 2025-12-03 11:22:51.540514 | controller | 2025-12-03 11:22:51.540559 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-12-03 11:22:51.540567 | controller | Wednesday 03 December 2025 11:22:51 +0000 (0:00:00.343) 0:01:15.518 **** 2025-12-03 11:22:51.540577 | controller | changed: [instance] 2025-12-03 11:22:51.917613 | controller | 2025-12-03 11:22:51.917648 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-12-03 11:22:51.917657 | controller | Wednesday 03 December 2025 11:22:51 +0000 (0:00:00.374) 0:01:15.892 **** 2025-12-03 11:22:51.917669 | controller | changed: [instance] 2025-12-03 11:22:51.918044 | controller | 2025-12-03 11:22:51.948672 | controller | TASK [Build utility records dataset] ******************************************* 2025-12-03 11:22:51.948706 | controller | Wednesday 03 December 2025 11:22:51 +0000 (0:00:00.377) 0:01:16.270 **** 2025-12-03 11:22:51.948726 | controller | 2025-12-03 11:22:51.948763 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-03 11:22:51.948777 | controller | Wednesday 03 December 2025 11:22:51 +0000 (0:00:00.031) 0:01:16.301 **** 2025-12-03 11:22:52.073310 | controller | ok: [instance] 2025-12-03 11:22:52.171642 | controller | 2025-12-03 11:22:52.171681 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 11:22:52.171689 | controller | Wednesday 03 December 2025 11:22:52 +0000 (0:00:00.124) 0:01:16.425 **** 2025-12-03 11:22:52.171701 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-03 11:22:52.172022 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 11:22:52.654654 | controller | 2025-12-03 11:22:52.654693 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 11:22:52.654704 | controller | Wednesday 03 December 2025 11:22:52 +0000 (0:00:00.098) 0:01:16.524 **** 2025-12-03 11:22:52.654723 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-03 11:22:52.654756 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 11:22:52.654765 | controller | 2025-12-03 11:22:52.654773 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-03 11:22:52.654782 | controller | Wednesday 03 December 2025 11:22:52 +0000 (0:00:00.471) 0:01:16.995 **** 2025-12-03 11:22:52.654807 | controller | 2025-12-03 11:22:52.655044 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-03 11:22:53.106393 | controller | Wednesday 03 December 2025 11:22:52 +0000 (0:00:00.010) 0:01:17.006 **** 2025-12-03 11:22:53.106425 | controller | changed: [instance] 2025-12-03 11:22:53.466460 | controller | 2025-12-03 11:22:53.466490 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-03 11:22:53.466498 | controller | Wednesday 03 December 2025 11:22:53 +0000 (0:00:00.451) 0:01:17.458 **** 2025-12-03 11:22:53.466509 | controller | changed: [instance] 2025-12-03 11:22:53.497635 | controller | 2025-12-03 11:22:53.497682 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-12-03 11:22:53.497692 | controller | Wednesday 03 December 2025 11:22:53 +0000 (0:00:00.360) 0:01:17.818 **** 2025-12-03 11:22:53.497705 | controller | skipping: [instance] 2025-12-03 11:22:53.497713 | controller | 2025-12-03 11:22:53.497720 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-12-03 11:22:53.497730 | controller | Wednesday 03 December 2025 11:22:53 +0000 (0:00:00.031) 0:01:17.850 **** 2025-12-03 11:22:53.576563 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-12-03 11:22:53.767412 | controller | 2025-12-03 11:22:53.767439 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-12-03 11:22:53.767449 | controller | Wednesday 03 December 2025 11:22:53 +0000 (0:00:00.078) 0:01:17.929 **** 2025-12-03 11:22:53.767461 | controller | ok: [instance] 2025-12-03 11:22:53.786971 | controller | 2025-12-03 11:22:53.786989 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-12-03 11:22:53.786996 | controller | Wednesday 03 December 2025 11:22:53 +0000 (0:00:00.190) 0:01:18.119 **** 2025-12-03 11:22:53.787005 | controller | skipping: [instance] 2025-12-03 11:22:54.103602 | controller | 2025-12-03 11:22:54.103635 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-12-03 11:22:54.103643 | controller | Wednesday 03 December 2025 11:22:53 +0000 (0:00:00.019) 0:01:18.139 **** 2025-12-03 11:22:54.103653 | controller | ok: [instance] 2025-12-03 11:22:54.331672 | controller | 2025-12-03 11:22:54.331705 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-12-03 11:22:54.331715 | controller | Wednesday 03 December 2025 11:22:54 +0000 (0:00:00.316) 0:01:18.455 **** 2025-12-03 11:22:54.331727 | controller | ok: [instance] 2025-12-03 11:22:54.331758 | controller | 2025-12-03 11:22:54.331768 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-12-03 11:22:54.331901 | controller | Wednesday 03 December 2025 11:22:54 +0000 (0:00:00.228) 0:01:18.684 **** 2025-12-03 11:22:54.555666 | controller | ok: [instance] 2025-12-03 11:22:54.555718 | controller | 2025-12-03 11:22:54.555731 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-12-03 11:22:54.555802 | controller | Wednesday 03 December 2025 11:22:54 +0000 (0:00:00.224) 0:01:18.908 **** 2025-12-03 11:22:54.776340 | controller | ok: [instance] 2025-12-03 11:22:55.003892 | controller | 2025-12-03 11:22:55.003920 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-12-03 11:22:55.003928 | controller | Wednesday 03 December 2025 11:22:54 +0000 (0:00:00.220) 0:01:19.128 **** 2025-12-03 11:22:55.003938 | controller | ok: [instance] 2025-12-03 11:22:55.043430 | controller | 2025-12-03 11:22:55.043452 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 11:22:55.043468 | controller | Wednesday 03 December 2025 11:22:55 +0000 (0:00:00.227) 0:01:19.356 **** 2025-12-03 11:22:55.043478 | controller | 2025-12-03 11:22:55.235511 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-03 11:22:55.235565 | controller | Wednesday 03 December 2025 11:22:55 +0000 (0:00:00.039) 0:01:19.395 **** 2025-12-03 11:22:55.235579 | controller | ok: [instance] 2025-12-03 11:22:55.257522 | controller | 2025-12-03 11:22:55.257566 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-03 11:22:55.257575 | controller | Wednesday 03 December 2025 11:22:55 +0000 (0:00:00.191) 0:01:19.587 **** 2025-12-03 11:22:55.257586 | controller | ok: [instance] 2025-12-03 11:22:55.283068 | controller | 2025-12-03 11:22:55.283103 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-03 11:22:55.283112 | controller | Wednesday 03 December 2025 11:22:55 +0000 (0:00:00.022) 0:01:19.609 **** 2025-12-03 11:22:55.283121 | controller | skipping: [instance] 2025-12-03 11:22:55.571467 | controller | 2025-12-03 11:22:55.571495 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-12-03 11:22:55.571503 | controller | Wednesday 03 December 2025 11:22:55 +0000 (0:00:00.025) 0:01:19.635 **** 2025-12-03 11:22:55.571513 | controller | ok: [instance] 2025-12-03 11:22:55.794934 | controller | 2025-12-03 11:22:55.794961 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-12-03 11:22:55.794969 | controller | Wednesday 03 December 2025 11:22:55 +0000 (0:00:00.288) 0:01:19.923 **** 2025-12-03 11:22:55.794979 | controller | ok: [instance] 2025-12-03 11:22:55.969432 | controller | 2025-12-03 11:22:55.969458 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-12-03 11:22:55.969466 | controller | Wednesday 03 December 2025 11:22:55 +0000 (0:00:00.223) 0:01:20.147 **** 2025-12-03 11:22:55.969476 | controller | ok: [instance] 2025-12-03 11:22:56.026158 | controller | 2025-12-03 11:22:56.026180 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-12-03 11:22:56.026187 | controller | Wednesday 03 December 2025 11:22:55 +0000 (0:00:00.174) 0:01:20.321 **** 2025-12-03 11:22:56.026196 | controller | 2025-12-03 11:22:56.068333 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-03 11:22:56.068352 | controller | Wednesday 03 December 2025 11:22:56 +0000 (0:00:00.056) 0:01:20.378 **** 2025-12-03 11:22:56.068362 | controller | ok: [instance] => changed=false 2025-12-03 11:22:56.243690 | controller | msg: All assertions passed 2025-12-03 11:22:56.243724 | controller | 2025-12-03 11:22:56.243732 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-03 11:22:56.243739 | controller | Wednesday 03 December 2025 11:22:56 +0000 (0:00:00.041) 0:01:20.420 **** 2025-12-03 11:22:56.243749 | controller | ok: [instance] 2025-12-03 11:22:56.243771 | controller | 2025-12-03 11:22:56.243908 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-03 11:22:56.243935 | controller | Wednesday 03 December 2025 11:22:56 +0000 (0:00:00.175) 0:01:20.596 **** 2025-12-03 11:22:56.433627 | controller | ok: [instance] 2025-12-03 11:22:56.433695 | controller | 2025-12-03 11:22:56.433708 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-03 11:22:56.433783 | controller | Wednesday 03 December 2025 11:22:56 +0000 (0:00:00.189) 0:01:20.785 **** 2025-12-03 11:22:56.457638 | controller | ok: [instance] => changed=false 2025-12-03 11:22:56.643623 | controller | msg: All assertions passed 2025-12-03 11:22:56.643655 | controller | 2025-12-03 11:22:56.643664 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-03 11:22:56.643672 | controller | Wednesday 03 December 2025 11:22:56 +0000 (0:00:00.024) 0:01:20.810 **** 2025-12-03 11:22:56.643683 | controller | ok: [instance] 2025-12-03 11:22:56.643691 | controller | 2025-12-03 11:22:56.643698 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-03 11:22:56.643707 | controller | Wednesday 03 December 2025 11:22:56 +0000 (0:00:00.185) 0:01:20.995 **** 2025-12-03 11:22:56.820684 | controller | ok: [instance] 2025-12-03 11:22:56.820743 | controller | 2025-12-03 11:22:56.820752 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-03 11:22:56.820760 | controller | Wednesday 03 December 2025 11:22:56 +0000 (0:00:00.177) 0:01:21.172 **** 2025-12-03 11:22:56.868674 | controller | ok: [instance] 2025-12-03 11:22:56.868751 | controller | 2025-12-03 11:22:56.868862 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-12-03 11:22:56.868887 | controller | Wednesday 03 December 2025 11:22:56 +0000 (0:00:00.048) 0:01:21.221 **** 2025-12-03 11:22:57.252634 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-12-03 11:22:57.252694 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-12-03 11:22:57.252990 | controller | 2025-12-03 11:22:57.273247 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-12-03 11:22:57.273267 | controller | Wednesday 03 December 2025 11:22:57 +0000 (0:00:00.383) 0:01:21.605 **** 2025-12-03 11:22:57.273279 | controller | skipping: [instance] 2025-12-03 11:22:57.297453 | controller | 2025-12-03 11:22:57.297472 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-12-03 11:22:57.297481 | controller | Wednesday 03 December 2025 11:22:57 +0000 (0:00:00.020) 0:01:21.625 **** 2025-12-03 11:22:57.297491 | controller | skipping: [instance] 2025-12-03 11:22:57.428924 | controller | 2025-12-03 11:22:57.428944 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-12-03 11:22:57.428951 | controller | Wednesday 03 December 2025 11:22:57 +0000 (0:00:00.024) 0:01:21.649 **** 2025-12-03 11:22:57.428960 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-12-03 11:22:57.452646 | controller | 2025-12-03 11:22:57.452672 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-12-03 11:22:57.452682 | controller | Wednesday 03 December 2025 11:22:57 +0000 (0:00:00.131) 0:01:21.781 **** 2025-12-03 11:22:57.452692 | controller | skipping: [instance] 2025-12-03 11:22:57.452723 | controller | 2025-12-03 11:22:57.452936 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-12-03 11:22:57.863442 | controller | Wednesday 03 December 2025 11:22:57 +0000 (0:00:00.024) 0:01:21.805 **** 2025-12-03 11:22:57.863483 | controller | changed: [instance] 2025-12-03 11:22:58.369627 | controller | 2025-12-03 11:22:58.369662 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-12-03 11:22:58.369670 | controller | Wednesday 03 December 2025 11:22:57 +0000 (0:00:00.410) 0:01:22.215 **** 2025-12-03 11:22:58.369680 | controller | changed: [instance] 2025-12-03 11:22:58.369701 | controller | 2025-12-03 11:22:58.369708 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-12-03 11:22:58.369715 | controller | Wednesday 03 December 2025 11:22:58 +0000 (0:00:00.495) 0:01:22.711 **** 2025-12-03 11:22:58.370023 | controller | 2025-12-03 11:22:58.811255 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-03 11:22:58.811293 | controller | Wednesday 03 December 2025 11:22:58 +0000 (0:00:00.010) 0:01:22.722 **** 2025-12-03 11:22:58.811305 | controller | changed: [instance] 2025-12-03 11:22:58.811324 | controller | 2025-12-03 11:22:58.811599 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-03 11:22:59.632464 | controller | Wednesday 03 December 2025 11:22:58 +0000 (0:00:00.441) 0:01:23.163 **** 2025-12-03 11:22:59.632497 | controller | changed: [instance] 2025-12-03 11:22:59.665633 | controller | 2025-12-03 11:22:59.665669 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-12-03 11:22:59.665677 | controller | Wednesday 03 December 2025 11:22:59 +0000 (0:00:00.821) 0:01:23.984 **** 2025-12-03 11:22:59.665688 | controller | skipping: [instance] 2025-12-03 11:22:59.698258 | controller | 2025-12-03 11:22:59.698283 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-12-03 11:22:59.698291 | controller | Wednesday 03 December 2025 11:22:59 +0000 (0:00:00.033) 0:01:24.018 **** 2025-12-03 11:22:59.698300 | controller | skipping: [instance] 2025-12-03 11:23:00.253325 | controller | 2025-12-03 11:23:00.253359 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-12-03 11:23:00.253368 | controller | Wednesday 03 December 2025 11:22:59 +0000 (0:00:00.032) 0:01:24.050 **** 2025-12-03 11:23:00.253378 | controller | changed: [instance] => (item=workload) 2025-12-03 11:23:00.657397 | controller | changed: [instance] => (item=reproducer-inventory) 2025-12-03 11:23:00.657429 | controller | ok: [instance] => (item=volumes) 2025-12-03 11:23:00.657437 | controller | 2025-12-03 11:23:00.657443 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-12-03 11:23:00.657449 | controller | Wednesday 03 December 2025 11:23:00 +0000 (0:00:00.554) 0:01:24.605 **** 2025-12-03 11:23:00.657459 | controller | changed: [instance] => (item=workload) 2025-12-03 11:23:00.683052 | controller | changed: [instance] => (item=volumes) 2025-12-03 11:23:00.683076 | controller | 2025-12-03 11:23:00.683084 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-12-03 11:23:00.683090 | controller | Wednesday 03 December 2025 11:23:00 +0000 (0:00:00.404) 0:01:25.009 **** 2025-12-03 11:23:00.683099 | controller | skipping: [instance] 2025-12-03 11:23:01.737200 | controller | 2025-12-03 11:23:01.737232 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-12-03 11:23:01.737241 | controller | Wednesday 03 December 2025 11:23:00 +0000 (0:00:00.025) 0:01:25.035 **** 2025-12-03 11:23:01.737251 | controller | changed: [instance] => (item=compute) 2025-12-03 11:23:02.131218 | controller | changed: [instance] => (item=controller) 2025-12-03 11:23:02.131251 | controller | changed: [instance] => (item=crc) 2025-12-03 11:23:02.131259 | controller | 2025-12-03 11:23:02.131265 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-12-03 11:23:02.131276 | controller | Wednesday 03 December 2025 11:23:01 +0000 (0:00:01.053) 0:01:26.088 **** 2025-12-03 11:23:02.131286 | controller | changed: [instance] 2025-12-03 11:23:02.179101 | controller | 2025-12-03 11:23:02.179123 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-12-03 11:23:02.179130 | controller | Wednesday 03 December 2025 11:23:02 +0000 (0:00:00.394) 0:01:26.482 **** 2025-12-03 11:23:02.179139 | controller | skipping: [instance] 2025-12-03 11:23:02.253189 | controller | 2025-12-03 11:23:02.253210 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-12-03 11:23:02.253217 | controller | Wednesday 03 December 2025 11:23:02 +0000 (0:00:00.048) 0:01:26.531 **** 2025-12-03 11:23:02.253226 | controller | skipping: [instance] => (item=crc) 2025-12-03 11:23:02.488171 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-12-03 11:23:02.488206 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-12-03 11:23:02.488216 | controller | 2025-12-03 11:23:02.488223 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-03 11:23:02.488231 | controller | Wednesday 03 December 2025 11:23:02 +0000 (0:00:00.073) 0:01:26.605 **** 2025-12-03 11:23:02.488242 | controller | changed: [instance] 2025-12-03 11:23:02.679013 | controller | 2025-12-03 11:23:02.679045 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-03 11:23:02.679053 | controller | Wednesday 03 December 2025 11:23:02 +0000 (0:00:00.234) 0:01:26.839 **** 2025-12-03 11:23:02.679063 | controller | ok: [instance] 2025-12-03 11:23:23.376619 | controller | 2025-12-03 11:23:23.376650 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-03 11:23:23.376658 | controller | Wednesday 03 December 2025 11:23:02 +0000 (0:00:00.191) 0:01:27.031 **** 2025-12-03 11:23:23.376668 | controller | changed: [instance] 2025-12-03 11:23:23.376694 | controller | 2025-12-03 11:23:23.376951 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-03 11:23:23.576220 | controller | Wednesday 03 December 2025 11:23:23 +0000 (0:00:20.697) 0:01:47.728 **** 2025-12-03 11:23:23.576260 | controller | ok: [instance] 2025-12-03 11:23:23.618440 | controller | 2025-12-03 11:23:23.618463 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-03 11:23:23.618480 | controller | Wednesday 03 December 2025 11:23:23 +0000 (0:00:00.199) 0:01:47.928 **** 2025-12-03 11:23:23.618491 | controller | ok: [instance] => changed=false 2025-12-03 11:23:23.829691 | controller | msg: All assertions passed 2025-12-03 11:23:23.829728 | controller | 2025-12-03 11:23:23.829738 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-03 11:23:23.829746 | controller | Wednesday 03 December 2025 11:23:23 +0000 (0:00:00.042) 0:01:47.970 **** 2025-12-03 11:23:23.829757 | controller | changed: [instance] 2025-12-03 11:23:23.829787 | controller | 2025-12-03 11:23:23.829797 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-03 11:23:23.829907 | controller | Wednesday 03 December 2025 11:23:23 +0000 (0:00:00.211) 0:01:48.181 **** 2025-12-03 11:23:24.038760 | controller | ok: [instance] 2025-12-03 11:23:24.235127 | controller | 2025-12-03 11:23:24.235157 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-03 11:23:24.235165 | controller | Wednesday 03 December 2025 11:23:24 +0000 (0:00:00.208) 0:01:48.390 **** 2025-12-03 11:23:24.235174 | controller | ok: [instance] 2025-12-03 11:23:24.258007 | controller | 2025-12-03 11:23:24.258027 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-03 11:23:24.258034 | controller | Wednesday 03 December 2025 11:23:24 +0000 (0:00:00.196) 0:01:48.587 **** 2025-12-03 11:23:24.258044 | controller | skipping: [instance] 2025-12-03 11:23:24.460012 | controller | 2025-12-03 11:23:24.460042 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-03 11:23:24.460050 | controller | Wednesday 03 December 2025 11:23:24 +0000 (0:00:00.023) 0:01:48.610 **** 2025-12-03 11:23:24.460059 | controller | ok: [instance] 2025-12-03 11:23:24.502656 | controller | 2025-12-03 11:23:24.502693 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-03 11:23:24.502703 | controller | Wednesday 03 December 2025 11:23:24 +0000 (0:00:00.201) 0:01:48.812 **** 2025-12-03 11:23:24.502715 | controller | ok: [instance] => changed=false 2025-12-03 11:23:24.502745 | controller | msg: All assertions passed 2025-12-03 11:23:24.502753 | controller | 2025-12-03 11:23:24.502762 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-03 11:23:24.721482 | controller | Wednesday 03 December 2025 11:23:24 +0000 (0:00:00.042) 0:01:48.854 **** 2025-12-03 11:23:24.721539 | controller | ok: [instance] 2025-12-03 11:23:24.918367 | controller | 2025-12-03 11:23:24.918409 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-12-03 11:23:24.918418 | controller | Wednesday 03 December 2025 11:23:24 +0000 (0:00:00.216) 0:01:49.071 **** 2025-12-03 11:23:24.918432 | controller | ok: [instance] 2025-12-03 11:23:24.918628 | controller | 2025-12-03 11:23:24.918662 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-12-03 11:23:25.320656 | controller | Wednesday 03 December 2025 11:23:24 +0000 (0:00:00.198) 0:01:49.270 **** 2025-12-03 11:23:25.320705 | controller | changed: [instance] 2025-12-03 11:23:25.498687 | controller | 2025-12-03 11:23:25.498721 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-12-03 11:23:25.498731 | controller | Wednesday 03 December 2025 11:23:25 +0000 (0:00:00.402) 0:01:49.672 **** 2025-12-03 11:23:25.498743 | controller | ok: [instance] 2025-12-03 11:23:25.498773 | controller | 2025-12-03 11:23:25.498783 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-12-03 11:23:25.498887 | controller | Wednesday 03 December 2025 11:23:25 +0000 (0:00:00.178) 0:01:49.851 **** 2025-12-03 11:23:25.676395 | controller | ok: [instance] 2025-12-03 11:23:26.092617 | controller | 2025-12-03 11:23:26.092647 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-12-03 11:23:26.092655 | controller | Wednesday 03 December 2025 11:23:25 +0000 (0:00:00.177) 0:01:50.028 **** 2025-12-03 11:23:26.092666 | controller | changed: [instance] 2025-12-03 11:23:26.092687 | controller | 2025-12-03 11:23:26.092695 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-12-03 11:23:26.092771 | controller | Wednesday 03 December 2025 11:23:26 +0000 (0:00:00.416) 0:01:50.444 **** 2025-12-03 11:23:26.114470 | controller | ok: [instance] 2025-12-03 11:23:26.345682 | controller | 2025-12-03 11:23:26.345721 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-12-03 11:23:26.345730 | controller | Wednesday 03 December 2025 11:23:26 +0000 (0:00:00.021) 0:01:50.466 **** 2025-12-03 11:23:26.345742 | controller | ok: [instance] 2025-12-03 11:23:26.345765 | controller | 2025-12-03 11:23:26.345797 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-12-03 11:23:26.345950 | controller | Wednesday 03 December 2025 11:23:26 +0000 (0:00:00.231) 0:01:50.698 **** 2025-12-03 11:23:26.820305 | controller | ok: [instance] 2025-12-03 11:23:26.942377 | controller | 2025-12-03 11:23:26.942425 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-12-03 11:23:26.942433 | controller | Wednesday 03 December 2025 11:23:26 +0000 (0:00:00.474) 0:01:51.172 **** 2025-12-03 11:23:26.942444 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 11:23:27.259297 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 11:23:27.259334 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 11:23:27.259344 | controller | 2025-12-03 11:23:27.259352 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-12-03 11:23:27.259359 | controller | Wednesday 03 December 2025 11:23:26 +0000 (0:00:00.121) 0:01:51.294 **** 2025-12-03 11:23:27.259371 | controller | changed: [instance] 2025-12-03 11:23:27.524344 | controller | 2025-12-03 11:23:27.524376 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-12-03 11:23:27.524384 | controller | Wednesday 03 December 2025 11:23:27 +0000 (0:00:00.317) 0:01:51.611 **** 2025-12-03 11:23:27.524406 | controller | changed: [instance] 2025-12-03 11:23:27.831012 | controller | 2025-12-03 11:23:27.831042 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-12-03 11:23:27.831050 | controller | Wednesday 03 December 2025 11:23:27 +0000 (0:00:00.265) 0:01:51.876 **** 2025-12-03 11:23:27.831061 | controller | changed: [instance] 2025-12-03 11:23:27.860632 | controller | 2025-12-03 11:23:27.860660 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-12-03 11:23:27.860670 | controller | Wednesday 03 December 2025 11:23:27 +0000 (0:00:00.306) 0:01:52.183 **** 2025-12-03 11:23:27.860681 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-03 11:23:27.860711 | controller | 2025-12-03 11:23:27.860721 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-03 11:23:27.860833 | controller | Wednesday 03 December 2025 11:23:27 +0000 (0:00:00.030) 0:01:52.213 **** 2025-12-03 11:23:27.908674 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-03 11:23:27.908799 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-03 11:23:27.908828 | controller | 2025-12-03 11:23:27.908836 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 11:23:27.908846 | controller | Wednesday 03 December 2025 11:23:27 +0000 (0:00:00.047) 0:01:52.260 **** 2025-12-03 11:23:28.140361 | controller | ok: [instance] 2025-12-03 11:23:28.186669 | controller | 2025-12-03 11:23:28.186704 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 11:23:28.186714 | controller | Wednesday 03 December 2025 11:23:28 +0000 (0:00:00.231) 0:01:52.492 **** 2025-12-03 11:23:28.186727 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:23:28.425699 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 11:23:28.425747 | controller | 2025-12-03 11:23:28.425757 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 11:23:28.425770 | controller | Wednesday 03 December 2025 11:23:28 +0000 (0:00:00.046) 0:01:52.538 **** 2025-12-03 11:23:28.425783 | controller | ok: [instance] 2025-12-03 11:23:28.425812 | controller | 2025-12-03 11:23:28.425822 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 11:23:28.425849 | controller | Wednesday 03 December 2025 11:23:28 +0000 (0:00:00.239) 0:01:52.778 **** 2025-12-03 11:23:28.629304 | controller | ok: [instance] 2025-12-03 11:23:28.926578 | controller | 2025-12-03 11:23:28.926608 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-12-03 11:23:28.926615 | controller | Wednesday 03 December 2025 11:23:28 +0000 (0:00:00.203) 0:01:52.981 **** 2025-12-03 11:23:28.926625 | controller | changed: [instance] 2025-12-03 11:23:29.158227 | controller | 2025-12-03 11:23:29.158257 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 11:23:29.158264 | controller | Wednesday 03 December 2025 11:23:28 +0000 (0:00:00.297) 0:01:53.278 **** 2025-12-03 11:23:29.158274 | controller | ok: [instance] 2025-12-03 11:23:29.205439 | controller | 2025-12-03 11:23:29.205468 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 11:23:29.205476 | controller | Wednesday 03 December 2025 11:23:29 +0000 (0:00:00.231) 0:01:53.510 **** 2025-12-03 11:23:29.205486 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:23:29.437171 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 11:23:29.437202 | controller | 2025-12-03 11:23:29.437212 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 11:23:29.437219 | controller | Wednesday 03 December 2025 11:23:29 +0000 (0:00:00.047) 0:01:53.557 **** 2025-12-03 11:23:29.437231 | controller | ok: [instance] 2025-12-03 11:23:29.641260 | controller | 2025-12-03 11:23:29.641287 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 11:23:29.641295 | controller | Wednesday 03 December 2025 11:23:29 +0000 (0:00:00.231) 0:01:53.789 **** 2025-12-03 11:23:29.641305 | controller | ok: [instance] 2025-12-03 11:23:29.931722 | controller | 2025-12-03 11:23:29.931756 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-12-03 11:23:29.931765 | controller | Wednesday 03 December 2025 11:23:29 +0000 (0:00:00.204) 0:01:53.993 **** 2025-12-03 11:23:29.931775 | controller | changed: [instance] 2025-12-03 11:23:29.931794 | controller | 2025-12-03 11:23:29.932049 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-12-03 11:23:29.954521 | controller | Wednesday 03 December 2025 11:23:29 +0000 (0:00:00.290) 0:01:54.284 **** 2025-12-03 11:23:29.954572 | controller | skipping: [instance] 2025-12-03 11:23:29.984697 | controller | 2025-12-03 11:23:29.984721 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-12-03 11:23:29.984731 | controller | Wednesday 03 December 2025 11:23:29 +0000 (0:00:00.022) 0:01:54.306 **** 2025-12-03 11:23:29.984742 | controller | skipping: [instance] 2025-12-03 11:23:29.984778 | controller | 2025-12-03 11:23:29.984788 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-12-03 11:23:29.984866 | controller | Wednesday 03 December 2025 11:23:29 +0000 (0:00:00.030) 0:01:54.337 **** 2025-12-03 11:23:30.014318 | controller | skipping: [instance] 2025-12-03 11:23:30.040699 | controller | 2025-12-03 11:23:30.040746 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-12-03 11:23:30.040756 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.029) 0:01:54.366 **** 2025-12-03 11:23:30.040768 | controller | skipping: [instance] 2025-12-03 11:23:30.040795 | controller | 2025-12-03 11:23:30.040805 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-03 11:23:30.253011 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.026) 0:01:54.393 **** 2025-12-03 11:23:30.253045 | controller | changed: [instance] 2025-12-03 11:23:30.289613 | controller | 2025-12-03 11:23:30.289639 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-03 11:23:30.289656 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.212) 0:01:54.605 **** 2025-12-03 11:23:30.289667 | controller | ok: [instance] 2025-12-03 11:23:30.289819 | controller | 2025-12-03 11:23:30.289837 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-03 11:23:30.345240 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.037) 0:01:54.642 **** 2025-12-03 11:23:30.345262 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-03 11:23:30.546089 | controller | 2025-12-03 11:23:30.546118 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-03 11:23:30.546126 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.055) 0:01:54.697 **** 2025-12-03 11:23:30.546140 | controller | ok: [instance] 2025-12-03 11:23:30.610547 | controller | 2025-12-03 11:23:30.610574 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-03 11:23:30.610583 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.200) 0:01:54.898 **** 2025-12-03 11:23:30.610595 | controller | ok: [instance] 2025-12-03 11:23:30.657284 | controller | 2025-12-03 11:23:30.657310 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-03 11:23:30.657318 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.064) 0:01:54.962 **** 2025-12-03 11:23:30.657327 | controller | ok: [instance] 2025-12-03 11:23:30.701141 | controller | 2025-12-03 11:23:30.701168 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-03 11:23:30.701175 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.047) 0:01:55.009 **** 2025-12-03 11:23:30.701185 | controller | skipping: [instance] 2025-12-03 11:23:30.746684 | controller | 2025-12-03 11:23:30.746723 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-03 11:23:30.746733 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.043) 0:01:55.053 **** 2025-12-03 11:23:30.746746 | controller | skipping: [instance] 2025-12-03 11:23:30.808243 | controller | 2025-12-03 11:23:30.808274 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-03 11:23:30.808289 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.045) 0:01:55.098 **** 2025-12-03 11:23:30.808299 | controller | 2025-12-03 11:23:31.217542 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-03 11:23:31.217573 | controller | Wednesday 03 December 2025 11:23:30 +0000 (0:00:00.061) 0:01:55.160 **** 2025-12-03 11:23:31.217585 | controller | ok: [instance] => (item=artifacts) 2025-12-03 11:23:32.464110 | controller | ok: [instance] => (item=logs) 2025-12-03 11:23:32.464139 | controller | 2025-12-03 11:23:32.464148 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-03 11:23:32.464154 | controller | Wednesday 03 December 2025 11:23:31 +0000 (0:00:00.408) 0:01:55.569 **** 2025-12-03 11:23:32.464163 | controller | ok: [instance] 2025-12-03 11:23:32.682580 | controller | 2025-12-03 11:23:32.682618 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-03 11:23:32.682627 | controller | Wednesday 03 December 2025 11:23:32 +0000 (0:00:01.246) 0:01:56.816 **** 2025-12-03 11:23:32.682638 | controller | changed: [instance] 2025-12-03 11:23:33.060694 | controller | 2025-12-03 11:23:33.060725 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-03 11:23:33.060733 | controller | Wednesday 03 December 2025 11:23:32 +0000 (0:00:00.218) 0:01:57.034 **** 2025-12-03 11:23:33.060743 | controller | changed: [instance] 2025-12-03 11:23:33.060768 | controller | 2025-12-03 11:23:33.060776 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-03 11:23:33.060918 | controller | Wednesday 03 December 2025 11:23:33 +0000 (0:00:00.378) 0:01:57.413 **** 2025-12-03 11:23:33.438670 | controller | changed: [instance] 2025-12-03 11:23:33.482270 | controller | 2025-12-03 11:23:33.482304 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-03 11:23:33.482314 | controller | Wednesday 03 December 2025 11:23:33 +0000 (0:00:00.377) 0:01:57.790 **** 2025-12-03 11:23:33.482331 | controller | skipping: [instance] 2025-12-03 11:23:33.684114 | controller | 2025-12-03 11:23:33.684140 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-03 11:23:33.684147 | controller | Wednesday 03 December 2025 11:23:33 +0000 (0:00:00.043) 0:01:57.834 **** 2025-12-03 11:23:33.684157 | controller | ok: [instance] 2025-12-03 11:23:33.726708 | controller | 2025-12-03 11:23:33.726746 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-03 11:23:33.726756 | controller | Wednesday 03 December 2025 11:23:33 +0000 (0:00:00.201) 0:01:58.036 **** 2025-12-03 11:23:33.726768 | controller | skipping: [instance] 2025-12-03 11:23:33.957607 | controller | 2025-12-03 11:23:33.957633 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-03 11:23:33.957641 | controller | Wednesday 03 December 2025 11:23:33 +0000 (0:00:00.042) 0:01:58.079 **** 2025-12-03 11:23:33.957652 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-12-03 11:23:34.238039 | controller | changed: [instance] 2025-12-03 11:23:34.238073 | controller | 2025-12-03 11:23:34.238081 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-03 11:23:34.238087 | controller | Wednesday 03 December 2025 11:23:33 +0000 (0:00:00.230) 0:01:58.309 **** 2025-12-03 11:23:34.238102 | controller | changed: [instance] 2025-12-03 11:23:34.281992 | controller | 2025-12-03 11:23:34.282017 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-03 11:23:34.282024 | controller | Wednesday 03 December 2025 11:23:34 +0000 (0:00:00.280) 0:01:58.590 **** 2025-12-03 11:23:34.282033 | controller | skipping: [instance] 2025-12-03 11:23:34.307917 | controller | 2025-12-03 11:23:34.307937 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2025-12-03 11:23:34.307944 | controller | Wednesday 03 December 2025 11:23:34 +0000 (0:00:00.044) 0:01:58.634 **** 2025-12-03 11:23:34.307953 | controller | skipping: [instance] 2025-12-03 11:23:34.554638 | controller | 2025-12-03 11:23:34.554670 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-12-03 11:23:34.554680 | controller | Wednesday 03 December 2025 11:23:34 +0000 (0:00:00.025) 0:01:58.660 **** 2025-12-03 11:23:34.554691 | controller | changed: [instance] 2025-12-03 11:23:34.554881 | controller | 2025-12-03 11:23:34.554913 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-12-03 11:23:34.778103 | controller | Wednesday 03 December 2025 11:23:34 +0000 (0:00:00.246) 0:01:58.907 **** 2025-12-03 11:23:34.778136 | controller | changed: [instance] 2025-12-03 11:23:35.110333 | controller | 2025-12-03 11:23:35.110361 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-12-03 11:23:35.110370 | controller | Wednesday 03 December 2025 11:23:34 +0000 (0:00:00.223) 0:01:59.130 **** 2025-12-03 11:23:35.110379 | controller | changed: [instance] 2025-12-03 11:23:35.139246 | controller | 2025-12-03 11:23:35.139269 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-12-03 11:23:35.139278 | controller | Wednesday 03 December 2025 11:23:35 +0000 (0:00:00.332) 0:01:59.462 **** 2025-12-03 11:23:35.139294 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-03 11:23:35.183426 | controller | 2025-12-03 11:23:35.183450 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-03 11:23:35.183459 | controller | Wednesday 03 December 2025 11:23:35 +0000 (0:00:00.028) 0:01:59.491 **** 2025-12-03 11:23:35.183483 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-03 11:23:35.435281 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-03 11:23:35.435317 | controller | 2025-12-03 11:23:35.435325 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 11:23:35.435331 | controller | Wednesday 03 December 2025 11:23:35 +0000 (0:00:00.044) 0:01:59.535 **** 2025-12-03 11:23:35.435346 | controller | ok: [instance] 2025-12-03 11:23:35.481407 | controller | 2025-12-03 11:23:35.481432 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 11:23:35.481439 | controller | Wednesday 03 December 2025 11:23:35 +0000 (0:00:00.251) 0:01:59.787 **** 2025-12-03 11:23:35.481449 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:23:35.717364 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 11:23:35.717398 | controller | 2025-12-03 11:23:35.717408 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 11:23:35.717415 | controller | Wednesday 03 December 2025 11:23:35 +0000 (0:00:00.046) 0:01:59.833 **** 2025-12-03 11:23:35.717427 | controller | ok: [instance] 2025-12-03 11:23:35.925647 | controller | 2025-12-03 11:23:35.925696 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 11:23:35.925706 | controller | Wednesday 03 December 2025 11:23:35 +0000 (0:00:00.235) 0:02:00.069 **** 2025-12-03 11:23:35.925720 | controller | ok: [instance] 2025-12-03 11:23:35.925768 | controller | 2025-12-03 11:23:35.925778 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-12-03 11:23:36.215650 | controller | Wednesday 03 December 2025 11:23:35 +0000 (0:00:00.208) 0:02:00.278 **** 2025-12-03 11:23:36.215690 | controller | changed: [instance] 2025-12-03 11:23:36.451701 | controller | 2025-12-03 11:23:36.451735 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 11:23:36.451745 | controller | Wednesday 03 December 2025 11:23:36 +0000 (0:00:00.289) 0:02:00.567 **** 2025-12-03 11:23:36.451757 | controller | ok: [instance] 2025-12-03 11:23:36.498231 | controller | 2025-12-03 11:23:36.498252 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 11:23:36.498260 | controller | Wednesday 03 December 2025 11:23:36 +0000 (0:00:00.235) 0:02:00.803 **** 2025-12-03 11:23:36.498269 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:23:36.733655 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 11:23:36.733691 | controller | 2025-12-03 11:23:36.733701 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 11:23:36.733708 | controller | Wednesday 03 December 2025 11:23:36 +0000 (0:00:00.046) 0:02:00.850 **** 2025-12-03 11:23:36.733721 | controller | ok: [instance] 2025-12-03 11:23:36.733751 | controller | 2025-12-03 11:23:36.733761 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 11:23:36.733883 | controller | Wednesday 03 December 2025 11:23:36 +0000 (0:00:00.235) 0:02:01.086 **** 2025-12-03 11:23:36.942681 | controller | ok: [instance] 2025-12-03 11:23:37.237190 | controller | 2025-12-03 11:23:37.237223 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-12-03 11:23:37.237233 | controller | Wednesday 03 December 2025 11:23:36 +0000 (0:00:00.208) 0:02:01.294 **** 2025-12-03 11:23:37.237245 | controller | changed: [instance] 2025-12-03 11:23:37.258656 | controller | 2025-12-03 11:23:37.258691 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-12-03 11:23:37.258701 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.294) 0:02:01.589 **** 2025-12-03 11:23:37.258713 | controller | skipping: [instance] 2025-12-03 11:23:37.258721 | controller | 2025-12-03 11:23:37.258727 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-12-03 11:23:37.258737 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.021) 0:02:01.611 **** 2025-12-03 11:23:37.288643 | controller | skipping: [instance] 2025-12-03 11:23:37.317317 | controller | 2025-12-03 11:23:37.317351 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-12-03 11:23:37.317361 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.029) 0:02:01.641 **** 2025-12-03 11:23:37.317373 | controller | skipping: [instance] 2025-12-03 11:23:37.344227 | controller | 2025-12-03 11:23:37.344253 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-12-03 11:23:37.344262 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.028) 0:02:01.669 **** 2025-12-03 11:23:37.344279 | controller | skipping: [instance] 2025-12-03 11:23:37.565624 | controller | 2025-12-03 11:23:37.565656 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-03 11:23:37.565665 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.026) 0:02:01.696 **** 2025-12-03 11:23:37.565675 | controller | changed: [instance] 2025-12-03 11:23:37.565694 | controller | 2025-12-03 11:23:37.565930 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-03 11:23:37.603651 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.221) 0:02:01.918 **** 2025-12-03 11:23:37.603716 | controller | ok: [instance] 2025-12-03 11:23:37.603767 | controller | 2025-12-03 11:23:37.603779 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-03 11:23:37.658442 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.038) 0:02:01.956 **** 2025-12-03 11:23:37.658478 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-03 11:23:37.857960 | controller | 2025-12-03 11:23:37.857986 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-03 11:23:37.857994 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.054) 0:02:02.010 **** 2025-12-03 11:23:37.858003 | controller | ok: [instance] 2025-12-03 11:23:37.920612 | controller | 2025-12-03 11:23:37.920645 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-03 11:23:37.920654 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.199) 0:02:02.210 **** 2025-12-03 11:23:37.920667 | controller | ok: [instance] 2025-12-03 11:23:37.967612 | controller | 2025-12-03 11:23:37.967649 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-03 11:23:37.967659 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.062) 0:02:02.272 **** 2025-12-03 11:23:37.967672 | controller | ok: [instance] 2025-12-03 11:23:37.967702 | controller | 2025-12-03 11:23:37.967938 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-03 11:23:38.011664 | controller | Wednesday 03 December 2025 11:23:37 +0000 (0:00:00.047) 0:02:02.320 **** 2025-12-03 11:23:38.011702 | controller | skipping: [instance] 2025-12-03 11:23:38.011756 | controller | 2025-12-03 11:23:38.011781 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-03 11:23:38.011793 | controller | Wednesday 03 December 2025 11:23:38 +0000 (0:00:00.043) 0:02:02.364 **** 2025-12-03 11:23:38.057093 | controller | skipping: [instance] 2025-12-03 11:23:38.117085 | controller | 2025-12-03 11:23:38.117113 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-03 11:23:38.117122 | controller | Wednesday 03 December 2025 11:23:38 +0000 (0:00:00.045) 0:02:02.409 **** 2025-12-03 11:23:38.117133 | controller | 2025-12-03 11:23:38.522444 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-03 11:23:38.522477 | controller | Wednesday 03 December 2025 11:23:38 +0000 (0:00:00.059) 0:02:02.469 **** 2025-12-03 11:23:38.522493 | controller | ok: [instance] => (item=artifacts) 2025-12-03 11:23:39.769254 | controller | ok: [instance] => (item=logs) 2025-12-03 11:23:39.769288 | controller | 2025-12-03 11:23:39.769295 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-03 11:23:39.769302 | controller | Wednesday 03 December 2025 11:23:38 +0000 (0:00:00.404) 0:02:02.874 **** 2025-12-03 11:23:39.769311 | controller | ok: [instance] 2025-12-03 11:23:39.988622 | controller | 2025-12-03 11:23:39.988653 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-03 11:23:39.988661 | controller | Wednesday 03 December 2025 11:23:39 +0000 (0:00:01.246) 0:02:04.121 **** 2025-12-03 11:23:39.988671 | controller | changed: [instance] 2025-12-03 11:23:39.988888 | controller | 2025-12-03 11:23:39.988902 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-03 11:23:40.362370 | controller | Wednesday 03 December 2025 11:23:39 +0000 (0:00:00.219) 0:02:04.341 **** 2025-12-03 11:23:40.362409 | controller | changed: [instance] 2025-12-03 11:23:40.743410 | controller | 2025-12-03 11:23:40.743441 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-03 11:23:40.743454 | controller | Wednesday 03 December 2025 11:23:40 +0000 (0:00:00.373) 0:02:04.714 **** 2025-12-03 11:23:40.743464 | controller | changed: [instance] 2025-12-03 11:23:40.789352 | controller | 2025-12-03 11:23:40.789370 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-03 11:23:40.789378 | controller | Wednesday 03 December 2025 11:23:40 +0000 (0:00:00.381) 0:02:05.095 **** 2025-12-03 11:23:40.789386 | controller | skipping: [instance] 2025-12-03 11:23:40.994467 | controller | 2025-12-03 11:23:40.994497 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-03 11:23:40.994505 | controller | Wednesday 03 December 2025 11:23:40 +0000 (0:00:00.046) 0:02:05.141 **** 2025-12-03 11:23:40.994515 | controller | ok: [instance] 2025-12-03 11:23:41.036219 | controller | 2025-12-03 11:23:41.036243 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-03 11:23:41.036253 | controller | Wednesday 03 December 2025 11:23:40 +0000 (0:00:00.204) 0:02:05.346 **** 2025-12-03 11:23:41.036264 | controller | skipping: [instance] 2025-12-03 11:23:41.275183 | controller | 2025-12-03 11:23:41.275208 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-03 11:23:41.275216 | controller | Wednesday 03 December 2025 11:23:41 +0000 (0:00:00.042) 0:02:05.388 **** 2025-12-03 11:23:41.275225 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-12-03 11:23:41.556248 | controller | changed: [instance] 2025-12-03 11:23:41.556279 | controller | 2025-12-03 11:23:41.556289 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-03 11:23:41.556296 | controller | Wednesday 03 December 2025 11:23:41 +0000 (0:00:00.238) 0:02:05.627 **** 2025-12-03 11:23:41.556308 | controller | changed: [instance] 2025-12-03 11:23:41.602969 | controller | 2025-12-03 11:23:41.602988 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-03 11:23:41.602995 | controller | Wednesday 03 December 2025 11:23:41 +0000 (0:00:00.280) 0:02:05.908 **** 2025-12-03 11:23:41.603005 | controller | skipping: [instance] 2025-12-03 11:23:41.631704 | controller | 2025-12-03 11:23:41.631740 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2025-12-03 11:23:41.631750 | controller | Wednesday 03 December 2025 11:23:41 +0000 (0:00:00.046) 0:02:05.955 **** 2025-12-03 11:23:41.631762 | controller | skipping: [instance] 2025-12-03 11:23:41.880310 | controller | 2025-12-03 11:23:41.880338 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-12-03 11:23:41.880346 | controller | Wednesday 03 December 2025 11:23:41 +0000 (0:00:00.028) 0:02:05.984 **** 2025-12-03 11:23:41.880356 | controller | changed: [instance] 2025-12-03 11:23:42.105481 | controller | 2025-12-03 11:23:42.105508 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-12-03 11:23:42.105516 | controller | Wednesday 03 December 2025 11:23:41 +0000 (0:00:00.248) 0:02:06.232 **** 2025-12-03 11:23:42.105555 | controller | changed: [instance] 2025-12-03 11:23:42.399662 | controller | 2025-12-03 11:23:42.399696 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-12-03 11:23:42.399706 | controller | Wednesday 03 December 2025 11:23:42 +0000 (0:00:00.225) 0:02:06.457 **** 2025-12-03 11:23:42.399718 | controller | changed: [instance] 2025-12-03 11:23:42.399752 | controller | 2025-12-03 11:23:42.399764 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-12-03 11:23:42.399882 | controller | Wednesday 03 December 2025 11:23:42 +0000 (0:00:00.294) 0:02:06.752 **** 2025-12-03 11:23:42.429439 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-03 11:23:42.474699 | controller | 2025-12-03 11:23:42.474738 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-03 11:23:42.474748 | controller | Wednesday 03 December 2025 11:23:42 +0000 (0:00:00.029) 0:02:06.781 **** 2025-12-03 11:23:42.474761 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-03 11:23:42.474797 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-03 11:23:42.474805 | controller | 2025-12-03 11:23:42.474819 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 11:23:42.474860 | controller | Wednesday 03 December 2025 11:23:42 +0000 (0:00:00.045) 0:02:06.827 **** 2025-12-03 11:23:42.709136 | controller | ok: [instance] 2025-12-03 11:23:42.754492 | controller | 2025-12-03 11:23:42.754510 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 11:23:42.754518 | controller | Wednesday 03 December 2025 11:23:42 +0000 (0:00:00.234) 0:02:07.061 **** 2025-12-03 11:23:42.754558 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:23:42.986462 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 11:23:42.986494 | controller | 2025-12-03 11:23:42.986502 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 11:23:42.986509 | controller | Wednesday 03 December 2025 11:23:42 +0000 (0:00:00.045) 0:02:07.106 **** 2025-12-03 11:23:42.986518 | controller | ok: [instance] 2025-12-03 11:23:43.189066 | controller | 2025-12-03 11:23:43.189101 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 11:23:43.189109 | controller | Wednesday 03 December 2025 11:23:42 +0000 (0:00:00.231) 0:02:07.338 **** 2025-12-03 11:23:43.189119 | controller | ok: [instance] 2025-12-03 11:23:43.513649 | controller | 2025-12-03 11:23:43.513688 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-12-03 11:23:43.513698 | controller | Wednesday 03 December 2025 11:23:43 +0000 (0:00:00.202) 0:02:07.541 **** 2025-12-03 11:23:43.513711 | controller | changed: [instance] 2025-12-03 11:23:43.513740 | controller | 2025-12-03 11:23:43.513751 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 11:23:43.513777 | controller | Wednesday 03 December 2025 11:23:43 +0000 (0:00:00.324) 0:02:07.865 **** 2025-12-03 11:23:43.742471 | controller | ok: [instance] 2025-12-03 11:23:43.787341 | controller | 2025-12-03 11:23:43.787368 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 11:23:43.787377 | controller | Wednesday 03 December 2025 11:23:43 +0000 (0:00:00.228) 0:02:08.094 **** 2025-12-03 11:23:43.787386 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 11:23:44.055021 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 11:23:44.055052 | controller | 2025-12-03 11:23:44.055060 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 11:23:44.055067 | controller | Wednesday 03 December 2025 11:23:43 +0000 (0:00:00.045) 0:02:08.139 **** 2025-12-03 11:23:44.055076 | controller | ok: [instance] 2025-12-03 11:23:44.264653 | controller | 2025-12-03 11:23:44.264693 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 11:23:44.264701 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.267) 0:02:08.407 **** 2025-12-03 11:23:44.264711 | controller | ok: [instance] 2025-12-03 11:23:44.264730 | controller | 2025-12-03 11:23:44.264948 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-12-03 11:23:44.560446 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.209) 0:02:08.617 **** 2025-12-03 11:23:44.560480 | controller | changed: [instance] 2025-12-03 11:23:44.581582 | controller | 2025-12-03 11:23:44.581606 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-12-03 11:23:44.581613 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.295) 0:02:08.912 **** 2025-12-03 11:23:44.581622 | controller | skipping: [instance] 2025-12-03 11:23:44.609675 | controller | 2025-12-03 11:23:44.609711 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-12-03 11:23:44.609721 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.021) 0:02:08.933 **** 2025-12-03 11:23:44.609733 | controller | skipping: [instance] 2025-12-03 11:23:44.609763 | controller | 2025-12-03 11:23:44.609773 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-12-03 11:23:44.609859 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.028) 0:02:08.962 **** 2025-12-03 11:23:44.641187 | controller | skipping: [instance] 2025-12-03 11:23:44.668649 | controller | 2025-12-03 11:23:44.668685 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-12-03 11:23:44.668695 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.031) 0:02:08.993 **** 2025-12-03 11:23:44.668707 | controller | skipping: [instance] 2025-12-03 11:23:44.668737 | controller | 2025-12-03 11:23:44.668952 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-03 11:23:44.888334 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.027) 0:02:09.021 **** 2025-12-03 11:23:44.888366 | controller | changed: [instance] 2025-12-03 11:23:44.927689 | controller | 2025-12-03 11:23:44.927727 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-03 11:23:44.927737 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.219) 0:02:09.240 **** 2025-12-03 11:23:44.927749 | controller | ok: [instance] 2025-12-03 11:23:44.955633 | controller | 2025-12-03 11:23:44.955654 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-03 11:23:44.955662 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.039) 0:02:09.279 **** 2025-12-03 11:23:44.955671 | controller | skipping: [instance] 2025-12-03 11:23:44.955696 | controller | 2025-12-03 11:23:44.955703 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-03 11:23:44.955710 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.028) 0:02:09.307 **** 2025-12-03 11:23:44.983720 | controller | skipping: [instance] 2025-12-03 11:23:44.983977 | controller | 2025-12-03 11:23:44.984018 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-03 11:23:45.030679 | controller | Wednesday 03 December 2025 11:23:44 +0000 (0:00:00.028) 0:02:09.336 **** 2025-12-03 11:23:45.030727 | controller | skipping: [instance] 2025-12-03 11:23:45.057646 | controller | 2025-12-03 11:23:45.057679 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2025-12-03 11:23:45.057689 | controller | Wednesday 03 December 2025 11:23:45 +0000 (0:00:00.046) 0:02:09.382 **** 2025-12-03 11:23:45.057701 | controller | skipping: [instance] 2025-12-03 11:23:45.057730 | controller | 2025-12-03 11:23:45.057741 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-12-03 11:23:45.057862 | controller | Wednesday 03 December 2025 11:23:45 +0000 (0:00:00.027) 0:02:09.410 **** 2025-12-03 11:23:45.123640 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-12-03 11:23:45.123810 | controller | 2025-12-03 11:23:45.123952 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-12-03 11:23:45.124137 | controller | Wednesday 03 December 2025 11:23:45 +0000 (0:00:00.065) 0:02:09.476 **** 2025-12-03 11:23:45.364835 | controller | ok: [instance] => (item=crc) 2025-12-03 11:23:45.364972 | controller | 2025-12-03 11:23:45.365093 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-12-03 11:23:45.365225 | controller | Wednesday 03 December 2025 11:23:45 +0000 (0:00:00.241) 0:02:09.717 **** 2025-12-03 11:23:47.437596 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 11:23:47.437804 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 11:23:47.437960 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 11:23:47.438031 | controller | 2025-12-03 11:23:47.438162 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-03 11:23:47.438289 | controller | Wednesday 03 December 2025 11:23:47 +0000 (0:00:02.072) 0:02:11.789 **** 2025-12-03 11:23:47.980103 | controller | changed: [instance] 2025-12-03 11:23:48.447647 | controller | 2025-12-03 11:23:48.447680 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-03 11:23:48.447689 | controller | Wednesday 03 December 2025 11:23:47 +0000 (0:00:00.542) 0:02:12.332 **** 2025-12-03 11:23:48.447699 | controller | changed: [instance] 2025-12-03 11:23:48.968153 | controller | 2025-12-03 11:23:48.968182 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-03 11:23:48.968191 | controller | Wednesday 03 December 2025 11:23:48 +0000 (0:00:00.467) 0:02:12.799 **** 2025-12-03 11:23:48.968201 | controller | changed: [instance] 2025-12-03 11:23:49.709025 | controller | 2025-12-03 11:23:49.709055 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-12-03 11:23:49.709063 | controller | Wednesday 03 December 2025 11:23:48 +0000 (0:00:00.520) 0:02:13.320 **** 2025-12-03 11:23:49.709073 | controller | changed: [instance] => (item=compute-0.utility) 2025-12-03 11:24:09.517162 | controller | changed: [instance] => (item=controller-0.utility) 2025-12-03 11:24:09.517197 | controller | changed: [instance] => (item=crc-0.utility) 2025-12-03 11:24:09.517205 | controller | 2025-12-03 11:24:09.517211 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-12-03 11:24:09.517217 | controller | Wednesday 03 December 2025 11:23:49 +0000 (0:00:00.740) 0:02:14.060 **** 2025-12-03 11:24:09.517227 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-03 11:24:09.517246 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-12-03 11:24:09.517591 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-12-03 11:24:09.517738 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-12-03 11:24:09.517862 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-12-03 11:24:09.517952 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2025-12-03 11:24:09.518081 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j644257155498.20937', 'results_file': '/home/zuul/.ansible_async/j644257155498.20937', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-12-03 11:24:09.518194 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j495052992071.20954', 'results_file': '/home/zuul/.ansible_async/j495052992071.20954', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-12-03 11:24:09.518292 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j931967743995.20970', 'results_file': '/home/zuul/.ansible_async/j931967743995.20970', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-12-03 11:24:09.518382 | controller | 2025-12-03 11:24:09.518492 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-12-03 11:24:09.518664 | controller | Wednesday 03 December 2025 11:24:09 +0000 (0:00:19.808) 0:02:33.869 **** 2025-12-03 11:24:09.635432 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 11:24:09.657633 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 11:24:09.657654 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 11:24:09.657662 | controller | 2025-12-03 11:24:09.657668 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 11:24:09.657674 | controller | Wednesday 03 December 2025 11:24:09 +0000 (0:00:00.117) 0:02:33.987 **** 2025-12-03 11:24:09.657686 | controller | skipping: [instance] 2025-12-03 11:24:09.694764 | controller | 2025-12-03 11:24:09.694786 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-12-03 11:24:09.694794 | controller | Wednesday 03 December 2025 11:24:09 +0000 (0:00:00.022) 0:02:34.010 **** 2025-12-03 11:24:09.694803 | controller | 2025-12-03 11:24:09.778338 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-03 11:24:09.778364 | controller | Wednesday 03 December 2025 11:24:09 +0000 (0:00:00.037) 0:02:34.047 **** 2025-12-03 11:24:09.778388 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-03 11:24:10.000370 | controller | 2025-12-03 11:24:10.000417 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-03 11:24:10.000426 | controller | Wednesday 03 December 2025 11:24:09 +0000 (0:00:00.083) 0:02:34.130 **** 2025-12-03 11:24:10.000438 | controller | changed: [instance] 2025-12-03 11:24:10.218065 | controller | 2025-12-03 11:24:10.218112 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-03 11:24:10.218121 | controller | Wednesday 03 December 2025 11:24:09 +0000 (0:00:00.221) 0:02:34.352 **** 2025-12-03 11:24:10.218133 | controller | changed: [instance] 2025-12-03 11:24:10.616322 | controller | 2025-12-03 11:24:10.616374 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-12-03 11:24:10.616383 | controller | Wednesday 03 December 2025 11:24:10 +0000 (0:00:00.217) 0:02:34.570 **** 2025-12-03 11:24:10.616395 | controller | changed: [instance] 2025-12-03 11:24:10.645387 | controller | 2025-12-03 11:24:10.645412 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-12-03 11:24:10.645420 | controller | Wednesday 03 December 2025 11:24:10 +0000 (0:00:00.397) 0:02:34.967 **** 2025-12-03 11:24:10.645435 | controller | skipping: [instance] 2025-12-03 11:24:10.645745 | controller | 2025-12-03 11:24:10.645763 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-03 11:24:10.677881 | controller | Wednesday 03 December 2025 11:24:10 +0000 (0:00:00.030) 0:02:34.997 **** 2025-12-03 11:24:10.677902 | controller | skipping: [instance] 2025-12-03 11:24:10.728021 | controller | 2025-12-03 11:24:10.728040 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-12-03 11:24:10.728048 | controller | Wednesday 03 December 2025 11:24:10 +0000 (0:00:00.032) 0:02:35.030 **** 2025-12-03 11:24:10.728057 | controller | skipping: [instance] 2025-12-03 11:24:10.792430 | controller | 2025-12-03 11:24:10.792481 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-12-03 11:24:10.792491 | controller | Wednesday 03 December 2025 11:24:10 +0000 (0:00:00.049) 0:02:35.080 **** 2025-12-03 11:24:10.792502 | controller | skipping: [instance] 2025-12-03 11:24:10.823449 | controller | 2025-12-03 11:24:10.823480 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 11:24:10.823488 | controller | Wednesday 03 December 2025 11:24:10 +0000 (0:00:00.063) 0:02:35.144 **** 2025-12-03 11:24:10.823498 | controller | skipping: [instance] 2025-12-03 11:24:10.862323 | controller | 2025-12-03 11:24:10.862345 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-12-03 11:24:10.862353 | controller | Wednesday 03 December 2025 11:24:10 +0000 (0:00:00.031) 0:02:35.175 **** 2025-12-03 11:24:10.862363 | controller | 2025-12-03 11:24:10.949811 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-03 11:24:10.949849 | controller | Wednesday 03 December 2025 11:24:10 +0000 (0:00:00.039) 0:02:35.214 **** 2025-12-03 11:24:10.949863 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-03 11:24:11.187745 | controller | 2025-12-03 11:24:11.187790 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-03 11:24:11.187799 | controller | Wednesday 03 December 2025 11:24:10 +0000 (0:00:00.086) 0:02:35.301 **** 2025-12-03 11:24:11.187811 | controller | ok: [instance] 2025-12-03 11:24:11.411059 | controller | 2025-12-03 11:24:11.411116 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-03 11:24:11.411125 | controller | Wednesday 03 December 2025 11:24:11 +0000 (0:00:00.237) 0:02:35.539 **** 2025-12-03 11:24:11.411138 | controller | ok: [instance] 2025-12-03 11:24:11.411302 | controller | 2025-12-03 11:24:11.411474 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-12-03 11:24:11.411647 | controller | Wednesday 03 December 2025 11:24:11 +0000 (0:00:00.223) 0:02:35.763 **** 2025-12-03 11:24:11.800779 | controller | changed: [instance] 2025-12-03 11:24:11.830883 | controller | 2025-12-03 11:24:11.830926 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-12-03 11:24:11.830940 | controller | Wednesday 03 December 2025 11:24:11 +0000 (0:00:00.389) 0:02:36.152 **** 2025-12-03 11:24:11.830952 | controller | skipping: [instance] 2025-12-03 11:24:11.863334 | controller | 2025-12-03 11:24:11.863387 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-03 11:24:11.863396 | controller | Wednesday 03 December 2025 11:24:11 +0000 (0:00:00.030) 0:02:36.182 **** 2025-12-03 11:24:11.863407 | controller | skipping: [instance] 2025-12-03 11:24:13.520094 | controller | 2025-12-03 11:24:13.520141 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-12-03 11:24:13.520150 | controller | Wednesday 03 December 2025 11:24:11 +0000 (0:00:00.032) 0:02:36.215 **** 2025-12-03 11:24:13.520160 | controller | changed: [instance -> controller-0.instance] 2025-12-03 11:24:13.520179 | controller | 2025-12-03 11:24:13.520185 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-12-03 11:24:13.520192 | controller | Wednesday 03 December 2025 11:24:13 +0000 (0:00:01.657) 0:02:37.872 **** 2025-12-03 11:24:14.612612 | controller | changed: [instance -> controller-0.instance] 2025-12-03 11:24:14.661868 | controller | 2025-12-03 11:24:14.661915 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 11:24:14.661924 | controller | Wednesday 03 December 2025 11:24:14 +0000 (0:00:01.092) 0:02:38.964 **** 2025-12-03 11:24:14.661935 | controller | 2025-12-03 11:24:14.882129 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-03 11:24:14.882160 | controller | Wednesday 03 December 2025 11:24:14 +0000 (0:00:00.049) 0:02:39.013 **** 2025-12-03 11:24:14.882172 | controller | ok: [instance] 2025-12-03 11:24:14.911342 | controller | 2025-12-03 11:24:14.911367 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-03 11:24:14.911375 | controller | Wednesday 03 December 2025 11:24:14 +0000 (0:00:00.220) 0:02:39.234 **** 2025-12-03 11:24:14.911385 | controller | ok: [instance] 2025-12-03 11:24:14.941571 | controller | 2025-12-03 11:24:14.941593 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-03 11:24:14.941600 | controller | Wednesday 03 December 2025 11:24:14 +0000 (0:00:00.029) 0:02:39.263 **** 2025-12-03 11:24:14.941610 | controller | skipping: [instance] 2025-12-03 11:24:14.989645 | controller | 2025-12-03 11:24:14.989688 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-12-03 11:24:14.989697 | controller | Wednesday 03 December 2025 11:24:14 +0000 (0:00:00.030) 0:02:39.293 **** 2025-12-03 11:24:14.989707 | controller | 2025-12-03 11:24:14.989737 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-03 11:24:14.989819 | controller | Wednesday 03 December 2025 11:24:14 +0000 (0:00:00.048) 0:02:39.342 **** 2025-12-03 11:24:15.075063 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-12-03 11:24:15.327146 | controller | 2025-12-03 11:24:15.327181 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-03 11:24:15.327189 | controller | Wednesday 03 December 2025 11:24:15 +0000 (0:00:00.084) 0:02:39.427 **** 2025-12-03 11:24:15.327199 | controller | ok: [instance] 2025-12-03 11:24:15.327545 | controller | 2025-12-03 11:24:15.543151 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-03 11:24:15.543184 | controller | Wednesday 03 December 2025 11:24:15 +0000 (0:00:00.252) 0:02:39.679 **** 2025-12-03 11:24:15.543196 | controller | ok: [instance] 2025-12-03 11:24:15.934611 | controller | 2025-12-03 11:24:15.934644 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-12-03 11:24:15.934652 | controller | Wednesday 03 December 2025 11:24:15 +0000 (0:00:00.215) 0:02:39.895 **** 2025-12-03 11:24:15.934662 | controller | changed: [instance] 2025-12-03 11:24:16.862643 | controller | 2025-12-03 11:24:16.862673 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-12-03 11:24:16.862681 | controller | Wednesday 03 December 2025 11:24:15 +0000 (0:00:00.391) 0:02:40.286 **** 2025-12-03 11:24:16.862691 | controller | changed: [instance] 2025-12-03 11:24:16.862716 | controller | 2025-12-03 11:24:16.862764 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-03 11:24:16.862877 | controller | Wednesday 03 December 2025 11:24:16 +0000 (0:00:00.928) 0:02:41.215 **** 2025-12-03 11:24:16.890880 | controller | skipping: [instance] 2025-12-03 11:24:16.891211 | controller | 2025-12-03 11:24:16.941178 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-12-03 11:24:16.941207 | controller | Wednesday 03 December 2025 11:24:16 +0000 (0:00:00.028) 0:02:41.243 **** 2025-12-03 11:24:16.941223 | controller | skipping: [instance] 2025-12-03 11:24:16.987798 | controller | 2025-12-03 11:24:16.987825 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-12-03 11:24:16.987853 | controller | Wednesday 03 December 2025 11:24:16 +0000 (0:00:00.050) 0:02:41.293 **** 2025-12-03 11:24:16.987864 | controller | skipping: [instance] 2025-12-03 11:24:17.038979 | controller | 2025-12-03 11:24:17.039011 | controller | TASK [Create VBMC entity] ****************************************************** 2025-12-03 11:24:17.039020 | controller | Wednesday 03 December 2025 11:24:16 +0000 (0:00:00.046) 0:02:41.340 **** 2025-12-03 11:24:17.039029 | controller | skipping: [instance] => (item=compute-0) 2025-12-03 11:24:17.039196 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 11:24:17.039208 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 11:24:17.039214 | controller | skipping: [instance] 2025-12-03 11:24:17.039222 | controller | 2025-12-03 11:24:17.039462 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-12-03 11:24:17.295285 | controller | Wednesday 03 December 2025 11:24:17 +0000 (0:00:00.051) 0:02:41.391 **** 2025-12-03 11:24:17.295318 | controller | ok: [instance] 2025-12-03 11:24:17.668352 | controller | 2025-12-03 11:24:17.668384 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-12-03 11:24:17.668392 | controller | Wednesday 03 December 2025 11:24:17 +0000 (0:00:00.256) 0:02:41.647 **** 2025-12-03 11:24:17.668402 | controller | changed: [instance] 2025-12-03 11:24:17.706974 | controller | 2025-12-03 11:24:17.707005 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-12-03 11:24:17.707019 | controller | Wednesday 03 December 2025 11:24:17 +0000 (0:00:00.373) 0:02:42.020 **** 2025-12-03 11:24:17.707029 | controller | skipping: [instance] 2025-12-03 11:24:17.707047 | controller | 2025-12-03 11:24:17.707151 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-12-03 11:24:17.707258 | controller | Wednesday 03 December 2025 11:24:17 +0000 (0:00:00.038) 0:02:42.059 **** 2025-12-03 11:24:17.743479 | controller | skipping: [instance] 2025-12-03 11:24:17.743555 | controller | 2025-12-03 11:24:17.743696 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-12-03 11:24:17.743818 | controller | Wednesday 03 December 2025 11:24:17 +0000 (0:00:00.036) 0:02:42.096 **** 2025-12-03 11:24:17.779895 | controller | skipping: [instance] 2025-12-03 11:24:17.779981 | controller | 2025-12-03 11:24:17.780084 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-12-03 11:24:17.780196 | controller | Wednesday 03 December 2025 11:24:17 +0000 (0:00:00.036) 0:02:42.132 **** 2025-12-03 11:24:18.607080 | controller | changed: [instance] 2025-12-03 11:24:18.607140 | controller | 2025-12-03 11:24:18.607248 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-12-03 11:24:18.607349 | controller | Wednesday 03 December 2025 11:24:18 +0000 (0:00:00.827) 0:02:42.959 **** 2025-12-03 11:24:19.288709 | controller | changed: [instance] 2025-12-03 11:24:19.288782 | controller | 2025-12-03 11:24:19.288900 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-12-03 11:24:19.289018 | controller | Wednesday 03 December 2025 11:24:19 +0000 (0:00:00.681) 0:02:43.641 **** 2025-12-03 11:24:19.328595 | controller | skipping: [instance] 2025-12-03 11:24:19.328694 | controller | 2025-12-03 11:24:19.328811 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-12-03 11:24:19.328922 | controller | Wednesday 03 December 2025 11:24:19 +0000 (0:00:00.039) 0:02:43.681 **** 2025-12-03 11:24:19.391130 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-12-03 11:24:19.391202 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-12-03 11:24:19.391290 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-12-03 11:24:19.391394 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-12-03 11:24:19.391486 | controller | 2025-12-03 11:24:19.391610 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-12-03 11:24:19.391707 | controller | Wednesday 03 December 2025 11:24:19 +0000 (0:00:00.062) 0:02:43.743 **** 2025-12-03 11:24:19.434021 | controller | skipping: [instance] 2025-12-03 11:24:19.434072 | controller | 2025-12-03 11:24:19.434192 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-12-03 11:24:19.434295 | controller | Wednesday 03 December 2025 11:24:19 +0000 (0:00:00.042) 0:02:43.786 **** 2025-12-03 11:24:19.470601 | controller | skipping: [instance] 2025-12-03 11:24:19.470898 | controller | 2025-12-03 11:24:19.507361 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-12-03 11:24:19.507388 | controller | Wednesday 03 December 2025 11:24:19 +0000 (0:00:00.036) 0:02:43.823 **** 2025-12-03 11:24:19.507399 | controller | skipping: [instance] 2025-12-03 11:24:19.507427 | controller | 2025-12-03 11:24:19.507739 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-12-03 11:24:19.507882 | controller | Wednesday 03 December 2025 11:24:19 +0000 (0:00:00.036) 0:02:43.859 **** 2025-12-03 11:24:19.542396 | controller | skipping: [instance] 2025-12-03 11:24:19.542492 | controller | 2025-12-03 11:24:19.542626 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-12-03 11:24:19.542732 | controller | Wednesday 03 December 2025 11:24:19 +0000 (0:00:00.035) 0:02:43.895 **** 2025-12-03 11:24:20.153955 | controller | changed: [instance] 2025-12-03 11:24:20.154012 | controller | 2025-12-03 11:24:20.154086 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-12-03 11:24:20.154200 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.611) 0:02:44.506 **** 2025-12-03 11:24:20.187104 | controller | skipping: [instance] 2025-12-03 11:24:20.187185 | controller | 2025-12-03 11:24:20.187292 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-12-03 11:24:20.187409 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.033) 0:02:44.539 **** 2025-12-03 11:24:20.219424 | controller | skipping: [instance] 2025-12-03 11:24:20.219513 | controller | 2025-12-03 11:24:20.219646 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-12-03 11:24:20.219748 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.032) 0:02:44.572 **** 2025-12-03 11:24:20.254067 | controller | skipping: [instance] 2025-12-03 11:24:20.254803 | controller | 2025-12-03 11:24:20.254939 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-03 11:24:20.255036 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.034) 0:02:44.606 **** 2025-12-03 11:24:20.288057 | controller | skipping: [instance] 2025-12-03 11:24:20.288169 | controller | 2025-12-03 11:24:20.288295 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-03 11:24:20.288416 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.034) 0:02:44.640 **** 2025-12-03 11:24:20.322792 | controller | skipping: [instance] 2025-12-03 11:24:20.323014 | controller | 2025-12-03 11:24:20.323106 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-03 11:24:20.323119 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.034) 0:02:44.675 **** 2025-12-03 11:24:20.355118 | controller | skipping: [instance] 2025-12-03 11:24:20.355210 | controller | 2025-12-03 11:24:20.355316 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-03 11:24:20.355419 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.032) 0:02:44.707 **** 2025-12-03 11:24:20.387793 | controller | skipping: [instance] 2025-12-03 11:24:20.387881 | controller | 2025-12-03 11:24:20.388007 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-03 11:24:20.388111 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.032) 0:02:44.740 **** 2025-12-03 11:24:20.418904 | controller | skipping: [instance] 2025-12-03 11:24:20.419023 | controller | 2025-12-03 11:24:20.419152 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-03 11:24:20.419273 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.031) 0:02:44.771 **** 2025-12-03 11:24:20.451134 | controller | skipping: [instance] 2025-12-03 11:24:20.451244 | controller | 2025-12-03 11:24:20.451357 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-03 11:24:20.451459 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.032) 0:02:44.803 **** 2025-12-03 11:24:20.497672 | controller | skipping: [instance] 2025-12-03 11:24:20.497779 | controller | 2025-12-03 11:24:20.497912 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-12-03 11:24:20.498035 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.046) 0:02:44.850 **** 2025-12-03 11:24:20.530018 | controller | skipping: [instance] 2025-12-03 11:24:20.530110 | controller | 2025-12-03 11:24:20.530216 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-12-03 11:24:20.530323 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.032) 0:02:44.882 **** 2025-12-03 11:24:20.721221 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-12-03 11:24:20.721294 | controller | 2025-12-03 11:24:20.721416 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-03 11:24:20.721569 | controller | Wednesday 03 December 2025 11:24:20 +0000 (0:00:00.190) 0:02:45.073 **** 2025-12-03 11:24:22.045785 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-03 11:24:22.045851 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-03 11:24:22.045965 | controller | 2025-12-03 11:24:22.046074 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-03 11:24:22.046176 | controller | Wednesday 03 December 2025 11:24:22 +0000 (0:00:01.324) 0:02:46.398 **** 2025-12-03 11:24:22.065745 | controller | skipping: [instance] 2025-12-03 11:24:22.065814 | controller | 2025-12-03 11:24:22.065938 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-03 11:24:22.066087 | controller | Wednesday 03 December 2025 11:24:22 +0000 (0:00:00.020) 0:02:46.418 **** 2025-12-03 11:24:22.666270 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:22.699645 | controller | 2025-12-03 11:24:22.699677 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-03 11:24:22.699687 | controller | Wednesday 03 December 2025 11:24:22 +0000 (0:00:00.599) 0:02:47.018 **** 2025-12-03 11:24:22.699697 | controller | skipping: [instance] 2025-12-03 11:24:22.699745 | controller | 2025-12-03 11:24:22.699780 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-03 11:24:22.699793 | controller | Wednesday 03 December 2025 11:24:22 +0000 (0:00:00.033) 0:02:47.052 **** 2025-12-03 11:24:22.735645 | controller | skipping: [instance] 2025-12-03 11:24:22.735785 | controller | 2025-12-03 11:24:22.735802 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-03 11:24:22.735812 | controller | Wednesday 03 December 2025 11:24:22 +0000 (0:00:00.035) 0:02:47.087 **** 2025-12-03 11:24:22.771438 | controller | skipping: [instance] 2025-12-03 11:24:24.312652 | controller | 2025-12-03 11:24:24.312696 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-03 11:24:24.312706 | controller | Wednesday 03 December 2025 11:24:22 +0000 (0:00:00.035) 0:02:47.123 **** 2025-12-03 11:24:24.312718 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:24.312896 | controller | 2025-12-03 11:24:24.313051 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-12-03 11:24:24.313198 | controller | Wednesday 03 December 2025 11:24:24 +0000 (0:00:01.541) 0:02:48.665 **** 2025-12-03 11:24:24.345445 | controller | skipping: [instance] 2025-12-03 11:24:24.345667 | controller | 2025-12-03 11:24:24.345852 | controller | TASK [reproducer : Install repos] ********************************************** 2025-12-03 11:24:24.345998 | controller | Wednesday 03 December 2025 11:24:24 +0000 (0:00:00.033) 0:02:48.698 **** 2025-12-03 11:24:24.378322 | controller | skipping: [instance] 2025-12-03 11:24:24.378471 | controller | 2025-12-03 11:24:24.378648 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-12-03 11:24:24.378810 | controller | Wednesday 03 December 2025 11:24:24 +0000 (0:00:00.032) 0:02:48.731 **** 2025-12-03 11:24:24.411570 | controller | skipping: [instance] 2025-12-03 11:24:24.411791 | controller | 2025-12-03 11:24:24.411966 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-12-03 11:24:24.412112 | controller | Wednesday 03 December 2025 11:24:24 +0000 (0:00:00.033) 0:02:48.764 **** 2025-12-03 11:24:24.443856 | controller | skipping: [instance] 2025-12-03 11:24:24.444004 | controller | 2025-12-03 11:24:24.444146 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-12-03 11:24:24.444286 | controller | Wednesday 03 December 2025 11:24:24 +0000 (0:00:00.032) 0:02:48.796 **** 2025-12-03 11:24:25.502338 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:26.609139 | controller | 2025-12-03 11:24:26.609168 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-12-03 11:24:26.609176 | controller | Wednesday 03 December 2025 11:24:25 +0000 (0:00:01.057) 0:02:49.854 **** 2025-12-03 11:24:26.609186 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:27.173179 | controller | 2025-12-03 11:24:27.173208 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-12-03 11:24:27.173216 | controller | Wednesday 03 December 2025 11:24:26 +0000 (0:00:01.106) 0:02:50.961 **** 2025-12-03 11:24:27.173226 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:28.190994 | controller | 2025-12-03 11:24:28.191024 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-12-03 11:24:28.191032 | controller | Wednesday 03 December 2025 11:24:27 +0000 (0:00:00.563) 0:02:51.525 **** 2025-12-03 11:24:28.191042 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:29.313444 | controller | 2025-12-03 11:24:29.313474 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-12-03 11:24:29.313482 | controller | Wednesday 03 December 2025 11:24:28 +0000 (0:00:01.017) 0:02:52.543 **** 2025-12-03 11:24:29.313492 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-03 11:24:29.983692 | controller | skipping: [instance] => (item=compute-0) 2025-12-03 11:24:29.983734 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 11:24:29.983742 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 11:24:29.983748 | controller | 2025-12-03 11:24:29.983754 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-12-03 11:24:29.983760 | controller | Wednesday 03 December 2025 11:24:29 +0000 (0:00:01.121) 0:02:53.665 **** 2025-12-03 11:24:29.983770 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-03 11:24:29.983805 | controller | skipping: [instance] => (item=compute-0) 2025-12-03 11:24:29.983826 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 11:24:29.983831 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 11:24:29.983838 | controller | 2025-12-03 11:24:29.983899 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-12-03 11:24:29.983933 | controller | Wednesday 03 December 2025 11:24:29 +0000 (0:00:00.670) 0:02:54.335 **** 2025-12-03 11:24:31.823439 | controller | skipping: [instance] => (item=instance) 2025-12-03 11:24:32.431634 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-12-03 11:24:32.431666 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-03 11:24:32.431673 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-12-03 11:24:32.431679 | controller | 2025-12-03 11:24:32.431685 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-12-03 11:24:32.431690 | controller | Wednesday 03 December 2025 11:24:31 +0000 (0:00:01.839) 0:02:56.175 **** 2025-12-03 11:24:32.431700 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:33.403471 | controller | 2025-12-03 11:24:33.403505 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-12-03 11:24:33.403513 | controller | Wednesday 03 December 2025 11:24:32 +0000 (0:00:00.608) 0:02:56.783 **** 2025-12-03 11:24:33.403537 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:34.515845 | controller | 2025-12-03 11:24:34.515882 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-12-03 11:24:34.515891 | controller | Wednesday 03 December 2025 11:24:33 +0000 (0:00:00.971) 0:02:57.755 **** 2025-12-03 11:24:34.515903 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:34.549006 | controller | 2025-12-03 11:24:34.549035 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-12-03 11:24:34.549043 | controller | Wednesday 03 December 2025 11:24:34 +0000 (0:00:01.112) 0:02:58.867 **** 2025-12-03 11:24:34.549053 | controller | skipping: [instance] 2025-12-03 11:24:35.144633 | controller | 2025-12-03 11:24:35.144663 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-12-03 11:24:35.144671 | controller | Wednesday 03 December 2025 11:24:34 +0000 (0:00:00.033) 0:02:58.901 **** 2025-12-03 11:24:35.144681 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:35.144780 | controller | 2025-12-03 11:24:35.144790 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-12-03 11:24:35.144798 | controller | Wednesday 03 December 2025 11:24:35 +0000 (0:00:00.595) 0:02:59.496 **** 2025-12-03 11:24:35.720187 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:35.758217 | controller | 2025-12-03 11:24:35.758244 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-12-03 11:24:35.758252 | controller | Wednesday 03 December 2025 11:24:35 +0000 (0:00:00.575) 0:03:00.072 **** 2025-12-03 11:24:35.758261 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:35.821798 | controller | 2025-12-03 11:24:35.821823 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-12-03 11:24:35.821831 | controller | Wednesday 03 December 2025 11:24:35 +0000 (0:00:00.038) 0:03:00.110 **** 2025-12-03 11:24:35.821855 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-12-03 11:24:35.874511 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-12-03 11:24:35.874553 | controller | 2025-12-03 11:24:35.874564 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-03 11:24:35.874570 | controller | Wednesday 03 December 2025 11:24:35 +0000 (0:00:00.063) 0:03:00.173 **** 2025-12-03 11:24:35.874579 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 11:24:35.921825 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-12-03 11:24:35.921859 | controller | 2025-12-03 11:24:35.921867 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-03 11:24:35.921873 | controller | Wednesday 03 December 2025 11:24:35 +0000 (0:00:00.052) 0:03:00.226 **** 2025-12-03 11:24:35.921883 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 11:24:35.971023 | controller | _secret_file: '' 2025-12-03 11:24:35.971042 | controller | 2025-12-03 11:24:35.971049 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-03 11:24:35.971055 | controller | Wednesday 03 December 2025 11:24:35 +0000 (0:00:00.047) 0:03:00.274 **** 2025-12-03 11:24:35.971065 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 11:24:36.021457 | controller | _secret_content: my-default-location-place 2025-12-03 11:24:36.021479 | controller | 2025-12-03 11:24:36.021488 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-03 11:24:36.021495 | controller | Wednesday 03 December 2025 11:24:35 +0000 (0:00:00.048) 0:03:00.323 **** 2025-12-03 11:24:36.021506 | controller | skipping: [instance] 2025-12-03 11:24:36.067239 | controller | 2025-12-03 11:24:36.067265 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-03 11:24:36.067273 | controller | Wednesday 03 December 2025 11:24:36 +0000 (0:00:00.050) 0:03:00.373 **** 2025-12-03 11:24:36.067282 | controller | skipping: [instance] 2025-12-03 11:24:36.067426 | controller | 2025-12-03 11:24:36.067594 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-03 11:24:36.067745 | controller | Wednesday 03 December 2025 11:24:36 +0000 (0:00:00.046) 0:03:00.419 **** 2025-12-03 11:24:36.123008 | controller | skipping: [instance] 2025-12-03 11:24:36.123189 | controller | 2025-12-03 11:24:36.123333 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-03 11:24:36.123471 | controller | Wednesday 03 December 2025 11:24:36 +0000 (0:00:00.055) 0:03:00.475 **** 2025-12-03 11:24:37.101686 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:37.102074 | controller | 2025-12-03 11:24:37.152617 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-03 11:24:37.152642 | controller | Wednesday 03 December 2025 11:24:37 +0000 (0:00:00.978) 0:03:01.454 **** 2025-12-03 11:24:37.152654 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 11:24:37.196869 | controller | _secret_dest: /home/zuul/ipmi-things 2025-12-03 11:24:37.196896 | controller | 2025-12-03 11:24:37.196905 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-03 11:24:37.196912 | controller | Wednesday 03 December 2025 11:24:37 +0000 (0:00:00.050) 0:03:01.504 **** 2025-12-03 11:24:37.196923 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 11:24:37.241120 | controller | _secret_file: /tmp/ipmi-things 2025-12-03 11:24:37.241142 | controller | 2025-12-03 11:24:37.241150 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-03 11:24:37.241159 | controller | Wednesday 03 December 2025 11:24:37 +0000 (0:00:00.044) 0:03:01.549 **** 2025-12-03 11:24:37.241168 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 11:24:37.293097 | controller | _secret_content: '' 2025-12-03 11:24:37.293123 | controller | 2025-12-03 11:24:37.293139 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-03 11:24:37.293148 | controller | Wednesday 03 December 2025 11:24:37 +0000 (0:00:00.044) 0:03:01.593 **** 2025-12-03 11:24:37.293159 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-12-03 11:24:37.852506 | controller | msg: All assertions passed 2025-12-03 11:24:37.852557 | controller | 2025-12-03 11:24:37.852577 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-03 11:24:37.852584 | controller | Wednesday 03 December 2025 11:24:37 +0000 (0:00:00.051) 0:03:01.645 **** 2025-12-03 11:24:37.852594 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:37.852770 | controller | 2025-12-03 11:24:37.852943 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-03 11:24:37.853105 | controller | Wednesday 03 December 2025 11:24:37 +0000 (0:00:00.559) 0:03:02.204 **** 2025-12-03 11:24:38.852504 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:38.852725 | controller | 2025-12-03 11:24:38.852900 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-03 11:24:38.853047 | controller | Wednesday 03 December 2025 11:24:38 +0000 (0:00:01.000) 0:03:03.205 **** 2025-12-03 11:24:38.906818 | controller | skipping: [instance] 2025-12-03 11:24:38.907029 | controller | 2025-12-03 11:24:38.907176 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-12-03 11:24:38.907341 | controller | Wednesday 03 December 2025 11:24:38 +0000 (0:00:00.054) 0:03:03.259 **** 2025-12-03 11:24:39.500897 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:39.501122 | controller | 2025-12-03 11:24:39.501282 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-12-03 11:24:39.501441 | controller | Wednesday 03 December 2025 11:24:39 +0000 (0:00:00.593) 0:03:03.852 **** 2025-12-03 11:24:40.111103 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:24:40.111295 | controller | 2025-12-03 11:24:40.111450 | controller | TASK [reproducer : Check package install status] ******************************* 2025-12-03 11:24:40.111648 | controller | Wednesday 03 December 2025 11:24:40 +0000 (0:00:00.610) 0:03:04.463 **** 2025-12-03 11:25:41.533634 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-12-03 11:25:42.180925 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-12-03 11:25:42.180957 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-12-03 11:25:42.180964 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-12-03 11:25:42.180970 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-12-03 11:25:42.180976 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-12-03 11:25:42.180981 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-12-03 11:25:42.180986 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-12-03 11:25:42.180991 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-12-03 11:25:42.180997 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). 2025-12-03 11:25:42.181014 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). 2025-12-03 11:25:42.181030 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:42.181036 | controller | 2025-12-03 11:25:42.181042 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-12-03 11:25:42.181055 | controller | Wednesday 03 December 2025 11:25:41 +0000 (0:01:01.420) 0:04:05.884 **** 2025-12-03 11:25:42.181065 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:45.040724 | controller | 2025-12-03 11:25:45.040757 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-12-03 11:25:45.040765 | controller | Wednesday 03 December 2025 11:25:42 +0000 (0:00:00.648) 0:04:06.533 **** 2025-12-03 11:25:45.040775 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:45.089346 | controller | 2025-12-03 11:25:45.089373 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-12-03 11:25:45.089380 | controller | Wednesday 03 December 2025 11:25:45 +0000 (0:00:02.859) 0:04:09.392 **** 2025-12-03 11:25:45.089390 | controller | skipping: [instance] 2025-12-03 11:25:45.134688 | controller | 2025-12-03 11:25:45.134711 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-12-03 11:25:45.134719 | controller | Wednesday 03 December 2025 11:25:45 +0000 (0:00:00.048) 0:04:09.441 **** 2025-12-03 11:25:45.134728 | controller | skipping: [instance] 2025-12-03 11:25:45.807054 | controller | 2025-12-03 11:25:45.807084 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-12-03 11:25:45.807092 | controller | Wednesday 03 December 2025 11:25:45 +0000 (0:00:00.045) 0:04:09.487 **** 2025-12-03 11:25:45.807102 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:46.400829 | controller | 2025-12-03 11:25:46.400866 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-12-03 11:25:46.400876 | controller | Wednesday 03 December 2025 11:25:45 +0000 (0:00:00.672) 0:04:10.159 **** 2025-12-03 11:25:46.400888 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:46.699452 | controller | 2025-12-03 11:25:46.699483 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-12-03 11:25:46.699491 | controller | Wednesday 03 December 2025 11:25:46 +0000 (0:00:00.593) 0:04:10.752 **** 2025-12-03 11:25:46.699501 | controller | changed: [instance] 2025-12-03 11:25:47.290636 | controller | 2025-12-03 11:25:47.290670 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-12-03 11:25:47.290678 | controller | Wednesday 03 December 2025 11:25:46 +0000 (0:00:00.298) 0:04:11.051 **** 2025-12-03 11:25:47.290688 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:48.275186 | controller | 2025-12-03 11:25:48.275222 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-12-03 11:25:48.275230 | controller | Wednesday 03 December 2025 11:25:47 +0000 (0:00:00.587) 0:04:11.639 **** 2025-12-03 11:25:48.275240 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:48.317970 | controller | 2025-12-03 11:25:48.317997 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-03 11:25:48.318004 | controller | Wednesday 03 December 2025 11:25:48 +0000 (0:00:00.988) 0:04:12.627 **** 2025-12-03 11:25:48.318027 | controller | skipping: [instance] 2025-12-03 11:25:48.364570 | controller | 2025-12-03 11:25:48.364597 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-03 11:25:48.364604 | controller | Wednesday 03 December 2025 11:25:48 +0000 (0:00:00.042) 0:04:12.670 **** 2025-12-03 11:25:48.364614 | controller | skipping: [instance] 2025-12-03 11:25:48.402181 | controller | 2025-12-03 11:25:48.402205 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-03 11:25:48.402212 | controller | Wednesday 03 December 2025 11:25:48 +0000 (0:00:00.046) 0:04:12.716 **** 2025-12-03 11:25:48.402221 | controller | skipping: [instance] 2025-12-03 11:25:48.452567 | controller | 2025-12-03 11:25:48.452595 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-12-03 11:25:48.452603 | controller | Wednesday 03 December 2025 11:25:48 +0000 (0:00:00.037) 0:04:12.754 **** 2025-12-03 11:25:48.452613 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:48.491099 | controller | 2025-12-03 11:25:48.491122 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-12-03 11:25:48.491129 | controller | Wednesday 03 December 2025 11:25:48 +0000 (0:00:00.050) 0:04:12.804 **** 2025-12-03 11:25:48.491138 | controller | skipping: [instance] 2025-12-03 11:25:48.528762 | controller | 2025-12-03 11:25:48.528788 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-12-03 11:25:48.528797 | controller | Wednesday 03 December 2025 11:25:48 +0000 (0:00:00.038) 0:04:12.843 **** 2025-12-03 11:25:48.528809 | controller | skipping: [instance] 2025-12-03 11:25:48.568601 | controller | 2025-12-03 11:25:48.568626 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-12-03 11:25:48.568633 | controller | Wednesday 03 December 2025 11:25:48 +0000 (0:00:00.037) 0:04:12.881 **** 2025-12-03 11:25:48.568643 | controller | skipping: [instance] 2025-12-03 11:25:49.160855 | controller | 2025-12-03 11:25:49.160892 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-12-03 11:25:49.160900 | controller | Wednesday 03 December 2025 11:25:48 +0000 (0:00:00.039) 0:04:12.920 **** 2025-12-03 11:25:49.160923 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:49.261703 | controller | 2025-12-03 11:25:49.261727 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-12-03 11:25:49.261739 | controller | Wednesday 03 December 2025 11:25:49 +0000 (0:00:00.592) 0:04:13.513 **** 2025-12-03 11:25:49.261749 | controller | skipping: [instance] => (item=secret) 2025-12-03 11:25:50.238232 | controller | skipping: [instance] => (item=configmap) 2025-12-03 11:25:50.238266 | controller | skipping: [instance] => (item=pod) 2025-12-03 11:25:50.238274 | controller | skipping: [instance] => (item=service) 2025-12-03 11:25:50.238280 | controller | skipping: [instance] => (item=route) 2025-12-03 11:25:50.238285 | controller | skipping: [instance] 2025-12-03 11:25:50.238292 | controller | 2025-12-03 11:25:50.238298 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-12-03 11:25:50.238303 | controller | Wednesday 03 December 2025 11:25:49 +0000 (0:00:00.098) 0:04:13.611 **** 2025-12-03 11:25:50.238313 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:50.238482 | controller | 2025-12-03 11:25:50.238663 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-12-03 11:25:50.238840 | controller | Wednesday 03 December 2025 11:25:50 +0000 (0:00:00.978) 0:04:14.590 **** 2025-12-03 11:25:51.202739 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:51.202962 | controller | 2025-12-03 11:25:51.203137 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-12-03 11:25:51.203286 | controller | Wednesday 03 December 2025 11:25:51 +0000 (0:00:00.964) 0:04:15.555 **** 2025-12-03 11:25:51.240994 | controller | skipping: [instance] 2025-12-03 11:25:51.241164 | controller | 2025-12-03 11:25:51.241316 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-12-03 11:25:51.241456 | controller | Wednesday 03 December 2025 11:25:51 +0000 (0:00:00.038) 0:04:15.593 **** 2025-12-03 11:25:51.276775 | controller | skipping: [instance] 2025-12-03 11:25:51.276953 | controller | 2025-12-03 11:25:51.277137 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-12-03 11:25:51.277303 | controller | Wednesday 03 December 2025 11:25:51 +0000 (0:00:00.035) 0:04:15.629 **** 2025-12-03 11:25:51.349328 | controller | skipping: [instance] => (item=secret) 2025-12-03 11:25:51.349568 | controller | skipping: [instance] => (item=configmap) 2025-12-03 11:25:51.349722 | controller | skipping: [instance] => (item=service) 2025-12-03 11:25:51.349861 | controller | skipping: [instance] => (item=route) 2025-12-03 11:25:51.349994 | controller | skipping: [instance] 2025-12-03 11:25:51.350134 | controller | 2025-12-03 11:25:51.350268 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-12-03 11:25:51.350401 | controller | Wednesday 03 December 2025 11:25:51 +0000 (0:00:00.072) 0:04:15.701 **** 2025-12-03 11:25:51.384891 | controller | skipping: [instance] 2025-12-03 11:25:51.385112 | controller | 2025-12-03 11:25:51.385310 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-12-03 11:25:51.385479 | controller | Wednesday 03 December 2025 11:25:51 +0000 (0:00:00.035) 0:04:15.737 **** 2025-12-03 11:25:52.907432 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:52.907630 | controller | 2025-12-03 11:25:52.907781 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-12-03 11:25:52.907922 | controller | Wednesday 03 December 2025 11:25:52 +0000 (0:00:01.522) 0:04:17.259 **** 2025-12-03 11:25:53.688988 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:25:53.689179 | controller | 2025-12-03 11:25:53.689327 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-12-03 11:25:53.689467 | controller | Wednesday 03 December 2025 11:25:53 +0000 (0:00:00.781) 0:04:18.041 **** 2025-12-03 11:25:53.728005 | controller | skipping: [instance] 2025-12-03 11:25:53.728175 | controller | 2025-12-03 11:25:53.728320 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-12-03 11:25:53.728458 | controller | Wednesday 03 December 2025 11:25:53 +0000 (0:00:00.039) 0:04:18.080 **** 2025-12-03 11:25:53.765504 | controller | skipping: [instance] 2025-12-03 11:25:53.765695 | controller | 2025-12-03 11:25:53.765851 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-12-03 11:25:53.765999 | controller | Wednesday 03 December 2025 11:25:53 +0000 (0:00:00.037) 0:04:18.118 **** 2025-12-03 11:25:53.809355 | controller | skipping: [instance] 2025-12-03 11:25:53.809519 | controller | 2025-12-03 11:25:53.809704 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-12-03 11:25:53.809847 | controller | Wednesday 03 December 2025 11:25:53 +0000 (0:00:00.043) 0:04:18.161 **** 2025-12-03 11:26:04.653101 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:06.031224 | controller | 2025-12-03 11:26:06.031256 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-12-03 11:26:06.031264 | controller | Wednesday 03 December 2025 11:26:04 +0000 (0:00:10.843) 0:04:29.005 **** 2025-12-03 11:26:06.031274 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:07.177419 | controller | 2025-12-03 11:26:07.177462 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-03 11:26:07.177470 | controller | Wednesday 03 December 2025 11:26:06 +0000 (0:00:01.378) 0:04:30.383 **** 2025-12-03 11:26:07.177480 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-03 11:26:07.221096 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-03 11:26:07.221125 | controller | 2025-12-03 11:26:07.221133 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-12-03 11:26:07.221139 | controller | Wednesday 03 December 2025 11:26:07 +0000 (0:00:01.145) 0:04:31.529 **** 2025-12-03 11:26:07.221162 | controller | skipping: [instance] 2025-12-03 11:26:07.788723 | controller | 2025-12-03 11:26:07.788757 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-12-03 11:26:07.788765 | controller | Wednesday 03 December 2025 11:26:07 +0000 (0:00:00.042) 0:04:31.571 **** 2025-12-03 11:26:07.788775 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:07.832573 | controller | 2025-12-03 11:26:07.832599 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-12-03 11:26:07.832607 | controller | Wednesday 03 December 2025 11:26:07 +0000 (0:00:00.565) 0:04:32.136 **** 2025-12-03 11:26:07.832616 | controller | skipping: [instance] 2025-12-03 11:26:07.875764 | controller | 2025-12-03 11:26:07.875789 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-12-03 11:26:07.875796 | controller | Wednesday 03 December 2025 11:26:07 +0000 (0:00:00.048) 0:04:32.184 **** 2025-12-03 11:26:07.875806 | controller | skipping: [instance] 2025-12-03 11:26:07.916874 | controller | 2025-12-03 11:26:07.916896 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-03 11:26:07.916904 | controller | Wednesday 03 December 2025 11:26:07 +0000 (0:00:00.043) 0:04:32.228 **** 2025-12-03 11:26:07.916918 | controller | skipping: [instance] 2025-12-03 11:26:07.952669 | controller | 2025-12-03 11:26:07.952689 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-03 11:26:07.952697 | controller | Wednesday 03 December 2025 11:26:07 +0000 (0:00:00.041) 0:04:32.269 **** 2025-12-03 11:26:07.952706 | controller | skipping: [instance] 2025-12-03 11:26:08.084448 | controller | 2025-12-03 11:26:08.084470 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-12-03 11:26:08.084477 | controller | Wednesday 03 December 2025 11:26:07 +0000 (0:00:00.035) 0:04:32.305 **** 2025-12-03 11:26:08.084486 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '669112e4-d06b-4876-9836-59ba8b1dcd5b'}) 2025-12-03 11:26:09.063221 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '7836cb95-239f-4b1e-b2ba-0b0c9d7ea51d'}) 2025-12-03 11:26:09.063252 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '8381bbe2-7b41-4ab2-a0d1-0a83b10220f6'}) 2025-12-03 11:26:09.063259 | controller | 2025-12-03 11:26:09.063266 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-12-03 11:26:09.063272 | controller | Wednesday 03 December 2025 11:26:08 +0000 (0:00:00.131) 0:04:32.436 **** 2025-12-03 11:26:09.063282 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:09.098880 | controller | 2025-12-03 11:26:09.098898 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-12-03 11:26:09.098906 | controller | Wednesday 03 December 2025 11:26:09 +0000 (0:00:00.978) 0:04:33.415 **** 2025-12-03 11:26:09.098915 | controller | skipping: [instance] 2025-12-03 11:26:09.238573 | controller | 2025-12-03 11:26:09.238602 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-12-03 11:26:09.238610 | controller | Wednesday 03 December 2025 11:26:09 +0000 (0:00:00.035) 0:04:33.451 **** 2025-12-03 11:26:09.238620 | controller | 2025-12-03 11:26:09.281042 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-12-03 11:26:09.281065 | controller | Wednesday 03 December 2025 11:26:09 +0000 (0:00:00.137) 0:04:33.589 **** 2025-12-03 11:26:09.281076 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:09.321574 | controller | 2025-12-03 11:26:09.321597 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-03 11:26:09.321606 | controller | Wednesday 03 December 2025 11:26:09 +0000 (0:00:00.044) 0:04:33.633 **** 2025-12-03 11:26:09.321615 | controller | skipping: [instance] 2025-12-03 11:26:09.356212 | controller | 2025-12-03 11:26:09.356231 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-03 11:26:09.356238 | controller | Wednesday 03 December 2025 11:26:09 +0000 (0:00:00.040) 0:04:33.673 **** 2025-12-03 11:26:09.356248 | controller | skipping: [instance] 2025-12-03 11:26:10.686512 | controller | 2025-12-03 11:26:10.686558 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-12-03 11:26:10.686567 | controller | Wednesday 03 December 2025 11:26:09 +0000 (0:00:00.034) 0:04:33.708 **** 2025-12-03 11:26:10.686577 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:15.317964 | controller | 2025-12-03 11:26:15.317994 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-12-03 11:26:15.318002 | controller | Wednesday 03 December 2025 11:26:10 +0000 (0:00:01.329) 0:04:35.038 **** 2025-12-03 11:26:15.318012 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=669112e4-d06b-4876-9836-59ba8b1dcd5b) 2025-12-03 11:26:15.417787 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=7836cb95-239f-4b1e-b2ba-0b0c9d7ea51d) 2025-12-03 11:26:15.417824 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=8381bbe2-7b41-4ab2-a0d1-0a83b10220f6) 2025-12-03 11:26:15.417841 | controller | 2025-12-03 11:26:15.417850 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-12-03 11:26:15.417858 | controller | Wednesday 03 December 2025 11:26:15 +0000 (0:00:04.631) 0:04:39.669 **** 2025-12-03 11:26:15.417870 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-12-03 11:26:15.644747 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-12-03 11:26:15.644775 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-12-03 11:26:15.644782 | controller | 2025-12-03 11:26:15.644788 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-12-03 11:26:15.644794 | controller | Wednesday 03 December 2025 11:26:15 +0000 (0:00:00.099) 0:04:39.769 **** 2025-12-03 11:26:15.644803 | controller | ok: [instance -> localhost] 2025-12-03 11:26:17.689922 | controller | 2025-12-03 11:26:17.689956 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-12-03 11:26:17.689971 | controller | Wednesday 03 December 2025 11:26:15 +0000 (0:00:00.227) 0:04:39.996 **** 2025-12-03 11:26:17.689983 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-12-03 11:26:18.303379 | controller | 2025-12-03 11:26:18.303411 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-12-03 11:26:18.303419 | controller | Wednesday 03 December 2025 11:26:17 +0000 (0:00:02.045) 0:04:42.042 **** 2025-12-03 11:26:18.303429 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:19.050059 | controller | 2025-12-03 11:26:19.050093 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-12-03 11:26:19.050101 | controller | Wednesday 03 December 2025 11:26:18 +0000 (0:00:00.613) 0:04:42.655 **** 2025-12-03 11:26:19.050111 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:20.122342 | controller | 2025-12-03 11:26:20.122374 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-12-03 11:26:20.122382 | controller | Wednesday 03 December 2025 11:26:19 +0000 (0:00:00.746) 0:04:43.402 **** 2025-12-03 11:26:20.122392 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:20.829743 | controller | 2025-12-03 11:26:20.829778 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-12-03 11:26:20.829786 | controller | Wednesday 03 December 2025 11:26:20 +0000 (0:00:01.072) 0:04:44.474 **** 2025-12-03 11:26:20.829796 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:21.872823 | controller | 2025-12-03 11:26:21.872852 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-12-03 11:26:21.872860 | controller | Wednesday 03 December 2025 11:26:20 +0000 (0:00:00.707) 0:04:45.181 **** 2025-12-03 11:26:21.872871 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:22.455447 | controller | 2025-12-03 11:26:22.455481 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-12-03 11:26:22.455489 | controller | Wednesday 03 December 2025 11:26:21 +0000 (0:00:01.043) 0:04:46.225 **** 2025-12-03 11:26:22.455500 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:23.066660 | controller | 2025-12-03 11:26:23.066689 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-12-03 11:26:23.066697 | controller | Wednesday 03 December 2025 11:26:22 +0000 (0:00:00.582) 0:04:46.807 **** 2025-12-03 11:26:23.066707 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:24.359690 | controller | 2025-12-03 11:26:24.359720 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-12-03 11:26:24.359727 | controller | Wednesday 03 December 2025 11:26:23 +0000 (0:00:00.611) 0:04:47.418 **** 2025-12-03 11:26:24.359742 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-03 11:26:24.359987 | controller | 2025-12-03 11:26:24.360161 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-03 11:26:24.360175 | controller | Wednesday 03 December 2025 11:26:24 +0000 (0:00:01.293) 0:04:48.712 **** 2025-12-03 11:26:24.398275 | controller | skipping: [instance] 2025-12-03 11:26:24.430938 | controller | 2025-12-03 11:26:24.430963 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 11:26:24.430972 | controller | Wednesday 03 December 2025 11:26:24 +0000 (0:00:00.035) 0:04:48.748 **** 2025-12-03 11:26:24.430983 | controller | skipping: [instance] 2025-12-03 11:26:24.470253 | controller | 2025-12-03 11:26:24.470278 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-03 11:26:24.470285 | controller | Wednesday 03 December 2025 11:26:24 +0000 (0:00:00.035) 0:04:48.783 **** 2025-12-03 11:26:24.470294 | controller | skipping: [instance] 2025-12-03 11:26:24.505238 | controller | 2025-12-03 11:26:24.505258 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-03 11:26:24.505265 | controller | Wednesday 03 December 2025 11:26:24 +0000 (0:00:00.039) 0:04:48.822 **** 2025-12-03 11:26:24.505274 | controller | skipping: [instance] 2025-12-03 11:26:24.538562 | controller | 2025-12-03 11:26:24.538581 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-03 11:26:24.538589 | controller | Wednesday 03 December 2025 11:26:24 +0000 (0:00:00.035) 0:04:48.857 **** 2025-12-03 11:26:24.538597 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:24.643790 | controller | 2025-12-03 11:26:24.643822 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-03 11:26:24.643832 | controller | Wednesday 03 December 2025 11:26:24 +0000 (0:00:00.033) 0:04:48.891 **** 2025-12-03 11:26:24.643846 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-03 11:26:24.644063 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-12-03 11:26:24.644234 | controller | 2025-12-03 11:26:24.644414 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-03 11:26:24.644573 | controller | Wednesday 03 December 2025 11:26:24 +0000 (0:00:00.105) 0:04:48.996 **** 2025-12-03 11:26:24.688575 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-12-03 11:26:24.688769 | controller | 2025-12-03 11:26:24.688958 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-12-03 11:26:24.689165 | controller | Wednesday 03 December 2025 11:26:24 +0000 (0:00:00.045) 0:04:49.041 **** 2025-12-03 11:26:27.881554 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-03 11:26:28.877113 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-12-03 11:26:28.877144 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-03 11:26:28.877151 | controller | 2025-12-03 11:26:28.877157 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-12-03 11:26:28.877163 | controller | Wednesday 03 December 2025 11:26:27 +0000 (0:00:03.192) 0:04:52.233 **** 2025-12-03 11:26:28.877190 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:29.369421 | controller | 2025-12-03 11:26:29.369453 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-03 11:26:29.369461 | controller | Wednesday 03 December 2025 11:26:28 +0000 (0:00:00.995) 0:04:53.229 **** 2025-12-03 11:26:29.369471 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:30.387862 | controller | 2025-12-03 11:26:30.387894 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-03 11:26:30.387902 | controller | Wednesday 03 December 2025 11:26:29 +0000 (0:00:00.492) 0:04:53.721 **** 2025-12-03 11:26:30.387912 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:30.462353 | controller | 2025-12-03 11:26:30.462380 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-03 11:26:30.462388 | controller | Wednesday 03 December 2025 11:26:30 +0000 (0:00:01.018) 0:04:54.740 **** 2025-12-03 11:26:30.462399 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:30.512944 | controller | 2025-12-03 11:26:30.512964 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-03 11:26:30.512971 | controller | Wednesday 03 December 2025 11:26:30 +0000 (0:00:00.074) 0:04:54.814 **** 2025-12-03 11:26:30.512980 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:31.465299 | controller | 2025-12-03 11:26:31.465330 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-03 11:26:31.465338 | controller | Wednesday 03 December 2025 11:26:30 +0000 (0:00:00.050) 0:04:54.865 **** 2025-12-03 11:26:31.465348 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:32.419633 | controller | 2025-12-03 11:26:32.419666 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-12-03 11:26:32.419675 | controller | Wednesday 03 December 2025 11:26:31 +0000 (0:00:00.952) 0:04:55.817 **** 2025-12-03 11:26:32.419685 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:32.419704 | controller | 2025-12-03 11:26:32.419768 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-12-03 11:26:32.419886 | controller | Wednesday 03 December 2025 11:26:32 +0000 (0:00:00.954) 0:04:56.772 **** 2025-12-03 11:26:38.404658 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-12-03 11:26:38.622018 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:38.622062 | controller | 2025-12-03 11:26:38.622070 | controller | TASK [Configure ntp service] *************************************************** 2025-12-03 11:26:38.622077 | controller | Wednesday 03 December 2025 11:26:38 +0000 (0:00:05.984) 0:05:02.756 **** 2025-12-03 11:26:38.622086 | controller | 2025-12-03 11:26:39.589217 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-12-03 11:26:39.589256 | controller | Wednesday 03 December 2025 11:26:38 +0000 (0:00:00.217) 0:05:02.974 **** 2025-12-03 11:26:39.589268 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:40.518286 | controller | 2025-12-03 11:26:40.518316 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-12-03 11:26:40.518324 | controller | Wednesday 03 December 2025 11:26:39 +0000 (0:00:00.966) 0:05:03.941 **** 2025-12-03 11:26:40.518334 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-12-03 11:26:41.415184 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-12-03 11:26:41.415213 | controller | 2025-12-03 11:26:41.415221 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-12-03 11:26:41.415227 | controller | Wednesday 03 December 2025 11:26:40 +0000 (0:00:00.929) 0:05:04.870 **** 2025-12-03 11:26:41.415237 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:42.029854 | controller | 2025-12-03 11:26:42.029885 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-12-03 11:26:42.029893 | controller | Wednesday 03 December 2025 11:26:41 +0000 (0:00:00.897) 0:05:05.767 **** 2025-12-03 11:26:42.029904 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:42.167644 | controller | 2025-12-03 11:26:42.167670 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-12-03 11:26:42.167678 | controller | Wednesday 03 December 2025 11:26:42 +0000 (0:00:00.614) 0:05:06.381 **** 2025-12-03 11:26:42.167688 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-12-03 11:26:42.609492 | controller | 2025-12-03 11:26:42.609539 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-12-03 11:26:42.609554 | controller | Wednesday 03 December 2025 11:26:42 +0000 (0:00:00.138) 0:05:06.519 **** 2025-12-03 11:26:42.609566 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:43.082437 | controller | 2025-12-03 11:26:43.082468 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-12-03 11:26:43.082476 | controller | Wednesday 03 December 2025 11:26:42 +0000 (0:00:00.441) 0:05:06.961 **** 2025-12-03 11:26:43.082486 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-03 11:26:43.719625 | controller | 2025-12-03 11:26:43.719660 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-12-03 11:26:43.719668 | controller | Wednesday 03 December 2025 11:26:43 +0000 (0:00:00.472) 0:05:07.434 **** 2025-12-03 11:26:43.719678 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-03 11:26:44.221518 | controller | 2025-12-03 11:26:44.221566 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-12-03 11:26:44.221574 | controller | Wednesday 03 December 2025 11:26:43 +0000 (0:00:00.637) 0:05:08.071 **** 2025-12-03 11:26:44.221584 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-03 11:26:44.269347 | controller | 2025-12-03 11:26:44.269379 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-12-03 11:26:44.269387 | controller | Wednesday 03 December 2025 11:26:44 +0000 (0:00:00.501) 0:05:08.573 **** 2025-12-03 11:26:44.269397 | controller | 2025-12-03 11:26:44.688865 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-12-03 11:26:44.688899 | controller | Wednesday 03 December 2025 11:26:44 +0000 (0:00:00.047) 0:05:08.621 **** 2025-12-03 11:26:44.688911 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-03 11:26:45.383986 | controller | 2025-12-03 11:26:45.384017 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-12-03 11:26:45.384025 | controller | Wednesday 03 December 2025 11:26:44 +0000 (0:00:00.419) 0:05:09.040 **** 2025-12-03 11:26:45.384048 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-03 11:26:45.410696 | controller | 2025-12-03 11:26:45.410731 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-12-03 11:26:45.410739 | controller | Wednesday 03 December 2025 11:26:45 +0000 (0:00:00.695) 0:05:09.736 **** 2025-12-03 11:26:45.410749 | controller | skipping: [instance] 2025-12-03 11:26:45.446474 | controller | 2025-12-03 11:26:45.446505 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-12-03 11:26:45.446512 | controller | Wednesday 03 December 2025 11:26:45 +0000 (0:00:00.026) 0:05:09.763 **** 2025-12-03 11:26:45.446541 | controller | skipping: [instance] 2025-12-03 11:26:45.671136 | controller | 2025-12-03 11:26:45.671166 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-12-03 11:26:45.671174 | controller | Wednesday 03 December 2025 11:26:45 +0000 (0:00:00.035) 0:05:09.798 **** 2025-12-03 11:26:45.671184 | controller | changed: [instance] 2025-12-03 11:26:45.744898 | controller | 2025-12-03 11:26:45.744932 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-12-03 11:26:45.744941 | controller | Wednesday 03 December 2025 11:26:45 +0000 (0:00:00.224) 0:05:10.023 **** 2025-12-03 11:26:45.744953 | controller | skipping: [instance] => (item=) 2025-12-03 11:26:45.775932 | controller | 2025-12-03 11:26:45.775958 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-12-03 11:26:45.775965 | controller | Wednesday 03 December 2025 11:26:45 +0000 (0:00:00.073) 0:05:10.097 **** 2025-12-03 11:26:45.775975 | controller | ok: [instance] 2025-12-03 11:26:45.846326 | controller | 2025-12-03 11:26:45.846357 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 11:26:45.846366 | controller | Wednesday 03 December 2025 11:26:45 +0000 (0:00:00.031) 0:05:10.128 **** 2025-12-03 11:26:45.846379 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-03 11:26:46.086293 | controller | 2025-12-03 11:26:46.086322 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 11:26:46.086330 | controller | Wednesday 03 December 2025 11:26:45 +0000 (0:00:00.070) 0:05:10.198 **** 2025-12-03 11:26:46.086340 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-03 11:26:46.138180 | controller | 2025-12-03 11:26:46.138206 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-12-03 11:26:46.138214 | controller | Wednesday 03 December 2025 11:26:46 +0000 (0:00:00.240) 0:05:10.438 **** 2025-12-03 11:26:46.138224 | controller | 2025-12-03 11:26:46.138492 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-03 11:26:46.197173 | controller | Wednesday 03 December 2025 11:26:46 +0000 (0:00:00.052) 0:05:10.490 **** 2025-12-03 11:26:46.197203 | controller | ok: [instance] 2025-12-03 11:26:46.251434 | controller | 2025-12-03 11:26:46.251453 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 11:26:46.251460 | controller | Wednesday 03 December 2025 11:26:46 +0000 (0:00:00.058) 0:05:10.549 **** 2025-12-03 11:26:46.251469 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-03 11:26:46.520159 | controller | 2025-12-03 11:26:46.520190 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 11:26:46.520198 | controller | Wednesday 03 December 2025 11:26:46 +0000 (0:00:00.054) 0:05:10.603 **** 2025-12-03 11:26:46.520208 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-03 11:26:46.921498 | controller | 2025-12-03 11:26:46.921545 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-12-03 11:26:46.921556 | controller | Wednesday 03 December 2025 11:26:46 +0000 (0:00:00.268) 0:05:10.872 **** 2025-12-03 11:26:46.921566 | controller | changed: [instance] 2025-12-03 11:26:47.598883 | controller | 2025-12-03 11:26:47.598919 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-03 11:26:47.598927 | controller | Wednesday 03 December 2025 11:26:46 +0000 (0:00:00.386) 0:05:11.259 **** 2025-12-03 11:26:47.598940 | controller | 2025-12-03 11:26:47.598946 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-12-03 11:26:47.598951 | controller | Wednesday 03 December 2025 11:26:46 +0000 (0:00:00.014) 0:05:11.273 **** 2025-12-03 11:26:47.598961 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:47.995189 | controller | 2025-12-03 11:26:47.995221 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-03 11:26:47.995229 | controller | Wednesday 03 December 2025 11:26:47 +0000 (0:00:00.677) 0:05:11.950 **** 2025-12-03 11:26:47.995239 | controller | changed: [instance] 2025-12-03 11:26:48.168486 | controller | 2025-12-03 11:26:48.168541 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-12-03 11:26:48.168553 | controller | Wednesday 03 December 2025 11:26:47 +0000 (0:00:00.396) 0:05:12.347 **** 2025-12-03 11:26:48.168563 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 11:26:49.609605 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 11:26:49.609637 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-12-03 11:26:49.609646 | controller | 2025-12-03 11:26:49.609652 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-12-03 11:26:49.609658 | controller | Wednesday 03 December 2025 11:26:48 +0000 (0:00:00.173) 0:05:12.520 **** 2025-12-03 11:26:49.609668 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-03 11:26:49.609801 | controller | 2025-12-03 11:26:49.609830 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-03 11:26:49.609842 | controller | Wednesday 03 December 2025 11:26:49 +0000 (0:00:01.441) 0:05:13.961 **** 2025-12-03 11:26:49.628629 | controller | skipping: [instance] 2025-12-03 11:26:49.628827 | controller | 2025-12-03 11:26:49.628847 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-03 11:26:50.106603 | controller | Wednesday 03 December 2025 11:26:49 +0000 (0:00:00.019) 0:05:13.981 **** 2025-12-03 11:26:50.106646 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-12-03 11:26:50.106673 | controller | 2025-12-03 11:26:50.106680 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-03 11:26:50.106688 | controller | Wednesday 03 December 2025 11:26:50 +0000 (0:00:00.477) 0:05:14.458 **** 2025-12-03 11:26:50.138049 | controller | skipping: [instance] 2025-12-03 11:26:50.169243 | controller | 2025-12-03 11:26:50.169261 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-03 11:26:50.169269 | controller | Wednesday 03 December 2025 11:26:50 +0000 (0:00:00.031) 0:05:14.490 **** 2025-12-03 11:26:50.169278 | controller | skipping: [instance] 2025-12-03 11:26:50.201555 | controller | 2025-12-03 11:26:50.201588 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-03 11:26:50.201597 | controller | Wednesday 03 December 2025 11:26:50 +0000 (0:00:00.031) 0:05:14.521 **** 2025-12-03 11:26:50.201607 | controller | skipping: [instance] 2025-12-03 11:26:50.201638 | controller | 2025-12-03 11:26:50.201647 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-03 11:26:50.201735 | controller | Wednesday 03 December 2025 11:26:50 +0000 (0:00:00.032) 0:05:14.554 **** 2025-12-03 11:26:51.625652 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-03 11:26:51.625736 | controller | 2025-12-03 11:26:51.625756 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-12-03 11:26:51.625768 | controller | Wednesday 03 December 2025 11:26:51 +0000 (0:00:01.423) 0:05:15.977 **** 2025-12-03 11:26:51.657404 | controller | skipping: [instance] 2025-12-03 11:26:51.657455 | controller | 2025-12-03 11:26:51.657618 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-12-03 11:26:51.657727 | controller | Wednesday 03 December 2025 11:26:51 +0000 (0:00:00.031) 0:05:16.009 **** 2025-12-03 11:26:51.676061 | controller | skipping: [instance] 2025-12-03 11:26:51.704060 | controller | 2025-12-03 11:26:51.704080 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-12-03 11:26:51.704098 | controller | Wednesday 03 December 2025 11:26:51 +0000 (0:00:00.018) 0:05:16.028 **** 2025-12-03 11:26:51.704107 | controller | skipping: [instance] 2025-12-03 11:26:51.754345 | controller | 2025-12-03 11:26:51.754373 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-12-03 11:26:51.754381 | controller | Wednesday 03 December 2025 11:26:51 +0000 (0:00:00.028) 0:05:16.056 **** 2025-12-03 11:26:51.754397 | controller | ok: [instance] 2025-12-03 11:26:51.754416 | controller | 2025-12-03 11:26:51.754546 | controller | TASK [reproducer : Push local code] ******************************************** 2025-12-03 11:26:51.754682 | controller | Wednesday 03 December 2025 11:26:51 +0000 (0:00:00.050) 0:05:16.106 **** 2025-12-03 11:26:51.851374 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-12-03 11:26:51.889079 | controller | 2025-12-03 11:26:51.889106 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-12-03 11:26:51.889114 | controller | Wednesday 03 December 2025 11:26:51 +0000 (0:00:00.096) 0:05:16.203 **** 2025-12-03 11:26:51.889123 | controller | skipping: [instance] 2025-12-03 11:26:51.926689 | controller | 2025-12-03 11:26:51.926710 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-12-03 11:26:51.926718 | controller | Wednesday 03 December 2025 11:26:51 +0000 (0:00:00.037) 0:05:16.241 **** 2025-12-03 11:26:51.926727 | controller | skipping: [instance] 2025-12-03 11:26:52.014156 | controller | 2025-12-03 11:26:52.014189 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-12-03 11:26:52.014197 | controller | Wednesday 03 December 2025 11:26:51 +0000 (0:00:00.037) 0:05:16.279 **** 2025-12-03 11:26:52.014207 | controller | skipping: [instance] 2025-12-03 11:26:52.050153 | controller | 2025-12-03 11:26:52.050193 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-12-03 11:26:52.050203 | controller | Wednesday 03 December 2025 11:26:52 +0000 (0:00:00.087) 0:05:16.366 **** 2025-12-03 11:26:52.050215 | controller | skipping: [instance] 2025-12-03 11:26:52.082423 | controller | 2025-12-03 11:26:52.082453 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-12-03 11:26:52.082465 | controller | Wednesday 03 December 2025 11:26:52 +0000 (0:00:00.036) 0:05:16.402 **** 2025-12-03 11:26:52.082475 | controller | skipping: [instance] 2025-12-03 11:26:52.534239 | controller | 2025-12-03 11:26:52.534273 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-12-03 11:26:52.534281 | controller | Wednesday 03 December 2025 11:26:52 +0000 (0:00:00.032) 0:05:16.434 **** 2025-12-03 11:26:52.534292 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-12-03 11:26:52.534733 | controller | 2025-12-03 11:26:53.126061 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-12-03 11:26:53.126093 | controller | Wednesday 03 December 2025 11:26:52 +0000 (0:00:00.452) 0:05:16.886 **** 2025-12-03 11:26:53.126112 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-12-03 11:26:53.126131 | controller | 2025-12-03 11:26:53.126139 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-12-03 11:26:53.126241 | controller | Wednesday 03 December 2025 11:26:53 +0000 (0:00:00.591) 0:05:17.478 **** 2025-12-03 11:26:53.172209 | controller | skipping: [instance] => (item=ci-framework) 2025-12-03 11:26:53.172318 | controller | skipping: [instance] 2025-12-03 11:26:53.172422 | controller | 2025-12-03 11:26:53.172547 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-12-03 11:26:53.172652 | controller | Wednesday 03 December 2025 11:26:53 +0000 (0:00:00.043) 0:05:17.522 **** 2025-12-03 11:26:53.249982 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-12-03 11:26:53.250109 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-12-03 11:26:53.250206 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-12-03 11:26:53.250303 | controller | 2025-12-03 11:26:53.250408 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-12-03 11:26:53.250511 | controller | Wednesday 03 December 2025 11:26:53 +0000 (0:00:00.080) 0:05:17.602 **** 2025-12-03 11:26:53.712601 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:53.712695 | controller | 2025-12-03 11:26:53.712815 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-12-03 11:26:53.712920 | controller | Wednesday 03 December 2025 11:26:53 +0000 (0:00:00.462) 0:05:18.065 **** 2025-12-03 11:26:53.749360 | controller | skipping: [instance] 2025-12-03 11:26:53.749433 | controller | 2025-12-03 11:26:53.749608 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-12-03 11:26:53.749689 | controller | Wednesday 03 December 2025 11:26:53 +0000 (0:00:00.036) 0:05:18.102 **** 2025-12-03 11:26:54.203653 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:54.203752 | controller | 2025-12-03 11:26:54.203875 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-12-03 11:26:54.203969 | controller | Wednesday 03 December 2025 11:26:54 +0000 (0:00:00.453) 0:05:18.555 **** 2025-12-03 11:26:54.240692 | controller | skipping: [instance] 2025-12-03 11:26:54.240781 | controller | 2025-12-03 11:26:54.240905 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-12-03 11:26:54.241026 | controller | Wednesday 03 December 2025 11:26:54 +0000 (0:00:00.037) 0:05:18.593 **** 2025-12-03 11:26:54.675390 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:54.675556 | controller | 2025-12-03 11:26:54.675597 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-12-03 11:26:54.675713 | controller | Wednesday 03 December 2025 11:26:54 +0000 (0:00:00.434) 0:05:19.027 **** 2025-12-03 11:26:56.873656 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:26:56.873743 | controller | 2025-12-03 11:26:56.873842 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-12-03 11:26:56.873950 | controller | Wednesday 03 December 2025 11:26:56 +0000 (0:00:02.198) 0:05:21.226 **** 2025-12-03 11:27:15.954716 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:15.954956 | controller | 2025-12-03 11:27:15.955002 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-12-03 11:27:15.955012 | controller | Wednesday 03 December 2025 11:27:15 +0000 (0:00:19.081) 0:05:40.307 **** 2025-12-03 11:27:16.903552 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:16.903664 | controller | 2025-12-03 11:27:16.903685 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-12-03 11:27:16.903790 | controller | Wednesday 03 December 2025 11:27:16 +0000 (0:00:00.948) 0:05:41.256 **** 2025-12-03 11:27:17.003558 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-12-03 11:27:17.003681 | controller | 2025-12-03 11:27:17.003759 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-12-03 11:27:17.003852 | controller | Wednesday 03 December 2025 11:27:17 +0000 (0:00:00.100) 0:05:41.356 **** 2025-12-03 11:27:17.432856 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:17.432907 | controller | 2025-12-03 11:27:17.433021 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-12-03 11:27:17.433136 | controller | Wednesday 03 December 2025 11:27:17 +0000 (0:00:00.429) 0:05:41.785 **** 2025-12-03 11:27:17.468206 | controller | skipping: [instance] 2025-12-03 11:27:17.468293 | controller | 2025-12-03 11:27:17.468399 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-12-03 11:27:17.468502 | controller | Wednesday 03 December 2025 11:27:17 +0000 (0:00:00.035) 0:05:41.820 **** 2025-12-03 11:27:17.510209 | controller | skipping: [instance] 2025-12-03 11:27:17.510291 | controller | 2025-12-03 11:27:17.510402 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-12-03 11:27:17.510509 | controller | Wednesday 03 December 2025 11:27:17 +0000 (0:00:00.041) 0:05:41.862 **** 2025-12-03 11:27:17.599923 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:17.600031 | controller | 2025-12-03 11:27:17.600149 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-03 11:27:17.600245 | controller | Wednesday 03 December 2025 11:27:17 +0000 (0:00:00.089) 0:05:41.952 **** 2025-12-03 11:27:18.065027 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:18.065114 | controller | 2025-12-03 11:27:18.065226 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-03 11:27:18.065332 | controller | Wednesday 03 December 2025 11:27:18 +0000 (0:00:00.465) 0:05:42.417 **** 2025-12-03 11:27:18.102900 | controller | skipping: [instance] 2025-12-03 11:27:18.102988 | controller | 2025-12-03 11:27:18.103199 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-03 11:27:18.103227 | controller | Wednesday 03 December 2025 11:27:18 +0000 (0:00:00.037) 0:05:42.455 **** 2025-12-03 11:27:18.141748 | controller | skipping: [instance] 2025-12-03 11:27:18.141850 | controller | 2025-12-03 11:27:18.141958 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-03 11:27:18.142068 | controller | Wednesday 03 December 2025 11:27:18 +0000 (0:00:00.038) 0:05:42.494 **** 2025-12-03 11:27:18.179370 | controller | skipping: [instance] 2025-12-03 11:27:18.179464 | controller | 2025-12-03 11:27:18.179597 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-03 11:27:18.179707 | controller | Wednesday 03 December 2025 11:27:18 +0000 (0:00:00.037) 0:05:42.532 **** 2025-12-03 11:27:19.671025 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:19.671087 | controller | 2025-12-03 11:27:19.671148 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-03 11:27:19.671258 | controller | Wednesday 03 December 2025 11:27:19 +0000 (0:00:01.491) 0:05:44.023 **** 2025-12-03 11:27:21.013755 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:27:21.013812 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:27:21.013822 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:27:21.013827 | controller | changed: [instance -> controller-0] 2025-12-03 11:27:21.013835 | controller | 2025-12-03 11:27:21.014035 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-03 11:27:21.972110 | controller | Wednesday 03 December 2025 11:27:21 +0000 (0:00:01.342) 0:05:45.365 **** 2025-12-03 11:27:21.972145 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:23.191961 | controller | 2025-12-03 11:27:23.191994 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-03 11:27:23.192002 | controller | Wednesday 03 December 2025 11:27:21 +0000 (0:00:00.958) 0:05:46.324 **** 2025-12-03 11:27:23.192012 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:23.192253 | controller | 2025-12-03 11:27:23.192422 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-03 11:27:23.192506 | controller | Wednesday 03 December 2025 11:27:23 +0000 (0:00:01.219) 0:05:47.544 **** 2025-12-03 11:27:30.978288 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:31.895613 | controller | 2025-12-03 11:27:31.895644 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-03 11:27:31.895652 | controller | Wednesday 03 December 2025 11:27:30 +0000 (0:00:07.786) 0:05:55.330 **** 2025-12-03 11:27:31.895662 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:31.933586 | controller | 2025-12-03 11:27:31.933615 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-03 11:27:31.933629 | controller | Wednesday 03 December 2025 11:27:31 +0000 (0:00:00.917) 0:05:56.247 **** 2025-12-03 11:27:31.933639 | controller | skipping: [instance] 2025-12-03 11:27:33.039361 | controller | 2025-12-03 11:27:33.039390 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-03 11:27:33.039398 | controller | Wednesday 03 December 2025 11:27:31 +0000 (0:00:00.038) 0:05:56.285 **** 2025-12-03 11:27:33.039408 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:33.039483 | controller | 2025-12-03 11:27:33.039571 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-03 11:27:33.039766 | controller | Wednesday 03 December 2025 11:27:33 +0000 (0:00:01.105) 0:05:57.391 **** 2025-12-03 11:27:33.090151 | controller | skipping: [instance] 2025-12-03 11:27:33.090181 | controller | 2025-12-03 11:27:33.090189 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-03 11:27:33.090197 | controller | Wednesday 03 December 2025 11:27:33 +0000 (0:00:00.050) 0:05:57.442 **** 2025-12-03 11:27:33.141305 | controller | skipping: [instance] 2025-12-03 11:27:33.191315 | controller | 2025-12-03 11:27:33.191347 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-03 11:27:33.191354 | controller | Wednesday 03 December 2025 11:27:33 +0000 (0:00:00.050) 0:05:57.493 **** 2025-12-03 11:27:33.191364 | controller | skipping: [instance] 2025-12-03 11:27:33.993359 | controller | 2025-12-03 11:27:33.993403 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-03 11:27:33.993412 | controller | Wednesday 03 December 2025 11:27:33 +0000 (0:00:00.050) 0:05:57.543 **** 2025-12-03 11:27:33.993423 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:34.890721 | controller | 2025-12-03 11:27:34.890769 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-03 11:27:34.890778 | controller | Wednesday 03 December 2025 11:27:33 +0000 (0:00:00.801) 0:05:58.345 **** 2025-12-03 11:27:34.890790 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:34.890907 | controller | 2025-12-03 11:27:34.890918 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-03 11:27:34.891007 | controller | Wednesday 03 December 2025 11:27:34 +0000 (0:00:00.897) 0:05:59.243 **** 2025-12-03 11:27:34.927145 | controller | skipping: [instance] 2025-12-03 11:27:34.927252 | controller | 2025-12-03 11:27:34.927361 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-03 11:27:34.927467 | controller | Wednesday 03 December 2025 11:27:34 +0000 (0:00:00.036) 0:05:59.279 **** 2025-12-03 11:27:34.963238 | controller | skipping: [instance] 2025-12-03 11:27:34.963359 | controller | 2025-12-03 11:27:34.963474 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-03 11:27:34.963560 | controller | Wednesday 03 December 2025 11:27:34 +0000 (0:00:00.036) 0:05:59.315 **** 2025-12-03 11:27:34.999196 | controller | skipping: [instance] 2025-12-03 11:27:34.999283 | controller | 2025-12-03 11:27:34.999390 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-03 11:27:34.999482 | controller | Wednesday 03 December 2025 11:27:34 +0000 (0:00:00.036) 0:05:59.351 **** 2025-12-03 11:27:35.048507 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:35.048636 | controller | 2025-12-03 11:27:35.048758 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-03 11:27:35.048860 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.049) 0:05:59.401 **** 2025-12-03 11:27:35.084205 | controller | skipping: [instance] 2025-12-03 11:27:35.084311 | controller | 2025-12-03 11:27:35.084429 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-03 11:27:35.084544 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.035) 0:05:59.436 **** 2025-12-03 11:27:35.119077 | controller | skipping: [instance] 2025-12-03 11:27:35.119189 | controller | 2025-12-03 11:27:35.119337 | controller | TASK [Download the RPM] ******************************************************** 2025-12-03 11:27:35.119431 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.034) 0:05:59.471 **** 2025-12-03 11:27:35.155911 | controller | skipping: [instance] 2025-12-03 11:27:35.156016 | controller | 2025-12-03 11:27:35.156178 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-03 11:27:35.156292 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.036) 0:05:59.508 **** 2025-12-03 11:27:35.191087 | controller | skipping: [instance] 2025-12-03 11:27:35.191173 | controller | 2025-12-03 11:27:35.191299 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-03 11:27:35.191404 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.035) 0:05:59.543 **** 2025-12-03 11:27:35.225910 | controller | skipping: [instance] 2025-12-03 11:27:35.225991 | controller | 2025-12-03 11:27:35.226125 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-03 11:27:35.226231 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.034) 0:05:59.578 **** 2025-12-03 11:27:35.265111 | controller | skipping: [instance] 2025-12-03 11:27:35.265406 | controller | 2025-12-03 11:27:35.265428 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-03 11:27:35.265448 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.039) 0:05:59.617 **** 2025-12-03 11:27:35.300341 | controller | skipping: [instance] 2025-12-03 11:27:35.300479 | controller | 2025-12-03 11:27:35.300492 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-03 11:27:35.300626 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.035) 0:05:59.652 **** 2025-12-03 11:27:35.749731 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:35.749804 | controller | 2025-12-03 11:27:35.749917 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-03 11:27:35.750020 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.449) 0:06:00.102 **** 2025-12-03 11:27:35.797456 | controller | skipping: [instance] 2025-12-03 11:27:35.797540 | controller | 2025-12-03 11:27:35.797681 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-03 11:27:35.797788 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.047) 0:06:00.150 **** 2025-12-03 11:27:35.846382 | controller | skipping: [instance] 2025-12-03 11:27:35.846472 | controller | 2025-12-03 11:27:35.846614 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-03 11:27:35.846730 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.049) 0:06:00.199 **** 2025-12-03 11:27:35.885324 | controller | skipping: [instance] 2025-12-03 11:27:35.885433 | controller | 2025-12-03 11:27:35.885559 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-03 11:27:35.885665 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.038) 0:06:00.238 **** 2025-12-03 11:27:35.934277 | controller | skipping: [instance] 2025-12-03 11:27:35.934331 | controller | 2025-12-03 11:27:35.934342 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-03 11:27:35.934408 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.048) 0:06:00.286 **** 2025-12-03 11:27:35.981891 | controller | skipping: [instance] 2025-12-03 11:27:35.981991 | controller | 2025-12-03 11:27:35.982004 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-03 11:27:35.982107 | controller | Wednesday 03 December 2025 11:27:35 +0000 (0:00:00.047) 0:06:00.334 **** 2025-12-03 11:27:36.029449 | controller | skipping: [instance] 2025-12-03 11:27:36.029553 | controller | 2025-12-03 11:27:36.029671 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-03 11:27:36.029771 | controller | Wednesday 03 December 2025 11:27:36 +0000 (0:00:00.047) 0:06:00.381 **** 2025-12-03 11:27:36.077505 | controller | skipping: [instance] 2025-12-03 11:27:36.077616 | controller | 2025-12-03 11:27:36.077729 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-03 11:27:36.077845 | controller | Wednesday 03 December 2025 11:27:36 +0000 (0:00:00.048) 0:06:00.430 **** 2025-12-03 11:27:36.126199 | controller | skipping: [instance] 2025-12-03 11:27:36.126320 | controller | 2025-12-03 11:27:36.126446 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-03 11:27:36.126515 | controller | Wednesday 03 December 2025 11:27:36 +0000 (0:00:00.048) 0:06:00.478 **** 2025-12-03 11:27:36.712472 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:36.712552 | controller | 2025-12-03 11:27:36.712673 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-03 11:27:36.712773 | controller | Wednesday 03 December 2025 11:27:36 +0000 (0:00:00.586) 0:06:01.064 **** 2025-12-03 11:27:37.746637 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:27:37.746688 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:27:37.746811 | controller | changed: [instance -> controller-0] 2025-12-03 11:27:37.746921 | controller | 2025-12-03 11:27:37.747016 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-03 11:27:37.747141 | controller | Wednesday 03 December 2025 11:27:37 +0000 (0:00:01.034) 0:06:02.099 **** 2025-12-03 11:27:38.445407 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:38.445473 | controller | 2025-12-03 11:27:38.445596 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-03 11:27:38.445716 | controller | Wednesday 03 December 2025 11:27:38 +0000 (0:00:00.698) 0:06:02.797 **** 2025-12-03 11:27:38.974282 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:38.974386 | controller | 2025-12-03 11:27:38.974542 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-03 11:27:38.974669 | controller | Wednesday 03 December 2025 11:27:38 +0000 (0:00:00.528) 0:06:03.326 **** 2025-12-03 11:27:39.033586 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:27:39.033973 | controller | ok: [instance -> controller-0] 2025-12-03 11:27:39.034096 | controller | 2025-12-03 11:27:39.034293 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-03 11:27:39.034407 | controller | Wednesday 03 December 2025 11:27:39 +0000 (0:00:00.059) 0:06:03.386 **** 2025-12-03 11:27:39.075633 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:27:39.075720 | controller | 2025-12-03 11:27:39.075826 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-03 11:27:39.075940 | controller | Wednesday 03 December 2025 11:27:39 +0000 (0:00:00.041) 0:06:03.428 **** 2025-12-03 11:28:08.738789 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:08.739079 | controller | 2025-12-03 11:28:09.195118 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-03 11:28:09.195150 | controller | Wednesday 03 December 2025 11:28:08 +0000 (0:00:29.662) 0:06:33.090 **** 2025-12-03 11:28:09.195162 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:09.688103 | controller | 2025-12-03 11:28:09.688142 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-03 11:28:09.688150 | controller | Wednesday 03 December 2025 11:28:09 +0000 (0:00:00.456) 0:06:33.547 **** 2025-12-03 11:28:09.688160 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:15.741987 | controller | 2025-12-03 11:28:15.742035 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-03 11:28:15.742044 | controller | Wednesday 03 December 2025 11:28:09 +0000 (0:00:00.492) 0:06:34.040 **** 2025-12-03 11:28:15.742073 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:15.742093 | controller | 2025-12-03 11:28:15.742101 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-03 11:28:15.742133 | controller | Wednesday 03 December 2025 11:28:15 +0000 (0:00:06.054) 0:06:40.094 **** 2025-12-03 11:28:15.790761 | controller | skipping: [instance] 2025-12-03 11:28:15.790845 | controller | 2025-12-03 11:28:15.790960 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-03 11:28:15.791072 | controller | Wednesday 03 December 2025 11:28:15 +0000 (0:00:00.049) 0:06:40.143 **** 2025-12-03 11:28:16.383722 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:16.383783 | controller | 2025-12-03 11:28:16.383870 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-03 11:28:16.383974 | controller | Wednesday 03 December 2025 11:28:16 +0000 (0:00:00.592) 0:06:40.736 **** 2025-12-03 11:28:16.845742 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:16.845793 | controller | 2025-12-03 11:28:16.845922 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-03 11:28:16.846020 | controller | Wednesday 03 December 2025 11:28:16 +0000 (0:00:00.462) 0:06:41.198 **** 2025-12-03 11:28:16.886566 | controller | skipping: [instance] 2025-12-03 11:28:16.886663 | controller | 2025-12-03 11:28:16.886770 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-03 11:28:16.886870 | controller | Wednesday 03 December 2025 11:28:16 +0000 (0:00:00.041) 0:06:41.239 **** 2025-12-03 11:28:16.923312 | controller | skipping: [instance] 2025-12-03 11:28:16.923428 | controller | 2025-12-03 11:28:16.923567 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-03 11:28:16.923701 | controller | Wednesday 03 December 2025 11:28:16 +0000 (0:00:00.036) 0:06:41.275 **** 2025-12-03 11:28:16.960174 | controller | skipping: [instance] 2025-12-03 11:28:16.960279 | controller | 2025-12-03 11:28:16.960404 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-03 11:28:16.960501 | controller | Wednesday 03 December 2025 11:28:16 +0000 (0:00:00.037) 0:06:41.312 **** 2025-12-03 11:28:16.996977 | controller | skipping: [instance] 2025-12-03 11:28:16.997085 | controller | 2025-12-03 11:28:16.997201 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-03 11:28:16.997318 | controller | Wednesday 03 December 2025 11:28:16 +0000 (0:00:00.036) 0:06:41.349 **** 2025-12-03 11:28:17.034692 | controller | skipping: [instance] 2025-12-03 11:28:17.034778 | controller | 2025-12-03 11:28:17.034883 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-03 11:28:17.034998 | controller | Wednesday 03 December 2025 11:28:17 +0000 (0:00:00.037) 0:06:41.387 **** 2025-12-03 11:28:17.075852 | controller | skipping: [instance] 2025-12-03 11:28:17.075925 | controller | 2025-12-03 11:28:17.076033 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-03 11:28:17.076150 | controller | Wednesday 03 December 2025 11:28:17 +0000 (0:00:00.041) 0:06:41.428 **** 2025-12-03 11:28:19.509127 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:28:19.509185 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:28:19.509302 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:28:19.509391 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:28:19.509493 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:28:19.509619 | controller | changed: [instance -> controller-0] 2025-12-03 11:28:19.509709 | controller | 2025-12-03 11:28:19.509819 | controller | TASK [Prepare install_yamls make targets] ************************************** 2025-12-03 11:28:19.509914 | controller | Wednesday 03 December 2025 11:28:19 +0000 (0:00:02.432) 0:06:43.861 **** 2025-12-03 11:28:19.661812 | controller | 2025-12-03 11:28:19.661890 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2025-12-03 11:28:19.661995 | controller | Wednesday 03 December 2025 11:28:19 +0000 (0:00:00.152) 0:06:44.014 **** 2025-12-03 11:28:21.093720 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:28:21.093770 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:28:21.093891 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:28:21.093980 | controller | changed: [instance -> controller-0] 2025-12-03 11:28:21.094079 | controller | 2025-12-03 11:28:21.094195 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2025-12-03 11:28:21.094302 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:01.431) 0:06:45.445 **** 2025-12-03 11:28:21.149779 | controller | 2025-12-03 11:28:21.149874 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2025-12-03 11:28:21.149974 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:00.056) 0:06:45.502 **** 2025-12-03 11:28:21.188769 | controller | skipping: [instance] 2025-12-03 11:28:21.188816 | controller | 2025-12-03 11:28:21.188930 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2025-12-03 11:28:21.189035 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:00.039) 0:06:45.541 **** 2025-12-03 11:28:21.234510 | controller | skipping: [instance] 2025-12-03 11:28:21.234584 | controller | 2025-12-03 11:28:21.234703 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2025-12-03 11:28:21.234824 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:00.045) 0:06:45.587 **** 2025-12-03 11:28:21.300798 | controller | 2025-12-03 11:28:21.300918 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 11:28:21.301043 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:00.066) 0:06:45.653 **** 2025-12-03 11:28:21.355173 | controller | skipping: [instance] 2025-12-03 11:28:21.355228 | controller | 2025-12-03 11:28:21.355344 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 11:28:21.355448 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:00.054) 0:06:45.707 **** 2025-12-03 11:28:21.393812 | controller | skipping: [instance] 2025-12-03 11:28:21.393862 | controller | 2025-12-03 11:28:21.393994 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 11:28:21.394114 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:00.038) 0:06:45.746 **** 2025-12-03 11:28:21.431213 | controller | skipping: [instance] 2025-12-03 11:28:21.431266 | controller | 2025-12-03 11:28:21.431381 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 11:28:21.431482 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:00.037) 0:06:45.783 **** 2025-12-03 11:28:21.475984 | controller | skipping: [instance] 2025-12-03 11:28:21.476041 | controller | 2025-12-03 11:28:21.476167 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2025-12-03 11:28:21.476315 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:00.044) 0:06:45.828 **** 2025-12-03 11:28:21.563477 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 11:28:21.563586 | controller | ok: [instance -> controller-0] 2025-12-03 11:28:21.563697 | controller | 2025-12-03 11:28:21.563795 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2025-12-03 11:28:21.563894 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:00.087) 0:06:45.916 **** 2025-12-03 11:28:21.623299 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:21.623355 | controller | 2025-12-03 11:28:21.623459 | controller | TASK [install_yamls : Get environment structure] ******************************* 2025-12-03 11:28:21.623582 | controller | Wednesday 03 December 2025 11:28:21 +0000 (0:00:00.059) 0:06:45.975 **** 2025-12-03 11:28:22.580391 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:22.580453 | controller | 2025-12-03 11:28:22.580586 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2025-12-03 11:28:22.580703 | controller | Wednesday 03 December 2025 11:28:22 +0000 (0:00:00.956) 0:06:46.932 **** 2025-12-03 11:28:22.618152 | controller | skipping: [instance] 2025-12-03 11:28:22.618235 | controller | 2025-12-03 11:28:22.618352 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2025-12-03 11:28:22.618460 | controller | Wednesday 03 December 2025 11:28:22 +0000 (0:00:00.037) 0:06:46.970 **** 2025-12-03 11:28:22.663244 | controller | skipping: [instance] 2025-12-03 11:28:22.663351 | controller | 2025-12-03 11:28:22.663467 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2025-12-03 11:28:22.663590 | controller | Wednesday 03 December 2025 11:28:22 +0000 (0:00:00.045) 0:06:47.015 **** 2025-12-03 11:28:22.700796 | controller | skipping: [instance] 2025-12-03 11:28:22.700877 | controller | 2025-12-03 11:28:22.701026 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2025-12-03 11:28:22.701136 | controller | Wednesday 03 December 2025 11:28:22 +0000 (0:00:00.037) 0:06:47.053 **** 2025-12-03 11:28:22.754342 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:22.754430 | controller | 2025-12-03 11:28:22.754556 | controller | TASK [install_yamls : Show the env structure] ********************************** 2025-12-03 11:28:22.754670 | controller | Wednesday 03 December 2025 11:28:22 +0000 (0:00:00.053) 0:06:47.106 **** 2025-12-03 11:28:22.798929 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:22.799015 | controller | 2025-12-03 11:28:22.799135 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2025-12-03 11:28:22.799239 | controller | Wednesday 03 December 2025 11:28:22 +0000 (0:00:00.044) 0:06:47.151 **** 2025-12-03 11:28:22.850810 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:22.850887 | controller | 2025-12-03 11:28:22.850996 | controller | TASK [install_yamls : Generate make targets] *********************************** 2025-12-03 11:28:22.851137 | controller | Wednesday 03 December 2025 11:28:22 +0000 (0:00:00.051) 0:06:47.203 **** 2025-12-03 11:28:23.469794 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:23.469867 | controller | 2025-12-03 11:28:23.469986 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2025-12-03 11:28:23.470077 | controller | Wednesday 03 December 2025 11:28:23 +0000 (0:00:00.618) 0:06:47.822 **** 2025-12-03 11:28:23.515138 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:23.515240 | controller | 2025-12-03 11:28:23.515361 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2025-12-03 11:28:23.515469 | controller | Wednesday 03 December 2025 11:28:23 +0000 (0:00:00.045) 0:06:47.867 **** 2025-12-03 11:28:24.488285 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:24.488382 | controller | 2025-12-03 11:28:24.488487 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2025-12-03 11:28:24.488633 | controller | Wednesday 03 December 2025 11:28:24 +0000 (0:00:00.973) 0:06:48.840 **** 2025-12-03 11:28:24.533423 | controller | skipping: [instance] 2025-12-03 11:28:24.533540 | controller | 2025-12-03 11:28:24.533658 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-03 11:28:24.533761 | controller | Wednesday 03 December 2025 11:28:24 +0000 (0:00:00.045) 0:06:48.886 **** 2025-12-03 11:28:25.240549 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:25.240617 | controller | 2025-12-03 11:28:25.240800 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-03 11:28:25.240891 | controller | Wednesday 03 December 2025 11:28:25 +0000 (0:00:00.706) 0:06:49.592 **** 2025-12-03 11:28:25.293153 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:25.293232 | controller | 2025-12-03 11:28:25.293354 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2025-12-03 11:28:25.293452 | controller | Wednesday 03 December 2025 11:28:25 +0000 (0:00:00.052) 0:06:49.645 **** 2025-12-03 11:28:26.194101 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:26.194156 | controller | 2025-12-03 11:28:26.194272 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2025-12-03 11:28:26.194399 | controller | Wednesday 03 December 2025 11:28:26 +0000 (0:00:00.900) 0:06:50.546 **** 2025-12-03 11:28:26.650740 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:26.650791 | controller | 2025-12-03 11:28:26.650898 | controller | TASK [Configure CRC network if needed] ***************************************** 2025-12-03 11:28:26.650997 | controller | Wednesday 03 December 2025 11:28:26 +0000 (0:00:00.456) 0:06:51.003 **** 2025-12-03 11:28:26.803145 | controller | 2025-12-03 11:28:26.803235 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2025-12-03 11:28:26.803337 | controller | Wednesday 03 December 2025 11:28:26 +0000 (0:00:00.152) 0:06:51.155 **** 2025-12-03 11:28:27.931305 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:27.931363 | controller | 2025-12-03 11:28:27.931463 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2025-12-03 11:28:27.931580 | controller | Wednesday 03 December 2025 11:28:27 +0000 (0:00:01.128) 0:06:52.283 **** 2025-12-03 11:28:29.041758 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:29.041811 | controller | 2025-12-03 11:28:29.041916 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2025-12-03 11:28:29.042020 | controller | Wednesday 03 December 2025 11:28:29 +0000 (0:00:01.110) 0:06:53.394 **** 2025-12-03 11:28:29.072134 | controller | skipping: [instance] 2025-12-03 11:28:29.072184 | controller | 2025-12-03 11:28:29.072310 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2025-12-03 11:28:29.072429 | controller | Wednesday 03 December 2025 11:28:29 +0000 (0:00:00.030) 0:06:53.424 **** 2025-12-03 11:28:29.108422 | controller | skipping: [instance] 2025-12-03 11:28:29.108506 | controller | 2025-12-03 11:28:29.108636 | controller | TASK [reproducer : Prepare architecture-based deployment] ********************** 2025-12-03 11:28:29.108739 | controller | Wednesday 03 December 2025 11:28:29 +0000 (0:00:00.036) 0:06:53.461 **** 2025-12-03 11:28:29.147543 | controller | skipping: [instance] 2025-12-03 11:28:29.147648 | controller | 2025-12-03 11:28:29.147759 | controller | TASK [reproducer : Prepare architecture-based post deployment] ***************** 2025-12-03 11:28:29.147865 | controller | Wednesday 03 December 2025 11:28:29 +0000 (0:00:00.039) 0:06:53.500 **** 2025-12-03 11:28:29.183721 | controller | skipping: [instance] 2025-12-03 11:28:29.183814 | controller | 2025-12-03 11:28:29.183921 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** 2025-12-03 11:28:29.184018 | controller | Wednesday 03 December 2025 11:28:29 +0000 (0:00:00.036) 0:06:53.536 **** 2025-12-03 11:28:30.097953 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:30.098008 | controller | 2025-12-03 11:28:30.098135 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** 2025-12-03 11:28:30.098237 | controller | Wednesday 03 December 2025 11:28:30 +0000 (0:00:00.914) 0:06:54.450 **** 2025-12-03 11:28:30.573984 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:30.574033 | controller | 2025-12-03 11:28:30.574165 | controller | TASK [Ensure we have needed inventory files] *********************************** 2025-12-03 11:28:30.574269 | controller | Wednesday 03 December 2025 11:28:30 +0000 (0:00:00.475) 0:06:54.926 **** 2025-12-03 11:28:31.043316 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:31.043367 | controller | 2025-12-03 11:28:31.043473 | controller | TASK [Ensure we have CRC ssh key] ********************************************** 2025-12-03 11:28:31.043608 | controller | Wednesday 03 December 2025 11:28:31 +0000 (0:00:00.469) 0:06:55.395 **** 2025-12-03 11:28:31.487342 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:31.487423 | controller | 2025-12-03 11:28:31.487557 | controller | TASK [Ensure we have the MAC mapping file] ************************************* 2025-12-03 11:28:31.487662 | controller | Wednesday 03 December 2025 11:28:31 +0000 (0:00:00.444) 0:06:55.839 **** 2025-12-03 11:28:31.981369 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:31.981425 | controller | 2025-12-03 11:28:31.981489 | controller | TASK [Load crc inventory] ****************************************************** 2025-12-03 11:28:31.981615 | controller | Wednesday 03 December 2025 11:28:31 +0000 (0:00:00.493) 0:06:56.333 **** 2025-12-03 11:28:32.431909 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:32.431963 | controller | 2025-12-03 11:28:32.432091 | controller | TASK [Load compute inventory] ************************************************** 2025-12-03 11:28:32.432199 | controller | Wednesday 03 December 2025 11:28:32 +0000 (0:00:00.450) 0:06:56.784 **** 2025-12-03 11:28:32.872354 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:32.872427 | controller | 2025-12-03 11:28:32.872574 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** 2025-12-03 11:28:32.872661 | controller | Wednesday 03 December 2025 11:28:32 +0000 (0:00:00.440) 0:06:57.224 **** 2025-12-03 11:28:33.343014 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:33.343109 | controller | 2025-12-03 11:28:33.343226 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* 2025-12-03 11:28:33.343336 | controller | Wednesday 03 December 2025 11:28:33 +0000 (0:00:00.470) 0:06:57.695 **** 2025-12-03 11:28:33.778798 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:33.778862 | controller | 2025-12-03 11:28:33.778978 | controller | TASK [Check default location secret file] ************************************** 2025-12-03 11:28:33.779093 | controller | Wednesday 03 December 2025 11:28:33 +0000 (0:00:00.435) 0:06:58.131 **** 2025-12-03 11:28:34.250672 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:34.250768 | controller | 2025-12-03 11:28:34.250895 | controller | TASK [Check non-default location secret] *************************************** 2025-12-03 11:28:34.251003 | controller | Wednesday 03 December 2025 11:28:34 +0000 (0:00:00.471) 0:06:58.603 **** 2025-12-03 11:28:34.698464 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 11:28:34.698558 | controller | 2025-12-03 11:28:34.698678 | controller | TASK [Assert all of the tests] ************************************************* 2025-12-03 11:28:34.698798 | controller | Wednesday 03 December 2025 11:28:34 +0000 (0:00:00.447) 0:06:59.051 **** 2025-12-03 11:28:34.735534 | controller | ok: [instance] 2025-12-03 11:28:34.735645 | controller | 2025-12-03 11:28:34.735960 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-12-03 11:28:34.948837 | controller | Wednesday 03 December 2025 11:28:34 +0000 (0:00:00.037) 0:06:59.088 **** 2025-12-03 11:28:34.948873 | controller | changed: [instance] 2025-12-03 11:28:34.949046 | controller | 2025-12-03 11:28:34.949303 | controller | TASK [Get journalctl in a file] ************************************************ 2025-12-03 11:28:34.949321 | controller | Wednesday 03 December 2025 11:28:34 +0000 (0:00:00.212) 0:06:59.301 **** 2025-12-03 11:28:35.161754 | controller | changed: [instance] 2025-12-03 11:28:35.161836 | controller | 2025-12-03 11:28:35.161958 | controller | TASK [Dump journalctl output] ************************************************** 2025-12-03 11:28:35.162074 | controller | Wednesday 03 December 2025 11:28:35 +0000 (0:00:00.213) 0:06:59.514 **** 2025-12-03 11:28:35.535006 | controller | changed: [instance] 2025-12-03 11:28:35.535074 | controller | 2025-12-03 11:28:35.535194 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-12-03 11:28:35.535286 | controller | Wednesday 03 December 2025 11:28:35 +0000 (0:00:00.373) 0:06:59.887 **** 2025-12-03 11:28:36.020893 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-03 11:28:36.021239 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-12-03 11:28:36.021302 | controller | 2025-12-03 11:28:36.021329 | controller | TASK [Create log directory] **************************************************** 2025-12-03 11:28:36.021339 | controller | Wednesday 03 December 2025 11:28:36 +0000 (0:00:00.485) 0:07:00.373 **** 2025-12-03 11:28:36.217719 | controller | changed: [instance] 2025-12-03 11:28:36.217768 | controller | 2025-12-03 11:28:36.217778 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-12-03 11:28:36.217933 | controller | Wednesday 03 December 2025 11:28:36 +0000 (0:00:00.196) 0:07:00.570 **** 2025-12-03 11:28:37.109000 | controller | changed: [instance] 2025-12-03 11:28:37.109039 | controller | 2025-12-03 11:28:37.109047 | controller | PLAY RECAP ********************************************************************* 2025-12-03 11:28:37.109054 | controller | instance : ok=540 changed=203 unreachable=0 failed=0 skipped=226 rescued=0 ignored=0 2025-12-03 11:28:37.109268 | controller | 2025-12-03 11:28:37.109278 | controller | Wednesday 03 December 2025 11:28:37 +0000 (0:00:00.889) 0:07:01.459 **** 2025-12-03 11:28:37.109286 | controller | =============================================================================== 2025-12-03 11:28:37.109462 | controller | reproducer : Check package install status ------------------------------ 61.42s 2025-12-03 11:28:37.109629 | controller | ci_setup : Install needed packages ------------------------------------- 29.66s 2025-12-03 11:28:37.109647 | controller | libvirt_manager : Download base image ---------------------------------- 20.70s 2025-12-03 11:28:37.109655 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.81s 2025-12-03 11:28:37.109665 | controller | reproducer : Install collections on controller-0 ----------------------- 19.08s 2025-12-03 11:28:37.109692 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.84s 2025-12-03 11:28:37.109702 | controller | ci_nmstate : Install required packages on localhost --------------------- 8.10s 2025-12-03 11:28:37.109863 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.08s 2025-12-03 11:28:37.109900 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.79s 2025-12-03 11:28:37.110287 | controller | ci_setup : Install openshift client ------------------------------------- 6.05s 2025-12-03 11:28:37.110411 | controller | reproducer : Ensure we have all dependencies installed ------------------ 5.98s 2025-12-03 11:28:37.110426 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 4.63s 2025-12-03 11:28:37.110433 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.69s 2025-12-03 11:28:37.110441 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.23s 2025-12-03 11:28:37.110476 | controller | networking_mapper : Gather the facts ------------------------------------ 3.19s 2025-12-03 11:28:37.110666 | controller | sushy_emulator : Install required packages ------------------------------ 2.86s 2025-12-03 11:28:37.110826 | controller | ci_setup : Manage directories ------------------------------------------- 2.43s 2025-12-03 11:28:37.110860 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.20s 2025-12-03 11:28:37.110869 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.08s 2025-12-03 11:28:37.111105 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2025-12-03 11:28:37.240738 | controller | INFO Running crc_layout > cleanup 2025-12-03 11:28:37.241216 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-03 11:28:37.248782 | controller | INFO Running job_uri > prepare 2025-12-03 11:28:37.249230 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-03 11:28:37.256645 | controller | INFO Running job_uri > converge 2025-12-03 11:28:37.719156 | controller | 2025-12-03 11:28:37.797701 | controller | PLAY [Prepare] ***************************************************************** 2025-12-03 11:28:37.797728 | controller | 2025-12-03 11:28:37.797736 | controller | TASK [Call task file in loop] ************************************************** 2025-12-03 11:28:37.797742 | controller | Wednesday 03 December 2025 11:28:37 +0000 (0:00:00.034) 0:00:00.034 **** 2025-12-03 11:28:37.797763 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) 2025-12-03 11:28:37.837966 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-12-03 11:28:37.837996 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-12-03 11:28:37.838006 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) 2025-12-03 11:28:37.838022 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-12-03 11:28:37.838030 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-12-03 11:28:37.838037 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) 2025-12-03 11:28:37.838044 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) 2025-12-03 11:28:37.838056 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) 2025-12-03 11:28:37.838080 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) 2025-12-03 11:28:37.838088 | controller | 2025-12-03 11:28:37.838095 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** 2025-12-03 11:28:37.838102 | controller | Wednesday 03 December 2025 11:28:37 +0000 (0:00:00.078) 0:00:00.112 **** 2025-12-03 11:28:37.838113 | controller | 2025-12-03 11:28:37.874237 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 11:28:37.874265 | controller | Wednesday 03 December 2025 11:28:37 +0000 (0:00:00.041) 0:00:00.153 **** 2025-12-03 11:28:37.874277 | controller | ok: [instance] 2025-12-03 11:28:37.913342 | controller | 2025-12-03 11:28:37.913372 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 11:28:37.913380 | controller | Wednesday 03 December 2025 11:28:37 +0000 (0:00:00.036) 0:00:00.189 **** 2025-12-03 11:28:37.913391 | controller | ok: [instance] 2025-12-03 11:28:37.960659 | controller | 2025-12-03 11:28:37.960680 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 11:28:37.960687 | controller | Wednesday 03 December 2025 11:28:37 +0000 (0:00:00.038) 0:00:00.228 **** 2025-12-03 11:28:37.960697 | controller | ok: [instance] 2025-12-03 11:28:37.984624 | controller | 2025-12-03 11:28:37.984645 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 11:28:37.984653 | controller | Wednesday 03 December 2025 11:28:37 +0000 (0:00:00.047) 0:00:00.276 **** 2025-12-03 11:28:37.984662 | controller | skipping: [instance] 2025-12-03 11:28:38.035870 | controller | 2025-12-03 11:28:38.035892 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 11:28:38.035900 | controller | Wednesday 03 December 2025 11:28:37 +0000 (0:00:00.024) 0:00:00.300 **** 2025-12-03 11:28:38.035909 | controller | ok: [instance] => changed=false 2025-12-03 11:28:38.073355 | controller | msg: All assertions passed 2025-12-03 11:28:38.073376 | controller | 2025-12-03 11:28:38.073384 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-12-03 11:28:38.073391 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.051) 0:00:00.351 **** 2025-12-03 11:28:38.073399 | controller | 2025-12-03 11:28:38.108226 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 11:28:38.108252 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.037) 0:00:00.389 **** 2025-12-03 11:28:38.108264 | controller | ok: [instance] 2025-12-03 11:28:38.144456 | controller | 2025-12-03 11:28:38.144483 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 11:28:38.144492 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.034) 0:00:00.423 **** 2025-12-03 11:28:38.144503 | controller | ok: [instance] 2025-12-03 11:28:38.178166 | controller | 2025-12-03 11:28:38.178188 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 11:28:38.178195 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.036) 0:00:00.460 **** 2025-12-03 11:28:38.178204 | controller | ok: [instance] 2025-12-03 11:28:38.207967 | controller | 2025-12-03 11:28:38.207989 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 11:28:38.207996 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.033) 0:00:00.493 **** 2025-12-03 11:28:38.208005 | controller | skipping: [instance] 2025-12-03 11:28:38.242148 | controller | 2025-12-03 11:28:38.242170 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 11:28:38.242178 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.029) 0:00:00.523 **** 2025-12-03 11:28:38.242193 | controller | ok: [instance] => changed=false 2025-12-03 11:28:38.282704 | controller | msg: All assertions passed 2025-12-03 11:28:38.282727 | controller | 2025-12-03 11:28:38.282736 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-12-03 11:28:38.282744 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.033) 0:00:00.557 **** 2025-12-03 11:28:38.282755 | controller | 2025-12-03 11:28:38.317905 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 11:28:38.317943 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.040) 0:00:00.598 **** 2025-12-03 11:28:38.317955 | controller | ok: [instance] 2025-12-03 11:28:38.317974 | controller | 2025-12-03 11:28:38.318089 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 11:28:38.318208 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.035) 0:00:00.633 **** 2025-12-03 11:28:38.356706 | controller | ok: [instance] 2025-12-03 11:28:38.356828 | controller | 2025-12-03 11:28:38.356961 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 11:28:38.357125 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.038) 0:00:00.672 **** 2025-12-03 11:28:38.391153 | controller | ok: [instance] 2025-12-03 11:28:38.391262 | controller | 2025-12-03 11:28:38.391390 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 11:28:38.391489 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.034) 0:00:00.707 **** 2025-12-03 11:28:38.415795 | controller | skipping: [instance] 2025-12-03 11:28:38.415908 | controller | 2025-12-03 11:28:38.416046 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 11:28:38.416192 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.024) 0:00:00.731 **** 2025-12-03 11:28:38.450375 | controller | ok: [instance] => changed=false 2025-12-03 11:28:38.450499 | controller | msg: All assertions passed 2025-12-03 11:28:38.450653 | controller | 2025-12-03 11:28:38.450800 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** 2025-12-03 11:28:38.450939 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.034) 0:00:00.766 **** 2025-12-03 11:28:38.486152 | controller | 2025-12-03 11:28:38.486255 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 11:28:38.486397 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.035) 0:00:00.802 **** 2025-12-03 11:28:38.520849 | controller | ok: [instance] 2025-12-03 11:28:38.520940 | controller | 2025-12-03 11:28:38.521052 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 11:28:38.521177 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.034) 0:00:00.836 **** 2025-12-03 11:28:38.560553 | controller | ok: [instance] 2025-12-03 11:28:38.560655 | controller | 2025-12-03 11:28:38.560777 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 11:28:38.560871 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.039) 0:00:00.876 **** 2025-12-03 11:28:38.594831 | controller | ok: [instance] 2025-12-03 11:28:38.594919 | controller | 2025-12-03 11:28:38.595052 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 11:28:38.595177 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.034) 0:00:00.910 **** 2025-12-03 11:28:38.623612 | controller | skipping: [instance] 2025-12-03 11:28:38.623714 | controller | 2025-12-03 11:28:38.623825 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 11:28:38.623932 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.028) 0:00:00.939 **** 2025-12-03 11:28:38.657730 | controller | ok: [instance] => changed=false 2025-12-03 11:28:38.657841 | controller | msg: All assertions passed 2025-12-03 11:28:38.657940 | controller | 2025-12-03 11:28:38.658059 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-12-03 11:28:38.658195 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.034) 0:00:00.973 **** 2025-12-03 11:28:38.711700 | controller | 2025-12-03 11:28:38.711811 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 11:28:38.711916 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.053) 0:00:01.027 **** 2025-12-03 11:28:38.744359 | controller | ok: [instance] 2025-12-03 11:28:38.744872 | controller | 2025-12-03 11:28:38.770004 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 11:28:38.770027 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.032) 0:00:01.060 **** 2025-12-03 11:28:38.770039 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:38.770123 | controller | assertion: _matched_url | default('') | length > 0 2025-12-03 11:28:38.770237 | controller | evaluated_to: false 2025-12-03 11:28:38.770470 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-03 11:28:38.800313 | controller | 2025-12-03 11:28:38.800450 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-03 11:28:38.800560 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.036) 0:00:01.097 **** 2025-12-03 11:28:38.800684 | controller | 2025-12-03 11:28:38.801039 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-03 11:28:38.831834 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.018) 0:00:01.115 **** 2025-12-03 11:28:38.831877 | controller | skipping: [instance] 2025-12-03 11:28:38.831912 | controller | 2025-12-03 11:28:38.832032 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-03 11:28:38.832153 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.032) 0:00:01.147 **** 2025-12-03 11:28:38.863660 | controller | skipping: [instance] 2025-12-03 11:28:38.863750 | controller | 2025-12-03 11:28:38.863890 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-12-03 11:28:38.864016 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.031) 0:00:01.179 **** 2025-12-03 11:28:38.899392 | controller | 2025-12-03 11:28:38.899507 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 11:28:38.899631 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.035) 0:00:01.215 **** 2025-12-03 11:28:38.933515 | controller | ok: [instance] 2025-12-03 11:28:38.933652 | controller | 2025-12-03 11:28:38.933777 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 11:28:38.933918 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.034) 0:00:01.249 **** 2025-12-03 11:28:38.959871 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:38.959976 | controller | assertion: _matched_url | default('') | length > 0 2025-12-03 11:28:38.960084 | controller | evaluated_to: false 2025-12-03 11:28:38.960218 | controller | msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-03 11:28:38.987706 | controller | 2025-12-03 11:28:38.987841 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-03 11:28:38.987894 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.037) 0:00:01.286 **** 2025-12-03 11:28:38.988050 | controller | 2025-12-03 11:28:38.988108 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-03 11:28:38.988211 | controller | Wednesday 03 December 2025 11:28:38 +0000 (0:00:00.016) 0:00:01.303 **** 2025-12-03 11:28:39.031130 | controller | skipping: [instance] 2025-12-03 11:28:39.031264 | controller | 2025-12-03 11:28:39.031378 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-03 11:28:39.031503 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.043) 0:00:01.347 **** 2025-12-03 11:28:39.060886 | controller | skipping: [instance] 2025-12-03 11:28:39.060992 | controller | 2025-12-03 11:28:39.061116 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** 2025-12-03 11:28:39.061229 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.029) 0:00:01.377 **** 2025-12-03 11:28:39.096973 | controller | 2025-12-03 11:28:39.097415 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 11:28:39.097558 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.036) 0:00:01.413 **** 2025-12-03 11:28:39.131339 | controller | ok: [instance] 2025-12-03 11:28:39.131425 | controller | 2025-12-03 11:28:39.131540 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 11:28:39.131654 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.034) 0:00:01.447 **** 2025-12-03 11:28:39.171721 | controller | ok: [instance] 2025-12-03 11:28:39.172036 | controller | 2025-12-03 11:28:39.207166 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 11:28:39.207192 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.040) 0:00:01.487 **** 2025-12-03 11:28:39.207206 | controller | ok: [instance] 2025-12-03 11:28:39.207238 | controller | 2025-12-03 11:28:39.207429 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 11:28:39.207572 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.035) 0:00:01.522 **** 2025-12-03 11:28:39.232951 | controller | skipping: [instance] 2025-12-03 11:28:39.267519 | controller | 2025-12-03 11:28:39.267568 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 11:28:39.267577 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.025) 0:00:01.548 **** 2025-12-03 11:28:39.267587 | controller | ok: [instance] => changed=false 2025-12-03 11:28:39.267780 | controller | msg: All assertions passed 2025-12-03 11:28:39.267796 | controller | 2025-12-03 11:28:39.267806 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** 2025-12-03 11:28:39.304119 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.034) 0:00:01.583 **** 2025-12-03 11:28:39.304152 | controller | 2025-12-03 11:28:39.362785 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 11:28:39.362818 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.036) 0:00:01.619 **** 2025-12-03 11:28:39.362837 | controller | ok: [instance] 2025-12-03 11:28:39.362856 | controller | 2025-12-03 11:28:39.362864 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 11:28:39.362988 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.058) 0:00:01.678 **** 2025-12-03 11:28:39.398852 | controller | ok: [instance] 2025-12-03 11:28:39.434050 | controller | 2025-12-03 11:28:39.434099 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 11:28:39.434108 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.035) 0:00:01.714 **** 2025-12-03 11:28:39.434128 | controller | ok: [instance] 2025-12-03 11:28:39.460540 | controller | 2025-12-03 11:28:39.460578 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 11:28:39.460587 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.035) 0:00:01.749 **** 2025-12-03 11:28:39.460598 | controller | skipping: [instance] 2025-12-03 11:28:39.460620 | controller | 2025-12-03 11:28:39.460635 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 11:28:39.460652 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.026) 0:00:01.776 **** 2025-12-03 11:28:39.495506 | controller | ok: [instance] => changed=false 2025-12-03 11:28:39.495732 | controller | msg: All assertions passed 2025-12-03 11:28:39.496017 | controller | 2025-12-03 11:28:39.496052 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** 2025-12-03 11:28:39.535289 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.035) 0:00:01.811 **** 2025-12-03 11:28:39.535342 | controller | 2025-12-03 11:28:39.535366 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 11:28:39.535492 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.039) 0:00:01.851 **** 2025-12-03 11:28:39.570658 | controller | ok: [instance] 2025-12-03 11:28:39.599655 | controller | 2025-12-03 11:28:39.599687 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 11:28:39.599695 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.035) 0:00:01.886 **** 2025-12-03 11:28:39.599705 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:39.599731 | controller | assertion: _matched_url | default('') | length > 0 2025-12-03 11:28:39.599740 | controller | evaluated_to: false 2025-12-03 11:28:39.599878 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-03 11:28:39.630546 | controller | 2025-12-03 11:28:39.630665 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-03 11:28:39.630680 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.041) 0:00:01.927 **** 2025-12-03 11:28:39.630794 | controller | 2025-12-03 11:28:39.630810 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-03 11:28:39.630833 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.018) 0:00:01.946 **** 2025-12-03 11:28:39.663613 | controller | skipping: [instance] 2025-12-03 11:28:39.695419 | controller | 2025-12-03 11:28:39.695445 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-03 11:28:39.695453 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.032) 0:00:01.979 **** 2025-12-03 11:28:39.695462 | controller | skipping: [instance] 2025-12-03 11:28:39.730993 | controller | 2025-12-03 11:28:39.731022 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** 2025-12-03 11:28:39.731037 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.032) 0:00:02.011 **** 2025-12-03 11:28:39.731047 | controller | 2025-12-03 11:28:39.766025 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 11:28:39.766050 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.035) 0:00:02.046 **** 2025-12-03 11:28:39.766071 | controller | ok: [instance] 2025-12-03 11:28:39.794086 | controller | 2025-12-03 11:28:39.794107 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 11:28:39.794115 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.035) 0:00:02.081 **** 2025-12-03 11:28:39.794124 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:39.821375 | controller | assertion: _matched_url | default('') | length > 0 2025-12-03 11:28:39.821409 | controller | evaluated_to: false 2025-12-03 11:28:39.821417 | controller | msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-03 11:28:39.821429 | controller | 2025-12-03 11:28:39.821448 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-03 11:28:39.821507 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.038) 0:00:02.119 **** 2025-12-03 11:28:39.821679 | controller | 2025-12-03 11:28:39.821787 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-03 11:28:39.821913 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.016) 0:00:02.136 **** 2025-12-03 11:28:39.854849 | controller | skipping: [instance] 2025-12-03 11:28:39.854943 | controller | 2025-12-03 11:28:39.855039 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-03 11:28:39.855155 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.033) 0:00:02.170 **** 2025-12-03 11:28:39.887822 | controller | skipping: [instance] 2025-12-03 11:28:39.887904 | controller | 2025-12-03 11:28:39.888018 | controller | TASK [Print success message] *************************************************** 2025-12-03 11:28:39.888135 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.032) 0:00:02.203 **** 2025-12-03 11:28:39.936016 | controller | ok: [instance] => 2025-12-03 11:28:39.936130 | controller | msg: All strings passed! 2025-12-03 11:28:39.936228 | controller | 2025-12-03 11:28:39.936344 | controller | PLAY RECAP ********************************************************************* 2025-12-03 11:28:39.936456 | controller | instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 2025-12-03 11:28:39.936572 | controller | 2025-12-03 11:28:39.936673 | controller | Wednesday 03 December 2025 11:28:39 +0000 (0:00:00.048) 0:00:02.251 **** 2025-12-03 11:28:39.936766 | controller | =============================================================================== 2025-12-03 11:28:39.936870 | controller | Call task file in loop -------------------------------------------------- 0.08s 2025-12-03 11:28:39.936952 | controller | reproducer : Apply regex match filter ----------------------------------- 0.06s 2025-12-03 11:28:39.937053 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.05s 2025-12-03 11:28:39.937163 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.05s 2025-12-03 11:28:39.937257 | controller | Print success message --------------------------------------------------- 0.05s 2025-12-03 11:28:39.937348 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2025-12-03 11:28:39.937444 | controller | Really fail if string passed but should have failed --------------------- 0.04s 2025-12-03 11:28:39.937562 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything///// --- 0.04s 2025-12-03 11:28:39.937660 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 11:28:39.937763 | controller | Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7 --- 0.04s 2025-12-03 11:28:39.937858 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 11:28:39.937953 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 --- 0.04s 2025-12-03 11:28:39.938047 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 11:28:39.938153 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 11:28:39.938249 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 11:28:39.938339 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 11:28:39.938441 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7 --- 0.04s 2025-12-03 11:28:39.938605 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 11:28:39.938640 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 11:28:39.938735 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 11:28:40.003057 | controller | INFO Running job_uri > cleanup 2025-12-03 11:28:40.003443 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-03 11:28:40.010983 | controller | INFO Running network_validations > prepare 2025-12-03 11:28:40.011393 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-03 11:28:40.018971 | controller | INFO Running network_validations > converge 2025-12-03 11:28:40.468037 | controller | 2025-12-03 11:28:40.468109 | controller | PLAY [Prepare] ***************************************************************** 2025-12-03 11:28:40.468226 | controller | 2025-12-03 11:28:40.468328 | controller | TASK [Set failed fact] ********************************************************* 2025-12-03 11:28:40.468429 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.033) 0:00:00.033 **** 2025-12-03 11:28:40.488781 | controller | ok: [instance] 2025-12-03 11:28:40.488994 | controller | 2025-12-03 11:28:40.489146 | controller | TASK [Load scenarios] ********************************************************** 2025-12-03 11:28:40.489162 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.021) 0:00:00.054 **** 2025-12-03 11:28:40.511749 | controller | ok: [instance] 2025-12-03 11:28:40.511851 | controller | 2025-12-03 11:28:40.511976 | controller | TASK [Test network validations] ************************************************ 2025-12-03 11:28:40.512120 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.022) 0:00:00.077 **** 2025-12-03 11:28:40.577297 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) 2025-12-03 11:28:40.577398 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) 2025-12-03 11:28:40.577514 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) 2025-12-03 11:28:40.577652 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) 2025-12-03 11:28:40.577776 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) 2025-12-03 11:28:40.577876 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) 2025-12-03 11:28:40.577957 | controller | 2025-12-03 11:28:40.578053 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:40.578166 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.065) 0:00:00.142 **** 2025-12-03 11:28:40.603953 | controller | ok: [instance] 2025-12-03 11:28:40.604040 | controller | 2025-12-03 11:28:40.604161 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:40.604264 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.026) 0:00:00.169 **** 2025-12-03 11:28:40.632098 | controller | ok: [instance] 2025-12-03 11:28:40.632200 | controller | 2025-12-03 11:28:40.632321 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:40.632419 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.028) 0:00:00.197 **** 2025-12-03 11:28:40.656042 | controller | ok: [instance] => 2025-12-03 11:28:40.656175 | controller | msg: 'Running: Default nets only' 2025-12-03 11:28:40.656275 | controller | 2025-12-03 11:28:40.656378 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:40.656479 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.024) 0:00:00.221 **** 2025-12-03 11:28:40.697627 | controller | 2025-12-03 11:28:40.697742 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 11:28:40.697880 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.041) 0:00:00.263 **** 2025-12-03 11:28:40.725271 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 11:28:40.725311 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 11:28:40.725321 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 11:28:40.725627 | controller | collisions and unexpected behavior. 2025-12-03 11:28:40.778722 | controller | ok: [instance] => (item=controller) 2025-12-03 11:28:40.778774 | controller | 2025-12-03 11:28:40.778880 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 11:28:40.778990 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.081) 0:00:00.344 **** 2025-12-03 11:28:40.831453 | controller | ok: [instance] 2025-12-03 11:28:40.831563 | controller | 2025-12-03 11:28:40.831724 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-03 11:28:40.831864 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.052) 0:00:00.397 **** 2025-12-03 11:28:40.894779 | controller | ok: [instance] => changed=false 2025-12-03 11:28:40.894888 | controller | msg: All assertions passed 2025-12-03 11:28:40.895006 | controller | 2025-12-03 11:28:40.895125 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:40.895227 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.063) 0:00:00.460 **** 2025-12-03 11:28:40.930812 | controller | skipping: [instance] 2025-12-03 11:28:40.930927 | controller | 2025-12-03 11:28:40.931058 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:40.931185 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.036) 0:00:00.496 **** 2025-12-03 11:28:40.962263 | controller | skipping: [instance] 2025-12-03 11:28:40.962367 | controller | 2025-12-03 11:28:40.962516 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:40.962675 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.031) 0:00:00.528 **** 2025-12-03 11:28:40.995574 | controller | skipping: [instance] 2025-12-03 11:28:40.995678 | controller | 2025-12-03 11:28:40.995795 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:40.995901 | controller | Wednesday 03 December 2025 11:28:40 +0000 (0:00:00.033) 0:00:00.561 **** 2025-12-03 11:28:41.017393 | controller | ok: [instance] 2025-12-03 11:28:41.017511 | controller | 2025-12-03 11:28:41.017670 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:41.017794 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.021) 0:00:00.583 **** 2025-12-03 11:28:41.044900 | controller | ok: [instance] 2025-12-03 11:28:41.045136 | controller | 2025-12-03 11:28:41.045504 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:41.045871 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.026) 0:00:00.609 **** 2025-12-03 11:28:41.070093 | controller | ok: [instance] => 2025-12-03 11:28:41.070197 | controller | msg: 'Running: Default nets and spine/leaf' 2025-12-03 11:28:41.070291 | controller | 2025-12-03 11:28:41.070422 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:41.070517 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.025) 0:00:00.635 **** 2025-12-03 11:28:41.114761 | controller | 2025-12-03 11:28:41.114880 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 11:28:41.115004 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.044) 0:00:00.680 **** 2025-12-03 11:28:41.138742 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 11:28:41.138846 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 11:28:41.139096 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 11:28:41.139222 | controller | collisions and unexpected behavior. 2025-12-03 11:28:41.159689 | controller | ok: [instance] => (item=controller) 2025-12-03 11:28:41.159782 | controller | 2025-12-03 11:28:41.159907 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 11:28:41.160014 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.045) 0:00:00.725 **** 2025-12-03 11:28:41.215169 | controller | ok: [instance] 2025-12-03 11:28:41.215257 | controller | 2025-12-03 11:28:41.215398 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-03 11:28:41.215515 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.055) 0:00:00.780 **** 2025-12-03 11:28:41.277358 | controller | ok: [instance] => changed=false 2025-12-03 11:28:41.277439 | controller | msg: All assertions passed 2025-12-03 11:28:41.277563 | controller | 2025-12-03 11:28:41.277663 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:41.277763 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.061) 0:00:00.842 **** 2025-12-03 11:28:41.320554 | controller | skipping: [instance] 2025-12-03 11:28:41.320604 | controller | 2025-12-03 11:28:41.320719 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:41.320820 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.043) 0:00:00.886 **** 2025-12-03 11:28:41.352889 | controller | skipping: [instance] 2025-12-03 11:28:41.352957 | controller | 2025-12-03 11:28:41.353072 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:41.353185 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.032) 0:00:00.918 **** 2025-12-03 11:28:41.385015 | controller | skipping: [instance] 2025-12-03 11:28:41.385123 | controller | 2025-12-03 11:28:41.385266 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:41.385368 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.032) 0:00:00.950 **** 2025-12-03 11:28:41.406125 | controller | ok: [instance] 2025-12-03 11:28:41.406200 | controller | 2025-12-03 11:28:41.406319 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:41.406456 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.021) 0:00:00.971 **** 2025-12-03 11:28:41.431515 | controller | ok: [instance] 2025-12-03 11:28:41.431628 | controller | 2025-12-03 11:28:41.431749 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:41.431868 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.025) 0:00:00.997 **** 2025-12-03 11:28:41.457019 | controller | ok: [instance] => 2025-12-03 11:28:41.457149 | controller | msg: 'Running: Default nets with extra defined net' 2025-12-03 11:28:41.457262 | controller | 2025-12-03 11:28:41.457365 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:41.457478 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.025) 0:00:01.022 **** 2025-12-03 11:28:41.495172 | controller | 2025-12-03 11:28:41.495312 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 11:28:41.495452 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.038) 0:00:01.061 **** 2025-12-03 11:28:41.519315 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 11:28:41.519577 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 11:28:41.519602 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 11:28:41.519614 | controller | collisions and unexpected behavior. 2025-12-03 11:28:41.559261 | controller | ok: [instance] => (item=controller) 2025-12-03 11:28:41.559327 | controller | 2025-12-03 11:28:41.559608 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 11:28:41.612951 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.064) 0:00:01.125 **** 2025-12-03 11:28:41.612989 | controller | ok: [instance] 2025-12-03 11:28:41.613019 | controller | 2025-12-03 11:28:41.613153 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-03 11:28:41.613249 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.053) 0:00:01.178 **** 2025-12-03 11:28:41.656611 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:41.656679 | controller | assertion: _defined | difference(_all_nets) | length == 0 2025-12-03 11:28:41.656788 | controller | evaluated_to: false 2025-12-03 11:28:41.656904 | controller | msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' 2025-12-03 11:28:41.667933 | controller | 2025-12-03 11:28:41.668024 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-03 11:28:41.668150 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.054) 0:00:01.233 **** 2025-12-03 11:28:41.698340 | controller | ok: [instance] => 2025-12-03 11:28:41.698520 | controller | cifmw_libvirt_manager_configuration: 2025-12-03 11:28:41.698664 | controller | networks: 2025-12-03 11:28:41.698681 | controller | public: defined 2025-12-03 11:28:41.698761 | controller | vms: 2025-12-03 11:28:41.698848 | controller | controller: 2025-12-03 11:28:41.698943 | controller | nets: 2025-12-03 11:28:41.699028 | controller | - public 2025-12-03 11:28:41.699152 | controller | 2025-12-03 11:28:41.699365 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-03 11:28:41.725339 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.030) 0:00:01.264 **** 2025-12-03 11:28:41.725366 | controller | skipping: [instance] 2025-12-03 11:28:41.725466 | controller | 2025-12-03 11:28:41.725541 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-03 11:28:41.725651 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.027) 0:00:01.291 **** 2025-12-03 11:28:41.794740 | controller | skipping: [instance] 2025-12-03 11:28:41.794812 | controller | 2025-12-03 11:28:41.794929 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-03 11:28:41.795043 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.069) 0:00:01.360 **** 2025-12-03 11:28:41.832421 | controller | ok: [instance] => 2025-12-03 11:28:41.832579 | controller | _cifmw_libvirt_manager_layout: 2025-12-03 11:28:41.832714 | controller | networks: 2025-12-03 11:28:41.832829 | controller | extra_net_1: defined 2025-12-03 11:28:41.832932 | controller | public: defined 2025-12-03 11:28:41.833083 | controller | vms: 2025-12-03 11:28:41.833162 | controller | controller: 2025-12-03 11:28:41.833262 | controller | nets: 2025-12-03 11:28:41.833352 | controller | - public 2025-12-03 11:28:41.833454 | controller | 2025-12-03 11:28:41.833558 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-03 11:28:41.833683 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.037) 0:00:01.397 **** 2025-12-03 11:28:41.845033 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:41.845156 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-03 11:28:41.872101 | controller | 2025-12-03 11:28:41.872193 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:41.872309 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.023) 0:00:01.421 **** 2025-12-03 11:28:41.872420 | controller | 2025-12-03 11:28:41.872555 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:41.872642 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.016) 0:00:01.437 **** 2025-12-03 11:28:41.893044 | controller | ok: [instance] 2025-12-03 11:28:41.893151 | controller | 2025-12-03 11:28:41.893324 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:41.893386 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.020) 0:00:01.458 **** 2025-12-03 11:28:41.928760 | controller | skipping: [instance] 2025-12-03 11:28:41.928832 | controller | 2025-12-03 11:28:41.928956 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:41.929053 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.035) 0:00:01.494 **** 2025-12-03 11:28:41.961696 | controller | skipping: [instance] 2025-12-03 11:28:41.961746 | controller | 2025-12-03 11:28:41.961874 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:41.961977 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.032) 0:00:01.527 **** 2025-12-03 11:28:41.998301 | controller | skipping: [instance] 2025-12-03 11:28:41.998410 | controller | 2025-12-03 11:28:41.998553 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:41.998678 | controller | Wednesday 03 December 2025 11:28:41 +0000 (0:00:00.036) 0:00:01.563 **** 2025-12-03 11:28:42.020974 | controller | ok: [instance] 2025-12-03 11:28:42.021061 | controller | 2025-12-03 11:28:42.021189 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:42.021292 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.022) 0:00:01.586 **** 2025-12-03 11:28:42.045828 | controller | ok: [instance] 2025-12-03 11:28:42.045929 | controller | 2025-12-03 11:28:42.046036 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:42.046161 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.024) 0:00:01.611 **** 2025-12-03 11:28:42.070823 | controller | ok: [instance] => 2025-12-03 11:28:42.070914 | controller | msg: 'Running: Missing default net definition' 2025-12-03 11:28:42.071011 | controller | 2025-12-03 11:28:42.071134 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:42.071240 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.024) 0:00:01.636 **** 2025-12-03 11:28:42.109247 | controller | 2025-12-03 11:28:42.109452 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 11:28:42.134337 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.038) 0:00:01.675 **** 2025-12-03 11:28:42.134370 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 11:28:42.134441 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 11:28:42.134542 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 11:28:42.134657 | controller | collisions and unexpected behavior. 2025-12-03 11:28:42.155351 | controller | ok: [instance] => (item=controller) 2025-12-03 11:28:42.155391 | controller | 2025-12-03 11:28:42.155542 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 11:28:42.155787 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.046) 0:00:01.721 **** 2025-12-03 11:28:42.199161 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:42.199314 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-12-03 11:28:42.199451 | controller | evaluated_to: false 2025-12-03 11:28:42.199617 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' 2025-12-03 11:28:42.210896 | controller | 2025-12-03 11:28:42.211002 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-03 11:28:42.211110 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.055) 0:00:01.776 **** 2025-12-03 11:28:42.242334 | controller | ok: [instance] => 2025-12-03 11:28:42.242452 | controller | cifmw_libvirt_manager_configuration: 2025-12-03 11:28:42.242604 | controller | networks: 2025-12-03 11:28:42.242711 | controller | public: defined 2025-12-03 11:28:42.242798 | controller | vms: 2025-12-03 11:28:42.242891 | controller | controller: 2025-12-03 11:28:42.242980 | controller | nets: 2025-12-03 11:28:42.243086 | controller | - public 2025-12-03 11:28:42.243181 | controller | 2025-12-03 11:28:42.243280 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-03 11:28:42.243376 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.031) 0:00:01.808 **** 2025-12-03 11:28:42.268451 | controller | skipping: [instance] 2025-12-03 11:28:42.268544 | controller | 2025-12-03 11:28:42.268660 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-03 11:28:42.268771 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.026) 0:00:01.834 **** 2025-12-03 11:28:42.360980 | controller | skipping: [instance] 2025-12-03 11:28:42.361082 | controller | 2025-12-03 11:28:42.361179 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-03 11:28:42.361765 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.092) 0:00:01.926 **** 2025-12-03 11:28:42.399251 | controller | ok: [instance] => 2025-12-03 11:28:42.399350 | controller | _cifmw_libvirt_manager_layout: 2025-12-03 11:28:42.399549 | controller | networks: 2025-12-03 11:28:42.399675 | controller | public: defined 2025-12-03 11:28:42.399777 | controller | vms: 2025-12-03 11:28:42.399955 | controller | controller: 2025-12-03 11:28:42.399973 | controller | nets: 2025-12-03 11:28:42.400079 | controller | - public 2025-12-03 11:28:42.400177 | controller | - foo 2025-12-03 11:28:42.400299 | controller | 2025-12-03 11:28:42.400507 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-03 11:28:42.400648 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.038) 0:00:01.965 **** 2025-12-03 11:28:42.415818 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:42.415920 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-03 11:28:42.466901 | controller | 2025-12-03 11:28:42.467003 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:42.467132 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.050) 0:00:02.015 **** 2025-12-03 11:28:42.467231 | controller | 2025-12-03 11:28:42.467576 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:42.490541 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.017) 0:00:02.032 **** 2025-12-03 11:28:42.490569 | controller | ok: [instance] 2025-12-03 11:28:42.490772 | controller | 2025-12-03 11:28:42.490848 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:42.490858 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.023) 0:00:02.056 **** 2025-12-03 11:28:42.526561 | controller | skipping: [instance] 2025-12-03 11:28:42.526650 | controller | 2025-12-03 11:28:42.526760 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:42.526861 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.035) 0:00:02.092 **** 2025-12-03 11:28:42.560464 | controller | skipping: [instance] 2025-12-03 11:28:42.560611 | controller | 2025-12-03 11:28:42.560728 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:42.560838 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.033) 0:00:02.126 **** 2025-12-03 11:28:42.592481 | controller | skipping: [instance] 2025-12-03 11:28:42.592588 | controller | 2025-12-03 11:28:42.592697 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:42.592802 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.032) 0:00:02.158 **** 2025-12-03 11:28:42.616134 | controller | ok: [instance] 2025-12-03 11:28:42.616226 | controller | 2025-12-03 11:28:42.616330 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:42.616447 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.023) 0:00:02.182 **** 2025-12-03 11:28:42.642858 | controller | ok: [instance] 2025-12-03 11:28:42.642951 | controller | 2025-12-03 11:28:42.643072 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:42.643185 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.026) 0:00:02.208 **** 2025-12-03 11:28:42.666855 | controller | ok: [instance] => 2025-12-03 11:28:42.666974 | controller | msg: 'Running: Missing spine/leaf net definition' 2025-12-03 11:28:42.667086 | controller | 2025-12-03 11:28:42.667187 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:42.667296 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.024) 0:00:02.232 **** 2025-12-03 11:28:42.706879 | controller | 2025-12-03 11:28:42.707025 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 11:28:42.707161 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.039) 0:00:02.272 **** 2025-12-03 11:28:42.733495 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 11:28:42.733553 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 11:28:42.733691 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 11:28:42.733792 | controller | collisions and unexpected behavior. 2025-12-03 11:28:42.755875 | controller | ok: [instance] => (item=controller) 2025-12-03 11:28:42.755984 | controller | 2025-12-03 11:28:42.756096 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 11:28:42.756207 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.049) 0:00:02.321 **** 2025-12-03 11:28:42.800665 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:42.800764 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-12-03 11:28:42.800879 | controller | evaluated_to: false 2025-12-03 11:28:42.800993 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' 2025-12-03 11:28:42.812673 | controller | 2025-12-03 11:28:42.812780 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-03 11:28:42.812884 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.056) 0:00:02.378 **** 2025-12-03 11:28:42.844616 | controller | ok: [instance] => 2025-12-03 11:28:42.844722 | controller | cifmw_libvirt_manager_configuration: 2025-12-03 11:28:42.844828 | controller | networks: 2025-12-03 11:28:42.844931 | controller | l00-s0: defined 2025-12-03 11:28:42.845019 | controller | public: defined 2025-12-03 11:28:42.845143 | controller | vms: 2025-12-03 11:28:42.845230 | controller | controller: 2025-12-03 11:28:42.845328 | controller | nets: 2025-12-03 11:28:42.845434 | controller | - public 2025-12-03 11:28:42.845521 | controller | spineleafnets: 2025-12-03 11:28:42.845638 | controller | - l00-s0 2025-12-03 11:28:42.845735 | controller | 2025-12-03 11:28:42.845834 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-03 11:28:42.845932 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.031) 0:00:02.410 **** 2025-12-03 11:28:42.873891 | controller | skipping: [instance] 2025-12-03 11:28:42.873968 | controller | 2025-12-03 11:28:42.874136 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-03 11:28:42.874190 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.028) 0:00:02.439 **** 2025-12-03 11:28:42.945692 | controller | skipping: [instance] 2025-12-03 11:28:42.945769 | controller | 2025-12-03 11:28:42.945871 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-03 11:28:42.945975 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.071) 0:00:02.511 **** 2025-12-03 11:28:42.983463 | controller | ok: [instance] => 2025-12-03 11:28:42.983592 | controller | _cifmw_libvirt_manager_layout: 2025-12-03 11:28:42.983701 | controller | networks: 2025-12-03 11:28:42.983808 | controller | l00-s0: defined 2025-12-03 11:28:42.983910 | controller | public: defined 2025-12-03 11:28:42.983990 | controller | vms: 2025-12-03 11:28:42.984112 | controller | controller: 2025-12-03 11:28:42.984204 | controller | nets: 2025-12-03 11:28:42.984305 | controller | - public 2025-12-03 11:28:42.984390 | controller | spineleafnets: 2025-12-03 11:28:42.984498 | controller | - l00-s0 2025-12-03 11:28:42.984614 | controller | - l00-s1 2025-12-03 11:28:42.984701 | controller | 2025-12-03 11:28:42.984801 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-03 11:28:42.984890 | controller | Wednesday 03 December 2025 11:28:42 +0000 (0:00:00.038) 0:00:02.549 **** 2025-12-03 11:28:42.995011 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:42.995147 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-03 11:28:43.023117 | controller | 2025-12-03 11:28:43.023221 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:43.023332 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.023) 0:00:02.572 **** 2025-12-03 11:28:43.023452 | controller | 2025-12-03 11:28:43.023549 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:43.023648 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.016) 0:00:02.588 **** 2025-12-03 11:28:43.045308 | controller | ok: [instance] 2025-12-03 11:28:43.045417 | controller | 2025-12-03 11:28:43.045551 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:43.045650 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.022) 0:00:02.611 **** 2025-12-03 11:28:43.081451 | controller | skipping: [instance] 2025-12-03 11:28:43.081568 | controller | 2025-12-03 11:28:43.081683 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:43.081783 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.036) 0:00:02.647 **** 2025-12-03 11:28:43.112985 | controller | skipping: [instance] 2025-12-03 11:28:43.113077 | controller | 2025-12-03 11:28:43.113187 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:43.113282 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.031) 0:00:02.678 **** 2025-12-03 11:28:43.144177 | controller | skipping: [instance] 2025-12-03 11:28:43.144257 | controller | 2025-12-03 11:28:43.144368 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:43.144496 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.031) 0:00:02.709 **** 2025-12-03 11:28:43.191364 | controller | ok: [instance] 2025-12-03 11:28:43.191457 | controller | 2025-12-03 11:28:43.191570 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:43.191672 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.047) 0:00:02.757 **** 2025-12-03 11:28:43.215750 | controller | ok: [instance] 2025-12-03 11:28:43.215836 | controller | 2025-12-03 11:28:43.215964 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:43.216057 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.024) 0:00:02.781 **** 2025-12-03 11:28:43.247636 | controller | ok: [instance] => 2025-12-03 11:28:43.247793 | controller | msg: 'Running: No network for a VM' 2025-12-03 11:28:43.247923 | controller | 2025-12-03 11:28:43.248047 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:43.248189 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.031) 0:00:02.813 **** 2025-12-03 11:28:43.286963 | controller | 2025-12-03 11:28:43.287107 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 11:28:43.287211 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.039) 0:00:02.852 **** 2025-12-03 11:28:43.311362 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 11:28:43.311461 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 11:28:43.312051 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 11:28:43.325103 | controller | collisions and unexpected behavior. 2025-12-03 11:28:43.325124 | controller | failed: [instance] (item=foo) => changed=false 2025-12-03 11:28:43.325198 | controller | ansible_loop_var: item 2025-12-03 11:28:43.325299 | controller | assertion: item.value.nets is defined 2025-12-03 11:28:43.325400 | controller | evaluated_to: false 2025-12-03 11:28:43.325499 | controller | item: 2025-12-03 11:28:43.325613 | controller | key: foo 2025-12-03 11:28:43.325706 | controller | value: 2025-12-03 11:28:43.325802 | controller | disksize: 10 2025-12-03 11:28:43.325903 | controller | msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' 2025-12-03 11:28:43.336673 | controller | ok: [instance] => (item=controller) 2025-12-03 11:28:43.336762 | controller | 2025-12-03 11:28:43.336864 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-03 11:28:43.336963 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.049) 0:00:02.902 **** 2025-12-03 11:28:43.368514 | controller | ok: [instance] => 2025-12-03 11:28:43.368656 | controller | cifmw_libvirt_manager_configuration: 2025-12-03 11:28:43.368760 | controller | networks: 2025-12-03 11:28:43.368861 | controller | public: defined 2025-12-03 11:28:43.368950 | controller | vms: 2025-12-03 11:28:43.369046 | controller | controller: 2025-12-03 11:28:43.369162 | controller | nets: 2025-12-03 11:28:43.369253 | controller | - public 2025-12-03 11:28:43.369351 | controller | 2025-12-03 11:28:43.369562 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-03 11:28:43.369660 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.030) 0:00:02.932 **** 2025-12-03 11:28:43.397255 | controller | skipping: [instance] 2025-12-03 11:28:43.397351 | controller | 2025-12-03 11:28:43.397484 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-03 11:28:43.397607 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.030) 0:00:02.962 **** 2025-12-03 11:28:43.466827 | controller | skipping: [instance] 2025-12-03 11:28:43.466912 | controller | 2025-12-03 11:28:43.467032 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-03 11:28:43.467147 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.069) 0:00:03.032 **** 2025-12-03 11:28:43.506941 | controller | ok: [instance] => 2025-12-03 11:28:43.507033 | controller | _cifmw_libvirt_manager_layout: 2025-12-03 11:28:43.507170 | controller | networks: 2025-12-03 11:28:43.507279 | controller | public: defined 2025-12-03 11:28:43.507385 | controller | vms: 2025-12-03 11:28:43.507468 | controller | controller: 2025-12-03 11:28:43.507579 | controller | nets: 2025-12-03 11:28:43.507682 | controller | - public 2025-12-03 11:28:43.507784 | controller | foo: 2025-12-03 11:28:43.507870 | controller | disksize: 10 2025-12-03 11:28:43.507965 | controller | 2025-12-03 11:28:43.508075 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-03 11:28:43.508186 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.040) 0:00:03.072 **** 2025-12-03 11:28:43.520837 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:43.520932 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-03 11:28:43.548575 | controller | 2025-12-03 11:28:43.548706 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:43.548821 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.024) 0:00:03.097 **** 2025-12-03 11:28:43.548903 | controller | 2025-12-03 11:28:43.549008 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:43.549123 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.016) 0:00:03.114 **** 2025-12-03 11:28:43.573206 | controller | ok: [instance] 2025-12-03 11:28:43.573305 | controller | 2025-12-03 11:28:43.573439 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:43.573567 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.024) 0:00:03.138 **** 2025-12-03 11:28:43.613519 | controller | skipping: [instance] 2025-12-03 11:28:43.613628 | controller | 2025-12-03 11:28:43.613735 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:43.613837 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.040) 0:00:03.179 **** 2025-12-03 11:28:43.645864 | controller | skipping: [instance] 2025-12-03 11:28:43.645942 | controller | 2025-12-03 11:28:43.646116 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:43.646222 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.032) 0:00:03.211 **** 2025-12-03 11:28:43.678908 | controller | skipping: [instance] 2025-12-03 11:28:43.678958 | controller | 2025-12-03 11:28:43.679119 | controller | TASK [Fail if needed] ********************************************************** 2025-12-03 11:28:43.679213 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.032) 0:00:03.244 **** 2025-12-03 11:28:43.735546 | controller | skipping: [instance] 2025-12-03 11:28:43.735605 | controller | 2025-12-03 11:28:43.735709 | controller | PLAY RECAP ********************************************************************* 2025-12-03 11:28:43.735799 | controller | instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 2025-12-03 11:28:43.735890 | controller | 2025-12-03 11:28:43.735992 | controller | Wednesday 03 December 2025 11:28:43 +0000 (0:00:00.056) 0:00:03.301 **** 2025-12-03 11:28:43.736102 | controller | =============================================================================== 2025-12-03 11:28:43.736207 | controller | reproducer : Dump layout patches ---------------------------------------- 0.09s 2025-12-03 11:28:43.736302 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.08s 2025-12-03 11:28:43.736405 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-12-03 11:28:43.736494 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-12-03 11:28:43.736612 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-12-03 11:28:43.736697 | controller | Test network validations ------------------------------------------------ 0.07s 2025-12-03 11:28:43.736797 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.06s 2025-12-03 11:28:43.736899 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-12-03 11:28:43.736982 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-12-03 11:28:43.737096 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-12-03 11:28:43.737184 | controller | Fail if needed ---------------------------------------------------------- 0.06s 2025-12-03 11:28:43.737278 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-12-03 11:28:43.737366 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-12-03 11:28:43.737465 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-12-03 11:28:43.737574 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2025-12-03 11:28:43.737673 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2025-12-03 11:28:43.737763 | controller | reproducer : Fail for good ---------------------------------------------- 0.05s 2025-12-03 11:28:43.737862 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s 2025-12-03 11:28:43.737946 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s 2025-12-03 11:28:43.738029 | controller | Mark run as failed ------------------------------------------------------ 0.05s 2025-12-03 11:28:43.799765 | controller | INFO Running network_validations > cleanup 2025-12-03 11:28:43.800145 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-03 11:28:43.809639 | controller | INFO Running ocp_validations > prepare 2025-12-03 11:28:43.810038 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-03 11:28:43.817471 | controller | INFO Running ocp_validations > converge 2025-12-03 11:28:44.254841 | controller | 2025-12-03 11:28:44.254911 | controller | PLAY [Prepare] ***************************************************************** 2025-12-03 11:28:44.255022 | controller | 2025-12-03 11:28:44.255145 | controller | TASK [Set failed fact] ********************************************************* 2025-12-03 11:28:44.255257 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.033) 0:00:00.033 **** 2025-12-03 11:28:44.276945 | controller | ok: [instance] 2025-12-03 11:28:44.277029 | controller | 2025-12-03 11:28:44.277158 | controller | TASK [Load scenarios] ********************************************************** 2025-12-03 11:28:44.277268 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.022) 0:00:00.056 **** 2025-12-03 11:28:44.302358 | controller | ok: [instance] 2025-12-03 11:28:44.302464 | controller | 2025-12-03 11:28:44.302590 | controller | TASK [Test no volumes] ********************************************************* 2025-12-03 11:28:44.302695 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.025) 0:00:00.081 **** 2025-12-03 11:28:44.404407 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) 2025-12-03 11:28:44.404467 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) 2025-12-03 11:28:44.404606 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) 2025-12-03 11:28:44.404704 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) 2025-12-03 11:28:44.404812 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) 2025-12-03 11:28:44.404918 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) 2025-12-03 11:28:44.405014 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) 2025-12-03 11:28:44.405185 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) 2025-12-03 11:28:44.405247 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) 2025-12-03 11:28:44.405388 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) 2025-12-03 11:28:44.405470 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) 2025-12-03 11:28:44.405605 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) 2025-12-03 11:28:44.405706 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) 2025-12-03 11:28:44.405787 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) 2025-12-03 11:28:44.405867 | controller | 2025-12-03 11:28:44.405973 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:44.406080 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.101) 0:00:00.183 **** 2025-12-03 11:28:44.430725 | controller | ok: [instance] 2025-12-03 11:28:44.430805 | controller | 2025-12-03 11:28:44.430923 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:44.431027 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.026) 0:00:00.210 **** 2025-12-03 11:28:44.458657 | controller | ok: [instance] 2025-12-03 11:28:44.458748 | controller | 2025-12-03 11:28:44.458839 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:44.458954 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.027) 0:00:00.237 **** 2025-12-03 11:28:44.486160 | controller | ok: [instance] => 2025-12-03 11:28:44.486253 | controller | msg: 'Running: No volume, no worker' 2025-12-03 11:28:44.486365 | controller | 2025-12-03 11:28:44.486472 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:44.486590 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.027) 0:00:00.265 **** 2025-12-03 11:28:44.547424 | controller | 2025-12-03 11:28:44.547492 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:44.547648 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.061) 0:00:00.326 **** 2025-12-03 11:28:44.605865 | controller | ok: [instance] 2025-12-03 11:28:44.605913 | controller | 2025-12-03 11:28:44.606048 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:44.606150 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.058) 0:00:00.385 **** 2025-12-03 11:28:44.647452 | controller | ok: [instance] 2025-12-03 11:28:44.647556 | controller | 2025-12-03 11:28:44.647685 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:44.647810 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.041) 0:00:00.426 **** 2025-12-03 11:28:44.715846 | controller | ok: [instance] 2025-12-03 11:28:44.715912 | controller | 2025-12-03 11:28:44.716019 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:44.716141 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.068) 0:00:00.495 **** 2025-12-03 11:28:44.753776 | controller | skipping: [instance] 2025-12-03 11:28:44.753870 | controller | 2025-12-03 11:28:44.753984 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:44.754100 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.037) 0:00:00.533 **** 2025-12-03 11:28:44.802083 | controller | ok: [instance] 2025-12-03 11:28:44.802172 | controller | 2025-12-03 11:28:44.802281 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 11:28:44.802403 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.048) 0:00:00.581 **** 2025-12-03 11:28:44.842454 | controller | skipping: [instance] 2025-12-03 11:28:44.842590 | controller | 2025-12-03 11:28:44.842685 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 11:28:44.842785 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.040) 0:00:00.621 **** 2025-12-03 11:28:44.879894 | controller | skipping: [instance] 2025-12-03 11:28:44.879977 | controller | 2025-12-03 11:28:44.880091 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 11:28:44.880213 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.037) 0:00:00.659 **** 2025-12-03 11:28:44.919725 | controller | skipping: [instance] 2025-12-03 11:28:44.919809 | controller | 2025-12-03 11:28:44.919940 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 11:28:44.920121 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.039) 0:00:00.699 **** 2025-12-03 11:28:44.958735 | controller | skipping: [instance] 2025-12-03 11:28:44.958829 | controller | 2025-12-03 11:28:44.958947 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 11:28:44.959145 | controller | Wednesday 03 December 2025 11:28:44 +0000 (0:00:00.039) 0:00:00.738 **** 2025-12-03 11:28:45.001646 | controller | skipping: [instance] 2025-12-03 11:28:45.001736 | controller | 2025-12-03 11:28:45.001844 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 11:28:45.001955 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.042) 0:00:00.780 **** 2025-12-03 11:28:45.051175 | controller | skipping: [instance] 2025-12-03 11:28:45.051208 | controller | 2025-12-03 11:28:45.051308 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:45.051409 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.048) 0:00:00.829 **** 2025-12-03 11:28:45.086889 | controller | skipping: [instance] 2025-12-03 11:28:45.086976 | controller | 2025-12-03 11:28:45.087663 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:45.087759 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.036) 0:00:00.866 **** 2025-12-03 11:28:45.120623 | controller | skipping: [instance] 2025-12-03 11:28:45.120741 | controller | 2025-12-03 11:28:45.120868 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:45.121019 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.033) 0:00:00.899 **** 2025-12-03 11:28:45.153808 | controller | skipping: [instance] 2025-12-03 11:28:45.153907 | controller | 2025-12-03 11:28:45.154040 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:45.154313 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.033) 0:00:00.933 **** 2025-12-03 11:28:45.175647 | controller | ok: [instance] 2025-12-03 11:28:45.175731 | controller | 2025-12-03 11:28:45.175851 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:45.175961 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.021) 0:00:00.955 **** 2025-12-03 11:28:45.201264 | controller | ok: [instance] 2025-12-03 11:28:45.201367 | controller | 2025-12-03 11:28:45.201483 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:45.201600 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.025) 0:00:00.980 **** 2025-12-03 11:28:45.225562 | controller | ok: [instance] => 2025-12-03 11:28:45.225665 | controller | msg: 'Running: No volume, with worker' 2025-12-03 11:28:45.225763 | controller | 2025-12-03 11:28:45.225861 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:45.225952 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.024) 0:00:01.004 **** 2025-12-03 11:28:45.266662 | controller | 2025-12-03 11:28:45.266790 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:45.266895 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.040) 0:00:01.045 **** 2025-12-03 11:28:45.324847 | controller | ok: [instance] 2025-12-03 11:28:45.324920 | controller | 2025-12-03 11:28:45.325025 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:45.325147 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.058) 0:00:01.104 **** 2025-12-03 11:28:45.368729 | controller | ok: [instance] 2025-12-03 11:28:45.368835 | controller | 2025-12-03 11:28:45.368941 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:45.369088 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.043) 0:00:01.147 **** 2025-12-03 11:28:45.463911 | controller | ok: [instance] 2025-12-03 11:28:45.463965 | controller | 2025-12-03 11:28:45.464136 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:45.464246 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.095) 0:00:01.243 **** 2025-12-03 11:28:45.531818 | controller | ok: [instance] 2025-12-03 11:28:45.531888 | controller | 2025-12-03 11:28:45.532106 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:45.583342 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.067) 0:00:01.311 **** 2025-12-03 11:28:45.583388 | controller | ok: [instance] 2025-12-03 11:28:45.583414 | controller | 2025-12-03 11:28:45.583564 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 11:28:45.583668 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.051) 0:00:01.362 **** 2025-12-03 11:28:45.622463 | controller | skipping: [instance] 2025-12-03 11:28:45.622566 | controller | 2025-12-03 11:28:45.622681 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 11:28:45.622784 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.039) 0:00:01.401 **** 2025-12-03 11:28:45.663479 | controller | skipping: [instance] 2025-12-03 11:28:45.663520 | controller | 2025-12-03 11:28:45.663688 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 11:28:45.663809 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.040) 0:00:01.442 **** 2025-12-03 11:28:45.702704 | controller | skipping: [instance] 2025-12-03 11:28:45.702800 | controller | 2025-12-03 11:28:45.702906 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 11:28:45.703011 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.039) 0:00:01.481 **** 2025-12-03 11:28:45.745206 | controller | skipping: [instance] 2025-12-03 11:28:45.745294 | controller | 2025-12-03 11:28:45.745407 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 11:28:45.745503 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.042) 0:00:01.524 **** 2025-12-03 11:28:45.785914 | controller | skipping: [instance] 2025-12-03 11:28:45.786007 | controller | 2025-12-03 11:28:45.786124 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 11:28:45.786237 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.040) 0:00:01.565 **** 2025-12-03 11:28:45.834844 | controller | skipping: [instance] 2025-12-03 11:28:45.834959 | controller | 2025-12-03 11:28:45.835115 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:45.835246 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.048) 0:00:01.613 **** 2025-12-03 11:28:45.871672 | controller | skipping: [instance] 2025-12-03 11:28:45.871738 | controller | 2025-12-03 11:28:45.871839 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:45.871941 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.037) 0:00:01.650 **** 2025-12-03 11:28:45.903597 | controller | skipping: [instance] 2025-12-03 11:28:45.903694 | controller | 2025-12-03 11:28:45.903807 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:45.903911 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.031) 0:00:01.682 **** 2025-12-03 11:28:45.934420 | controller | skipping: [instance] 2025-12-03 11:28:45.934834 | controller | 2025-12-03 11:28:45.934957 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:45.935079 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.030) 0:00:01.713 **** 2025-12-03 11:28:45.956402 | controller | ok: [instance] 2025-12-03 11:28:45.956506 | controller | 2025-12-03 11:28:45.956664 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:45.956772 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.022) 0:00:01.735 **** 2025-12-03 11:28:45.981215 | controller | ok: [instance] 2025-12-03 11:28:45.981334 | controller | 2025-12-03 11:28:45.981476 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:45.981612 | controller | Wednesday 03 December 2025 11:28:45 +0000 (0:00:00.024) 0:00:01.760 **** 2025-12-03 11:28:46.005663 | controller | ok: [instance] => 2025-12-03 11:28:46.005767 | controller | msg: 'Running: Volume, no worker' 2025-12-03 11:28:46.005862 | controller | 2025-12-03 11:28:46.006693 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:46.006989 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.024) 0:00:01.784 **** 2025-12-03 11:28:46.047231 | controller | 2025-12-03 11:28:46.047347 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:46.047494 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.041) 0:00:01.826 **** 2025-12-03 11:28:46.106039 | controller | ok: [instance] 2025-12-03 11:28:46.106150 | controller | 2025-12-03 11:28:46.106264 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:46.106368 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.058) 0:00:01.885 **** 2025-12-03 11:28:46.145855 | controller | ok: [instance] 2025-12-03 11:28:46.145952 | controller | 2025-12-03 11:28:46.146073 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:46.146183 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.039) 0:00:01.924 **** 2025-12-03 11:28:46.215983 | controller | ok: [instance] 2025-12-03 11:28:46.216072 | controller | 2025-12-03 11:28:46.216189 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:46.216320 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.070) 0:00:01.995 **** 2025-12-03 11:28:46.253971 | controller | skipping: [instance] 2025-12-03 11:28:46.254166 | controller | 2025-12-03 11:28:46.254279 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:46.254439 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.038) 0:00:02.033 **** 2025-12-03 11:28:46.296423 | controller | skipping: [instance] 2025-12-03 11:28:46.296575 | controller | 2025-12-03 11:28:46.296724 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 11:28:46.296841 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.042) 0:00:02.075 **** 2025-12-03 11:28:46.340188 | controller | ok: [instance] 2025-12-03 11:28:46.340286 | controller | 2025-12-03 11:28:46.340407 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 11:28:46.340512 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.043) 0:00:02.119 **** 2025-12-03 11:28:46.433715 | controller | skipping: [instance] 2025-12-03 11:28:46.433768 | controller | 2025-12-03 11:28:46.433897 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 11:28:46.434003 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.093) 0:00:02.212 **** 2025-12-03 11:28:46.499625 | controller | ok: [instance] 2025-12-03 11:28:46.499693 | controller | 2025-12-03 11:28:46.499803 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 11:28:46.499921 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.065) 0:00:02.278 **** 2025-12-03 11:28:46.564499 | controller | ok: [instance] 2025-12-03 11:28:46.564605 | controller | 2025-12-03 11:28:46.564733 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 11:28:46.564836 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.065) 0:00:02.343 **** 2025-12-03 11:28:46.633153 | controller | ok: [instance] => changed=false 2025-12-03 11:28:46.633209 | controller | msg: All assertions passed 2025-12-03 11:28:46.633317 | controller | 2025-12-03 11:28:46.633422 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 11:28:46.633540 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.068) 0:00:02.412 **** 2025-12-03 11:28:46.713357 | controller | ok: [instance] => changed=false 2025-12-03 11:28:46.713446 | controller | msg: All assertions passed 2025-12-03 11:28:46.713557 | controller | 2025-12-03 11:28:46.713680 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:46.713774 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.080) 0:00:02.492 **** 2025-12-03 11:28:46.755085 | controller | skipping: [instance] 2025-12-03 11:28:46.755133 | controller | 2025-12-03 11:28:46.755257 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:46.755353 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.041) 0:00:02.534 **** 2025-12-03 11:28:46.788933 | controller | skipping: [instance] 2025-12-03 11:28:46.788986 | controller | 2025-12-03 11:28:46.789079 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:46.789173 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.033) 0:00:02.567 **** 2025-12-03 11:28:46.830054 | controller | skipping: [instance] 2025-12-03 11:28:46.830123 | controller | 2025-12-03 11:28:46.830206 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:46.830310 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.039) 0:00:02.607 **** 2025-12-03 11:28:46.858611 | controller | ok: [instance] 2025-12-03 11:28:46.858672 | controller | 2025-12-03 11:28:46.858760 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:46.858859 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.030) 0:00:02.637 **** 2025-12-03 11:28:46.892553 | controller | ok: [instance] 2025-12-03 11:28:46.892610 | controller | 2025-12-03 11:28:46.892711 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:46.892828 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.033) 0:00:02.671 **** 2025-12-03 11:28:46.920802 | controller | ok: [instance] => 2025-12-03 11:28:46.920869 | controller | msg: 'Running: Volume, with worker' 2025-12-03 11:28:46.920981 | controller | 2025-12-03 11:28:46.921100 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:46.921209 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.026) 0:00:02.698 **** 2025-12-03 11:28:46.966709 | controller | 2025-12-03 11:28:46.966767 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:46.966889 | controller | Wednesday 03 December 2025 11:28:46 +0000 (0:00:00.047) 0:00:02.745 **** 2025-12-03 11:28:47.031048 | controller | ok: [instance] 2025-12-03 11:28:47.031117 | controller | 2025-12-03 11:28:47.031128 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:47.031241 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.062) 0:00:02.808 **** 2025-12-03 11:28:47.073446 | controller | ok: [instance] 2025-12-03 11:28:47.073498 | controller | 2025-12-03 11:28:47.073652 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:47.073750 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.044) 0:00:02.852 **** 2025-12-03 11:28:47.144456 | controller | ok: [instance] 2025-12-03 11:28:47.144506 | controller | 2025-12-03 11:28:47.144631 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:47.144743 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.070) 0:00:02.923 **** 2025-12-03 11:28:47.221475 | controller | ok: [instance] 2025-12-03 11:28:47.221544 | controller | 2025-12-03 11:28:47.221662 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:47.221758 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.076) 0:00:03.000 **** 2025-12-03 11:28:47.263951 | controller | skipping: [instance] 2025-12-03 11:28:47.264010 | controller | 2025-12-03 11:28:47.264162 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 11:28:47.264257 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.042) 0:00:03.043 **** 2025-12-03 11:28:47.311256 | controller | ok: [instance] 2025-12-03 11:28:47.311306 | controller | 2025-12-03 11:28:47.311435 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 11:28:47.311540 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.047) 0:00:03.090 **** 2025-12-03 11:28:47.366413 | controller | ok: [instance] 2025-12-03 11:28:47.366477 | controller | 2025-12-03 11:28:47.366618 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 11:28:47.366719 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.055) 0:00:03.145 **** 2025-12-03 11:28:47.438632 | controller | ok: [instance] 2025-12-03 11:28:47.438694 | controller | 2025-12-03 11:28:47.438703 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 11:28:47.438712 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.070) 0:00:03.215 **** 2025-12-03 11:28:47.563647 | controller | ok: [instance] 2025-12-03 11:28:47.563702 | controller | 2025-12-03 11:28:47.563831 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 11:28:47.563930 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.126) 0:00:03.342 **** 2025-12-03 11:28:47.638449 | controller | ok: [instance] => changed=false 2025-12-03 11:28:47.638551 | controller | msg: All assertions passed 2025-12-03 11:28:47.638660 | controller | 2025-12-03 11:28:47.638765 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 11:28:47.638873 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.073) 0:00:03.416 **** 2025-12-03 11:28:47.719797 | controller | ok: [instance] => changed=false 2025-12-03 11:28:47.719858 | controller | msg: All assertions passed 2025-12-03 11:28:47.719966 | controller | 2025-12-03 11:28:47.720101 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:47.720187 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.082) 0:00:03.498 **** 2025-12-03 11:28:47.758465 | controller | skipping: [instance] 2025-12-03 11:28:47.758562 | controller | 2025-12-03 11:28:47.758677 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:47.758866 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.038) 0:00:03.537 **** 2025-12-03 11:28:47.792154 | controller | skipping: [instance] 2025-12-03 11:28:47.792248 | controller | 2025-12-03 11:28:47.792353 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:47.792483 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.033) 0:00:03.571 **** 2025-12-03 11:28:47.827274 | controller | skipping: [instance] 2025-12-03 11:28:47.827376 | controller | 2025-12-03 11:28:47.827490 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:47.827614 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.035) 0:00:03.606 **** 2025-12-03 11:28:47.849470 | controller | ok: [instance] 2025-12-03 11:28:47.849588 | controller | 2025-12-03 11:28:47.849697 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:47.849808 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.022) 0:00:03.628 **** 2025-12-03 11:28:47.876331 | controller | ok: [instance] 2025-12-03 11:28:47.876440 | controller | 2025-12-03 11:28:47.876571 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:47.876676 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.026) 0:00:03.655 **** 2025-12-03 11:28:47.904226 | controller | ok: [instance] => 2025-12-03 11:28:47.904336 | controller | msg: 'Running: Too many allocated volumes' 2025-12-03 11:28:47.904460 | controller | 2025-12-03 11:28:47.904580 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:47.904694 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.027) 0:00:03.683 **** 2025-12-03 11:28:47.945636 | controller | 2025-12-03 11:28:47.945750 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:47.945860 | controller | Wednesday 03 December 2025 11:28:47 +0000 (0:00:00.041) 0:00:03.724 **** 2025-12-03 11:28:48.003174 | controller | ok: [instance] 2025-12-03 11:28:48.003277 | controller | 2025-12-03 11:28:48.003404 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:48.003507 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.057) 0:00:03.782 **** 2025-12-03 11:28:48.045552 | controller | ok: [instance] 2025-12-03 11:28:48.045637 | controller | 2025-12-03 11:28:48.045747 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:48.045844 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.042) 0:00:03.824 **** 2025-12-03 11:28:48.115180 | controller | ok: [instance] 2025-12-03 11:28:48.115237 | controller | 2025-12-03 11:28:48.115344 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:48.115470 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.069) 0:00:03.894 **** 2025-12-03 11:28:48.156176 | controller | skipping: [instance] 2025-12-03 11:28:48.156231 | controller | 2025-12-03 11:28:48.156333 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:48.156451 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.041) 0:00:03.935 **** 2025-12-03 11:28:48.205756 | controller | skipping: [instance] 2025-12-03 11:28:48.205811 | controller | 2025-12-03 11:28:48.205926 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 11:28:48.206025 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.049) 0:00:03.984 **** 2025-12-03 11:28:48.252852 | controller | ok: [instance] 2025-12-03 11:28:48.252904 | controller | 2025-12-03 11:28:48.253023 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 11:28:48.253136 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.047) 0:00:04.031 **** 2025-12-03 11:28:48.297387 | controller | skipping: [instance] 2025-12-03 11:28:48.297470 | controller | 2025-12-03 11:28:48.297601 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 11:28:48.297710 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.044) 0:00:04.076 **** 2025-12-03 11:28:48.355335 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:48.355435 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-12-03 11:28:48.355560 | controller | evaluated_to: false 2025-12-03 11:28:48.355688 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' 2025-12-03 11:28:48.382434 | controller | 2025-12-03 11:28:48.382519 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:48.382650 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.068) 0:00:04.145 **** 2025-12-03 11:28:48.382742 | controller | 2025-12-03 11:28:48.382839 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:48.382975 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.016) 0:00:04.161 **** 2025-12-03 11:28:48.405264 | controller | ok: [instance] 2025-12-03 11:28:48.405354 | controller | 2025-12-03 11:28:48.405456 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:48.405596 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.022) 0:00:04.184 **** 2025-12-03 11:28:48.441236 | controller | skipping: [instance] 2025-12-03 11:28:48.441322 | controller | 2025-12-03 11:28:48.441446 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:48.441573 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.036) 0:00:04.220 **** 2025-12-03 11:28:48.529252 | controller | skipping: [instance] 2025-12-03 11:28:48.529310 | controller | 2025-12-03 11:28:48.529428 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:48.529557 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.087) 0:00:04.308 **** 2025-12-03 11:28:48.563882 | controller | skipping: [instance] 2025-12-03 11:28:48.563938 | controller | 2025-12-03 11:28:48.564043 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:48.564164 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.034) 0:00:04.343 **** 2025-12-03 11:28:48.587308 | controller | ok: [instance] 2025-12-03 11:28:48.587362 | controller | 2025-12-03 11:28:48.587494 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:48.587630 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.022) 0:00:04.366 **** 2025-12-03 11:28:48.613668 | controller | ok: [instance] 2025-12-03 11:28:48.613742 | controller | 2025-12-03 11:28:48.613862 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:48.613964 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.026) 0:00:04.392 **** 2025-12-03 11:28:48.640778 | controller | ok: [instance] => 2025-12-03 11:28:48.640872 | controller | msg: 'Running: Different volume amount' 2025-12-03 11:28:48.640975 | controller | 2025-12-03 11:28:48.641086 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:48.641201 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.027) 0:00:04.419 **** 2025-12-03 11:28:48.681901 | controller | 2025-12-03 11:28:48.681974 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:48.682112 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.041) 0:00:04.461 **** 2025-12-03 11:28:48.739981 | controller | ok: [instance] 2025-12-03 11:28:48.740037 | controller | 2025-12-03 11:28:48.740183 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:48.740286 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.057) 0:00:04.519 **** 2025-12-03 11:28:48.782329 | controller | ok: [instance] 2025-12-03 11:28:48.782398 | controller | 2025-12-03 11:28:48.782566 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:48.782646 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.042) 0:00:04.561 **** 2025-12-03 11:28:48.861928 | controller | ok: [instance] 2025-12-03 11:28:48.861987 | controller | 2025-12-03 11:28:48.862094 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:48.862216 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.077) 0:00:04.638 **** 2025-12-03 11:28:48.938861 | controller | ok: [instance] 2025-12-03 11:28:48.938915 | controller | 2025-12-03 11:28:48.939006 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:48.939115 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.079) 0:00:04.717 **** 2025-12-03 11:28:48.985874 | controller | skipping: [instance] 2025-12-03 11:28:48.985931 | controller | 2025-12-03 11:28:48.986037 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 11:28:48.986144 | controller | Wednesday 03 December 2025 11:28:48 +0000 (0:00:00.045) 0:00:04.763 **** 2025-12-03 11:28:49.034862 | controller | ok: [instance] 2025-12-03 11:28:49.034918 | controller | 2025-12-03 11:28:49.035017 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 11:28:49.035136 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.050) 0:00:04.813 **** 2025-12-03 11:28:49.081437 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:49.081513 | controller | assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 2025-12-03 11:28:49.081645 | controller | evaluated_to: false 2025-12-03 11:28:49.081753 | controller | msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' 2025-12-03 11:28:49.107811 | controller | 2025-12-03 11:28:49.107901 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:49.107996 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.056) 0:00:04.870 **** 2025-12-03 11:28:49.108099 | controller | 2025-12-03 11:28:49.108206 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:49.108314 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.016) 0:00:04.886 **** 2025-12-03 11:28:49.132174 | controller | ok: [instance] 2025-12-03 11:28:49.132272 | controller | 2025-12-03 11:28:49.132384 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:49.132496 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.023) 0:00:04.909 **** 2025-12-03 11:28:49.174021 | controller | skipping: [instance] 2025-12-03 11:28:49.174086 | controller | 2025-12-03 11:28:49.174178 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:49.174267 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.043) 0:00:04.953 **** 2025-12-03 11:28:49.212808 | controller | skipping: [instance] 2025-12-03 11:28:49.212866 | controller | 2025-12-03 11:28:49.212982 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:49.213095 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.038) 0:00:04.991 **** 2025-12-03 11:28:49.245397 | controller | skipping: [instance] 2025-12-03 11:28:49.245457 | controller | 2025-12-03 11:28:49.245586 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:49.245690 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.032) 0:00:05.024 **** 2025-12-03 11:28:49.270304 | controller | ok: [instance] 2025-12-03 11:28:49.270368 | controller | 2025-12-03 11:28:49.270479 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:49.270614 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.024) 0:00:05.049 **** 2025-12-03 11:28:49.299999 | controller | ok: [instance] 2025-12-03 11:28:49.300093 | controller | 2025-12-03 11:28:49.300206 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:49.300332 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.029) 0:00:05.079 **** 2025-12-03 11:28:49.333359 | controller | ok: [instance] => 2025-12-03 11:28:49.333474 | controller | msg: 'Running: Create LVM without volume' 2025-12-03 11:28:49.333584 | controller | 2025-12-03 11:28:49.333689 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:49.333792 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.033) 0:00:05.112 **** 2025-12-03 11:28:49.412657 | controller | 2025-12-03 11:28:49.412762 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:49.412864 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.079) 0:00:05.191 **** 2025-12-03 11:28:49.476585 | controller | ok: [instance] 2025-12-03 11:28:49.476665 | controller | 2025-12-03 11:28:49.476768 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:49.476879 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.063) 0:00:05.255 **** 2025-12-03 11:28:49.522929 | controller | ok: [instance] 2025-12-03 11:28:49.523030 | controller | 2025-12-03 11:28:49.523156 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:49.523264 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.046) 0:00:05.302 **** 2025-12-03 11:28:49.600981 | controller | ok: [instance] 2025-12-03 11:28:49.601043 | controller | 2025-12-03 11:28:49.601172 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:49.601262 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.077) 0:00:05.379 **** 2025-12-03 11:28:49.644268 | controller | skipping: [instance] 2025-12-03 11:28:49.644310 | controller | 2025-12-03 11:28:49.644495 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:49.644712 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.043) 0:00:05.423 **** 2025-12-03 11:28:49.683118 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:49.683324 | controller | assertion: not cifmw_devscripts_create_logical_volume | bool 2025-12-03 11:28:49.683496 | controller | evaluated_to: false 2025-12-03 11:28:49.683677 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-12-03 11:28:49.710831 | controller | 2025-12-03 11:28:49.711023 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:49.711197 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.050) 0:00:05.473 **** 2025-12-03 11:28:49.711341 | controller | 2025-12-03 11:28:49.711498 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:49.711661 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.016) 0:00:05.490 **** 2025-12-03 11:28:49.739155 | controller | ok: [instance] 2025-12-03 11:28:49.739330 | controller | 2025-12-03 11:28:49.739511 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:49.739689 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.028) 0:00:05.518 **** 2025-12-03 11:28:49.785234 | controller | skipping: [instance] 2025-12-03 11:28:49.826254 | controller | 2025-12-03 11:28:49.826286 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:49.826300 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.043) 0:00:05.561 **** 2025-12-03 11:28:49.826310 | controller | skipping: [instance] 2025-12-03 11:28:49.864264 | controller | 2025-12-03 11:28:49.864298 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:49.864306 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.043) 0:00:05.605 **** 2025-12-03 11:28:49.864316 | controller | skipping: [instance] 2025-12-03 11:28:49.888723 | controller | 2025-12-03 11:28:49.888754 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:49.888762 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.036) 0:00:05.641 **** 2025-12-03 11:28:49.888772 | controller | ok: [instance] 2025-12-03 11:28:49.888995 | controller | 2025-12-03 11:28:49.889010 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:49.917256 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.025) 0:00:05.666 **** 2025-12-03 11:28:49.917285 | controller | ok: [instance] 2025-12-03 11:28:49.944924 | controller | 2025-12-03 11:28:49.944954 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:49.944962 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.029) 0:00:05.696 **** 2025-12-03 11:28:49.944971 | controller | ok: [instance] => 2025-12-03 11:28:49.988127 | controller | msg: 'Running: Create LVMS without volume' 2025-12-03 11:28:49.988157 | controller | 2025-12-03 11:28:49.988171 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:49.988178 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.026) 0:00:05.723 **** 2025-12-03 11:28:49.988187 | controller | 2025-12-03 11:28:50.053598 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:50.053631 | controller | Wednesday 03 December 2025 11:28:49 +0000 (0:00:00.044) 0:00:05.767 **** 2025-12-03 11:28:50.053643 | controller | ok: [instance] 2025-12-03 11:28:50.101993 | controller | 2025-12-03 11:28:50.102026 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:50.102034 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.063) 0:00:05.830 **** 2025-12-03 11:28:50.102044 | controller | ok: [instance] 2025-12-03 11:28:50.102216 | controller | 2025-12-03 11:28:50.102409 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:50.180974 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.050) 0:00:05.881 **** 2025-12-03 11:28:50.181013 | controller | ok: [instance] 2025-12-03 11:28:50.227900 | controller | 2025-12-03 11:28:50.227931 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:50.227940 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.078) 0:00:05.959 **** 2025-12-03 11:28:50.227950 | controller | skipping: [instance] 2025-12-03 11:28:50.228127 | controller | 2025-12-03 11:28:50.228281 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:50.228439 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.047) 0:00:06.007 **** 2025-12-03 11:28:50.276247 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:50.276458 | controller | assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 2025-12-03 11:28:50.276627 | controller | evaluated_to: false 2025-12-03 11:28:50.276789 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-12-03 11:28:50.328422 | controller | 2025-12-03 11:28:50.328641 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:50.328806 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.058) 0:00:06.065 **** 2025-12-03 11:28:50.328940 | controller | 2025-12-03 11:28:50.329094 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:50.329252 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.041) 0:00:06.107 **** 2025-12-03 11:28:50.350664 | controller | ok: [instance] 2025-12-03 11:28:50.350826 | controller | 2025-12-03 11:28:50.350979 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:50.351139 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.022) 0:00:06.129 **** 2025-12-03 11:28:50.391949 | controller | skipping: [instance] 2025-12-03 11:28:50.392149 | controller | 2025-12-03 11:28:50.392314 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:50.392460 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.041) 0:00:06.171 **** 2025-12-03 11:28:50.427482 | controller | skipping: [instance] 2025-12-03 11:28:50.427684 | controller | 2025-12-03 11:28:50.427838 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:50.428005 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.035) 0:00:06.206 **** 2025-12-03 11:28:50.465271 | controller | skipping: [instance] 2025-12-03 11:28:50.465474 | controller | 2025-12-03 11:28:50.465657 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:50.465808 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.036) 0:00:06.243 **** 2025-12-03 11:28:50.490823 | controller | ok: [instance] 2025-12-03 11:28:50.490994 | controller | 2025-12-03 11:28:50.491165 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:50.491319 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.025) 0:00:06.268 **** 2025-12-03 11:28:50.518339 | controller | ok: [instance] 2025-12-03 11:28:50.518549 | controller | 2025-12-03 11:28:50.518715 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:50.518862 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.028) 0:00:06.296 **** 2025-12-03 11:28:50.543621 | controller | ok: [instance] => 2025-12-03 11:28:50.543799 | controller | msg: 'Running: Allocate same volume twice' 2025-12-03 11:28:50.543936 | controller | 2025-12-03 11:28:50.544114 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:50.544256 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.026) 0:00:06.322 **** 2025-12-03 11:28:50.586429 | controller | 2025-12-03 11:28:50.586686 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:50.586867 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.042) 0:00:06.365 **** 2025-12-03 11:28:50.651018 | controller | ok: [instance] 2025-12-03 11:28:50.651227 | controller | 2025-12-03 11:28:50.651400 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:50.651580 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.063) 0:00:06.428 **** 2025-12-03 11:28:50.697553 | controller | ok: [instance] 2025-12-03 11:28:50.697758 | controller | 2025-12-03 11:28:50.697919 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:50.698078 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.047) 0:00:06.476 **** 2025-12-03 11:28:50.775703 | controller | ok: [instance] 2025-12-03 11:28:50.775901 | controller | 2025-12-03 11:28:50.776085 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:50.776252 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.076) 0:00:06.552 **** 2025-12-03 11:28:50.818901 | controller | skipping: [instance] 2025-12-03 11:28:50.819098 | controller | 2025-12-03 11:28:50.819272 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:50.819419 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.044) 0:00:06.597 **** 2025-12-03 11:28:50.864349 | controller | skipping: [instance] 2025-12-03 11:28:50.864562 | controller | 2025-12-03 11:28:50.864727 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 11:28:50.864874 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.045) 0:00:06.643 **** 2025-12-03 11:28:50.911354 | controller | ok: [instance] 2025-12-03 11:28:50.911596 | controller | 2025-12-03 11:28:50.911775 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 11:28:50.911921 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.047) 0:00:06.690 **** 2025-12-03 11:28:50.955173 | controller | skipping: [instance] 2025-12-03 11:28:50.955362 | controller | 2025-12-03 11:28:50.955548 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 11:28:50.955716 | controller | Wednesday 03 December 2025 11:28:50 +0000 (0:00:00.043) 0:00:06.734 **** 2025-12-03 11:28:51.015955 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:51.016188 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-12-03 11:28:51.016347 | controller | evaluated_to: false 2025-12-03 11:28:51.016507 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' 2025-12-03 11:28:51.045477 | controller | 2025-12-03 11:28:51.045684 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:51.045837 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.072) 0:00:06.806 **** 2025-12-03 11:28:51.045983 | controller | 2025-12-03 11:28:51.046134 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:51.046272 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.018) 0:00:06.824 **** 2025-12-03 11:28:51.068716 | controller | ok: [instance] 2025-12-03 11:28:51.068889 | controller | 2025-12-03 11:28:51.069036 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:51.069205 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.022) 0:00:06.847 **** 2025-12-03 11:28:51.108599 | controller | skipping: [instance] 2025-12-03 11:28:51.144288 | controller | 2025-12-03 11:28:51.144323 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:51.144331 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.037) 0:00:06.885 **** 2025-12-03 11:28:51.144341 | controller | skipping: [instance] 2025-12-03 11:28:51.144752 | controller | 2025-12-03 11:28:51.181993 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:51.182019 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.037) 0:00:06.923 **** 2025-12-03 11:28:51.182029 | controller | skipping: [instance] 2025-12-03 11:28:51.230082 | controller | 2025-12-03 11:28:51.230115 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:51.230123 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.035) 0:00:06.958 **** 2025-12-03 11:28:51.230133 | controller | ok: [instance] 2025-12-03 11:28:51.260753 | controller | 2025-12-03 11:28:51.260781 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:51.260789 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.049) 0:00:07.008 **** 2025-12-03 11:28:51.260799 | controller | ok: [instance] 2025-12-03 11:28:51.293213 | controller | 2025-12-03 11:28:51.293243 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:51.293251 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.030) 0:00:07.039 **** 2025-12-03 11:28:51.293261 | controller | ok: [instance] => 2025-12-03 11:28:51.293509 | controller | msg: 'Running: Allocate same volume twice - no LVMS' 2025-12-03 11:28:51.293523 | controller | 2025-12-03 11:28:51.293728 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:51.339562 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.032) 0:00:07.072 **** 2025-12-03 11:28:51.339595 | controller | 2025-12-03 11:28:51.403311 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:51.403341 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.046) 0:00:07.118 **** 2025-12-03 11:28:51.403353 | controller | ok: [instance] 2025-12-03 11:28:51.446927 | controller | 2025-12-03 11:28:51.446959 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:51.446967 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.061) 0:00:07.180 **** 2025-12-03 11:28:51.446977 | controller | ok: [instance] 2025-12-03 11:28:51.538241 | controller | 2025-12-03 11:28:51.538275 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:51.538283 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.045) 0:00:07.225 **** 2025-12-03 11:28:51.538293 | controller | ok: [instance] 2025-12-03 11:28:51.583379 | controller | 2025-12-03 11:28:51.583409 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:51.583417 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.091) 0:00:07.316 **** 2025-12-03 11:28:51.583427 | controller | skipping: [instance] 2025-12-03 11:28:51.632924 | controller | 2025-12-03 11:28:51.632956 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:51.632964 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.045) 0:00:07.362 **** 2025-12-03 11:28:51.632974 | controller | skipping: [instance] 2025-12-03 11:28:51.683109 | controller | 2025-12-03 11:28:51.683141 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 11:28:51.683149 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.049) 0:00:07.411 **** 2025-12-03 11:28:51.683159 | controller | ok: [instance] 2025-12-03 11:28:51.683326 | controller | 2025-12-03 11:28:51.683495 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 11:28:51.683680 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.050) 0:00:07.462 **** 2025-12-03 11:28:51.727726 | controller | skipping: [instance] 2025-12-03 11:28:51.727920 | controller | 2025-12-03 11:28:51.728087 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 11:28:51.728255 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.043) 0:00:07.505 **** 2025-12-03 11:28:51.798645 | controller | ok: [instance] 2025-12-03 11:28:51.798875 | controller | 2025-12-03 11:28:51.799033 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 11:28:51.799216 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.071) 0:00:07.577 **** 2025-12-03 11:28:51.852480 | controller | skipping: [instance] 2025-12-03 11:28:51.852693 | controller | 2025-12-03 11:28:51.852856 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 11:28:51.853004 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.052) 0:00:07.630 **** 2025-12-03 11:28:51.929679 | controller | ok: [instance] => changed=false 2025-12-03 11:28:51.929881 | controller | msg: All assertions passed 2025-12-03 11:28:51.930025 | controller | 2025-12-03 11:28:51.930191 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 11:28:51.930332 | controller | Wednesday 03 December 2025 11:28:51 +0000 (0:00:00.076) 0:00:07.706 **** 2025-12-03 11:28:52.016037 | controller | ok: [instance] => changed=false 2025-12-03 11:28:52.016233 | controller | msg: All assertions passed 2025-12-03 11:28:52.016370 | controller | 2025-12-03 11:28:52.016510 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:52.016675 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.088) 0:00:07.794 **** 2025-12-03 11:28:52.057706 | controller | skipping: [instance] 2025-12-03 11:28:52.057879 | controller | 2025-12-03 11:28:52.058029 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:52.058199 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.042) 0:00:07.836 **** 2025-12-03 11:28:52.090020 | controller | skipping: [instance] 2025-12-03 11:28:52.090222 | controller | 2025-12-03 11:28:52.090380 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:52.090597 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.032) 0:00:07.869 **** 2025-12-03 11:28:52.129840 | controller | skipping: [instance] 2025-12-03 11:28:52.130016 | controller | 2025-12-03 11:28:52.130192 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:52.130341 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.038) 0:00:07.907 **** 2025-12-03 11:28:52.153796 | controller | ok: [instance] 2025-12-03 11:28:52.153969 | controller | 2025-12-03 11:28:52.154134 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:52.154290 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.024) 0:00:07.931 **** 2025-12-03 11:28:52.183682 | controller | ok: [instance] 2025-12-03 11:28:52.183851 | controller | 2025-12-03 11:28:52.184006 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:52.184172 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.030) 0:00:07.962 **** 2025-12-03 11:28:52.210554 | controller | ok: [instance] => 2025-12-03 11:28:52.210738 | controller | msg: 'Running: Allocate same volume twice - no cinder_lvm' 2025-12-03 11:28:52.210879 | controller | 2025-12-03 11:28:52.211018 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:52.211183 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.026) 0:00:07.988 **** 2025-12-03 11:28:52.276230 | controller | 2025-12-03 11:28:52.276461 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:52.276643 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.066) 0:00:08.055 **** 2025-12-03 11:28:52.340701 | controller | ok: [instance] 2025-12-03 11:28:52.340889 | controller | 2025-12-03 11:28:52.341045 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:52.341209 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.062) 0:00:08.118 **** 2025-12-03 11:28:52.389569 | controller | ok: [instance] 2025-12-03 11:28:52.389750 | controller | 2025-12-03 11:28:52.389901 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:52.390044 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.050) 0:00:08.168 **** 2025-12-03 11:28:52.476089 | controller | ok: [instance] 2025-12-03 11:28:52.476271 | controller | 2025-12-03 11:28:52.476438 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:52.476615 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.086) 0:00:08.255 **** 2025-12-03 11:28:52.519784 | controller | skipping: [instance] 2025-12-03 11:28:52.519951 | controller | 2025-12-03 11:28:52.520128 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:52.520273 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.042) 0:00:08.298 **** 2025-12-03 11:28:52.567670 | controller | skipping: [instance] 2025-12-03 11:28:52.567831 | controller | 2025-12-03 11:28:52.567979 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 11:28:52.568161 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.048) 0:00:08.346 **** 2025-12-03 11:28:52.618081 | controller | ok: [instance] 2025-12-03 11:28:52.618342 | controller | 2025-12-03 11:28:52.618567 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 11:28:52.618730 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.050) 0:00:08.397 **** 2025-12-03 11:28:52.683378 | controller | skipping: [instance] 2025-12-03 11:28:52.683663 | controller | 2025-12-03 11:28:52.683906 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 11:28:52.684130 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.065) 0:00:08.462 **** 2025-12-03 11:28:52.769333 | controller | ok: [instance] 2025-12-03 11:28:52.769571 | controller | 2025-12-03 11:28:52.769768 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 11:28:52.769956 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.085) 0:00:08.548 **** 2025-12-03 11:28:52.837959 | controller | skipping: [instance] 2025-12-03 11:28:52.838195 | controller | 2025-12-03 11:28:52.838408 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 11:28:52.838618 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.068) 0:00:08.617 **** 2025-12-03 11:28:52.926027 | controller | ok: [instance] => changed=false 2025-12-03 11:28:52.926295 | controller | msg: All assertions passed 2025-12-03 11:28:52.926488 | controller | 2025-12-03 11:28:52.926705 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 11:28:52.926919 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.085) 0:00:08.702 **** 2025-12-03 11:28:53.000250 | controller | skipping: [instance] 2025-12-03 11:28:53.000461 | controller | 2025-12-03 11:28:53.000643 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:53.000818 | controller | Wednesday 03 December 2025 11:28:52 +0000 (0:00:00.077) 0:00:08.779 **** 2025-12-03 11:28:53.049737 | controller | skipping: [instance] 2025-12-03 11:28:53.049966 | controller | 2025-12-03 11:28:53.050175 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:53.050361 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.048) 0:00:08.827 **** 2025-12-03 11:28:53.087340 | controller | skipping: [instance] 2025-12-03 11:28:53.087516 | controller | 2025-12-03 11:28:53.087715 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:53.087864 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.038) 0:00:08.866 **** 2025-12-03 11:28:53.123149 | controller | skipping: [instance] 2025-12-03 11:28:53.123331 | controller | 2025-12-03 11:28:53.123480 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:53.123681 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.035) 0:00:08.902 **** 2025-12-03 11:28:53.151347 | controller | ok: [instance] 2025-12-03 11:28:53.187109 | controller | 2025-12-03 11:28:53.187139 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:53.187147 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.025) 0:00:08.927 **** 2025-12-03 11:28:53.187156 | controller | ok: [instance] 2025-12-03 11:28:53.214790 | controller | 2025-12-03 11:28:53.214830 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:53.214839 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.038) 0:00:08.965 **** 2025-12-03 11:28:53.214848 | controller | ok: [instance] => 2025-12-03 11:28:53.256804 | controller | msg: 'Running: Config overrides via devscripts' 2025-12-03 11:28:53.256832 | controller | 2025-12-03 11:28:53.256858 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:53.256865 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.027) 0:00:08.993 **** 2025-12-03 11:28:53.256875 | controller | 2025-12-03 11:28:53.293785 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:53.293811 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.042) 0:00:09.035 **** 2025-12-03 11:28:53.293823 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:53.350353 | controller | assertion: cifmw_devscripts_config.master_memory is undefined 2025-12-03 11:28:53.350384 | controller | evaluated_to: false 2025-12-03 11:28:53.350393 | controller | msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' 2025-12-03 11:28:53.350403 | controller | 2025-12-03 11:28:53.375815 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:53.375842 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.048) 0:00:09.084 **** 2025-12-03 11:28:53.375849 | controller | 2025-12-03 11:28:53.375856 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:53.375861 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.044) 0:00:09.128 **** 2025-12-03 11:28:53.375871 | controller | ok: [instance] 2025-12-03 11:28:53.376021 | controller | 2025-12-03 11:28:53.376209 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:53.376409 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.025) 0:00:09.154 **** 2025-12-03 11:28:53.420230 | controller | skipping: [instance] 2025-12-03 11:28:53.420494 | controller | 2025-12-03 11:28:53.420738 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:53.420942 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.044) 0:00:09.198 **** 2025-12-03 11:28:53.464871 | controller | skipping: [instance] 2025-12-03 11:28:53.465097 | controller | 2025-12-03 11:28:53.465290 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:53.465490 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.045) 0:00:09.243 **** 2025-12-03 11:28:53.505987 | controller | skipping: [instance] 2025-12-03 11:28:53.506187 | controller | 2025-12-03 11:28:53.506374 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:53.506565 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.039) 0:00:09.283 **** 2025-12-03 11:28:53.532743 | controller | ok: [instance] 2025-12-03 11:28:53.532923 | controller | 2025-12-03 11:28:53.533120 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:53.533288 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.026) 0:00:09.310 **** 2025-12-03 11:28:53.566707 | controller | ok: [instance] 2025-12-03 11:28:53.566898 | controller | 2025-12-03 11:28:53.567087 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:53.567278 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.035) 0:00:09.345 **** 2025-12-03 11:28:53.597973 | controller | ok: [instance] => 2025-12-03 11:28:53.598198 | controller | msg: 'Running: Inject 10 dev-scripts extra_worker' 2025-12-03 11:28:53.598372 | controller | 2025-12-03 11:28:53.598591 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:53.598789 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.030) 0:00:09.376 **** 2025-12-03 11:28:53.651879 | controller | 2025-12-03 11:28:53.652158 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:53.652365 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.054) 0:00:09.430 **** 2025-12-03 11:28:53.727777 | controller | ok: [instance] 2025-12-03 11:28:53.728006 | controller | 2025-12-03 11:28:53.728204 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:53.728356 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.076) 0:00:09.506 **** 2025-12-03 11:28:53.767010 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 11:28:53.799469 | controller | assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 2025-12-03 11:28:53.799494 | controller | evaluated_to: false 2025-12-03 11:28:53.799502 | controller | msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' 2025-12-03 11:28:53.799517 | controller | 2025-12-03 11:28:53.824692 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 11:28:53.824726 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.050) 0:00:09.557 **** 2025-12-03 11:28:53.824738 | controller | 2025-12-03 11:28:53.824744 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:53.824750 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.020) 0:00:09.577 **** 2025-12-03 11:28:53.824762 | controller | ok: [instance] 2025-12-03 11:28:53.870296 | controller | 2025-12-03 11:28:53.870329 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:53.870338 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.025) 0:00:09.603 **** 2025-12-03 11:28:53.870347 | controller | skipping: [instance] 2025-12-03 11:28:53.910709 | controller | 2025-12-03 11:28:53.910751 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:53.910759 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.044) 0:00:09.647 **** 2025-12-03 11:28:53.910773 | controller | skipping: [instance] 2025-12-03 11:28:53.955385 | controller | 2025-12-03 11:28:53.955435 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:53.955444 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.039) 0:00:09.687 **** 2025-12-03 11:28:53.955455 | controller | skipping: [instance] 2025-12-03 11:28:53.955661 | controller | 2025-12-03 11:28:53.955859 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 11:28:53.956040 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.046) 0:00:09.734 **** 2025-12-03 11:28:53.984893 | controller | ok: [instance] 2025-12-03 11:28:53.985104 | controller | 2025-12-03 11:28:53.985298 | controller | TASK [Load environment file] *************************************************** 2025-12-03 11:28:53.985483 | controller | Wednesday 03 December 2025 11:28:53 +0000 (0:00:00.029) 0:00:09.763 **** 2025-12-03 11:28:54.017625 | controller | ok: [instance] 2025-12-03 11:28:54.017832 | controller | 2025-12-03 11:28:54.017987 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 11:28:54.018161 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.032) 0:00:09.796 **** 2025-12-03 11:28:54.064826 | controller | ok: [instance] => 2025-12-03 11:28:54.065044 | controller | msg: 'Running: Inject 0 dev-scripts extra_worker' 2025-12-03 11:28:54.065246 | controller | 2025-12-03 11:28:54.065449 | controller | TASK [Validate data] *********************************************************** 2025-12-03 11:28:54.065661 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.028) 0:00:09.825 **** 2025-12-03 11:28:54.094183 | controller | 2025-12-03 11:28:54.094380 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 11:28:54.094603 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.048) 0:00:09.873 **** 2025-12-03 11:28:54.199400 | controller | ok: [instance] 2025-12-03 11:28:54.199668 | controller | 2025-12-03 11:28:54.199838 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 11:28:54.200022 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.103) 0:00:09.977 **** 2025-12-03 11:28:54.252399 | controller | ok: [instance] 2025-12-03 11:28:54.252633 | controller | 2025-12-03 11:28:54.252836 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 11:28:54.253012 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.054) 0:00:10.031 **** 2025-12-03 11:28:54.336553 | controller | ok: [instance] 2025-12-03 11:28:54.336817 | controller | 2025-12-03 11:28:54.337036 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 11:28:54.337241 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.083) 0:00:10.115 **** 2025-12-03 11:28:54.391702 | controller | skipping: [instance] 2025-12-03 11:28:54.391946 | controller | 2025-12-03 11:28:54.392149 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 11:28:54.392329 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.055) 0:00:10.170 **** 2025-12-03 11:28:54.458233 | controller | ok: [instance] 2025-12-03 11:28:54.458494 | controller | 2025-12-03 11:28:54.458714 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 11:28:54.458914 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.066) 0:00:10.236 **** 2025-12-03 11:28:54.514865 | controller | skipping: [instance] 2025-12-03 11:28:54.515095 | controller | 2025-12-03 11:28:54.515292 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 11:28:54.515472 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.056) 0:00:10.293 **** 2025-12-03 11:28:54.574046 | controller | skipping: [instance] 2025-12-03 11:28:54.574274 | controller | 2025-12-03 11:28:54.574460 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 11:28:54.574649 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.059) 0:00:10.352 **** 2025-12-03 11:28:54.627012 | controller | skipping: [instance] 2025-12-03 11:28:54.627236 | controller | 2025-12-03 11:28:54.627416 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 11:28:54.627614 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.052) 0:00:10.405 **** 2025-12-03 11:28:54.682640 | controller | skipping: [instance] 2025-12-03 11:28:54.682857 | controller | 2025-12-03 11:28:54.683045 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 11:28:54.683255 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.056) 0:00:10.461 **** 2025-12-03 11:28:54.735663 | controller | skipping: [instance] 2025-12-03 11:28:54.735891 | controller | 2025-12-03 11:28:54.736109 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 11:28:54.736305 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.051) 0:00:10.512 **** 2025-12-03 11:28:54.802332 | controller | skipping: [instance] 2025-12-03 11:28:54.802562 | controller | 2025-12-03 11:28:54.802737 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 11:28:54.802986 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.068) 0:00:10.581 **** 2025-12-03 11:28:54.847518 | controller | skipping: [instance] 2025-12-03 11:28:54.847717 | controller | 2025-12-03 11:28:54.847890 | controller | TASK [Display error message] *************************************************** 2025-12-03 11:28:54.848054 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.045) 0:00:10.626 **** 2025-12-03 11:28:54.901241 | controller | skipping: [instance] 2025-12-03 11:28:54.944797 | controller | 2025-12-03 11:28:54.944818 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 11:28:54.944825 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.053) 0:00:10.679 **** 2025-12-03 11:28:54.944840 | controller | skipping: [instance] 2025-12-03 11:28:55.021107 | controller | 2025-12-03 11:28:55.021143 | controller | TASK [Fail if needed] ********************************************************** 2025-12-03 11:28:55.021151 | controller | Wednesday 03 December 2025 11:28:54 +0000 (0:00:00.043) 0:00:10.723 **** 2025-12-03 11:28:55.021167 | controller | skipping: [instance] 2025-12-03 11:28:55.096167 | controller | 2025-12-03 11:28:55.096207 | controller | PLAY RECAP ********************************************************************* 2025-12-03 11:28:55.096234 | controller | instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 2025-12-03 11:28:55.096244 | controller | 2025-12-03 11:28:55.096250 | controller | Wednesday 03 December 2025 11:28:55 +0000 (0:00:00.073) 0:00:10.796 **** 2025-12-03 11:28:55.096256 | controller | =============================================================================== 2025-12-03 11:28:55.096261 | controller | reproducer : Ensure no allocation overlap ------------------------------- 0.13s 2025-12-03 11:28:55.096270 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.10s 2025-12-03 11:28:55.096280 | controller | Test no volumes --------------------------------------------------------- 0.10s 2025-12-03 11:28:55.096285 | controller | reproducer : Ensure we get required data in the layout description ------ 0.10s 2025-12-03 11:28:55.096291 | controller | reproducer : Ensure same amount of disks are created -------------------- 0.09s 2025-12-03 11:28:55.096299 | controller | reproducer : Ensure we get required data in the layout description ------ 0.09s 2025-12-03 11:28:55.096306 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.09s 2025-12-03 11:28:55.096311 | controller | Display error message --------------------------------------------------- 0.09s 2025-12-03 11:28:55.096316 | controller | reproducer : Ensure we get required data in the layout description ------ 0.09s 2025-12-03 11:28:55.096322 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.09s 2025-12-03 11:28:55.096330 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.09s 2025-12-03 11:28:55.096337 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-12-03 11:28:55.096342 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-12-03 11:28:55.096347 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-12-03 11:28:55.096353 | controller | Validate data ----------------------------------------------------------- 0.08s 2025-12-03 11:28:55.096361 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.08s 2025-12-03 11:28:55.096367 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-12-03 11:28:55.096373 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-12-03 11:28:55.096378 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-12-03 11:28:55.096387 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-12-03 11:28:55.096398 | controller | INFO Running ocp_validations > cleanup 2025-12-03 11:28:55.096917 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-03 11:28:55.097586 | controller | INFO Writing /tmp/report.html report. 2025-12-03 11:28:55.295245 | [controller] Waiting on logger 2025-12-03 11:29:00.428235 | [controller] Waiting on logger 2025-12-03 11:29:10.859355 | [controller] Waiting on logger 2025-12-03 11:29:21.291323 | [controller] Waiting on logger 2025-12-03 11:29:25.269571 | [Zuul] Log Stream did not terminate 2025-12-03 11:29:25.269889 | controller | changed 2025-12-03 11:29:25.333248 | 2025-12-03 11:29:25.333362 | PLAY RECAP 2025-12-03 11:29:25.333402 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-03 11:29:25.333427 | 2025-12-03 11:29:25.400513 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-03 11:29:25.401364 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-03 11:29:25.911126 | 2025-12-03 11:29:25.911239 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-12-03 11:29:25.930861 | 2025-12-03 11:29:25.930934 | TASK [Filter out host if needed] 2025-12-03 11:29:25.939228 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-12-03 11:29:25.943606 | 2025-12-03 11:29:25.943672 | TASK [Ensure file is present] 2025-12-03 11:29:26.571088 | controller | ok 2025-12-03 11:29:26.576661 | 2025-12-03 11:29:26.576747 | TASK [Manage molecule report file] 2025-12-03 11:29:26.596862 | [controller] Waiting on logger 2025-12-03 11:29:35.948635 | [controller] Waiting on logger 2025-12-03 11:29:45.327939 | [controller] Waiting on logger 2025-12-03 11:29:55.723390 | [controller] Waiting on logger 2025-12-03 11:29:57.073001 | [Zuul] Log Stream did not terminate 2025-12-03 11:29:57.073221 | controller | changed 2025-12-03 11:29:57.079893 | 2025-12-03 11:29:57.079983 | TASK [Check if we get ci-framework-data basedir] 2025-12-03 11:29:57.423686 | controller | ok 2025-12-03 11:29:57.428913 | 2025-12-03 11:29:57.428997 | TASK [Create ci-framework-data log directory for zuul] 2025-12-03 11:29:57.822689 | controller | changed 2025-12-03 11:29:57.828589 | 2025-12-03 11:29:57.828682 | TASK [Copy ci-framework interesting files] 2025-12-03 11:29:57.849322 | [controller] Waiting on logger 2025-12-03 11:30:04.093041 | controller | changed 2025-12-03 11:30:04.098370 | 2025-12-03 11:30:04.098457 | TASK [Get SELinux listing] 2025-12-03 11:30:08.203282 | [controller] Waiting on logger 2025-12-03 11:30:09.128738 | controller | changed 2025-12-03 11:30:09.138137 | 2025-12-03 11:30:09.138243 | TASK [Generate log index] 2025-12-03 11:30:10.409618 | controller | changed 2025-12-03 11:30:10.415324 | 2025-12-03 11:30:10.415405 | TASK [Get some env related data] 2025-12-03 11:30:10.437268 | [controller] Waiting on logger 2025-12-03 11:30:26.827194 | [controller] Waiting on logger 2025-12-03 11:30:29.067119 | [controller] Waiting on logger 2025-12-03 11:30:42.340641 | [Zuul] Log Stream did not terminate 2025-12-03 11:30:42.340848 | controller | changed 2025-12-03 11:30:42.366431 | 2025-12-03 11:30:42.366523 | TASK [Generate list of logs to collect in home directory] 2025-12-03 11:30:43.076017 | controller | ok: All paths examined 2025-12-03 11:30:43.081419 | 2025-12-03 11:30:43.081487 | LOOP [Copy logs from home directory] 2025-12-03 11:30:43.660193 | controller | changed: 2025-12-03 11:30:43.660423 | controller | { 2025-12-03 11:30:43.660453 | controller | "atime": 1763989167.9348345, 2025-12-03 11:30:43.660473 | controller | "ctime": 1763990251.6129293, 2025-12-03 11:30:43.660489 | controller | "dev": 64513, 2025-12-03 11:30:43.660505 | controller | "gid": 1000, 2025-12-03 11:30:43.660521 | controller | "gr_name": "zuul", 2025-12-03 11:30:43.660536 | controller | "inode": 5131423, 2025-12-03 11:30:43.660556 | controller | "isblk": false, 2025-12-03 11:30:43.660571 | controller | "ischr": false, 2025-12-03 11:30:43.660586 | controller | "isdir": false, 2025-12-03 11:30:43.660602 | controller | "isfifo": false, 2025-12-03 11:30:43.660618 | controller | "isgid": false, 2025-12-03 11:30:43.660633 | controller | "islnk": false, 2025-12-03 11:30:43.660648 | controller | "isreg": true, 2025-12-03 11:30:43.660663 | controller | "issock": false, 2025-12-03 11:30:43.660677 | controller | "isuid": false, 2025-12-03 11:30:43.660712 | controller | "mode": "0644", 2025-12-03 11:30:43.660740 | controller | "mtime": 1763990251.6129293, 2025-12-03 11:30:43.660759 | controller | "nlink": 1, 2025-12-03 11:30:43.660776 | controller | "path": "/home/zuul/crc-setup.log", 2025-12-03 11:30:43.660791 | controller | "pw_name": "zuul", 2025-12-03 11:30:43.660806 | controller | "rgrp": true, 2025-12-03 11:30:43.660821 | controller | "roth": true, 2025-12-03 11:30:43.660836 | controller | "rusr": true, 2025-12-03 11:30:43.660850 | controller | "size": 4108, 2025-12-03 11:30:43.660863 | controller | "uid": 1000, 2025-12-03 11:30:43.660877 | controller | "wgrp": false, 2025-12-03 11:30:43.660891 | controller | "woth": false, 2025-12-03 11:30:43.660906 | controller | "wusr": true, 2025-12-03 11:30:43.660920 | controller | "xgrp": false, 2025-12-03 11:30:43.660935 | controller | "xoth": false, 2025-12-03 11:30:43.660949 | controller | "xusr": false 2025-12-03 11:30:43.660963 | controller | } 2025-12-03 11:30:44.201603 | controller | changed: 2025-12-03 11:30:44.201789 | controller | { 2025-12-03 11:30:44.201829 | controller | "atime": 1763990253.7119775, 2025-12-03 11:30:44.201852 | controller | "ctime": 1763991032.5164254, 2025-12-03 11:30:44.201870 | controller | "dev": 64513, 2025-12-03 11:30:44.201886 | controller | "gid": 1000, 2025-12-03 11:30:44.201903 | controller | "gr_name": "zuul", 2025-12-03 11:30:44.201917 | controller | "inode": 5131425, 2025-12-03 11:30:44.201932 | controller | "isblk": false, 2025-12-03 11:30:44.201947 | controller | "ischr": false, 2025-12-03 11:30:44.201961 | controller | "isdir": false, 2025-12-03 11:30:44.201976 | controller | "isfifo": false, 2025-12-03 11:30:44.201990 | controller | "isgid": false, 2025-12-03 11:30:44.202005 | controller | "islnk": false, 2025-12-03 11:30:44.202020 | controller | "isreg": true, 2025-12-03 11:30:44.202034 | controller | "issock": false, 2025-12-03 11:30:44.202049 | controller | "isuid": false, 2025-12-03 11:30:44.202063 | controller | "mode": "0644", 2025-12-03 11:30:44.202077 | controller | "mtime": 1763991032.5164254, 2025-12-03 11:30:44.202092 | controller | "nlink": 1, 2025-12-03 11:30:44.202106 | controller | "path": "/home/zuul/crc-start.log", 2025-12-03 11:30:44.202121 | controller | "pw_name": "zuul", 2025-12-03 11:30:44.202137 | controller | "rgrp": true, 2025-12-03 11:30:44.202153 | controller | "roth": true, 2025-12-03 11:30:44.202168 | controller | "rusr": true, 2025-12-03 11:30:44.202184 | controller | "size": 4428, 2025-12-03 11:30:44.202198 | controller | "uid": 1000, 2025-12-03 11:30:44.202212 | controller | "wgrp": false, 2025-12-03 11:30:44.202227 | controller | "woth": false, 2025-12-03 11:30:44.202240 | controller | "wusr": true, 2025-12-03 11:30:44.202254 | controller | "xgrp": false, 2025-12-03 11:30:44.202267 | controller | "xoth": false, 2025-12-03 11:30:44.202280 | controller | "xusr": false 2025-12-03 11:30:44.202293 | controller | } 2025-12-03 11:30:44.726051 | controller | changed: 2025-12-03 11:30:44.726147 | controller | { 2025-12-03 11:30:44.726173 | controller | "atime": 1764760772.2540388, 2025-12-03 11:30:44.726192 | controller | "ctime": 1764760797.4661784, 2025-12-03 11:30:44.726209 | controller | "dev": 64513, 2025-12-03 11:30:44.726226 | controller | "gid": 1000, 2025-12-03 11:30:44.726242 | controller | "gr_name": "zuul", 2025-12-03 11:30:44.726257 | controller | "inode": 5131559, 2025-12-03 11:30:44.726273 | controller | "isblk": false, 2025-12-03 11:30:44.726293 | controller | "ischr": false, 2025-12-03 11:30:44.726327 | controller | "isdir": false, 2025-12-03 11:30:44.726344 | controller | "isfifo": false, 2025-12-03 11:30:44.726360 | controller | "isgid": false, 2025-12-03 11:30:44.726375 | controller | "islnk": false, 2025-12-03 11:30:44.726391 | controller | "isreg": true, 2025-12-03 11:30:44.726408 | controller | "issock": false, 2025-12-03 11:30:44.726422 | controller | "isuid": false, 2025-12-03 11:30:44.726436 | controller | "mode": "0644", 2025-12-03 11:30:44.726450 | controller | "mtime": 1764760797.4661784, 2025-12-03 11:30:44.726464 | controller | "nlink": 1, 2025-12-03 11:30:44.726479 | controller | "path": "/home/zuul/ansible.log", 2025-12-03 11:30:44.726493 | controller | "pw_name": "zuul", 2025-12-03 11:30:44.726507 | controller | "rgrp": true, 2025-12-03 11:30:44.726520 | controller | "roth": true, 2025-12-03 11:30:44.726534 | controller | "rusr": true, 2025-12-03 11:30:44.726548 | controller | "size": 6749, 2025-12-03 11:30:44.726563 | controller | "uid": 1000, 2025-12-03 11:30:44.726576 | controller | "wgrp": false, 2025-12-03 11:30:44.726590 | controller | "woth": false, 2025-12-03 11:30:44.726604 | controller | "wusr": true, 2025-12-03 11:30:44.726617 | controller | "xgrp": false, 2025-12-03 11:30:44.726630 | controller | "xoth": false, 2025-12-03 11:30:44.726644 | controller | "xusr": false 2025-12-03 11:30:44.726657 | controller | } 2025-12-03 11:30:44.734314 | 2025-12-03 11:30:44.734427 | TASK [Copy crio stats log file] 2025-12-03 11:30:44.748550 | controller | skipping: Conditional result was False 2025-12-03 11:30:44.753964 | 2025-12-03 11:30:44.754028 | TASK [Get SELinux related data] 2025-12-03 11:30:45.643197 | [controller] Waiting on logger 2025-12-03 11:30:47.883362 | [controller] Waiting on logger 2025-12-03 11:31:04.459204 | [controller] Waiting on logger 2025-12-03 11:31:14.891315 | [controller] Waiting on logger 2025-12-03 11:31:15.066014 | [Zuul] Log Stream did not terminate 2025-12-03 11:31:15.066253 | controller | ERROR 2025-12-03 11:31:15.066364 | controller | { 2025-12-03 11:31:15.066395 | controller | "delta": "0:00:00.011690", 2025-12-03 11:31:15.066415 | controller | "end": "2025-12-03 11:30:45.040799", 2025-12-03 11:31:15.066433 | controller | "msg": "non-zero return code", 2025-12-03 11:31:15.066449 | controller | "rc": 1, 2025-12-03 11:31:15.066465 | controller | "start": "2025-12-03 11:30:45.029109" 2025-12-03 11:31:15.066479 | controller | } 2025-12-03 11:31:15.066504 | controller | ERROR: Ignoring Errors 2025-12-03 11:31:15.071838 | 2025-12-03 11:31:15.071904 | TASK [Create system configuration directory] 2025-12-03 11:31:15.344336 | controller | changed 2025-12-03 11:31:15.349103 | 2025-12-03 11:31:15.349168 | TASK [Get some of the system configurations] 2025-12-03 11:31:15.369648 | [controller] Waiting on logger 2025-12-03 11:31:25.771225 | [controller] Waiting on logger 2025-12-03 11:31:36.203142 | [controller] Waiting on logger 2025-12-03 11:31:45.547344 | [controller] Waiting on logger 2025-12-03 11:31:45.682284 | [Zuul] Log Stream did not terminate 2025-12-03 11:31:45.682447 | controller | changed 2025-12-03 11:31:45.687377 | 2025-12-03 11:31:45.687436 | TASK [Copy generated documentation if available] 2025-12-03 11:31:45.700944 | controller | skipping: Conditional result was False 2025-12-03 11:31:45.706612 | 2025-12-03 11:31:45.706681 | TASK [Copy generated AsciiDoc documentation if available] 2025-12-03 11:31:45.719462 | controller | skipping: Conditional result was False 2025-12-03 11:31:45.724609 | 2025-12-03 11:31:45.724671 | TASK [Compress logs bigger than 2MB] 2025-12-03 11:31:48.811352 | [controller] Waiting on logger 2025-12-03 11:31:55.069778 | controller | changed 2025-12-03 11:31:55.074991 | 2025-12-03 11:31:55.075054 | TASK [Copy files from workspace on node] 2025-12-03 11:31:55.093103 | controller | ok 2025-12-03 11:31:55.115198 | 2025-12-03 11:31:55.115270 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-03 11:31:55.128761 | controller | skipping: Conditional result was False 2025-12-03 11:31:55.134229 | 2025-12-03 11:31:55.134311 | TASK [fetch-output : Set log path for single node] 2025-12-03 11:31:55.162230 | controller | ok 2025-12-03 11:31:55.167093 | 2025-12-03 11:31:55.167156 | LOOP [fetch-output : Ensure local output dirs] 2025-12-03 11:31:55.360111 | controller -> localhost | ok: "/var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/logs" 2025-12-03 11:31:55.360366 | controller -> localhost | changed: All items complete 2025-12-03 11:31:55.360400 | 2025-12-03 11:31:55.535113 | controller -> localhost | changed: "/var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/artifacts" 2025-12-03 11:31:55.707116 | controller -> localhost | changed: "/var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/docs" 2025-12-03 11:31:55.718751 | 2025-12-03 11:31:55.718863 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-03 11:31:56.366724 | controller | changed: 2025-12-03 11:31:56.366895 | controller | .d..t...... ./ 2025-12-03 11:31:56.366927 | controller | >f+++++++++ README.html 2025-12-03 11:31:56.366950 | controller | >f+++++++++ ansible-execution.log 2025-12-03 11:31:56.366969 | controller | >f+++++++++ ansible.log 2025-12-03 11:31:56.366988 | controller | >f+++++++++ crc-setup.log 2025-12-03 11:31:56.367005 | controller | >f+++++++++ crc-start.log 2025-12-03 11:31:56.367021 | controller | >f+++++++++ dmesg.log 2025-12-03 11:31:56.367037 | controller | >f+++++++++ installed-pkgs.log 2025-12-03 11:31:56.367053 | controller | >f+++++++++ python.log 2025-12-03 11:31:56.367069 | controller | >f+++++++++ registries.conf 2025-12-03 11:31:56.367085 | controller | >f+++++++++ report.html 2025-12-03 11:31:56.367102 | controller | >f+++++++++ selinux-denials.log 2025-12-03 11:31:56.367117 | controller | >f+++++++++ selinux-listing.log 2025-12-03 11:31:56.367131 | controller | cd+++++++++ ci-framework-data/ 2025-12-03 11:31:56.367146 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-12-03 11:31:56.367161 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-12-03 11:31:56.367176 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-12-03 11:31:56.367191 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-12-03 11:31:56.367206 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-12-03 11:31:56.367221 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-12-03 11:31:56.367235 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-12-03 11:31:56.367250 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-12-03 11:31:56.367264 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-12-03 11:31:56.367278 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-12-03 11:31:56.367292 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-12-03 11:31:56.367320 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-12-03 11:31:56.367338 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-12-03 11:31:56.367354 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-12-03 11:31:56.367369 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:37:1b:b6 2025-12-03 11:31:56.367385 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:c2:3b:f4 2025-12-03 11:31:56.367400 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:b9:de:ee 2025-12-03 11:31:56.367414 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:9a:6f:d7 2025-12-03 11:31:56.367427 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:e5:46:76 2025-12-03 11:31:56.367446 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:61:97:18 2025-12-03 11:31:56.367461 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-12-03 11:31:56.367475 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-12-03 11:31:56.367490 | controller | cd+++++++++ ci-framework-data/logs/ 2025-12-03 11:31:56.367504 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-12-03 11:31:56.367518 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-12-03 11:31:56.367531 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-12-03 11:31:56.367545 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-12-03 11:31:56.367559 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-12-03 11:31:56.367572 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-12-03 11:31:56.367586 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-12-03 11:31:56.367600 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2025-12-03 11:31:56.367614 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2025-12-03 11:31:56.367627 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2025-12-03 11:31:56.367642 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2025-12-03 11:31:56.367656 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2025-12-03 11:31:56.367673 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2025-12-03 11:31:56.367688 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2025-12-03 11:31:56.367736 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2025-12-03 11:31:56.367757 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2025-12-03 11:31:56.367773 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2025-12-03 11:31:56.367790 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2025-12-03 11:31:56.367805 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2025-12-03 11:31:56.367820 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2025-12-03 11:31:56.367835 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2025-12-03 11:31:56.367850 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2025-12-03 11:31:56.367864 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-12-03 11:31:56.367878 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-12-03 11:31:56.367892 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-12-03 11:31:56.367906 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-12-03 11:31:56.367920 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2025-12-03 11:31:56.367938 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-12-03 11:31:56.367953 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-12-03 11:31:56.367967 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-12-03 11:31:56.367981 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-12-03 11:31:56.367995 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-12-03 11:31:56.368008 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-12-03 11:31:56.368022 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-12-03 11:31:56.368035 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2025-12-03 11:31:56.368049 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-12-03 11:31:56.368064 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-12-03 11:31:56.368078 | controller | cd+++++++++ registries.conf.d/ 2025-12-03 11:31:56.368092 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-12-03 11:31:56.368106 | controller | cd+++++++++ system-config/ 2025-12-03 11:31:56.368120 | controller | cd+++++++++ system-config/libvirt/ 2025-12-03 11:31:56.368134 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-12-03 11:31:56.368148 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-12-03 11:31:56.368161 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-12-03 11:31:56.368175 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-12-03 11:31:56.368189 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-12-03 11:31:56.368203 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-12-03 11:31:56.368217 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-12-03 11:31:56.368230 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-12-03 11:31:56.368244 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-12-03 11:31:56.368257 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-12-03 11:31:56.368271 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-12-03 11:31:56.368284 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-12-03 11:31:56.368309 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-12-03 11:31:56.368325 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-12-03 11:31:56.368340 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-12-03 11:31:56.368353 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-12-03 11:31:56.803871 | controller | changed: .d..t...... ./ 2025-12-03 11:31:57.229902 | controller | changed: .d..t...... ./ 2025-12-03 11:31:57.242499 | 2025-12-03 11:31:57.242604 | TASK [Return artifact to Zuul] 2025-12-03 11:31:57.271718 | controller | ok 2025-12-03 11:31:57.291871 | 2025-12-03 11:31:57.291945 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-12-03 11:31:57.292053 | 2025-12-03 11:31:57.292081 | PLAY RECAP 2025-12-03 11:31:57.292120 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-12-03 11:31:57.292142 | 2025-12-03 11:31:57.373664 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-03 11:31:57.374468 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-03 11:31:57.876215 | 2025-12-03 11:31:57.876318 | PLAY [all] 2025-12-03 11:31:57.894404 | 2025-12-03 11:31:57.894543 | TASK [include_role : fetch-output] 2025-12-03 11:31:57.922716 | controller | ok 2025-12-03 11:31:57.938893 | 2025-12-03 11:31:57.938976 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-03 11:31:57.982537 | controller | skipping: Conditional result was False 2025-12-03 11:31:57.987972 | 2025-12-03 11:31:57.988057 | TASK [fetch-output : Set log path for single node] 2025-12-03 11:31:58.016431 | controller | ok 2025-12-03 11:31:58.021402 | 2025-12-03 11:31:58.021471 | LOOP [fetch-output : Ensure local output dirs] 2025-12-03 11:31:58.356237 | controller -> localhost | ok: "/var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/logs" 2025-12-03 11:31:58.533605 | controller -> localhost | ok: "/var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/artifacts" 2025-12-03 11:31:58.709523 | controller -> localhost | ok: "/var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/docs" 2025-12-03 11:31:58.721395 | 2025-12-03 11:31:58.721482 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-03 11:31:59.291523 | controller | ok 2025-12-03 11:31:59.291747 | controller | ok: All items complete 2025-12-03 11:31:59.291781 | 2025-12-03 11:31:59.726067 | controller | ok 2025-12-03 11:32:00.182344 | controller | ok 2025-12-03 11:32:00.198664 | 2025-12-03 11:32:00.198806 | TASK [include_role : fetch-output-openshift] 2025-12-03 11:32:00.211943 | controller | skipping: Conditional result was False 2025-12-03 11:32:00.217715 | 2025-12-03 11:32:00.217795 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-12-03 11:32:00.559938 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006595 2025-12-03 11:32:00.754670 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006972 2025-12-03 11:32:00.781732 | 2025-12-03 11:32:00.781825 | PLAY [all] 2025-12-03 11:32:00.795418 | 2025-12-03 11:32:00.795486 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-12-03 11:32:01.320712 | controller | changed 2025-12-03 11:32:01.342109 | 2025-12-03 11:32:01.342162 | PLAY RECAP 2025-12-03 11:32:01.342206 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-12-03 11:32:01.342230 | 2025-12-03 11:32:01.405975 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-03 11:32:01.406826 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-12-03 11:32:01.946754 | 2025-12-03 11:32:01.946860 | PLAY [localhost] 2025-12-03 11:32:01.964141 | 2025-12-03 11:32:01.964218 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-12-03 11:32:02.264938 | localhost | changed 2025-12-03 11:32:02.269456 | 2025-12-03 11:32:02.269531 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-12-03 11:32:02.286582 | localhost | ok 2025-12-03 11:32:02.294178 | 2025-12-03 11:32:02.294246 | TASK [add-fileserver : Create SSH private key tempfile] 2025-12-03 11:32:02.584180 | localhost | changed 2025-12-03 11:32:02.589749 | 2025-12-03 11:32:02.589842 | TASK [add-fileserver : Create SSH private key from secret] 2025-12-03 11:32:03.122890 | localhost | changed 2025-12-03 11:32:03.127806 | 2025-12-03 11:32:03.127876 | TASK [add-fileserver : Add fileserver ssh key] 2025-12-03 11:32:03.469612 | localhost | Identity added: /var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/tmp/ansible.j5xn71vo (/var/lib/zuul/builds/f3934d13a4b54a848e5c6ab9f4d622ee/work/tmp/ansible.j5xn71vo) 2025-12-03 11:32:03.469804 | localhost | ok: Runtime: 0:00:00.006569 2025-12-03 11:32:03.474193 | 2025-12-03 11:32:03.474268 | TASK [add-fileserver : Remove SSH private key from disk] 2025-12-03 11:32:03.684600 | localhost | ok: Runtime: 0:00:00.004424 2025-12-03 11:32:03.689384 | 2025-12-03 11:32:03.689458 | TASK [add-fileserver : Add fileserver to inventory] 2025-12-03 11:32:03.737216 | localhost | changed 2025-12-03 11:32:03.741971 | 2025-12-03 11:32:03.742038 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-12-03 11:32:04.063276 | localhost | changed 2025-12-03 11:32:04.082600 | 2025-12-03 11:32:04.082663 | PLAY [localhost] 2025-12-03 11:32:04.093727 | 2025-12-03 11:32:04.093792 | TASK [Generate bulk log download script] 2025-12-03 11:32:04.111689 | localhost | ok 2025-12-03 11:32:04.122765 | 2025-12-03 11:32:04.122829 | TASK [local-log-download : Check API endpoint is defined] 2025-12-03 11:32:04.150190 | localhost | ok: All assertions passed 2025-12-03 11:32:04.154555 | 2025-12-03 11:32:04.154617 | TASK [local-log-download : Create download script] 2025-12-03 11:32:04.512239 | localhost -> localhost | changed 2025-12-03 11:32:04.521129 | 2025-12-03 11:32:04.521209 | TASK [Register quick-download link] 2025-12-03 11:32:04.550444 | localhost | ok 2025-12-03 11:32:04.594506 | 2025-12-03 11:32:04.594602 | PLAY [logserver.rdoproject.org] 2025-12-03 11:32:04.604117 | 2025-12-03 11:32:04.604189 | TASK [Set zuul-log-path fact] 2025-12-03 11:32:04.621539 | logserver.rdoproject.org | ok 2025-12-03 11:32:04.631258 | 2025-12-03 11:32:04.631341 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-03 11:32:04.658294 | logserver.rdoproject.org | ok 2025-12-03 11:32:04.664222 | 2025-12-03 11:32:04.664317 | TASK [upload-logs : Create log directories] 2025-12-03 11:32:06.497047 | logserver.rdoproject.org | changed 2025-12-03 11:32:06.500084 | 2025-12-03 11:32:06.500151 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-12-03 11:32:06.716461 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005004 2025-12-03 11:32:06.720959 | 2025-12-03 11:32:06.721025 | TASK [upload-logs : Upload logs to log server] 2025-12-03 11:32:09.046125 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-12-03 11:32:09.048943 | 2025-12-03 11:32:09.049011 | LOOP [upload-logs : Compress console log and json output] 2025-12-03 11:32:09.086649 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 11:32:09.095325 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 11:32:09.106064 | 2025-12-03 11:32:09.106134 | LOOP [upload-logs : Upload compressed console log and json output] 2025-12-03 11:32:09.139684 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 11:32:09.139938 | 2025-12-03 11:32:09.143170 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 11:32:09.154287 | 2025-12-03 11:32:09.154414 | LOOP [upload-logs : Upload console log and json output]