2025-12-03 18:22:35.753542 | Job console starting... 2025-12-03 18:22:35.964302 | Updating repositories 2025-12-03 18:22:36.727881 | Preparing job workspace 2025-12-03 18:22:44.035043 | Running Ansible setup... 2025-12-03 18:22:47.533586 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-03 18:22:48.016602 | 2025-12-03 18:22:48.016716 | PLAY [localhost] 2025-12-03 18:22:48.024810 | 2025-12-03 18:22:48.024882 | TASK [Gathering Facts] 2025-12-03 18:22:48.808339 | localhost | ok 2025-12-03 18:22:48.821240 | 2025-12-03 18:22:48.821319 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-12-03 18:22:49.127952 | localhost -> localhost | changed 2025-12-03 18:22:49.133095 | 2025-12-03 18:22:49.133169 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-12-03 18:22:49.804666 | localhost -> localhost | changed 2025-12-03 18:22:49.814880 | 2025-12-03 18:22:49.814968 | TASK [Setup log path fact] 2025-12-03 18:22:49.834821 | localhost | ok 2025-12-03 18:22:49.846271 | 2025-12-03 18:22:49.846335 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-03 18:22:49.874826 | localhost | ok 2025-12-03 18:22:49.882020 | 2025-12-03 18:22:49.882082 | TASK [emit-job-header : Print job information] 2025-12-03 18:22:49.911839 | # Job Information 2025-12-03 18:22:49.912002 | Ansible Version: 2.15.12 2025-12-03 18:22:49.912034 | Job: cifmw-molecule-reproducer 2025-12-03 18:22:49.912058 | Pipeline: github-check 2025-12-03 18:22:49.912079 | Executor: ibm-bm4-ze.softwarefactory-project.io 2025-12-03 18:22:49.912098 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3529 2025-12-03 18:22:49.912117 | Log URL (when completed): https://logserver.rdoproject.org/9a2/rdoproject.org/9a2d2770fc304b35ae064f6f714ac638/ 2025-12-03 18:22:49.912136 | Event ID: e8d43350-d074-11f0-9f5e-1309c6d0a319 2025-12-03 18:22:49.915798 | 2025-12-03 18:22:49.915877 | LOOP [emit-job-header : Print node information] 2025-12-03 18:22:50.006525 | localhost | ok: 2025-12-03 18:22:50.006749 | localhost | # Node Information 2025-12-03 18:22:50.006792 | localhost | Inventory Hostname: controller 2025-12-03 18:22:50.006821 | localhost | Hostname: np0005544597 2025-12-03 18:22:50.006843 | localhost | Username: zuul 2025-12-03 18:22:50.006866 | localhost | Distro: CentOS 9 2025-12-03 18:22:50.006886 | localhost | Provider: ibm-bm4-nodepool 2025-12-03 18:22:50.006905 | localhost | Region: regionOne 2025-12-03 18:22:50.006946 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-12-03 18:22:50.006968 | localhost | Product Name: OpenStack Compute 2025-12-03 18:22:50.006987 | localhost | Interface IP: 192.168.26.204 2025-12-03 18:22:50.031475 | 2025-12-03 18:22:50.031573 | PLAY [all] 2025-12-03 18:22:50.037919 | 2025-12-03 18:22:50.037985 | TASK [Gather network facts] 2025-12-03 18:22:50.468157 | controller | ok 2025-12-03 18:22:50.481416 | 2025-12-03 18:22:50.481479 | TASK [include_role : start-zuul-console] 2025-12-03 18:22:50.502217 | controller | ok 2025-12-03 18:22:50.513619 | 2025-12-03 18:22:50.513680 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-12-03 18:22:50.898871 | controller | ok 2025-12-03 18:22:50.907085 | 2025-12-03 18:22:50.907153 | TASK [include_role : add-build-sshkey] 2025-12-03 18:22:50.928393 | controller | ok 2025-12-03 18:22:50.940836 | 2025-12-03 18:22:50.940897 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-12-03 18:22:51.149256 | controller -> localhost | ok 2025-12-03 18:22:51.155490 | 2025-12-03 18:22:51.155555 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-12-03 18:22:51.177661 | controller | ok 2025-12-03 18:22:51.189581 | controller | included: /var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-12-03 18:22:51.194860 | 2025-12-03 18:22:51.194937 | TASK [add-build-sshkey : Create Temp SSH key] 2025-12-03 18:22:51.715956 | controller -> localhost | Generating public/private rsa key pair. 2025-12-03 18:22:51.716299 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/9a2d2770fc304b35ae064f6f714ac638_id_rsa. 2025-12-03 18:22:51.716334 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/9a2d2770fc304b35ae064f6f714ac638_id_rsa.pub. 2025-12-03 18:22:51.716358 | controller -> localhost | The key fingerprint is: 2025-12-03 18:22:51.716380 | controller -> localhost | SHA256:j3u+Vsgkd/Z8M7likvpcXuAHGDLl61/xaHGwloTr1Gk zuul-build-sshkey 2025-12-03 18:22:51.716400 | controller -> localhost | The key's randomart image is: 2025-12-03 18:22:51.716418 | controller -> localhost | +---[RSA 3072]----+ 2025-12-03 18:22:51.716436 | controller -> localhost | | . | 2025-12-03 18:22:51.716454 | controller -> localhost | | o . | 2025-12-03 18:22:51.716471 | controller -> localhost | | o o. o | 2025-12-03 18:22:51.716489 | controller -> localhost | | . = *+ = | 2025-12-03 18:22:51.716507 | controller -> localhost | | S= *o=E.o| 2025-12-03 18:22:51.716524 | controller -> localhost | | o+ooo=B+| 2025-12-03 18:22:51.716542 | controller -> localhost | | . .oooo==| 2025-12-03 18:22:51.716563 | controller -> localhost | | .+o+++. | 2025-12-03 18:22:51.716581 | controller -> localhost | | .==+oo. | 2025-12-03 18:22:51.716599 | controller -> localhost | +----[SHA256]-----+ 2025-12-03 18:22:51.716650 | controller -> localhost | ok: Runtime: 0:00:00.203020 2025-12-03 18:22:51.722960 | 2025-12-03 18:22:51.723029 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-12-03 18:22:51.754294 | controller | ok 2025-12-03 18:22:51.764165 | controller | included: /var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-12-03 18:22:51.771650 | 2025-12-03 18:22:51.771713 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-12-03 18:22:51.788050 | controller | skipping: Conditional result was False 2025-12-03 18:22:51.794545 | 2025-12-03 18:22:51.794609 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-12-03 18:22:52.253699 | controller | changed 2025-12-03 18:22:52.265416 | 2025-12-03 18:22:52.265489 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-12-03 18:22:52.527350 | controller | ok 2025-12-03 18:22:52.532382 | 2025-12-03 18:22:52.532449 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-12-03 18:22:53.708077 | controller | changed 2025-12-03 18:22:53.712989 | 2025-12-03 18:22:53.713130 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-12-03 18:22:54.936410 | controller | changed 2025-12-03 18:22:54.941198 | 2025-12-03 18:22:54.941268 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-12-03 18:22:54.954862 | controller | skipping: Conditional result was False 2025-12-03 18:22:54.960043 | 2025-12-03 18:22:54.960113 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-12-03 18:22:55.257139 | controller -> localhost | changed 2025-12-03 18:22:55.267084 | 2025-12-03 18:22:55.267163 | TASK [add-build-sshkey : Add back temp key] 2025-12-03 18:22:55.486894 | controller -> localhost | Identity added: /var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/9a2d2770fc304b35ae064f6f714ac638_id_rsa (zuul-build-sshkey) 2025-12-03 18:22:55.487127 | controller -> localhost | ok: Runtime: 0:00:00.006399 2025-12-03 18:22:55.494226 | 2025-12-03 18:22:55.494301 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-12-03 18:22:55.846970 | controller | ok 2025-12-03 18:22:55.851152 | 2025-12-03 18:22:55.851216 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-12-03 18:22:55.885697 | controller | skipping: Conditional result was False 2025-12-03 18:22:55.894545 | 2025-12-03 18:22:55.894609 | TASK [include_role : validate-host] 2025-12-03 18:22:55.911701 | controller | ok 2025-12-03 18:22:55.929179 | 2025-12-03 18:22:55.929238 | TASK [validate-host : Define zuul_info_dir fact] 2025-12-03 18:22:55.956817 | controller | ok 2025-12-03 18:22:55.961184 | 2025-12-03 18:22:55.961244 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-12-03 18:22:56.166744 | controller -> localhost | ok 2025-12-03 18:22:56.173363 | 2025-12-03 18:22:56.173426 | TASK [validate-host : Collect information about the host] 2025-12-03 18:22:56.887948 | controller | ok 2025-12-03 18:22:56.895772 | 2025-12-03 18:22:56.895834 | TASK [validate-host : Sanitize hostname] 2025-12-03 18:22:56.933789 | controller | ok 2025-12-03 18:22:56.938265 | 2025-12-03 18:22:56.938329 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-12-03 18:22:57.295619 | controller -> localhost | changed 2025-12-03 18:22:57.305738 | 2025-12-03 18:22:57.305818 | TASK [validate-host : Collect information about zuul worker] 2025-12-03 18:22:57.712287 | controller | ok 2025-12-03 18:22:57.716829 | 2025-12-03 18:22:57.716897 | TASK [validate-host : Write out all zuul information for each host] 2025-12-03 18:22:58.065114 | controller -> localhost | changed 2025-12-03 18:22:58.074284 | 2025-12-03 18:22:58.074347 | TASK [include_role : prepare-workspace-openshift] 2025-12-03 18:22:58.087080 | controller | skipping: Conditional result was False 2025-12-03 18:22:58.091825 | 2025-12-03 18:22:58.091886 | TASK [include_role : remove-zuul-sshkey] 2025-12-03 18:22:58.105309 | controller | skipping: Conditional result was False 2025-12-03 18:22:58.110322 | 2025-12-03 18:22:58.110384 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-12-03 18:22:58.369308 | controller | ok: "logs" 2025-12-03 18:22:58.369562 | controller | ok: All items complete 2025-12-03 18:22:58.369594 | 2025-12-03 18:22:58.598535 | controller | ok: "artifacts" 2025-12-03 18:22:58.833214 | controller | ok: "docs" 2025-12-03 18:22:58.840972 | 2025-12-03 18:22:58.841080 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-12-03 18:22:59.097412 | controller | changed: "logs" 2025-12-03 18:22:59.331287 | controller | changed: "artifacts" 2025-12-03 18:22:59.553111 | controller | changed: "docs" 2025-12-03 18:22:59.574887 | 2025-12-03 18:22:59.574982 | PLAY RECAP 2025-12-03 18:22:59.575028 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-03 18:22:59.575056 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-03 18:22:59.575075 | 2025-12-03 18:22:59.654651 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-03 18:22:59.655371 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-03 18:23:00.173849 | 2025-12-03 18:23:00.173961 | PLAY [all] 2025-12-03 18:23:00.192472 | 2025-12-03 18:23:00.192540 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-03 18:23:00.241026 | controller | ok 2025-12-03 18:23:00.245700 | 2025-12-03 18:23:00.245789 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-03 18:23:00.639169 | controller | changed 2025-12-03 18:23:00.644563 | 2025-12-03 18:23:00.644634 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-03 18:23:01.911782 | controller | changed 2025-12-03 18:23:01.922190 | 2025-12-03 18:23:01.922258 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-12-03 18:23:02.338359 | controller | changed: 2025-12-03 18:23:02.338504 | controller | { 2025-12-03 18:23:02.338536 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-12-03 18:23:02.338566 | controller | } 2025-12-03 18:23:02.634777 | controller | changed: 2025-12-03 18:23:02.634858 | controller | { 2025-12-03 18:23:02.634891 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-12-03 18:23:02.635000 | controller | } 2025-12-03 18:23:02.928962 | controller | changed: 2025-12-03 18:23:02.929045 | controller | { 2025-12-03 18:23:02.929072 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-12-03 18:23:02.929091 | controller | } 2025-12-03 18:23:03.212345 | controller | changed: 2025-12-03 18:23:03.212411 | controller | { 2025-12-03 18:23:03.212437 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-12-03 18:23:03.212457 | controller | } 2025-12-03 18:23:03.492984 | controller | changed: 2025-12-03 18:23:03.493042 | controller | { 2025-12-03 18:23:03.493067 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-12-03 18:23:03.493085 | controller | } 2025-12-03 18:23:03.774042 | controller | changed: 2025-12-03 18:23:03.774129 | controller | { 2025-12-03 18:23:03.774156 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-12-03 18:23:03.774176 | controller | } 2025-12-03 18:23:04.056392 | controller | changed: 2025-12-03 18:23:04.056514 | controller | { 2025-12-03 18:23:04.056545 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-12-03 18:23:04.056566 | controller | } 2025-12-03 18:23:04.346036 | controller | changed: 2025-12-03 18:23:04.346122 | controller | { 2025-12-03 18:23:04.346149 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-12-03 18:23:04.346169 | controller | } 2025-12-03 18:23:04.640853 | controller | changed: 2025-12-03 18:23:04.640951 | controller | { 2025-12-03 18:23:04.640980 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-12-03 18:23:04.641001 | controller | } 2025-12-03 18:23:04.966614 | controller | changed: 2025-12-03 18:23:04.966686 | controller | { 2025-12-03 18:23:04.966712 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-12-03 18:23:04.966731 | controller | } 2025-12-03 18:23:05.248861 | controller | changed: 2025-12-03 18:23:05.248952 | controller | { 2025-12-03 18:23:05.248980 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-12-03 18:23:05.248999 | controller | } 2025-12-03 18:23:05.559963 | controller | changed: 2025-12-03 18:23:05.560055 | controller | { 2025-12-03 18:23:05.560081 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-12-03 18:23:05.560100 | controller | } 2025-12-03 18:23:05.871638 | controller | changed: 2025-12-03 18:23:05.871830 | controller | { 2025-12-03 18:23:05.871860 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-12-03 18:23:05.871880 | controller | } 2025-12-03 18:23:06.195552 | controller | changed: 2025-12-03 18:23:06.195638 | controller | { 2025-12-03 18:23:06.195664 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-12-03 18:23:06.195683 | controller | } 2025-12-03 18:23:06.513602 | controller | changed: 2025-12-03 18:23:06.513679 | controller | { 2025-12-03 18:23:06.513705 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-12-03 18:23:06.513724 | controller | } 2025-12-03 18:23:06.817676 | controller | changed: 2025-12-03 18:23:06.817736 | controller | { 2025-12-03 18:23:06.817772 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-12-03 18:23:06.817793 | controller | } 2025-12-03 18:23:07.109982 | controller | changed: 2025-12-03 18:23:07.110044 | controller | { 2025-12-03 18:23:07.110070 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-12-03 18:23:07.110089 | controller | } 2025-12-03 18:23:07.406060 | controller | changed: 2025-12-03 18:23:07.406149 | controller | { 2025-12-03 18:23:07.406177 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-12-03 18:23:07.406204 | controller | } 2025-12-03 18:23:07.713237 | controller | changed: 2025-12-03 18:23:07.713326 | controller | { 2025-12-03 18:23:07.713352 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-12-03 18:23:07.713371 | controller | } 2025-12-03 18:23:08.010421 | controller | changed: 2025-12-03 18:23:08.010480 | controller | { 2025-12-03 18:23:08.010507 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-12-03 18:23:08.010528 | controller | } 2025-12-03 18:23:08.292977 | controller | changed: 2025-12-03 18:23:08.293045 | controller | { 2025-12-03 18:23:08.293070 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-12-03 18:23:08.293089 | controller | } 2025-12-03 18:23:08.574798 | controller | changed: 2025-12-03 18:23:08.574853 | controller | { 2025-12-03 18:23:08.574877 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-12-03 18:23:08.574895 | controller | } 2025-12-03 18:23:08.863064 | controller | changed: 2025-12-03 18:23:08.863155 | controller | { 2025-12-03 18:23:08.863181 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-12-03 18:23:08.863201 | controller | } 2025-12-03 18:23:09.139896 | controller | changed: 2025-12-03 18:23:09.139967 | controller | { 2025-12-03 18:23:09.139993 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-12-03 18:23:09.140012 | controller | } 2025-12-03 18:23:09.429524 | controller | changed: 2025-12-03 18:23:09.429574 | controller | { 2025-12-03 18:23:09.429599 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-12-03 18:23:09.429618 | controller | } 2025-12-03 18:23:09.710178 | controller | changed: 2025-12-03 18:23:09.710229 | controller | { 2025-12-03 18:23:09.710254 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-12-03 18:23:09.710272 | controller | } 2025-12-03 18:23:09.725273 | 2025-12-03 18:23:09.725340 | TASK [Set timezone to UTC] 2025-12-03 18:23:10.189580 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-12-03 18:23:10.194171 | 2025-12-03 18:23:10.194232 | TASK [Create nodepool directory] 2025-12-03 18:23:10.445776 | controller | changed 2025-12-03 18:23:10.451146 | 2025-12-03 18:23:10.451210 | TASK [Create nodepool sub_nodes file] 2025-12-03 18:23:11.339936 | controller | changed 2025-12-03 18:23:11.344719 | 2025-12-03 18:23:11.344793 | TASK [Create nodepool sub_nodes_private file] 2025-12-03 18:23:12.225311 | controller | changed 2025-12-03 18:23:12.230148 | 2025-12-03 18:23:12.230210 | LOOP [Populate nodepool sub_nodes file] 2025-12-03 18:23:12.258932 | 2025-12-03 18:23:12.259053 | LOOP [Populate nodepool sub_nodes_private file] 2025-12-03 18:23:12.287194 | 2025-12-03 18:23:12.287314 | TASK [Create nodepool primary file] 2025-12-03 18:23:12.310570 | controller | skipping: Conditional result was False 2025-12-03 18:23:12.315599 | 2025-12-03 18:23:12.315668 | TASK [Create nodepool node_private for this node] 2025-12-03 18:23:13.236014 | controller | changed 2025-12-03 18:23:13.241312 | 2025-12-03 18:23:13.241377 | LOOP [Copy ssh keys to nodepool directory] 2025-12-03 18:23:13.601000 | controller | ok: Item: id_rsa Runtime: 0:00:00.003378 2025-12-03 18:23:13.601196 | 2025-12-03 18:23:13.810141 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.003904 2025-12-03 18:23:13.818164 | 2025-12-03 18:23:13.818272 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-12-03 18:23:14.718139 | controller | changed 2025-12-03 18:23:14.722937 | 2025-12-03 18:23:14.723002 | TASK [Validate sudoers config after edits] 2025-12-03 18:23:14.983007 | controller | /etc/sudoers: parsed OK 2025-12-03 18:23:14.983068 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-12-03 18:23:14.983083 | controller | /etc/sudoers.d/zuul: parsed OK 2025-12-03 18:23:14.983090 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-12-03 18:23:15.247342 | controller | ok: Runtime: 0:00:00.004954 2025-12-03 18:23:15.252185 | 2025-12-03 18:23:15.252245 | TASK [Show the environment passed in to job shell scripts] 2025-12-03 18:23:15.500478 | controller | SHELL=/bin/bash 2025-12-03 18:23:15.500522 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-12-03 18:23:15.500531 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-12-03 18:23:15.500537 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/29/3529/cc293441ff422ca382e4d760aca371c71c87aebe 2025-12-03 18:23:15.500542 | controller | PWD=/home/zuul 2025-12-03 18:23:15.500560 | controller | ZUUL_PIPELINE=github-check 2025-12-03 18:23:15.500610 | controller | LOGNAME=zuul 2025-12-03 18:23:15.500618 | controller | XDG_SESSION_TYPE=tty 2025-12-03 18:23:15.500623 | controller | _=/usr/bin/env 2025-12-03 18:23:15.500628 | controller | MOTD_SHOWN=pam 2025-12-03 18:23:15.500633 | controller | HOME=/home/zuul 2025-12-03 18:23:15.500638 | controller | LANG=en_US.UTF-8 2025-12-03 18:23:15.500650 | controller | SSH_CONNECTION=192.168.26.12 44420 192.168.26.204 22 2025-12-03 18:23:15.500656 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-12-03 18:23:15.500665 | controller | ZUUL_CHANGE_IDS=3529,cc293441ff422ca382e4d760aca371c71c87aebe 2025-12-03 18:23:15.500669 | controller | WORKSPACE=/home/zuul/workspace 2025-12-03 18:23:15.500675 | controller | XDG_SESSION_CLASS=user 2025-12-03 18:23:15.500680 | controller | SELINUX_ROLE_REQUESTED= 2025-12-03 18:23:15.500685 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-12-03 18:23:15.500689 | controller | USER=zuul 2025-12-03 18:23:15.500694 | controller | ZUUL_VOTING=True 2025-12-03 18:23:15.500699 | controller | BUILD_TIMEOUT=5400000 2025-12-03 18:23:15.500704 | controller | SELINUX_USE_CURRENT_RANGE= 2025-12-03 18:23:15.500708 | controller | SHLVL=1 2025-12-03 18:23:15.500714 | controller | ZUUL_PATCHSET=cc293441ff422ca382e4d760aca371c71c87aebe 2025-12-03 18:23:15.500719 | controller | XDG_SESSION_ID=1 2025-12-03 18:23:15.500723 | controller | ZUUL_BRANCH=main 2025-12-03 18:23:15.500728 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-12-03 18:23:15.500733 | controller | SSH_CLIENT=192.168.26.12 44420 22 2025-12-03 18:23:15.500738 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-12-03 18:23:15.500743 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-12-03 18:23:15.500748 | controller | which_declare=declare -f 2025-12-03 18:23:15.500753 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-12-03 18:23:15.500758 | controller | SELINUX_LEVEL_REQUESTED= 2025-12-03 18:23:15.500763 | controller | ZUUL_CHANGE=3529 2025-12-03 18:23:15.500767 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-12-03 18:23:15.500772 | controller | ZUUL_UUID=9a2d2770fc304b35ae064f6f714ac638 2025-12-03 18:23:15.500777 | controller | BASH_FUNC_which%%=() { ( alias; 2025-12-03 18:23:15.500782 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-12-03 18:23:15.500787 | controller | } 2025-12-03 18:23:15.778602 | controller | ok: Runtime: 0:00:00.005177 2025-12-03 18:23:15.783619 | 2025-12-03 18:23:15.783678 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-12-03 18:23:15.797335 | controller | skipping: Conditional result was False 2025-12-03 18:23:15.802652 | 2025-12-03 18:23:15.802715 | TASK [Symlink /home/zuul-worker/workspace] 2025-12-03 18:23:16.346461 | controller | skipping: Conditional result was False 2025-12-03 18:23:16.352141 | 2025-12-03 18:23:16.352208 | TASK [Ensure legacy workspace directory] 2025-12-03 18:23:16.592735 | controller | changed 2025-12-03 18:23:16.610543 | 2025-12-03 18:23:16.610601 | PLAY RECAP 2025-12-03 18:23:16.610646 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-03 18:23:16.610669 | 2025-12-03 18:23:16.699350 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-03 18:23:16.700124 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-03 18:23:17.171166 | 2025-12-03 18:23:17.171261 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-12-03 18:23:17.189629 | 2025-12-03 18:23:17.189700 | TASK [Create zuul-output directory] 2025-12-03 18:23:17.542616 | controller | changed 2025-12-03 18:23:17.547601 | 2025-12-03 18:23:17.547677 | TASK [Slurp Zuul inventory test] 2025-12-03 18:23:17.814536 | controller -> localhost | ok 2025-12-03 18:23:17.820253 | 2025-12-03 18:23:17.820319 | TASK [Save zuul inventory] 2025-12-03 18:23:18.933332 | controller | changed 2025-12-03 18:23:18.938144 | 2025-12-03 18:23:18.938210 | TASK [Save zuul vars without the change_message] 2025-12-03 18:23:19.908564 | controller | changed 2025-12-03 18:23:19.925769 | 2025-12-03 18:23:19.925821 | PLAY RECAP 2025-12-03 18:23:19.925862 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-03 18:23:19.925884 | 2025-12-03 18:23:19.986716 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-03 18:23:19.987509 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-03 18:23:20.517360 | 2025-12-03 18:23:20.517470 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-12-03 18:23:20.536117 | 2025-12-03 18:23:20.536188 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-12-03 18:23:20.553929 | controller | ok 2025-12-03 18:23:20.570088 | 2025-12-03 18:23:20.570169 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-03 18:23:20.593254 | controller | skipping: Conditional result was False 2025-12-03 18:23:20.598677 | 2025-12-03 18:23:20.598748 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-03 18:23:20.951202 | controller | ok 2025-12-03 18:23:20.956343 | 2025-12-03 18:23:20.956409 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-03 18:23:21.869514 | controller | ok 2025-12-03 18:23:21.878593 | 2025-12-03 18:23:21.878658 | TASK [Prepare workspace] 2025-12-03 18:23:21.896427 | controller | ok 2025-12-03 18:23:21.912110 | 2025-12-03 18:23:21.912175 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-12-03 18:23:22.245135 | controller | ok 2025-12-03 18:23:22.250614 | 2025-12-03 18:23:22.250678 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-12-03 18:23:24.422037 | controller | Output suppressed because no_log was given 2025-12-03 18:23:24.430613 | 2025-12-03 18:23:24.430676 | LOOP [Create zuul-output directory] 2025-12-03 18:23:24.660814 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-12-03 18:23:24.866542 | controller | ok: "/home/zuul/zuul-output/logs" 2025-12-03 18:23:24.877245 | 2025-12-03 18:23:24.877336 | TASK [Install required packages] 2025-12-03 18:23:57.407067 | controller | ok: Nothing to do 2025-12-03 18:23:57.412070 | 2025-12-03 18:23:57.412132 | TASK [Install venv] 2025-12-03 18:24:53.070503 | controller | changed 2025-12-03 18:24:53.093788 | 2025-12-03 18:24:53.093858 | PLAY RECAP 2025-12-03 18:24:53.093902 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-03 18:24:53.093948 | 2025-12-03 18:24:53.160875 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-03 18:24:53.161632 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-03 18:24:53.639181 | 2025-12-03 18:24:53.639271 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-12-03 18:24:53.657861 | 2025-12-03 18:24:53.657944 | TASK [Gather required facts] 2025-12-03 18:24:54.153724 | controller | ok 2025-12-03 18:24:54.158479 | 2025-12-03 18:24:54.158613 | TASK [Load environment var if instructed to] 2025-12-03 18:24:54.173027 | controller | skipping: Conditional result was False 2025-12-03 18:24:54.178389 | 2025-12-03 18:24:54.178463 | TASK [Ensure group_vars dir exists] 2025-12-03 18:24:54.510470 | controller | ok 2025-12-03 18:24:54.516225 | 2025-12-03 18:24:54.516288 | TASK [Print related variables] 2025-12-03 18:24:54.544446 | controller | ok: 2025-12-03 18:24:54.544550 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2025-12-03 18:24:54.544578 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2025-12-03 18:24:54.549126 | 2025-12-03 18:24:54.549186 | TASK [Run molecule] 2025-12-03 18:24:55.465726 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-12-03 18:24:55.719215 | controller | INFO Performing prerun with role_name_check=0... 2025-12-03 18:25:11.593878 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.594272 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.594698 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.595112 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.595549 | controller | WARNING Another version of 'cifmw.general' 1.0.0+cc293441 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+cc293441 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.595952 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.596359 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.596773 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.597181 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.597589 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.597973 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.598391 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.598804 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.599216 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.599639 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 18:25:11.608410 | controller | INFO Running crc_layout > prepare 2025-12-03 18:25:12.252026 | controller | 2025-12-03 18:25:12.252227 | controller | PLAY [Prepare] ***************************************************************** 2025-12-03 18:25:12.252441 | controller | 2025-12-03 18:25:12.252587 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-03 18:25:12.252819 | controller | Wednesday 03 December 2025 18:25:12 +0000 (0:00:00.018) 0:00:00.018 **** 2025-12-03 18:25:13.068086 | controller | ok: [instance] 2025-12-03 18:25:13.068228 | controller | 2025-12-03 18:25:13.068370 | controller | TASK [Create custom basedir] *************************************************** 2025-12-03 18:25:13.068513 | controller | Wednesday 03 December 2025 18:25:13 +0000 (0:00:00.816) 0:00:00.835 **** 2025-12-03 18:25:13.353823 | controller | changed: [instance] 2025-12-03 18:25:13.353981 | controller | 2025-12-03 18:25:13.354216 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-12-03 18:25:13.354357 | controller | Wednesday 03 December 2025 18:25:13 +0000 (0:00:00.285) 0:00:01.121 **** 2025-12-03 18:25:13.370757 | controller | skipping: [instance] 2025-12-03 18:25:13.370941 | controller | 2025-12-03 18:25:13.371167 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-12-03 18:25:13.371355 | controller | Wednesday 03 December 2025 18:25:13 +0000 (0:00:00.016) 0:00:01.138 **** 2025-12-03 18:25:13.408694 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-12-03 18:25:13.408886 | controller | 2025-12-03 18:25:13.409057 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-12-03 18:25:13.409296 | controller | Wednesday 03 December 2025 18:25:13 +0000 (0:00:00.037) 0:00:01.176 **** 2025-12-03 18:25:13.670783 | controller | ok: [instance] 2025-12-03 18:25:13.670818 | controller | 2025-12-03 18:25:13.670926 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-12-03 18:25:13.671018 | controller | Wednesday 03 December 2025 18:25:13 +0000 (0:00:00.262) 0:00:01.438 **** 2025-12-03 18:25:13.864933 | controller | ok: [instance] 2025-12-03 18:25:13.864987 | controller | 2025-12-03 18:25:13.865092 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-12-03 18:25:13.865196 | controller | Wednesday 03 December 2025 18:25:13 +0000 (0:00:00.194) 0:00:01.632 **** 2025-12-03 18:25:14.502377 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-12-03 18:25:14.502451 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-12-03 18:25:14.502567 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-12-03 18:25:14.502672 | controller | 2025-12-03 18:25:14.502777 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-12-03 18:25:14.502866 | controller | Wednesday 03 December 2025 18:25:14 +0000 (0:00:00.637) 0:00:02.269 **** 2025-12-03 18:25:14.558214 | controller | 2025-12-03 18:25:14.558410 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-03 18:25:14.558585 | controller | Wednesday 03 December 2025 18:25:14 +0000 (0:00:00.055) 0:00:02.325 **** 2025-12-03 18:25:15.052923 | controller | changed: [instance] => (item=tmp) 2025-12-03 18:25:15.053112 | controller | changed: [instance] => (item=artifacts/repositories) 2025-12-03 18:25:15.053327 | controller | changed: [instance] => (item=venv/repo_setup) 2025-12-03 18:25:15.053491 | controller | 2025-12-03 18:25:15.053602 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-03 18:25:15.053689 | controller | Wednesday 03 December 2025 18:25:15 +0000 (0:00:00.494) 0:00:02.820 **** 2025-12-03 18:25:15.800116 | controller | ok: [instance] 2025-12-03 18:25:15.800172 | controller | 2025-12-03 18:25:15.800432 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-03 18:25:16.810588 | controller | Wednesday 03 December 2025 18:25:15 +0000 (0:00:00.747) 0:00:03.567 **** 2025-12-03 18:25:16.810627 | controller | changed: [instance] 2025-12-03 18:25:24.254978 | controller | 2025-12-03 18:25:24.255016 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-03 18:25:24.255024 | controller | Wednesday 03 December 2025 18:25:16 +0000 (0:00:01.009) 0:00:04.577 **** 2025-12-03 18:25:24.255050 | controller | changed: [instance] 2025-12-03 18:25:24.940129 | controller | 2025-12-03 18:25:24.940179 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-03 18:25:24.940189 | controller | Wednesday 03 December 2025 18:25:24 +0000 (0:00:07.444) 0:00:12.021 **** 2025-12-03 18:25:24.940201 | controller | changed: [instance] 2025-12-03 18:25:24.961724 | controller | 2025-12-03 18:25:24.961748 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-03 18:25:24.961757 | controller | Wednesday 03 December 2025 18:25:24 +0000 (0:00:00.685) 0:00:12.707 **** 2025-12-03 18:25:24.961767 | controller | skipping: [instance] 2025-12-03 18:25:25.727398 | controller | 2025-12-03 18:25:25.727426 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-03 18:25:25.727434 | controller | Wednesday 03 December 2025 18:25:24 +0000 (0:00:00.021) 0:00:12.728 **** 2025-12-03 18:25:25.727444 | controller | changed: [instance] 2025-12-03 18:25:25.762848 | controller | 2025-12-03 18:25:25.762864 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-03 18:25:25.762871 | controller | Wednesday 03 December 2025 18:25:25 +0000 (0:00:00.765) 0:00:13.494 **** 2025-12-03 18:25:25.762879 | controller | skipping: [instance] 2025-12-03 18:25:25.796183 | controller | 2025-12-03 18:25:25.796337 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-03 18:25:25.796353 | controller | Wednesday 03 December 2025 18:25:25 +0000 (0:00:00.035) 0:00:13.529 **** 2025-12-03 18:25:25.796371 | controller | skipping: [instance] 2025-12-03 18:25:25.830413 | controller | 2025-12-03 18:25:25.830434 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-03 18:25:25.830441 | controller | Wednesday 03 December 2025 18:25:25 +0000 (0:00:00.033) 0:00:13.563 **** 2025-12-03 18:25:25.830450 | controller | skipping: [instance] 2025-12-03 18:25:26.340962 | controller | 2025-12-03 18:25:26.340994 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-03 18:25:26.341001 | controller | Wednesday 03 December 2025 18:25:25 +0000 (0:00:00.034) 0:00:13.597 **** 2025-12-03 18:25:26.341011 | controller | changed: [instance] 2025-12-03 18:25:26.758194 | controller | 2025-12-03 18:25:26.758223 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-03 18:25:26.758232 | controller | Wednesday 03 December 2025 18:25:26 +0000 (0:00:00.510) 0:00:14.107 **** 2025-12-03 18:25:26.758243 | controller | changed: [instance] 2025-12-03 18:25:26.784179 | controller | 2025-12-03 18:25:26.784213 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-03 18:25:26.784222 | controller | Wednesday 03 December 2025 18:25:26 +0000 (0:00:00.417) 0:00:14.525 **** 2025-12-03 18:25:26.784235 | controller | skipping: [instance] 2025-12-03 18:25:26.811847 | controller | 2025-12-03 18:25:26.811880 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-03 18:25:26.811890 | controller | Wednesday 03 December 2025 18:25:26 +0000 (0:00:00.025) 0:00:14.551 **** 2025-12-03 18:25:26.811903 | controller | skipping: [instance] 2025-12-03 18:25:26.839845 | controller | 2025-12-03 18:25:26.839868 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-03 18:25:26.839877 | controller | Wednesday 03 December 2025 18:25:26 +0000 (0:00:00.027) 0:00:14.578 **** 2025-12-03 18:25:26.839887 | controller | skipping: [instance] 2025-12-03 18:25:26.890190 | controller | 2025-12-03 18:25:26.890228 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-03 18:25:26.890237 | controller | Wednesday 03 December 2025 18:25:26 +0000 (0:00:00.028) 0:00:14.607 **** 2025-12-03 18:25:26.890250 | controller | ok: [instance] 2025-12-03 18:25:26.916189 | controller | 2025-12-03 18:25:26.916230 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-03 18:25:26.916239 | controller | Wednesday 03 December 2025 18:25:26 +0000 (0:00:00.050) 0:00:14.657 **** 2025-12-03 18:25:26.916261 | controller | skipping: [instance] 2025-12-03 18:25:26.941666 | controller | 2025-12-03 18:25:26.941692 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-03 18:25:26.941701 | controller | Wednesday 03 December 2025 18:25:26 +0000 (0:00:00.025) 0:00:14.683 **** 2025-12-03 18:25:26.941712 | controller | skipping: [instance] 2025-12-03 18:25:26.941800 | controller | 2025-12-03 18:25:26.941967 | controller | TASK [Download the RPM] ******************************************************** 2025-12-03 18:25:26.942089 | controller | Wednesday 03 December 2025 18:25:26 +0000 (0:00:00.025) 0:00:14.709 **** 2025-12-03 18:25:26.968445 | controller | skipping: [instance] 2025-12-03 18:25:26.968607 | controller | 2025-12-03 18:25:26.968751 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-03 18:25:26.968896 | controller | Wednesday 03 December 2025 18:25:26 +0000 (0:00:00.026) 0:00:14.736 **** 2025-12-03 18:25:26.994689 | controller | skipping: [instance] 2025-12-03 18:25:26.994860 | controller | 2025-12-03 18:25:26.994986 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-03 18:25:26.995170 | controller | Wednesday 03 December 2025 18:25:26 +0000 (0:00:00.026) 0:00:14.762 **** 2025-12-03 18:25:27.022061 | controller | skipping: [instance] 2025-12-03 18:25:27.022224 | controller | 2025-12-03 18:25:27.022329 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-03 18:25:27.022450 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.027) 0:00:14.789 **** 2025-12-03 18:25:27.050354 | controller | skipping: [instance] 2025-12-03 18:25:27.050512 | controller | 2025-12-03 18:25:27.050675 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-03 18:25:27.050805 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.028) 0:00:14.817 **** 2025-12-03 18:25:27.076200 | controller | skipping: [instance] 2025-12-03 18:25:27.076349 | controller | 2025-12-03 18:25:27.076451 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-03 18:25:27.076559 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.025) 0:00:14.843 **** 2025-12-03 18:25:27.248514 | controller | ok: [instance] 2025-12-03 18:25:27.248676 | controller | 2025-12-03 18:25:27.248791 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-03 18:25:27.248909 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.172) 0:00:15.015 **** 2025-12-03 18:25:27.448199 | controller | changed: [instance] 2025-12-03 18:25:27.664209 | controller | 2025-12-03 18:25:27.664258 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-03 18:25:27.664273 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.199) 0:00:15.215 **** 2025-12-03 18:25:27.664292 | controller | changed: [instance] 2025-12-03 18:25:27.684200 | controller | 2025-12-03 18:25:27.684248 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-03 18:25:27.684259 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.215) 0:00:15.431 **** 2025-12-03 18:25:27.684276 | controller | skipping: [instance] 2025-12-03 18:25:27.684309 | controller | 2025-12-03 18:25:27.684321 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-03 18:25:27.704000 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.020) 0:00:15.451 **** 2025-12-03 18:25:27.704070 | controller | skipping: [instance] 2025-12-03 18:25:27.724126 | controller | 2025-12-03 18:25:27.724148 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-03 18:25:27.724157 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.019) 0:00:15.471 **** 2025-12-03 18:25:27.724168 | controller | skipping: [instance] 2025-12-03 18:25:27.724250 | controller | 2025-12-03 18:25:27.724268 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-03 18:25:27.724280 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.020) 0:00:15.491 **** 2025-12-03 18:25:27.745952 | controller | skipping: [instance] 2025-12-03 18:25:27.766069 | controller | 2025-12-03 18:25:27.766090 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-03 18:25:27.766106 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.021) 0:00:15.513 **** 2025-12-03 18:25:27.766117 | controller | skipping: [instance] 2025-12-03 18:25:27.786514 | controller | 2025-12-03 18:25:27.786535 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-03 18:25:27.786544 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.020) 0:00:15.533 **** 2025-12-03 18:25:27.786558 | controller | skipping: [instance] 2025-12-03 18:25:27.802298 | controller | 2025-12-03 18:25:27.802318 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-03 18:25:27.802326 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.020) 0:00:15.553 **** 2025-12-03 18:25:27.802336 | controller | skipping: [instance] 2025-12-03 18:25:27.802497 | controller | 2025-12-03 18:25:27.802692 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-03 18:25:27.802831 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.016) 0:00:15.569 **** 2025-12-03 18:25:27.828316 | controller | skipping: [instance] 2025-12-03 18:25:27.828492 | controller | 2025-12-03 18:25:27.828668 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-03 18:25:27.828821 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.026) 0:00:15.596 **** 2025-12-03 18:25:27.845385 | controller | skipping: [instance] 2025-12-03 18:25:27.845654 | controller | 2025-12-03 18:25:27.845868 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-03 18:25:27.846000 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.016) 0:00:15.612 **** 2025-12-03 18:25:27.864878 | controller | skipping: [instance] 2025-12-03 18:25:27.865019 | controller | 2025-12-03 18:25:27.865176 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-12-03 18:25:27.865310 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.019) 0:00:15.632 **** 2025-12-03 18:25:27.891946 | controller | skipping: [instance] 2025-12-03 18:25:27.892147 | controller | 2025-12-03 18:25:27.892313 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-12-03 18:25:27.892471 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.027) 0:00:15.659 **** 2025-12-03 18:25:27.921109 | controller | skipping: [instance] 2025-12-03 18:25:27.921282 | controller | 2025-12-03 18:25:27.921455 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-12-03 18:25:27.921611 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.029) 0:00:15.688 **** 2025-12-03 18:25:27.948436 | controller | skipping: [instance] 2025-12-03 18:25:27.948609 | controller | 2025-12-03 18:25:27.948787 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-12-03 18:25:27.948948 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.027) 0:00:15.716 **** 2025-12-03 18:25:27.976174 | controller | skipping: [instance] 2025-12-03 18:25:27.976456 | controller | 2025-12-03 18:25:27.976742 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-12-03 18:25:27.976993 | controller | Wednesday 03 December 2025 18:25:27 +0000 (0:00:00.027) 0:00:15.743 **** 2025-12-03 18:26:11.642184 | controller | ok: [instance] 2025-12-03 18:26:11.642243 | controller | 2025-12-03 18:26:11.642510 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-12-03 18:26:12.765223 | controller | Wednesday 03 December 2025 18:26:11 +0000 (0:00:43.665) 0:00:59.409 **** 2025-12-03 18:26:12.765257 | controller | ok: [instance] 2025-12-03 18:26:12.806961 | controller | 2025-12-03 18:26:12.806996 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-12-03 18:26:12.807009 | controller | Wednesday 03 December 2025 18:26:12 +0000 (0:00:01.123) 0:01:00.532 **** 2025-12-03 18:26:12.807025 | controller | skipping: [instance] 2025-12-03 18:26:12.854249 | controller | 2025-12-03 18:26:12.854296 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-03 18:26:12.854310 | controller | Wednesday 03 December 2025 18:26:12 +0000 (0:00:00.041) 0:01:00.573 **** 2025-12-03 18:26:12.854328 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-12-03 18:26:12.877198 | controller | 2025-12-03 18:26:12.877264 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-03 18:26:12.877283 | controller | Wednesday 03 December 2025 18:26:12 +0000 (0:00:00.047) 0:01:00.621 **** 2025-12-03 18:26:12.877299 | controller | ok: [instance] => 2025-12-03 18:26:21.029165 | controller | cifmw_ci_setup_packages: 2025-12-03 18:26:21.029204 | controller | - bash-completion 2025-12-03 18:26:21.029212 | controller | - ca-certificates 2025-12-03 18:26:21.029218 | controller | - git-core 2025-12-03 18:26:21.029224 | controller | - make 2025-12-03 18:26:21.029229 | controller | - tar 2025-12-03 18:26:21.029235 | controller | - tmux 2025-12-03 18:26:21.029240 | controller | - python3-pip 2025-12-03 18:26:21.029245 | controller | 2025-12-03 18:26:21.029251 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-03 18:26:21.029257 | controller | Wednesday 03 December 2025 18:26:12 +0000 (0:00:00.021) 0:01:00.642 **** 2025-12-03 18:26:21.029268 | controller | changed: [instance] 2025-12-03 18:26:21.629621 | controller | 2025-12-03 18:26:21.629660 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-03 18:26:21.629669 | controller | Wednesday 03 December 2025 18:26:21 +0000 (0:00:08.153) 0:01:08.796 **** 2025-12-03 18:26:21.629680 | controller | ok: [instance] 2025-12-03 18:26:21.827240 | controller | 2025-12-03 18:26:21.827274 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-03 18:26:21.827283 | controller | Wednesday 03 December 2025 18:26:21 +0000 (0:00:00.600) 0:01:09.396 **** 2025-12-03 18:26:21.827293 | controller | changed: [instance] 2025-12-03 18:26:21.827475 | controller | 2025-12-03 18:26:27.767163 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-03 18:26:27.767201 | controller | Wednesday 03 December 2025 18:26:21 +0000 (0:00:00.197) 0:01:09.594 **** 2025-12-03 18:26:27.767216 | controller | changed: [instance] 2025-12-03 18:26:27.767224 | controller | 2025-12-03 18:26:27.767231 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-03 18:26:27.767240 | controller | Wednesday 03 December 2025 18:26:27 +0000 (0:00:05.939) 0:01:15.534 **** 2025-12-03 18:26:27.819029 | controller | ok: [instance] 2025-12-03 18:26:27.819091 | controller | 2025-12-03 18:26:27.819539 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-03 18:26:28.060672 | controller | Wednesday 03 December 2025 18:26:27 +0000 (0:00:00.052) 0:01:15.586 **** 2025-12-03 18:26:28.060715 | controller | changed: [instance] 2025-12-03 18:26:28.317204 | controller | 2025-12-03 18:26:28.317241 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-03 18:26:28.317251 | controller | Wednesday 03 December 2025 18:26:28 +0000 (0:00:00.241) 0:01:15.827 **** 2025-12-03 18:26:28.317263 | controller | changed: [instance] 2025-12-03 18:26:28.333547 | controller | 2025-12-03 18:26:28.333580 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-03 18:26:28.333588 | controller | Wednesday 03 December 2025 18:26:28 +0000 (0:00:00.256) 0:01:16.084 **** 2025-12-03 18:26:28.333598 | controller | skipping: [instance] 2025-12-03 18:26:28.350156 | controller | 2025-12-03 18:26:28.350184 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-03 18:26:28.350193 | controller | Wednesday 03 December 2025 18:26:28 +0000 (0:00:00.016) 0:01:16.100 **** 2025-12-03 18:26:28.350204 | controller | skipping: [instance] 2025-12-03 18:26:28.350511 | controller | 2025-12-03 18:26:28.350545 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-03 18:26:28.366763 | controller | Wednesday 03 December 2025 18:26:28 +0000 (0:00:00.016) 0:01:16.117 **** 2025-12-03 18:26:28.366787 | controller | skipping: [instance] 2025-12-03 18:26:28.383245 | controller | 2025-12-03 18:26:28.383285 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-03 18:26:28.383305 | controller | Wednesday 03 December 2025 18:26:28 +0000 (0:00:00.016) 0:01:16.134 **** 2025-12-03 18:26:28.383322 | controller | skipping: [instance] 2025-12-03 18:26:28.399183 | controller | 2025-12-03 18:26:28.399222 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-03 18:26:28.399241 | controller | Wednesday 03 December 2025 18:26:28 +0000 (0:00:00.016) 0:01:16.150 **** 2025-12-03 18:26:28.399253 | controller | skipping: [instance] 2025-12-03 18:26:28.399319 | controller | 2025-12-03 18:26:28.399340 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-03 18:26:28.399352 | controller | Wednesday 03 December 2025 18:26:28 +0000 (0:00:00.016) 0:01:16.166 **** 2025-12-03 18:26:28.420912 | controller | skipping: [instance] 2025-12-03 18:26:29.327048 | controller | 2025-12-03 18:26:29.327078 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-03 18:26:29.327086 | controller | Wednesday 03 December 2025 18:26:28 +0000 (0:00:00.021) 0:01:16.188 **** 2025-12-03 18:26:29.327095 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-12-03 18:26:29.636130 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-12-03 18:26:29.636159 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-12-03 18:26:29.636167 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-12-03 18:26:29.636173 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-12-03 18:26:29.636179 | controller | 2025-12-03 18:26:29.636184 | controller | TASK [Create secret file] ****************************************************** 2025-12-03 18:26:29.636190 | controller | Wednesday 03 December 2025 18:26:29 +0000 (0:00:00.905) 0:01:17.093 **** 2025-12-03 18:26:29.636205 | controller | changed: [instance] 2025-12-03 18:26:29.636230 | controller | 2025-12-03 18:26:29.637166 | controller | PLAY RECAP ********************************************************************* 2025-12-03 18:26:29.637209 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-12-03 18:26:29.637217 | controller | 2025-12-03 18:26:29.637223 | controller | Wednesday 03 December 2025 18:26:29 +0000 (0:00:00.309) 0:01:17.403 **** 2025-12-03 18:26:29.637229 | controller | =============================================================================== 2025-12-03 18:26:29.637234 | controller | test_deps : Install selinux python libs -------------------------------- 43.67s 2025-12-03 18:26:29.637240 | controller | ci_setup : Install needed packages -------------------------------------- 8.15s 2025-12-03 18:26:29.637245 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.44s 2025-12-03 18:26:29.637250 | controller | ci_setup : Install openshift client ------------------------------------- 5.94s 2025-12-03 18:26:29.637257 | controller | test_deps : Install python yaml libs ------------------------------------ 1.12s 2025-12-03 18:26:29.637282 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.01s 2025-12-03 18:26:29.638551 | controller | ci_setup : Manage directories ------------------------------------------- 0.91s 2025-12-03 18:26:29.692459 | controller | Gathering Facts --------------------------------------------------------- 0.82s 2025-12-03 18:26:29.692492 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.77s 2025-12-03 18:26:29.692500 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.75s 2025-12-03 18:26:29.692505 | controller | repo_setup : Install repo-setup package --------------------------------- 0.69s 2025-12-03 18:26:29.692511 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.64s 2025-12-03 18:26:29.692516 | controller | ci_setup : Gather version of openshift client --------------------------- 0.60s 2025-12-03 18:26:29.692521 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.51s 2025-12-03 18:26:29.692526 | controller | repo_setup : Ensure directories are present ----------------------------- 0.49s 2025-12-03 18:26:29.692531 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.42s 2025-12-03 18:26:29.692536 | controller | Create secret file ------------------------------------------------------ 0.31s 2025-12-03 18:26:29.692542 | controller | Create custom basedir --------------------------------------------------- 0.29s 2025-12-03 18:26:29.692547 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.26s 2025-12-03 18:26:29.692558 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.26s 2025-12-03 18:26:29.692569 | controller | INFO Running crc_layout > converge 2025-12-03 18:26:30.236607 | controller | 2025-12-03 18:26:30.236811 | controller | PLAY [Converge] **************************************************************** 2025-12-03 18:26:30.236949 | controller | 2025-12-03 18:26:30.237110 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-03 18:26:30.237243 | controller | Wednesday 03 December 2025 18:26:30 +0000 (0:00:00.024) 0:00:00.024 **** 2025-12-03 18:26:32.021022 | controller | ok: [instance] 2025-12-03 18:26:32.043774 | controller | 2025-12-03 18:26:32.043810 | controller | TASK [Load networking definition from scenario file] *************************** 2025-12-03 18:26:32.043819 | controller | Wednesday 03 December 2025 18:26:32 +0000 (0:00:01.784) 0:00:01.808 **** 2025-12-03 18:26:32.043828 | controller | ok: [instance] 2025-12-03 18:26:33.867170 | controller | 2025-12-03 18:26:33.867204 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-03 18:26:33.867212 | controller | Wednesday 03 December 2025 18:26:32 +0000 (0:00:00.023) 0:00:01.831 **** 2025-12-03 18:26:33.867223 | controller | changed: [instance] 2025-12-03 18:26:33.867247 | controller | 2025-12-03 18:26:33.867253 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-03 18:26:33.867260 | controller | Wednesday 03 December 2025 18:26:33 +0000 (0:00:01.823) 0:00:03.655 **** 2025-12-03 18:26:33.893159 | controller | ok: [instance] 2025-12-03 18:26:33.893480 | controller | 2025-12-03 18:26:33.911689 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-12-03 18:26:33.911706 | controller | Wednesday 03 December 2025 18:26:33 +0000 (0:00:00.026) 0:00:03.681 **** 2025-12-03 18:26:33.911715 | controller | skipping: [instance] 2025-12-03 18:26:33.955757 | controller | 2025-12-03 18:26:33.955772 | controller | TASK [Build final libvirt layout] ********************************************** 2025-12-03 18:26:33.955778 | controller | Wednesday 03 December 2025 18:26:33 +0000 (0:00:00.018) 0:00:03.699 **** 2025-12-03 18:26:33.955786 | controller | 2025-12-03 18:26:34.044880 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-12-03 18:26:34.044897 | controller | Wednesday 03 December 2025 18:26:33 +0000 (0:00:00.044) 0:00:03.744 **** 2025-12-03 18:26:34.044906 | controller | ok: [instance] 2025-12-03 18:26:34.099292 | controller | 2025-12-03 18:26:34.099344 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-12-03 18:26:34.099360 | controller | Wednesday 03 December 2025 18:26:34 +0000 (0:00:00.088) 0:00:03.832 **** 2025-12-03 18:26:34.099381 | controller | skipping: [instance] 2025-12-03 18:26:34.123314 | controller | 2025-12-03 18:26:34.123355 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-12-03 18:26:34.123369 | controller | Wednesday 03 December 2025 18:26:34 +0000 (0:00:00.054) 0:00:03.886 **** 2025-12-03 18:26:34.123387 | controller | ok: [instance] 2025-12-03 18:26:34.123526 | controller | 2025-12-03 18:26:34.123671 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-12-03 18:26:34.123770 | controller | Wednesday 03 December 2025 18:26:34 +0000 (0:00:00.024) 0:00:03.911 **** 2025-12-03 18:26:34.144584 | controller | ok: [instance] => changed=false 2025-12-03 18:26:34.144787 | controller | msg: All assertions passed 2025-12-03 18:26:34.145021 | controller | 2025-12-03 18:26:34.145325 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-12-03 18:26:34.145503 | controller | Wednesday 03 December 2025 18:26:34 +0000 (0:00:00.021) 0:00:03.932 **** 2025-12-03 18:26:34.183815 | controller | ok: [instance] 2025-12-03 18:26:34.184019 | controller | 2025-12-03 18:26:34.184319 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-12-03 18:26:34.184508 | controller | Wednesday 03 December 2025 18:26:34 +0000 (0:00:00.039) 0:00:03.972 **** 2025-12-03 18:26:34.598211 | controller | ok: [instance] => (item=artifacts) 2025-12-03 18:26:34.598266 | controller | ok: [instance] => (item=logs) 2025-12-03 18:26:34.598275 | controller | 2025-12-03 18:26:34.598283 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-12-03 18:26:34.598299 | controller | Wednesday 03 December 2025 18:26:34 +0000 (0:00:00.414) 0:00:04.386 **** 2025-12-03 18:26:34.670272 | controller | 2025-12-03 18:26:34.857841 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-12-03 18:26:34.857873 | controller | Wednesday 03 December 2025 18:26:34 +0000 (0:00:00.071) 0:00:04.458 **** 2025-12-03 18:26:34.857884 | controller | ok: [instance] 2025-12-03 18:26:35.101570 | controller | 2025-12-03 18:26:35.101601 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-12-03 18:26:35.101609 | controller | Wednesday 03 December 2025 18:26:34 +0000 (0:00:00.186) 0:00:04.645 **** 2025-12-03 18:26:35.101619 | controller | changed: [instance] 2025-12-03 18:26:35.347113 | controller | 2025-12-03 18:26:35.347143 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-12-03 18:26:35.347150 | controller | Wednesday 03 December 2025 18:26:35 +0000 (0:00:00.244) 0:00:04.889 **** 2025-12-03 18:26:35.347160 | controller | ok: [instance] 2025-12-03 18:26:35.347182 | controller | 2025-12-03 18:26:35.347190 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-12-03 18:26:35.347353 | controller | Wednesday 03 December 2025 18:26:35 +0000 (0:00:00.245) 0:00:05.135 **** 2025-12-03 18:26:35.375100 | controller | skipping: [instance] 2025-12-03 18:26:35.375388 | controller | 2025-12-03 18:26:35.392781 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-12-03 18:26:35.392814 | controller | Wednesday 03 December 2025 18:26:35 +0000 (0:00:00.028) 0:00:05.163 **** 2025-12-03 18:26:35.392826 | controller | skipping: [instance] 2025-12-03 18:26:35.412852 | controller | 2025-12-03 18:26:35.412872 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-12-03 18:26:35.412881 | controller | Wednesday 03 December 2025 18:26:35 +0000 (0:00:00.017) 0:00:05.180 **** 2025-12-03 18:26:35.412891 | controller | ok: [instance] 2025-12-03 18:26:35.438752 | controller | 2025-12-03 18:26:35.438772 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-12-03 18:26:35.438787 | controller | Wednesday 03 December 2025 18:26:35 +0000 (0:00:00.019) 0:00:05.200 **** 2025-12-03 18:26:35.438797 | controller | skipping: [instance] 2025-12-03 18:26:43.245728 | controller | 2025-12-03 18:26:43.245760 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-12-03 18:26:43.245768 | controller | Wednesday 03 December 2025 18:26:35 +0000 (0:00:00.025) 0:00:05.226 **** 2025-12-03 18:26:43.245778 | controller | changed: [instance] 2025-12-03 18:26:43.245796 | controller | 2025-12-03 18:26:43.245830 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-12-03 18:26:43.245989 | controller | Wednesday 03 December 2025 18:26:43 +0000 (0:00:07.806) 0:00:13.033 **** 2025-12-03 18:26:43.451790 | controller | changed: [instance] 2025-12-03 18:26:43.932797 | controller | 2025-12-03 18:26:43.932838 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-12-03 18:26:43.932846 | controller | Wednesday 03 December 2025 18:26:43 +0000 (0:00:00.205) 0:00:13.239 **** 2025-12-03 18:26:43.932857 | controller | changed: [instance] 2025-12-03 18:26:44.481700 | controller | 2025-12-03 18:26:44.481732 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-12-03 18:26:44.481742 | controller | Wednesday 03 December 2025 18:26:43 +0000 (0:00:00.481) 0:00:13.720 **** 2025-12-03 18:26:44.481753 | controller | changed: [instance] 2025-12-03 18:26:44.668888 | controller | 2025-12-03 18:26:44.668911 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-12-03 18:26:44.668920 | controller | Wednesday 03 December 2025 18:26:44 +0000 (0:00:00.548) 0:00:14.269 **** 2025-12-03 18:26:44.668931 | controller | ok: [instance] 2025-12-03 18:26:45.282697 | controller | 2025-12-03 18:26:45.282722 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-12-03 18:26:45.282729 | controller | Wednesday 03 December 2025 18:26:44 +0000 (0:00:00.187) 0:00:14.456 **** 2025-12-03 18:26:45.282738 | controller | ok: [instance] 2025-12-03 18:26:46.203140 | controller | 2025-12-03 18:26:46.203173 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-12-03 18:26:46.203190 | controller | Wednesday 03 December 2025 18:26:45 +0000 (0:00:00.613) 0:00:15.070 **** 2025-12-03 18:26:46.203202 | controller | changed: [instance] 2025-12-03 18:26:46.203229 | controller | 2025-12-03 18:26:46.203238 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-12-03 18:26:46.203261 | controller | Wednesday 03 December 2025 18:26:46 +0000 (0:00:00.920) 0:00:15.991 **** 2025-12-03 18:26:46.279205 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-12-03 18:26:46.280202 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-12-03 18:26:46.280236 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-12-03 18:26:46.575099 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-12-03 18:26:46.575119 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-12-03 18:26:46.575127 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-12-03 18:26:46.575132 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-12-03 18:26:46.575138 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-12-03 18:26:46.575143 | controller | 2025-12-03 18:26:46.575149 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-12-03 18:26:46.575154 | controller | Wednesday 03 December 2025 18:26:46 +0000 (0:00:00.075) 0:00:16.067 **** 2025-12-03 18:26:46.575163 | controller | ok: [instance] 2025-12-03 18:26:46.575285 | controller | 2025-12-03 18:26:46.575296 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-12-03 18:26:46.575304 | controller | Wednesday 03 December 2025 18:26:46 +0000 (0:00:00.296) 0:00:16.363 **** 2025-12-03 18:26:46.874006 | controller | ok: [instance] 2025-12-03 18:26:47.168993 | controller | 2025-12-03 18:26:47.169012 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-12-03 18:26:47.169019 | controller | Wednesday 03 December 2025 18:26:46 +0000 (0:00:00.298) 0:00:16.662 **** 2025-12-03 18:26:47.169028 | controller | ok: [instance] 2025-12-03 18:26:47.478832 | controller | 2025-12-03 18:26:47.478851 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-12-03 18:26:47.478859 | controller | Wednesday 03 December 2025 18:26:47 +0000 (0:00:00.295) 0:00:16.957 **** 2025-12-03 18:26:47.478868 | controller | ok: [instance] 2025-12-03 18:26:47.780841 | controller | 2025-12-03 18:26:47.780860 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-12-03 18:26:47.780867 | controller | Wednesday 03 December 2025 18:26:47 +0000 (0:00:00.309) 0:00:17.267 **** 2025-12-03 18:26:47.780875 | controller | ok: [instance] 2025-12-03 18:26:48.074123 | controller | 2025-12-03 18:26:48.074153 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-12-03 18:26:48.074161 | controller | Wednesday 03 December 2025 18:26:47 +0000 (0:00:00.301) 0:00:17.568 **** 2025-12-03 18:26:48.074171 | controller | ok: [instance] 2025-12-03 18:26:48.371718 | controller | 2025-12-03 18:26:48.371742 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-12-03 18:26:48.371750 | controller | Wednesday 03 December 2025 18:26:48 +0000 (0:00:00.293) 0:00:17.862 **** 2025-12-03 18:26:48.371764 | controller | ok: [instance] 2025-12-03 18:26:48.669257 | controller | 2025-12-03 18:26:48.669278 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-12-03 18:26:48.669285 | controller | Wednesday 03 December 2025 18:26:48 +0000 (0:00:00.297) 0:00:18.159 **** 2025-12-03 18:26:48.669300 | controller | ok: [instance] 2025-12-03 18:26:48.968074 | controller | 2025-12-03 18:26:48.968103 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-12-03 18:26:48.968111 | controller | Wednesday 03 December 2025 18:26:48 +0000 (0:00:00.297) 0:00:18.457 **** 2025-12-03 18:26:48.968121 | controller | ok: [instance] 2025-12-03 18:26:49.273080 | controller | 2025-12-03 18:26:49.273103 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-12-03 18:26:49.273111 | controller | Wednesday 03 December 2025 18:26:48 +0000 (0:00:00.298) 0:00:18.755 **** 2025-12-03 18:26:49.273120 | controller | ok: [instance] 2025-12-03 18:26:49.577634 | controller | 2025-12-03 18:26:49.577662 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-12-03 18:26:49.577670 | controller | Wednesday 03 December 2025 18:26:49 +0000 (0:00:00.305) 0:00:19.061 **** 2025-12-03 18:26:49.577679 | controller | ok: [instance] 2025-12-03 18:26:49.892189 | controller | 2025-12-03 18:26:49.892224 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-12-03 18:26:49.892234 | controller | Wednesday 03 December 2025 18:26:49 +0000 (0:00:00.304) 0:00:19.365 **** 2025-12-03 18:26:49.892246 | controller | ok: [instance] 2025-12-03 18:26:50.210134 | controller | 2025-12-03 18:26:50.210165 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-12-03 18:26:50.210173 | controller | Wednesday 03 December 2025 18:26:49 +0000 (0:00:00.314) 0:00:19.680 **** 2025-12-03 18:26:50.210184 | controller | ok: [instance] 2025-12-03 18:26:50.529811 | controller | 2025-12-03 18:26:50.529853 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-12-03 18:26:50.529861 | controller | Wednesday 03 December 2025 18:26:50 +0000 (0:00:00.317) 0:00:19.998 **** 2025-12-03 18:26:50.529872 | controller | ok: [instance] 2025-12-03 18:26:50.846175 | controller | 2025-12-03 18:26:50.846218 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-12-03 18:26:50.846228 | controller | Wednesday 03 December 2025 18:26:50 +0000 (0:00:00.319) 0:00:20.317 **** 2025-12-03 18:26:50.846240 | controller | ok: [instance] 2025-12-03 18:26:50.846273 | controller | 2025-12-03 18:26:50.846283 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-12-03 18:26:51.163160 | controller | Wednesday 03 December 2025 18:26:50 +0000 (0:00:00.316) 0:00:20.634 **** 2025-12-03 18:26:51.163207 | controller | ok: [instance] 2025-12-03 18:26:51.163328 | controller | 2025-12-03 18:26:51.163366 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-12-03 18:26:51.470671 | controller | Wednesday 03 December 2025 18:26:51 +0000 (0:00:00.316) 0:00:20.951 **** 2025-12-03 18:26:51.470707 | controller | ok: [instance] 2025-12-03 18:26:51.786094 | controller | 2025-12-03 18:26:51.786132 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-12-03 18:26:51.786142 | controller | Wednesday 03 December 2025 18:26:51 +0000 (0:00:00.307) 0:00:21.258 **** 2025-12-03 18:26:51.786155 | controller | ok: [instance] 2025-12-03 18:26:52.098106 | controller | 2025-12-03 18:26:52.098136 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-12-03 18:26:52.098144 | controller | Wednesday 03 December 2025 18:26:51 +0000 (0:00:00.315) 0:00:21.573 **** 2025-12-03 18:26:52.098154 | controller | ok: [instance] 2025-12-03 18:26:52.098176 | controller | 2025-12-03 18:26:52.098182 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-12-03 18:26:52.098189 | controller | Wednesday 03 December 2025 18:26:52 +0000 (0:00:00.312) 0:00:21.886 **** 2025-12-03 18:26:52.418577 | controller | ok: [instance] 2025-12-03 18:26:52.730197 | controller | 2025-12-03 18:26:52.730228 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-12-03 18:26:52.730236 | controller | Wednesday 03 December 2025 18:26:52 +0000 (0:00:00.320) 0:00:22.206 **** 2025-12-03 18:26:52.730246 | controller | ok: [instance] 2025-12-03 18:26:52.730270 | controller | 2025-12-03 18:26:52.730278 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-12-03 18:26:52.730384 | controller | Wednesday 03 December 2025 18:26:52 +0000 (0:00:00.311) 0:00:22.518 **** 2025-12-03 18:26:53.036491 | controller | ok: [instance] 2025-12-03 18:26:53.337996 | controller | 2025-12-03 18:26:53.338028 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-12-03 18:26:53.338058 | controller | Wednesday 03 December 2025 18:26:53 +0000 (0:00:00.306) 0:00:22.824 **** 2025-12-03 18:26:53.338072 | controller | ok: [instance] 2025-12-03 18:26:53.655087 | controller | 2025-12-03 18:26:53.655126 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-12-03 18:26:53.655134 | controller | Wednesday 03 December 2025 18:26:53 +0000 (0:00:00.301) 0:00:23.125 **** 2025-12-03 18:26:53.655145 | controller | ok: [instance] 2025-12-03 18:26:53.675005 | controller | 2025-12-03 18:26:53.675052 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-12-03 18:26:53.675064 | controller | Wednesday 03 December 2025 18:26:53 +0000 (0:00:00.316) 0:00:23.442 **** 2025-12-03 18:26:53.675075 | controller | skipping: [instance] 2025-12-03 18:26:53.957866 | controller | 2025-12-03 18:26:53.957897 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-12-03 18:26:53.957905 | controller | Wednesday 03 December 2025 18:26:53 +0000 (0:00:00.020) 0:00:23.463 **** 2025-12-03 18:26:53.957915 | controller | ok: [instance] 2025-12-03 18:26:54.329771 | controller | 2025-12-03 18:26:54.329800 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-12-03 18:26:54.329808 | controller | Wednesday 03 December 2025 18:26:53 +0000 (0:00:00.282) 0:00:23.745 **** 2025-12-03 18:26:54.329817 | controller | ok: [instance] 2025-12-03 18:26:54.622704 | controller | 2025-12-03 18:26:54.622734 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-12-03 18:26:54.622742 | controller | Wednesday 03 December 2025 18:26:54 +0000 (0:00:00.371) 0:00:24.117 **** 2025-12-03 18:26:54.622752 | controller | changed: [instance] 2025-12-03 18:26:54.898209 | controller | 2025-12-03 18:26:54.898236 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-12-03 18:26:54.898244 | controller | Wednesday 03 December 2025 18:26:54 +0000 (0:00:00.293) 0:00:24.410 **** 2025-12-03 18:26:54.898254 | controller | [WARNING]: Reset is not implemented for this connection 2025-12-03 18:26:54.908157 | controller | changed: [instance] 2025-12-03 18:26:54.908204 | controller | 2025-12-03 18:26:54.908214 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-12-03 18:26:54.908222 | controller | Wednesday 03 December 2025 18:26:54 +0000 (0:00:00.270) 0:00:24.680 **** 2025-12-03 18:26:54.908228 | controller | 2025-12-03 18:26:54.908235 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-12-03 18:26:54.908244 | controller | Wednesday 03 December 2025 18:26:54 +0000 (0:00:00.015) 0:00:24.695 **** 2025-12-03 18:26:54.979847 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-12-03 18:26:55.021195 | controller | 2025-12-03 18:26:55.021234 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-12-03 18:26:55.021244 | controller | Wednesday 03 December 2025 18:26:54 +0000 (0:00:00.072) 0:00:24.767 **** 2025-12-03 18:26:55.021261 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-12-03 18:26:55.067856 | controller | 2025-12-03 18:26:55.067881 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 18:26:55.067890 | controller | Wednesday 03 December 2025 18:26:55 +0000 (0:00:00.040) 0:00:24.808 **** 2025-12-03 18:26:55.067902 | controller | ok: [instance] => (item=compute) 2025-12-03 18:26:55.108614 | controller | ok: [instance] => (item=controller) 2025-12-03 18:26:55.108638 | controller | ok: [instance] => (item=crc) 2025-12-03 18:26:55.108647 | controller | 2025-12-03 18:26:55.108654 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 18:26:55.108661 | controller | Wednesday 03 December 2025 18:26:55 +0000 (0:00:00.046) 0:00:24.855 **** 2025-12-03 18:26:55.108673 | controller | ok: [instance] 2025-12-03 18:26:55.149174 | controller | 2025-12-03 18:26:55.149204 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-03 18:26:55.149226 | controller | Wednesday 03 December 2025 18:26:55 +0000 (0:00:00.040) 0:00:24.896 **** 2025-12-03 18:26:55.149241 | controller | ok: [instance] => changed=false 2025-12-03 18:26:55.149508 | controller | msg: All assertions passed 2025-12-03 18:26:55.149660 | controller | 2025-12-03 18:26:55.149795 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-12-03 18:26:55.149946 | controller | Wednesday 03 December 2025 18:26:55 +0000 (0:00:00.040) 0:00:24.937 **** 2025-12-03 18:26:55.188368 | controller | 2025-12-03 18:26:55.188636 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-12-03 18:26:55.188904 | controller | Wednesday 03 December 2025 18:26:55 +0000 (0:00:00.039) 0:00:24.976 **** 2025-12-03 18:26:55.274541 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-12-03 18:26:55.274709 | controller | ok: [instance] => (item={}) 2025-12-03 18:26:55.274845 | controller | 2025-12-03 18:26:55.274975 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-12-03 18:26:55.275126 | controller | Wednesday 03 December 2025 18:26:55 +0000 (0:00:00.085) 0:00:25.062 **** 2025-12-03 18:26:55.291641 | controller | skipping: [instance] 2025-12-03 18:26:55.291940 | controller | 2025-12-03 18:26:55.292240 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-12-03 18:26:55.292499 | controller | Wednesday 03 December 2025 18:26:55 +0000 (0:00:00.017) 0:00:25.079 **** 2025-12-03 18:26:55.495740 | controller | ok: [instance] 2025-12-03 18:26:55.495904 | controller | 2025-12-03 18:26:55.496058 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-12-03 18:26:55.496205 | controller | Wednesday 03 December 2025 18:26:55 +0000 (0:00:00.204) 0:00:25.284 **** 2025-12-03 18:26:55.821638 | controller | changed: [instance] 2025-12-03 18:26:56.539064 | controller | 2025-12-03 18:26:56.539096 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-12-03 18:26:56.539104 | controller | Wednesday 03 December 2025 18:26:55 +0000 (0:00:00.325) 0:00:25.609 **** 2025-12-03 18:26:56.539114 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-12-03 18:26:56.564146 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-12-03 18:26:56.564178 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-12-03 18:26:56.564186 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-12-03 18:26:56.564193 | controller | 2025-12-03 18:26:56.564200 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-12-03 18:26:56.564206 | controller | Wednesday 03 December 2025 18:26:56 +0000 (0:00:00.717) 0:00:26.326 **** 2025-12-03 18:26:56.564217 | controller | skipping: [instance] 2025-12-03 18:26:56.564251 | controller | 2025-12-03 18:26:56.564261 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-12-03 18:26:56.564279 | controller | Wednesday 03 December 2025 18:26:56 +0000 (0:00:00.025) 0:00:26.352 **** 2025-12-03 18:26:56.924267 | controller | changed: [instance] 2025-12-03 18:26:56.924749 | controller | 2025-12-03 18:26:56.924765 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-12-03 18:26:56.924775 | controller | Wednesday 03 December 2025 18:26:56 +0000 (0:00:00.351) 0:00:26.703 **** 2025-12-03 18:26:57.336186 | controller | 2025-12-03 18:26:57.336216 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-03 18:26:57.336224 | controller | Wednesday 03 December 2025 18:26:56 +0000 (0:00:00.008) 0:00:26.712 **** 2025-12-03 18:26:57.336240 | controller | changed: [instance] 2025-12-03 18:26:57.408597 | controller | 2025-12-03 18:26:57.408623 | controller | TASK [Ensure no default networks exists] *************************************** 2025-12-03 18:26:57.408631 | controller | Wednesday 03 December 2025 18:26:57 +0000 (0:00:00.411) 0:00:27.123 **** 2025-12-03 18:26:57.408641 | controller | 2025-12-03 18:26:58.574055 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-12-03 18:26:58.574085 | controller | Wednesday 03 December 2025 18:26:57 +0000 (0:00:00.072) 0:00:27.196 **** 2025-12-03 18:26:58.574095 | controller | ok: [instance] 2025-12-03 18:26:58.790172 | controller | 2025-12-03 18:26:58.790206 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-12-03 18:26:58.790216 | controller | Wednesday 03 December 2025 18:26:58 +0000 (0:00:01.165) 0:00:28.361 **** 2025-12-03 18:26:58.790228 | controller | ok: [instance] 2025-12-03 18:26:58.790394 | controller | 2025-12-03 18:26:58.790418 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-12-03 18:26:59.266499 | controller | Wednesday 03 December 2025 18:26:58 +0000 (0:00:00.216) 0:00:28.578 **** 2025-12-03 18:26:59.266524 | controller | ok: [instance] 2025-12-03 18:26:59.474117 | controller | 2025-12-03 18:26:59.474150 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-12-03 18:26:59.474158 | controller | Wednesday 03 December 2025 18:26:59 +0000 (0:00:00.476) 0:00:29.054 **** 2025-12-03 18:26:59.474168 | controller | ok: [instance] 2025-12-03 18:26:59.474193 | controller | 2025-12-03 18:26:59.474428 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-12-03 18:27:00.575807 | controller | Wednesday 03 December 2025 18:26:59 +0000 (0:00:00.207) 0:00:29.262 **** 2025-12-03 18:27:00.575832 | controller | ok: [instance] 2025-12-03 18:27:00.866208 | controller | 2025-12-03 18:27:00.866244 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-12-03 18:27:00.866253 | controller | Wednesday 03 December 2025 18:27:00 +0000 (0:00:01.101) 0:00:30.363 **** 2025-12-03 18:27:00.866272 | controller | ok: [instance] 2025-12-03 18:27:00.866302 | controller | 2025-12-03 18:27:00.866312 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-12-03 18:27:00.866338 | controller | Wednesday 03 December 2025 18:27:00 +0000 (0:00:00.290) 0:00:30.654 **** 2025-12-03 18:27:01.147013 | controller | changed: [instance] 2025-12-03 18:27:01.431586 | controller | 2025-12-03 18:27:01.431620 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-12-03 18:27:01.431628 | controller | Wednesday 03 December 2025 18:27:01 +0000 (0:00:00.280) 0:00:30.934 **** 2025-12-03 18:27:01.431638 | controller | changed: [instance] 2025-12-03 18:27:01.944749 | controller | 2025-12-03 18:27:01.944772 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-12-03 18:27:01.944779 | controller | Wednesday 03 December 2025 18:27:01 +0000 (0:00:00.284) 0:00:31.219 **** 2025-12-03 18:27:01.944788 | controller | changed: [instance] => (item=arptables) 2025-12-03 18:27:02.241108 | controller | changed: [instance] => (item=iptables) 2025-12-03 18:27:02.241135 | controller | changed: [instance] => (item=ip6tables) 2025-12-03 18:27:02.241143 | controller | 2025-12-03 18:27:02.241149 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-12-03 18:27:02.241154 | controller | Wednesday 03 December 2025 18:27:01 +0000 (0:00:00.512) 0:00:31.732 **** 2025-12-03 18:27:02.241164 | controller | ok: [instance] 2025-12-03 18:27:02.241543 | controller | 2025-12-03 18:27:02.328120 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-12-03 18:27:02.328168 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.296) 0:00:32.029 **** 2025-12-03 18:27:02.328180 | controller | ok: [instance] 2025-12-03 18:27:02.328196 | controller | 2025-12-03 18:27:02.328202 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-12-03 18:27:02.328209 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.086) 0:00:32.116 **** 2025-12-03 18:27:02.367679 | controller | 2025-12-03 18:27:02.367767 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-12-03 18:27:02.367882 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.039) 0:00:32.156 **** 2025-12-03 18:27:02.388218 | controller | skipping: [instance] 2025-12-03 18:27:02.388361 | controller | 2025-12-03 18:27:02.388463 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-12-03 18:27:02.388577 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.020) 0:00:32.176 **** 2025-12-03 18:27:02.408119 | controller | skipping: [instance] 2025-12-03 18:27:02.408173 | controller | 2025-12-03 18:27:02.408330 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 18:27:02.426454 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.019) 0:00:32.196 **** 2025-12-03 18:27:02.426474 | controller | skipping: [instance] 2025-12-03 18:27:02.450170 | controller | 2025-12-03 18:27:02.450232 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-12-03 18:27:02.450246 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.018) 0:00:32.214 **** 2025-12-03 18:27:02.450266 | controller | skipping: [instance] 2025-12-03 18:27:02.484793 | controller | 2025-12-03 18:27:02.484823 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-12-03 18:27:02.484833 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.023) 0:00:32.238 **** 2025-12-03 18:27:02.484845 | controller | ok: [instance] 2025-12-03 18:27:02.513843 | controller | 2025-12-03 18:27:02.513870 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-12-03 18:27:02.513876 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.034) 0:00:32.272 **** 2025-12-03 18:27:02.513884 | controller | skipping: [instance] 2025-12-03 18:27:02.533462 | controller | 2025-12-03 18:27:02.533476 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-12-03 18:27:02.533483 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.029) 0:00:32.302 **** 2025-12-03 18:27:02.533490 | controller | skipping: [instance] 2025-12-03 18:27:02.581991 | controller | 2025-12-03 18:27:02.582012 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-12-03 18:27:02.582020 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.019) 0:00:32.321 **** 2025-12-03 18:27:02.582029 | controller | ok: [instance] 2025-12-03 18:27:02.582230 | controller | 2025-12-03 18:27:02.582395 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-12-03 18:27:02.582521 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.048) 0:00:32.370 **** 2025-12-03 18:27:02.600572 | controller | skipping: [instance] 2025-12-03 18:27:02.600742 | controller | 2025-12-03 18:27:02.600931 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-12-03 18:27:02.601133 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.018) 0:00:32.389 **** 2025-12-03 18:27:02.641758 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-12-03 18:27:02.642104 | controller | 2025-12-03 18:27:02.642382 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-03 18:27:02.642610 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.040) 0:00:32.429 **** 2025-12-03 18:27:02.942544 | controller | ok: [instance -> localhost] 2025-12-03 18:27:07.848193 | controller | 2025-12-03 18:27:07.848227 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-12-03 18:27:07.848236 | controller | Wednesday 03 December 2025 18:27:02 +0000 (0:00:00.300) 0:00:32.730 **** 2025-12-03 18:27:07.848246 | controller | changed: [instance -> localhost] 2025-12-03 18:27:08.047588 | controller | 2025-12-03 18:27:08.047623 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-03 18:27:08.047633 | controller | Wednesday 03 December 2025 18:27:07 +0000 (0:00:04.905) 0:00:37.635 **** 2025-12-03 18:27:08.047644 | controller | changed: [instance] 2025-12-03 18:27:08.364743 | controller | 2025-12-03 18:27:08.364772 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-12-03 18:27:08.364781 | controller | Wednesday 03 December 2025 18:27:08 +0000 (0:00:00.199) 0:00:37.835 **** 2025-12-03 18:27:08.364799 | controller | changed: [instance] 2025-12-03 18:27:09.928704 | controller | 2025-12-03 18:27:09.928734 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-12-03 18:27:09.928742 | controller | Wednesday 03 December 2025 18:27:08 +0000 (0:00:00.317) 0:00:38.152 **** 2025-12-03 18:27:09.928752 | controller | changed: [instance -> localhost] 2025-12-03 18:27:10.256085 | controller | 2025-12-03 18:27:10.256115 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-12-03 18:27:10.256123 | controller | Wednesday 03 December 2025 18:27:09 +0000 (0:00:01.563) 0:00:39.716 **** 2025-12-03 18:27:10.256133 | controller | changed: [instance] 2025-12-03 18:27:10.285453 | controller | 2025-12-03 18:27:10.285472 | controller | TASK [reproducer : Select right domain] **************************************** 2025-12-03 18:27:10.285480 | controller | Wednesday 03 December 2025 18:27:10 +0000 (0:00:00.327) 0:00:40.043 **** 2025-12-03 18:27:10.285489 | controller | ok: [instance] 2025-12-03 18:27:10.394716 | controller | 2025-12-03 18:27:10.394738 | controller | TASK [Create the virtual networks] ********************************************* 2025-12-03 18:27:10.394747 | controller | Wednesday 03 December 2025 18:27:10 +0000 (0:00:00.029) 0:00:40.073 **** 2025-12-03 18:27:10.394757 | controller | 2025-12-03 18:27:10.412164 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-12-03 18:27:10.412203 | controller | Wednesday 03 December 2025 18:27:10 +0000 (0:00:00.109) 0:00:40.182 **** 2025-12-03 18:27:10.412223 | controller | ok: [instance] 2025-12-03 18:27:10.412268 | controller | 2025-12-03 18:27:10.412282 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-12-03 18:27:10.412359 | controller | Wednesday 03 December 2025 18:27:10 +0000 (0:00:00.017) 0:00:40.200 **** 2025-12-03 18:27:10.583160 | controller | ok: [instance] 2025-12-03 18:27:10.583399 | controller | 2025-12-03 18:27:10.583420 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-12-03 18:27:10.610134 | controller | Wednesday 03 December 2025 18:27:10 +0000 (0:00:00.171) 0:00:40.371 **** 2025-12-03 18:27:10.610181 | controller | skipping: [instance] 2025-12-03 18:27:10.610246 | controller | 2025-12-03 18:27:10.610261 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-12-03 18:27:10.610395 | controller | Wednesday 03 December 2025 18:27:10 +0000 (0:00:00.026) 0:00:40.398 **** 2025-12-03 18:27:10.635639 | controller | skipping: [instance] 2025-12-03 18:27:10.635888 | controller | 2025-12-03 18:27:10.636135 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-12-03 18:27:10.636425 | controller | Wednesday 03 December 2025 18:27:10 +0000 (0:00:00.025) 0:00:40.424 **** 2025-12-03 18:27:10.685969 | controller | ok: [instance] 2025-12-03 18:27:10.686223 | controller | 2025-12-03 18:27:10.686549 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-12-03 18:27:10.686780 | controller | Wednesday 03 December 2025 18:27:10 +0000 (0:00:00.050) 0:00:40.474 **** 2025-12-03 18:27:10.796468 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 18:27:10.796632 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 18:27:10.796785 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 18:27:10.796889 | controller | 2025-12-03 18:27:10.797009 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-12-03 18:27:10.797135 | controller | Wednesday 03 December 2025 18:27:10 +0000 (0:00:00.110) 0:00:40.584 **** 2025-12-03 18:27:10.828667 | controller | skipping: [instance] 2025-12-03 18:27:10.828784 | controller | 2025-12-03 18:27:10.828918 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-12-03 18:27:10.829052 | controller | Wednesday 03 December 2025 18:27:10 +0000 (0:00:00.032) 0:00:40.617 **** 2025-12-03 18:27:11.148010 | controller | changed: [instance] 2025-12-03 18:27:11.256695 | controller | 2025-12-03 18:27:11.256718 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-12-03 18:27:11.256727 | controller | Wednesday 03 December 2025 18:27:11 +0000 (0:00:00.318) 0:00:40.935 **** 2025-12-03 18:27:11.256746 | controller | changed: [instance] => (item=Adding compute-0 to computes) 2025-12-03 18:27:11.277644 | controller | changed: [instance] => (item=Adding controller-0 to controllers) 2025-12-03 18:27:11.277665 | controller | changed: [instance] => (item=Adding crc-0 to ocps) 2025-12-03 18:27:11.277673 | controller | 2025-12-03 18:27:11.277679 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-03 18:27:11.277685 | controller | Wednesday 03 December 2025 18:27:11 +0000 (0:00:00.108) 0:00:41.044 **** 2025-12-03 18:27:11.277695 | controller | skipping: [instance] 2025-12-03 18:27:11.300487 | controller | 2025-12-03 18:27:11.300508 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 18:27:11.300516 | controller | Wednesday 03 December 2025 18:27:11 +0000 (0:00:00.021) 0:00:41.065 **** 2025-12-03 18:27:11.300526 | controller | skipping: [instance] 2025-12-03 18:27:11.323114 | controller | 2025-12-03 18:27:11.323161 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-03 18:27:11.323171 | controller | Wednesday 03 December 2025 18:27:11 +0000 (0:00:00.022) 0:00:41.088 **** 2025-12-03 18:27:11.323185 | controller | skipping: [instance] 2025-12-03 18:27:11.323221 | controller | 2025-12-03 18:27:11.323231 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-03 18:27:11.323336 | controller | Wednesday 03 December 2025 18:27:11 +0000 (0:00:00.022) 0:00:41.111 **** 2025-12-03 18:27:11.345629 | controller | skipping: [instance] 2025-12-03 18:27:11.362155 | controller | 2025-12-03 18:27:11.362181 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-03 18:27:11.362191 | controller | Wednesday 03 December 2025 18:27:11 +0000 (0:00:00.022) 0:00:41.133 **** 2025-12-03 18:27:11.362202 | controller | ok: [instance] 2025-12-03 18:27:11.362368 | controller | 2025-12-03 18:27:11.362534 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-03 18:27:11.362688 | controller | Wednesday 03 December 2025 18:27:11 +0000 (0:00:00.016) 0:00:41.150 **** 2025-12-03 18:27:11.433062 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-03 18:27:11.433241 | controller | 2025-12-03 18:27:11.433377 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-03 18:27:11.433510 | controller | Wednesday 03 December 2025 18:27:11 +0000 (0:00:00.070) 0:00:41.221 **** 2025-12-03 18:27:11.448418 | controller | skipping: [instance] 2025-12-03 18:27:11.448590 | controller | 2025-12-03 18:27:11.448752 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-03 18:27:11.448922 | controller | Wednesday 03 December 2025 18:27:11 +0000 (0:00:00.015) 0:00:41.236 **** 2025-12-03 18:27:11.638098 | controller | changed: [instance] 2025-12-03 18:27:11.638186 | controller | 2025-12-03 18:27:11.638202 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-03 18:27:11.638213 | controller | Wednesday 03 December 2025 18:27:11 +0000 (0:00:00.189) 0:00:41.426 **** 2025-12-03 18:27:12.011162 | controller | changed: [instance] 2025-12-03 18:27:12.011215 | controller | 2025-12-03 18:27:12.011428 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-03 18:27:12.090441 | controller | Wednesday 03 December 2025 18:27:12 +0000 (0:00:00.372) 0:00:41.799 **** 2025-12-03 18:27:12.090462 | controller | ok: [instance] 2025-12-03 18:27:12.120441 | controller | 2025-12-03 18:27:12.120457 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-03 18:27:12.120464 | controller | Wednesday 03 December 2025 18:27:12 +0000 (0:00:00.079) 0:00:41.878 **** 2025-12-03 18:27:12.120473 | controller | ok: [instance] 2025-12-03 18:27:12.479168 | controller | 2025-12-03 18:27:12.479203 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-03 18:27:12.479213 | controller | Wednesday 03 December 2025 18:27:12 +0000 (0:00:00.029) 0:00:41.908 **** 2025-12-03 18:27:12.479226 | controller | changed: [instance] 2025-12-03 18:27:12.552759 | controller | 2025-12-03 18:27:12.552799 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-12-03 18:27:12.552809 | controller | Wednesday 03 December 2025 18:27:12 +0000 (0:00:00.358) 0:00:42.266 **** 2025-12-03 18:27:12.552820 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-12-03 18:27:12.599664 | controller | 2025-12-03 18:27:12.599681 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-12-03 18:27:12.599694 | controller | Wednesday 03 December 2025 18:27:12 +0000 (0:00:00.073) 0:00:42.340 **** 2025-12-03 18:27:12.599702 | controller | ok: [instance] => (item=public) 2025-12-03 18:27:13.023150 | controller | ok: [instance] => (item=osp_trunk) 2025-12-03 18:27:13.023184 | controller | 2025-12-03 18:27:13.023194 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-12-03 18:27:13.023201 | controller | Wednesday 03 December 2025 18:27:12 +0000 (0:00:00.046) 0:00:42.387 **** 2025-12-03 18:27:13.023213 | controller | changed: [instance] => (item=cifmw-public) 2025-12-03 18:27:13.584062 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:27:13.584094 | controller | 2025-12-03 18:27:13.584102 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-12-03 18:27:13.584107 | controller | Wednesday 03 December 2025 18:27:13 +0000 (0:00:00.423) 0:00:42.810 **** 2025-12-03 18:27:13.584117 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 18:27:13.982191 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:27:13.982227 | controller | 2025-12-03 18:27:13.982236 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-12-03 18:27:13.982242 | controller | Wednesday 03 December 2025 18:27:13 +0000 (0:00:00.560) 0:00:43.371 **** 2025-12-03 18:27:13.982253 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 18:27:14.386364 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:27:14.386394 | controller | 2025-12-03 18:27:14.386403 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-12-03 18:27:14.386411 | controller | Wednesday 03 December 2025 18:27:13 +0000 (0:00:00.398) 0:00:43.769 **** 2025-12-03 18:27:14.386429 | controller | changed: [instance] => (item=cifmw-public) 2025-12-03 18:27:14.438194 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:27:14.438227 | controller | 2025-12-03 18:27:14.438236 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-12-03 18:27:14.438243 | controller | Wednesday 03 December 2025 18:27:14 +0000 (0:00:00.404) 0:00:44.174 **** 2025-12-03 18:27:14.438254 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-12-03 18:27:14.607117 | controller | 2025-12-03 18:27:14.607151 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-12-03 18:27:14.607159 | controller | Wednesday 03 December 2025 18:27:14 +0000 (0:00:00.051) 0:00:44.226 **** 2025-12-03 18:27:14.607170 | controller | ok: [instance] 2025-12-03 18:27:14.607200 | controller | 2025-12-03 18:27:14.607209 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-12-03 18:27:14.607311 | controller | Wednesday 03 December 2025 18:27:14 +0000 (0:00:00.169) 0:00:44.395 **** 2025-12-03 18:27:14.971960 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 18:27:15.034015 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:27:15.034092 | controller | 2025-12-03 18:27:15.034110 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-12-03 18:27:15.034120 | controller | Wednesday 03 December 2025 18:27:14 +0000 (0:00:00.364) 0:00:44.759 **** 2025-12-03 18:27:15.034130 | controller | 2025-12-03 18:27:15.065186 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-03 18:27:15.065223 | controller | Wednesday 03 December 2025 18:27:15 +0000 (0:00:00.062) 0:00:44.821 **** 2025-12-03 18:27:15.065238 | controller | skipping: [instance] 2025-12-03 18:27:15.065275 | controller | 2025-12-03 18:27:15.065701 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-12-03 18:27:16.219112 | controller | Wednesday 03 December 2025 18:27:15 +0000 (0:00:00.031) 0:00:44.853 **** 2025-12-03 18:27:16.219149 | controller | ok: [instance] 2025-12-03 18:27:16.219174 | controller | 2025-12-03 18:27:16.219181 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-03 18:27:16.219188 | controller | Wednesday 03 December 2025 18:27:16 +0000 (0:00:01.153) 0:00:46.007 **** 2025-12-03 18:27:16.408081 | controller | ok: [instance] 2025-12-03 18:27:16.744866 | controller | 2025-12-03 18:27:16.744911 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-12-03 18:27:16.744920 | controller | Wednesday 03 December 2025 18:27:16 +0000 (0:00:00.189) 0:00:46.196 **** 2025-12-03 18:27:16.744930 | controller | changed: [instance] 2025-12-03 18:27:18.390142 | controller | 2025-12-03 18:27:18.390174 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-12-03 18:27:18.390183 | controller | Wednesday 03 December 2025 18:27:16 +0000 (0:00:00.336) 0:00:46.532 **** 2025-12-03 18:27:18.390194 | controller | changed: [instance] 2025-12-03 18:27:18.390233 | controller | 2025-12-03 18:27:18.390241 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-12-03 18:27:18.390250 | controller | Wednesday 03 December 2025 18:27:18 +0000 (0:00:01.645) 0:00:48.178 **** 2025-12-03 18:27:18.721121 | controller | changed: [instance] 2025-12-03 18:27:18.721218 | controller | 2025-12-03 18:27:18.721248 | controller | TASK [Create extra network configuration] ************************************** 2025-12-03 18:27:18.721259 | controller | Wednesday 03 December 2025 18:27:18 +0000 (0:00:00.330) 0:00:48.509 **** 2025-12-03 18:27:18.751207 | controller | skipping: [instance] 2025-12-03 18:27:18.751233 | controller | 2025-12-03 18:27:18.751241 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-12-03 18:27:18.751251 | controller | Wednesday 03 December 2025 18:27:18 +0000 (0:00:00.029) 0:00:48.538 **** 2025-12-03 18:27:18.776444 | controller | skipping: [instance] 2025-12-03 18:27:19.188183 | controller | 2025-12-03 18:27:19.188217 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-12-03 18:27:19.188232 | controller | Wednesday 03 December 2025 18:27:18 +0000 (0:00:00.025) 0:00:48.564 **** 2025-12-03 18:27:19.188244 | controller | ok: [instance] 2025-12-03 18:27:19.188282 | controller | 2025-12-03 18:27:19.188291 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-12-03 18:27:19.188300 | controller | Wednesday 03 December 2025 18:27:19 +0000 (0:00:00.412) 0:00:48.976 **** 2025-12-03 18:27:19.321334 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 18:27:19.321391 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:27:19.321401 | controller | 2025-12-03 18:27:19.321411 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-12-03 18:27:19.321486 | controller | Wednesday 03 December 2025 18:27:19 +0000 (0:00:00.132) 0:00:49.109 **** 2025-12-03 18:27:20.451124 | controller | ok: [instance] 2025-12-03 18:27:20.451410 | controller | 2025-12-03 18:27:20.451435 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-12-03 18:27:23.935685 | controller | Wednesday 03 December 2025 18:27:20 +0000 (0:00:01.129) 0:00:50.238 **** 2025-12-03 18:27:23.935726 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-12-03 18:27:24.141107 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-12-03 18:27:24.141134 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-12-03 18:27:24.141142 | controller | 2025-12-03 18:27:24.141149 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-12-03 18:27:24.141154 | controller | Wednesday 03 December 2025 18:27:23 +0000 (0:00:03.484) 0:00:53.723 **** 2025-12-03 18:27:24.141164 | controller | changed: [instance] 2025-12-03 18:27:24.141217 | controller | 2025-12-03 18:27:24.141225 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-12-03 18:27:24.141233 | controller | Wednesday 03 December 2025 18:27:24 +0000 (0:00:00.205) 0:00:53.929 **** 2025-12-03 18:27:24.496160 | controller | changed: [instance] 2025-12-03 18:27:24.496240 | controller | 2025-12-03 18:27:24.496253 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-12-03 18:27:24.496317 | controller | Wednesday 03 December 2025 18:27:24 +0000 (0:00:00.354) 0:00:54.284 **** 2025-12-03 18:27:24.891742 | controller | changed: [instance] 2025-12-03 18:27:24.923066 | controller | 2025-12-03 18:27:24.923097 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-12-03 18:27:24.923107 | controller | Wednesday 03 December 2025 18:27:24 +0000 (0:00:00.395) 0:00:54.679 **** 2025-12-03 18:27:24.923120 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-12-03 18:27:25.305484 | controller | 2025-12-03 18:27:25.305513 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-12-03 18:27:25.305521 | controller | Wednesday 03 December 2025 18:27:24 +0000 (0:00:00.031) 0:00:54.711 **** 2025-12-03 18:27:25.305531 | controller | changed: [instance] 2025-12-03 18:27:25.324740 | controller | 2025-12-03 18:27:25.324762 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-12-03 18:27:25.324770 | controller | Wednesday 03 December 2025 18:27:25 +0000 (0:00:00.382) 0:00:55.093 **** 2025-12-03 18:27:25.324781 | controller | skipping: [instance] 2025-12-03 18:27:25.356960 | controller | 2025-12-03 18:27:25.356982 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-12-03 18:27:25.356990 | controller | Wednesday 03 December 2025 18:27:25 +0000 (0:00:00.019) 0:00:55.112 **** 2025-12-03 18:27:25.357000 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-12-03 18:27:25.702154 | controller | 2025-12-03 18:27:25.702187 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-12-03 18:27:25.702197 | controller | Wednesday 03 December 2025 18:27:25 +0000 (0:00:00.032) 0:00:55.145 **** 2025-12-03 18:27:25.702209 | controller | changed: [instance] 2025-12-03 18:27:25.720792 | controller | 2025-12-03 18:27:25.720822 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-12-03 18:27:25.720832 | controller | Wednesday 03 December 2025 18:27:25 +0000 (0:00:00.345) 0:00:55.490 **** 2025-12-03 18:27:25.720843 | controller | skipping: [instance] 2025-12-03 18:27:25.923460 | controller | 2025-12-03 18:27:25.923484 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-12-03 18:27:25.923492 | controller | Wednesday 03 December 2025 18:27:25 +0000 (0:00:00.018) 0:00:55.508 **** 2025-12-03 18:27:25.923501 | controller | ok: [instance] => (item=127.0.0.2) 2025-12-03 18:27:26.571104 | controller | 2025-12-03 18:27:26.571134 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-12-03 18:27:26.571148 | controller | Wednesday 03 December 2025 18:27:25 +0000 (0:00:00.202) 0:00:55.711 **** 2025-12-03 18:27:26.571158 | controller | changed: [instance] 2025-12-03 18:27:26.589608 | controller | 2025-12-03 18:27:26.589640 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-12-03 18:27:26.589649 | controller | Wednesday 03 December 2025 18:27:26 +0000 (0:00:00.647) 0:00:56.358 **** 2025-12-03 18:27:26.589660 | controller | skipping: [instance] 2025-12-03 18:27:26.606867 | controller | 2025-12-03 18:27:26.606886 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-12-03 18:27:26.606893 | controller | Wednesday 03 December 2025 18:27:26 +0000 (0:00:00.018) 0:00:56.377 **** 2025-12-03 18:27:26.606902 | controller | skipping: [instance] 2025-12-03 18:27:26.634186 | controller | 2025-12-03 18:27:26.634224 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-12-03 18:27:26.634233 | controller | Wednesday 03 December 2025 18:27:26 +0000 (0:00:00.017) 0:00:56.394 **** 2025-12-03 18:27:26.634245 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-03 18:27:26.634275 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-12-03 18:27:26.634282 | controller | skipping: [instance] 2025-12-03 18:27:26.634288 | controller | 2025-12-03 18:27:26.634296 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-12-03 18:27:26.746344 | controller | Wednesday 03 December 2025 18:27:26 +0000 (0:00:00.027) 0:00:56.422 **** 2025-12-03 18:27:26.746374 | controller | 2025-12-03 18:27:26.772250 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-03 18:27:26.772288 | controller | Wednesday 03 December 2025 18:27:26 +0000 (0:00:00.112) 0:00:56.534 **** 2025-12-03 18:27:26.772308 | controller | ok: [instance] => changed=false 2025-12-03 18:27:26.772338 | controller | msg: All assertions passed 2025-12-03 18:27:26.772351 | controller | 2025-12-03 18:27:26.772445 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-03 18:27:26.772467 | controller | Wednesday 03 December 2025 18:27:26 +0000 (0:00:00.025) 0:00:56.560 **** 2025-12-03 18:27:26.807961 | controller | ok: [instance] => changed=false 2025-12-03 18:27:27.224664 | controller | msg: All assertions passed 2025-12-03 18:27:27.224695 | controller | 2025-12-03 18:27:27.224703 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-03 18:27:27.224709 | controller | Wednesday 03 December 2025 18:27:26 +0000 (0:00:00.035) 0:00:56.595 **** 2025-12-03 18:27:27.224719 | controller | changed: [instance] 2025-12-03 18:27:27.241089 | controller | 2025-12-03 18:27:27.241111 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-03 18:27:27.241122 | controller | Wednesday 03 December 2025 18:27:27 +0000 (0:00:00.416) 0:00:57.012 **** 2025-12-03 18:27:27.241131 | controller | skipping: [instance] 2025-12-03 18:27:27.241447 | controller | 2025-12-03 18:27:27.262960 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-03 18:27:27.262978 | controller | Wednesday 03 December 2025 18:27:27 +0000 (0:00:00.016) 0:00:57.029 **** 2025-12-03 18:27:27.262989 | controller | skipping: [instance] 2025-12-03 18:27:27.289171 | controller | 2025-12-03 18:27:27.289200 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-03 18:27:27.289208 | controller | Wednesday 03 December 2025 18:27:27 +0000 (0:00:00.021) 0:00:57.051 **** 2025-12-03 18:27:27.289223 | controller | ok: [instance] => changed=false 2025-12-03 18:27:27.289249 | controller | msg: All assertions passed 2025-12-03 18:27:27.289255 | controller | 2025-12-03 18:27:27.289261 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-03 18:27:27.289282 | controller | Wednesday 03 December 2025 18:27:27 +0000 (0:00:00.026) 0:00:57.077 **** 2025-12-03 18:27:27.323151 | controller | ok: [instance] => changed=false 2025-12-03 18:27:27.323200 | controller | msg: All assertions passed 2025-12-03 18:27:27.323209 | controller | 2025-12-03 18:27:27.323231 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-03 18:27:27.323240 | controller | Wednesday 03 December 2025 18:27:27 +0000 (0:00:00.033) 0:00:57.111 **** 2025-12-03 18:27:27.741819 | controller | changed: [instance] 2025-12-03 18:27:27.760162 | controller | 2025-12-03 18:27:27.760191 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-03 18:27:27.760201 | controller | Wednesday 03 December 2025 18:27:27 +0000 (0:00:00.418) 0:00:57.529 **** 2025-12-03 18:27:27.760213 | controller | skipping: [instance] 2025-12-03 18:27:27.760243 | controller | 2025-12-03 18:27:27.760251 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-03 18:27:27.760259 | controller | Wednesday 03 December 2025 18:27:27 +0000 (0:00:00.018) 0:00:57.548 **** 2025-12-03 18:27:27.782537 | controller | skipping: [instance] 2025-12-03 18:27:27.809083 | controller | 2025-12-03 18:27:27.809104 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2025-12-03 18:27:27.809112 | controller | Wednesday 03 December 2025 18:27:27 +0000 (0:00:00.022) 0:00:57.570 **** 2025-12-03 18:27:27.809126 | controller | skipping: [instance] 2025-12-03 18:27:27.809158 | controller | 2025-12-03 18:27:27.809175 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-12-03 18:27:27.809186 | controller | Wednesday 03 December 2025 18:27:27 +0000 (0:00:00.026) 0:00:57.597 **** 2025-12-03 18:27:28.297590 | controller | changed: [instance] => (item=cifmw-public) 2025-12-03 18:27:28.332061 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:27:28.332094 | controller | 2025-12-03 18:27:28.332104 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-03 18:27:28.332112 | controller | Wednesday 03 December 2025 18:27:28 +0000 (0:00:00.488) 0:00:58.085 **** 2025-12-03 18:27:28.332124 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-12-03 18:27:28.657231 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-12-03 18:27:28.657262 | controller | 2025-12-03 18:27:28.657270 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-03 18:27:28.657277 | controller | Wednesday 03 December 2025 18:27:28 +0000 (0:00:00.034) 0:00:58.119 **** 2025-12-03 18:27:28.657287 | controller | ok: [instance] 2025-12-03 18:27:28.695002 | controller | 2025-12-03 18:27:28.695033 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-03 18:27:28.695063 | controller | Wednesday 03 December 2025 18:27:28 +0000 (0:00:00.324) 0:00:58.443 **** 2025-12-03 18:27:28.695074 | controller | ok: [instance] 2025-12-03 18:27:28.901496 | controller | 2025-12-03 18:27:28.901525 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-03 18:27:28.901533 | controller | Wednesday 03 December 2025 18:27:28 +0000 (0:00:00.039) 0:00:58.482 **** 2025-12-03 18:27:28.901543 | controller | ok: [instance] 2025-12-03 18:27:28.935170 | controller | 2025-12-03 18:27:28.935210 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-03 18:27:28.935221 | controller | Wednesday 03 December 2025 18:27:28 +0000 (0:00:00.206) 0:00:58.689 **** 2025-12-03 18:27:28.935236 | controller | ok: [instance] 2025-12-03 18:27:28.935290 | controller | 2025-12-03 18:27:28.935319 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-12-03 18:27:28.935337 | controller | Wednesday 03 December 2025 18:27:28 +0000 (0:00:00.033) 0:00:58.723 **** 2025-12-03 18:27:29.259161 | controller | changed: [instance] 2025-12-03 18:27:29.259189 | controller | 2025-12-03 18:27:29.259196 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-12-03 18:27:29.259205 | controller | Wednesday 03 December 2025 18:27:29 +0000 (0:00:00.324) 0:00:59.047 **** 2025-12-03 18:27:29.592136 | controller | changed: [instance] 2025-12-03 18:27:29.930115 | controller | 2025-12-03 18:27:29.930147 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-12-03 18:27:29.930154 | controller | Wednesday 03 December 2025 18:27:29 +0000 (0:00:00.332) 0:00:59.379 **** 2025-12-03 18:27:29.930165 | controller | changed: [instance] 2025-12-03 18:27:30.026175 | controller | 2025-12-03 18:27:30.026209 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-12-03 18:27:30.026219 | controller | Wednesday 03 December 2025 18:27:29 +0000 (0:00:00.337) 0:00:59.717 **** 2025-12-03 18:27:30.026231 | controller | ok: [instance] 2025-12-03 18:27:30.026263 | controller | 2025-12-03 18:27:30.026480 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-12-03 18:27:30.346231 | controller | Wednesday 03 December 2025 18:27:30 +0000 (0:00:00.096) 0:00:59.814 **** 2025-12-03 18:27:30.346291 | controller | changed: [instance] 2025-12-03 18:27:30.369827 | controller | 2025-12-03 18:27:30.369862 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-03 18:27:30.369872 | controller | Wednesday 03 December 2025 18:27:30 +0000 (0:00:00.319) 0:01:00.134 **** 2025-12-03 18:27:30.369885 | controller | skipping: [instance] 2025-12-03 18:27:30.391805 | controller | 2025-12-03 18:27:30.391828 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 18:27:30.391837 | controller | Wednesday 03 December 2025 18:27:30 +0000 (0:00:00.023) 0:01:00.157 **** 2025-12-03 18:27:30.391847 | controller | skipping: [instance] 2025-12-03 18:27:30.414129 | controller | 2025-12-03 18:27:30.414164 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-03 18:27:30.414174 | controller | Wednesday 03 December 2025 18:27:30 +0000 (0:00:00.022) 0:01:00.179 **** 2025-12-03 18:27:30.414186 | controller | skipping: [instance] 2025-12-03 18:27:30.414457 | controller | 2025-12-03 18:27:30.414484 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-03 18:27:30.437128 | controller | Wednesday 03 December 2025 18:27:30 +0000 (0:00:00.022) 0:01:00.202 **** 2025-12-03 18:27:30.437162 | controller | skipping: [instance] 2025-12-03 18:27:30.456020 | controller | 2025-12-03 18:27:30.456077 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-03 18:27:30.456099 | controller | Wednesday 03 December 2025 18:27:30 +0000 (0:00:00.022) 0:01:00.225 **** 2025-12-03 18:27:30.456114 | controller | ok: [instance] 2025-12-03 18:27:30.538330 | controller | 2025-12-03 18:27:30.538353 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-03 18:27:30.538361 | controller | Wednesday 03 December 2025 18:27:30 +0000 (0:00:00.018) 0:01:00.243 **** 2025-12-03 18:27:30.538373 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-03 18:27:30.538549 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-03 18:27:30.538688 | controller | 2025-12-03 18:27:30.538825 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-03 18:27:30.538968 | controller | Wednesday 03 December 2025 18:27:30 +0000 (0:00:00.082) 0:01:00.326 **** 2025-12-03 18:27:30.556752 | controller | skipping: [instance] 2025-12-03 18:27:30.557073 | controller | 2025-12-03 18:27:30.557342 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-03 18:27:30.557498 | controller | Wednesday 03 December 2025 18:27:30 +0000 (0:00:00.018) 0:01:00.345 **** 2025-12-03 18:27:30.747183 | controller | ok: [instance] 2025-12-03 18:27:30.747229 | controller | 2025-12-03 18:27:30.747451 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-03 18:27:31.119085 | controller | Wednesday 03 December 2025 18:27:30 +0000 (0:00:00.190) 0:01:00.535 **** 2025-12-03 18:27:31.119126 | controller | changed: [instance] 2025-12-03 18:27:31.177692 | controller | 2025-12-03 18:27:31.177720 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-03 18:27:31.177728 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.371) 0:01:00.907 **** 2025-12-03 18:27:31.177738 | controller | ok: [instance] 2025-12-03 18:27:31.207908 | controller | 2025-12-03 18:27:31.207941 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-03 18:27:31.207950 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.058) 0:01:00.965 **** 2025-12-03 18:27:31.207960 | controller | ok: [instance] 2025-12-03 18:27:31.580743 | controller | 2025-12-03 18:27:31.580775 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-03 18:27:31.580783 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.030) 0:01:00.996 **** 2025-12-03 18:27:31.580794 | controller | changed: [instance] 2025-12-03 18:27:31.607450 | controller | 2025-12-03 18:27:31.607470 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-12-03 18:27:31.607477 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.372) 0:01:01.368 **** 2025-12-03 18:27:31.607487 | controller | ok: [instance] 2025-12-03 18:27:31.625557 | controller | 2025-12-03 18:27:31.625572 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-12-03 18:27:31.625578 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.026) 0:01:01.395 **** 2025-12-03 18:27:31.625585 | controller | ok: [instance] 2025-12-03 18:27:31.643181 | controller | 2025-12-03 18:27:31.643203 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-12-03 18:27:31.643211 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.018) 0:01:01.413 **** 2025-12-03 18:27:31.643221 | controller | ok: [instance] 2025-12-03 18:27:31.712214 | controller | 2025-12-03 18:27:31.712248 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-12-03 18:27:31.712257 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.017) 0:01:01.431 **** 2025-12-03 18:27:31.712269 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-12-03 18:27:31.712306 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-12-03 18:27:31.712313 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-12-03 18:27:31.712322 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-12-03 18:27:31.712940 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-12-03 18:27:31.841229 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-12-03 18:27:31.841261 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-12-03 18:27:31.841270 | controller | 2025-12-03 18:27:31.841277 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 18:27:31.841285 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.068) 0:01:01.500 **** 2025-12-03 18:27:31.841296 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-12-03 18:27:31.841493 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-12-03 18:27:31.841666 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-12-03 18:27:31.841819 | controller | 2025-12-03 18:27:31.841966 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 18:27:31.842126 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.129) 0:01:01.629 **** 2025-12-03 18:27:31.917951 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-12-03 18:27:31.918168 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-12-03 18:27:31.918332 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-12-03 18:27:31.918483 | controller | skipping: [instance] 2025-12-03 18:27:31.918621 | controller | 2025-12-03 18:27:31.918767 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 18:27:31.918910 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.076) 0:01:01.706 **** 2025-12-03 18:27:31.992844 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-12-03 18:27:31.993072 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-12-03 18:27:31.993238 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-12-03 18:27:31.993385 | controller | skipping: [instance] 2025-12-03 18:27:31.993511 | controller | 2025-12-03 18:27:31.993642 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 18:27:31.993772 | controller | Wednesday 03 December 2025 18:27:31 +0000 (0:00:00.074) 0:01:01.781 **** 2025-12-03 18:27:32.067451 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-12-03 18:27:32.067636 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-12-03 18:27:32.067800 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-12-03 18:27:32.067962 | controller | skipping: [instance] 2025-12-03 18:27:32.068135 | controller | 2025-12-03 18:27:32.068293 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 18:27:32.068417 | controller | Wednesday 03 December 2025 18:27:32 +0000 (0:00:00.074) 0:01:01.855 **** 2025-12-03 18:27:32.144828 | controller | skipping: [instance] => (item=compute-0 - external) 2025-12-03 18:27:32.145025 | controller | skipping: [instance] => (item=controller-0 - external) 2025-12-03 18:27:32.145241 | controller | skipping: [instance] => (item=crc-0 - external) 2025-12-03 18:27:32.145395 | controller | skipping: [instance] 2025-12-03 18:27:32.145513 | controller | 2025-12-03 18:27:32.145637 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 18:27:32.145757 | controller | Wednesday 03 December 2025 18:27:32 +0000 (0:00:00.077) 0:01:01.933 **** 2025-12-03 18:27:32.220914 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-12-03 18:27:32.221163 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-12-03 18:27:32.221341 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-12-03 18:27:32.221512 | controller | skipping: [instance] 2025-12-03 18:27:32.221636 | controller | 2025-12-03 18:27:32.221773 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 18:27:32.221904 | controller | Wednesday 03 December 2025 18:27:32 +0000 (0:00:00.076) 0:01:02.009 **** 2025-12-03 18:27:32.356424 | controller | ok: [instance] => (item=compute-0 - public) 2025-12-03 18:27:32.356613 | controller | ok: [instance] => (item=controller-0 - public) 2025-12-03 18:27:32.356770 | controller | ok: [instance] => (item=crc-0 - public) 2025-12-03 18:27:32.356900 | controller | 2025-12-03 18:27:32.357062 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-12-03 18:27:32.357207 | controller | Wednesday 03 December 2025 18:27:32 +0000 (0:00:00.135) 0:01:02.144 **** 2025-12-03 18:27:32.457773 | controller | 2025-12-03 18:27:32.458098 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-12-03 18:27:32.458237 | controller | Wednesday 03 December 2025 18:27:32 +0000 (0:00:00.101) 0:01:02.246 **** 2025-12-03 18:27:32.493371 | controller | ok: [instance] 2025-12-03 18:27:32.493539 | controller | 2025-12-03 18:27:32.493697 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-12-03 18:27:32.493847 | controller | Wednesday 03 December 2025 18:27:32 +0000 (0:00:00.035) 0:01:02.281 **** 2025-12-03 18:27:32.587576 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:84:c2:bf', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-03 18:27:32.587768 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:7e:67:f8', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-03 18:27:32.587953 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:db:52:37', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-03 18:27:32.588153 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:31:e9:23', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-03 18:27:32.588323 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:46:1f:c9', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-03 18:27:32.588454 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:9c:41:7d', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-03 18:27:32.588568 | controller | 2025-12-03 18:27:32.588687 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-12-03 18:27:32.588816 | controller | Wednesday 03 December 2025 18:27:32 +0000 (0:00:00.094) 0:01:02.375 **** 2025-12-03 18:27:32.635327 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-12-03 18:27:32.635615 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-12-03 18:27:32.635832 | controller | 2025-12-03 18:27:32.636111 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-03 18:27:32.636353 | controller | Wednesday 03 December 2025 18:27:32 +0000 (0:00:00.047) 0:01:02.423 **** 2025-12-03 18:27:32.811216 | controller | ok: [instance] 2025-12-03 18:27:32.811385 | controller | 2025-12-03 18:27:32.811525 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-03 18:27:32.811670 | controller | Wednesday 03 December 2025 18:27:32 +0000 (0:00:00.175) 0:01:02.599 **** 2025-12-03 18:27:32.835946 | controller | ok: [instance] 2025-12-03 18:27:32.836169 | controller | 2025-12-03 18:27:32.836354 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-03 18:27:32.836523 | controller | Wednesday 03 December 2025 18:27:32 +0000 (0:00:00.024) 0:01:02.624 **** 2025-12-03 18:27:33.011179 | controller | ok: [instance] 2025-12-03 18:27:33.011231 | controller | 2025-12-03 18:27:33.011244 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-03 18:27:33.011306 | controller | Wednesday 03 December 2025 18:27:33 +0000 (0:00:00.174) 0:01:02.799 **** 2025-12-03 18:27:33.034154 | controller | ok: [instance] 2025-12-03 18:27:33.034245 | controller | 2025-12-03 18:27:33.034264 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-12-03 18:27:33.034275 | controller | Wednesday 03 December 2025 18:27:33 +0000 (0:00:00.022) 0:01:02.822 **** 2025-12-03 18:27:33.053705 | controller | ok: [instance] 2025-12-03 18:27:33.232185 | controller | 2025-12-03 18:27:33.232219 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-12-03 18:27:33.232229 | controller | Wednesday 03 December 2025 18:27:33 +0000 (0:00:00.019) 0:01:02.841 **** 2025-12-03 18:27:33.232242 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:84:c2:bf', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-03 18:27:33.232250 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:7e:67:f8', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-03 18:27:33.232257 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:db:52:37', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-03 18:27:33.232264 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:31:e9:23', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-03 18:27:33.232270 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:46:1f:c9', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-03 18:27:33.232277 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:9c:41:7d', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-03 18:27:33.232283 | controller | 2025-12-03 18:27:33.232290 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-12-03 18:27:33.232299 | controller | Wednesday 03 December 2025 18:27:33 +0000 (0:00:00.177) 0:01:03.019 **** 2025-12-03 18:27:33.269698 | controller | ok: [instance] 2025-12-03 18:27:35.184190 | controller | 2025-12-03 18:27:35.184222 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-12-03 18:27:35.184231 | controller | Wednesday 03 December 2025 18:27:33 +0000 (0:00:00.038) 0:01:03.057 **** 2025-12-03 18:27:35.184243 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:84:c2:bf', 'entry': 'set:compute,52:54:00:84:c2:bf,192.168.140.100,compute-0', 'state': 'present'}) 2025-12-03 18:27:35.184272 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:7e:67:f8', 'entry': 'set:controller,52:54:01:7e:67:f8,192.168.140.9,controller-0', 'state': 'present'}) 2025-12-03 18:27:35.184281 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:db:52:37', 'entry': 'set:ocp,52:54:02:db:52:37,192.168.140.10,crc-0', 'state': 'present'}) 2025-12-03 18:27:35.184809 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:31:e9:23', 'entry': 'set:compute,52:54:00:31:e9:23,192.168.101.100,compute-0', 'state': 'present'}) 2025-12-03 18:27:35.206121 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:46:1f:c9', 'entry': 'set:controller,52:54:01:46:1f:c9,192.168.101.9,controller-0', 'state': 'present'}) 2025-12-03 18:27:35.206150 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:9c:41:7d', 'entry': 'set:ocp,52:54:02:9c:41:7d,192.168.101.10,crc-0', 'state': 'present'}) 2025-12-03 18:27:35.206170 | controller | 2025-12-03 18:27:35.206177 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-12-03 18:27:35.206189 | controller | Wednesday 03 December 2025 18:27:35 +0000 (0:00:01.914) 0:01:04.972 **** 2025-12-03 18:27:35.206200 | controller | skipping: [instance] 2025-12-03 18:27:35.206232 | controller | 2025-12-03 18:27:35.206241 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-12-03 18:27:35.206310 | controller | Wednesday 03 December 2025 18:27:35 +0000 (0:00:00.022) 0:01:04.994 **** 2025-12-03 18:27:35.415622 | controller | ok: [instance] => (item=compute-0) 2025-12-03 18:27:35.525111 | controller | ok: [instance] => (item=controller-0) 2025-12-03 18:27:35.525133 | controller | ok: [instance] => (item=crc-0) 2025-12-03 18:27:35.525142 | controller | 2025-12-03 18:27:35.525149 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-12-03 18:27:35.525156 | controller | Wednesday 03 December 2025 18:27:35 +0000 (0:00:00.208) 0:01:05.203 **** 2025-12-03 18:27:35.525166 | controller | 2025-12-03 18:27:35.525262 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-03 18:27:35.525275 | controller | Wednesday 03 December 2025 18:27:35 +0000 (0:00:00.110) 0:01:05.313 **** 2025-12-03 18:27:35.566250 | controller | ok: [instance] 2025-12-03 18:27:35.758090 | controller | 2025-12-03 18:27:35.758120 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 18:27:35.758128 | controller | Wednesday 03 December 2025 18:27:35 +0000 (0:00:00.040) 0:01:05.354 **** 2025-12-03 18:27:35.758139 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 18:27:35.758183 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 18:27:35.758191 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-03 18:27:35.758197 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-03 18:27:35.758202 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-03 18:27:35.758209 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-03 18:27:35.758324 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-03 18:27:35.758441 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 18:27:35.758565 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 18:27:35.758682 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-03 18:27:35.758786 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 18:27:35.758893 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 18:27:35.759014 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-03 18:27:35.759143 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-03 18:27:35.759261 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-03 18:27:35.759369 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-03 18:27:35.759464 | controller | 2025-12-03 18:27:35.759565 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 18:27:35.759667 | controller | Wednesday 03 December 2025 18:27:35 +0000 (0:00:00.191) 0:01:05.545 **** 2025-12-03 18:27:38.803169 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 18:27:38.823645 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 18:27:38.823678 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-03 18:27:38.823686 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-03 18:27:38.823692 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-03 18:27:38.823697 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-03 18:27:38.823702 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-03 18:27:38.823708 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 18:27:38.823713 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 18:27:38.823718 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-03 18:27:38.823723 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 18:27:38.823728 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 18:27:38.823733 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-03 18:27:38.823737 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-03 18:27:38.823742 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-03 18:27:38.823748 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-03 18:27:38.823753 | controller | 2025-12-03 18:27:38.823758 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2025-12-03 18:27:38.823764 | controller | Wednesday 03 December 2025 18:27:38 +0000 (0:00:03.043) 0:01:08.589 **** 2025-12-03 18:27:38.823773 | controller | ok: [instance] 2025-12-03 18:27:38.870493 | controller | 2025-12-03 18:27:38.870533 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2025-12-03 18:27:38.870544 | controller | Wednesday 03 December 2025 18:27:38 +0000 (0:00:00.022) 0:01:08.611 **** 2025-12-03 18:27:38.870557 | controller | skipping: [instance] => (item=compute) 2025-12-03 18:27:38.870580 | controller | skipping: [instance] => (item=controller) 2025-12-03 18:27:38.870587 | controller | skipping: [instance] => (item=crc) 2025-12-03 18:27:38.870594 | controller | skipping: [instance] 2025-12-03 18:27:38.870601 | controller | 2025-12-03 18:27:38.870610 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2025-12-03 18:27:38.901090 | controller | Wednesday 03 December 2025 18:27:38 +0000 (0:00:00.046) 0:01:08.658 **** 2025-12-03 18:27:38.901122 | controller | skipping: [instance] 2025-12-03 18:27:39.247184 | controller | 2025-12-03 18:27:39.247219 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-12-03 18:27:39.247229 | controller | Wednesday 03 December 2025 18:27:38 +0000 (0:00:00.030) 0:01:08.689 **** 2025-12-03 18:27:39.247241 | controller | changed: [instance] 2025-12-03 18:27:39.247271 | controller | 2025-12-03 18:27:39.247280 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-12-03 18:27:39.247638 | controller | Wednesday 03 December 2025 18:27:39 +0000 (0:00:00.336) 0:01:09.025 **** 2025-12-03 18:27:40.008159 | controller | 2025-12-03 18:27:40.008183 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-03 18:27:40.008192 | controller | Wednesday 03 December 2025 18:27:39 +0000 (0:00:00.010) 0:01:09.035 **** 2025-12-03 18:27:40.008201 | controller | changed: [instance] 2025-12-03 18:27:40.339150 | controller | 2025-12-03 18:27:40.339185 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-03 18:27:40.339194 | controller | Wednesday 03 December 2025 18:27:40 +0000 (0:00:00.760) 0:01:09.796 **** 2025-12-03 18:27:40.339204 | controller | changed: [instance] 2025-12-03 18:27:40.339229 | controller | 2025-12-03 18:27:40.339512 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-12-03 18:27:40.686127 | controller | Wednesday 03 December 2025 18:27:40 +0000 (0:00:00.331) 0:01:10.127 **** 2025-12-03 18:27:40.686180 | controller | changed: [instance] 2025-12-03 18:27:40.686219 | controller | 2025-12-03 18:27:40.686226 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-12-03 18:27:40.686233 | controller | Wednesday 03 December 2025 18:27:40 +0000 (0:00:00.346) 0:01:10.474 **** 2025-12-03 18:27:41.045444 | controller | changed: [instance] 2025-12-03 18:27:41.408073 | controller | 2025-12-03 18:27:41.408106 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-12-03 18:27:41.408114 | controller | Wednesday 03 December 2025 18:27:41 +0000 (0:00:00.359) 0:01:10.833 **** 2025-12-03 18:27:41.408130 | controller | changed: [instance] 2025-12-03 18:27:41.439219 | controller | 2025-12-03 18:27:41.439258 | controller | TASK [Build utility records dataset] ******************************************* 2025-12-03 18:27:41.439268 | controller | Wednesday 03 December 2025 18:27:41 +0000 (0:00:00.362) 0:01:11.195 **** 2025-12-03 18:27:41.439282 | controller | 2025-12-03 18:27:41.528518 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-03 18:27:41.528550 | controller | Wednesday 03 December 2025 18:27:41 +0000 (0:00:00.031) 0:01:11.227 **** 2025-12-03 18:27:41.528562 | controller | ok: [instance] 2025-12-03 18:27:41.620625 | controller | 2025-12-03 18:27:41.620647 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 18:27:41.620654 | controller | Wednesday 03 December 2025 18:27:41 +0000 (0:00:00.089) 0:01:11.316 **** 2025-12-03 18:27:41.620662 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-03 18:27:42.097194 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 18:27:42.097247 | controller | 2025-12-03 18:27:42.097262 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 18:27:42.097273 | controller | Wednesday 03 December 2025 18:27:41 +0000 (0:00:00.092) 0:01:11.408 **** 2025-12-03 18:27:42.097300 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-03 18:27:42.097498 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 18:27:42.097527 | controller | 2025-12-03 18:27:42.097534 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-03 18:27:42.097540 | controller | Wednesday 03 December 2025 18:27:42 +0000 (0:00:00.466) 0:01:11.874 **** 2025-12-03 18:27:42.097550 | controller | 2025-12-03 18:27:42.570201 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-03 18:27:42.570233 | controller | Wednesday 03 December 2025 18:27:42 +0000 (0:00:00.009) 0:01:11.884 **** 2025-12-03 18:27:42.570245 | controller | changed: [instance] 2025-12-03 18:27:42.570426 | controller | 2025-12-03 18:27:42.570438 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-03 18:27:42.570446 | controller | Wednesday 03 December 2025 18:27:42 +0000 (0:00:00.473) 0:01:12.357 **** 2025-12-03 18:27:42.911148 | controller | changed: [instance] 2025-12-03 18:27:42.911205 | controller | 2025-12-03 18:27:42.911391 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-12-03 18:27:42.944068 | controller | Wednesday 03 December 2025 18:27:42 +0000 (0:00:00.341) 0:01:12.699 **** 2025-12-03 18:27:42.944091 | controller | skipping: [instance] 2025-12-03 18:27:43.018897 | controller | 2025-12-03 18:27:43.018913 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-12-03 18:27:43.018920 | controller | Wednesday 03 December 2025 18:27:42 +0000 (0:00:00.032) 0:01:12.732 **** 2025-12-03 18:27:43.018928 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-12-03 18:27:43.225371 | controller | 2025-12-03 18:27:43.225390 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-12-03 18:27:43.225397 | controller | Wednesday 03 December 2025 18:27:43 +0000 (0:00:00.074) 0:01:12.806 **** 2025-12-03 18:27:43.225405 | controller | ok: [instance] 2025-12-03 18:27:43.244475 | controller | 2025-12-03 18:27:43.244492 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-12-03 18:27:43.244499 | controller | Wednesday 03 December 2025 18:27:43 +0000 (0:00:00.206) 0:01:13.013 **** 2025-12-03 18:27:43.244507 | controller | skipping: [instance] 2025-12-03 18:27:43.543177 | controller | 2025-12-03 18:27:43.543213 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-12-03 18:27:43.543222 | controller | Wednesday 03 December 2025 18:27:43 +0000 (0:00:00.019) 0:01:13.032 **** 2025-12-03 18:27:43.543234 | controller | ok: [instance] 2025-12-03 18:27:43.772534 | controller | 2025-12-03 18:27:43.772559 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-12-03 18:27:43.772568 | controller | Wednesday 03 December 2025 18:27:43 +0000 (0:00:00.298) 0:01:13.331 **** 2025-12-03 18:27:43.772578 | controller | ok: [instance] 2025-12-03 18:27:43.980507 | controller | 2025-12-03 18:27:43.980528 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-12-03 18:27:43.980536 | controller | Wednesday 03 December 2025 18:27:43 +0000 (0:00:00.229) 0:01:13.560 **** 2025-12-03 18:27:43.980544 | controller | ok: [instance] 2025-12-03 18:27:44.190456 | controller | 2025-12-03 18:27:44.190475 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-12-03 18:27:44.190483 | controller | Wednesday 03 December 2025 18:27:43 +0000 (0:00:00.208) 0:01:13.768 **** 2025-12-03 18:27:44.190492 | controller | ok: [instance] 2025-12-03 18:27:44.408920 | controller | 2025-12-03 18:27:44.408939 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-12-03 18:27:44.408949 | controller | Wednesday 03 December 2025 18:27:44 +0000 (0:00:00.209) 0:01:13.978 **** 2025-12-03 18:27:44.408969 | controller | ok: [instance] 2025-12-03 18:27:44.446185 | controller | 2025-12-03 18:27:44.446229 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 18:27:44.446246 | controller | Wednesday 03 December 2025 18:27:44 +0000 (0:00:00.218) 0:01:14.197 **** 2025-12-03 18:27:44.446260 | controller | 2025-12-03 18:27:44.446297 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-03 18:27:44.446472 | controller | Wednesday 03 December 2025 18:27:44 +0000 (0:00:00.037) 0:01:14.234 **** 2025-12-03 18:27:44.630139 | controller | ok: [instance] 2025-12-03 18:27:44.630274 | controller | 2025-12-03 18:27:44.630284 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-03 18:27:44.630345 | controller | Wednesday 03 December 2025 18:27:44 +0000 (0:00:00.183) 0:01:14.418 **** 2025-12-03 18:27:44.652238 | controller | ok: [instance] 2025-12-03 18:27:44.652287 | controller | 2025-12-03 18:27:44.652322 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-03 18:27:44.652469 | controller | Wednesday 03 December 2025 18:27:44 +0000 (0:00:00.022) 0:01:14.440 **** 2025-12-03 18:27:44.677996 | controller | skipping: [instance] 2025-12-03 18:27:44.953609 | controller | 2025-12-03 18:27:44.953628 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-12-03 18:27:44.953635 | controller | Wednesday 03 December 2025 18:27:44 +0000 (0:00:00.025) 0:01:14.466 **** 2025-12-03 18:27:44.953643 | controller | ok: [instance] 2025-12-03 18:27:45.164849 | controller | 2025-12-03 18:27:45.164868 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-12-03 18:27:45.164875 | controller | Wednesday 03 December 2025 18:27:44 +0000 (0:00:00.275) 0:01:14.741 **** 2025-12-03 18:27:45.164883 | controller | ok: [instance] 2025-12-03 18:27:45.330166 | controller | 2025-12-03 18:27:45.330190 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-12-03 18:27:45.330198 | controller | Wednesday 03 December 2025 18:27:45 +0000 (0:00:00.211) 0:01:14.952 **** 2025-12-03 18:27:45.330207 | controller | ok: [instance] 2025-12-03 18:27:45.386453 | controller | 2025-12-03 18:27:45.386475 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-12-03 18:27:45.386484 | controller | Wednesday 03 December 2025 18:27:45 +0000 (0:00:00.165) 0:01:15.118 **** 2025-12-03 18:27:45.386495 | controller | 2025-12-03 18:27:45.427198 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-03 18:27:45.427232 | controller | Wednesday 03 December 2025 18:27:45 +0000 (0:00:00.056) 0:01:15.174 **** 2025-12-03 18:27:45.427246 | controller | ok: [instance] => changed=false 2025-12-03 18:27:45.427276 | controller | msg: All assertions passed 2025-12-03 18:27:45.427286 | controller | 2025-12-03 18:27:45.427602 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-03 18:27:45.597931 | controller | Wednesday 03 December 2025 18:27:45 +0000 (0:00:00.040) 0:01:15.215 **** 2025-12-03 18:27:45.597953 | controller | ok: [instance] 2025-12-03 18:27:45.782833 | controller | 2025-12-03 18:27:45.782852 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-03 18:27:45.782860 | controller | Wednesday 03 December 2025 18:27:45 +0000 (0:00:00.170) 0:01:15.386 **** 2025-12-03 18:27:45.782869 | controller | ok: [instance] 2025-12-03 18:27:45.808189 | controller | 2025-12-03 18:27:45.808225 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-03 18:27:45.808235 | controller | Wednesday 03 December 2025 18:27:45 +0000 (0:00:00.184) 0:01:15.570 **** 2025-12-03 18:27:45.808248 | controller | ok: [instance] => changed=false 2025-12-03 18:27:45.983871 | controller | msg: All assertions passed 2025-12-03 18:27:45.983891 | controller | 2025-12-03 18:27:45.983898 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-03 18:27:45.983904 | controller | Wednesday 03 December 2025 18:27:45 +0000 (0:00:00.025) 0:01:15.596 **** 2025-12-03 18:27:45.983912 | controller | ok: [instance] 2025-12-03 18:27:46.147115 | controller | 2025-12-03 18:27:46.147151 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-03 18:27:46.147160 | controller | Wednesday 03 December 2025 18:27:45 +0000 (0:00:00.176) 0:01:15.772 **** 2025-12-03 18:27:46.147172 | controller | ok: [instance] 2025-12-03 18:27:46.147347 | controller | 2025-12-03 18:27:46.193444 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-03 18:27:46.193461 | controller | Wednesday 03 December 2025 18:27:46 +0000 (0:00:00.163) 0:01:15.935 **** 2025-12-03 18:27:46.193475 | controller | ok: [instance] 2025-12-03 18:27:46.552189 | controller | 2025-12-03 18:27:46.552226 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-12-03 18:27:46.552235 | controller | Wednesday 03 December 2025 18:27:46 +0000 (0:00:00.046) 0:01:15.981 **** 2025-12-03 18:27:46.552247 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-12-03 18:27:46.552282 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-12-03 18:27:46.552289 | controller | 2025-12-03 18:27:46.552297 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-12-03 18:27:46.552354 | controller | Wednesday 03 December 2025 18:27:46 +0000 (0:00:00.358) 0:01:16.340 **** 2025-12-03 18:27:46.570981 | controller | skipping: [instance] 2025-12-03 18:27:46.592198 | controller | 2025-12-03 18:27:46.592238 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-12-03 18:27:46.592249 | controller | Wednesday 03 December 2025 18:27:46 +0000 (0:00:00.018) 0:01:16.358 **** 2025-12-03 18:27:46.592262 | controller | skipping: [instance] 2025-12-03 18:27:46.592298 | controller | 2025-12-03 18:27:46.592653 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-12-03 18:27:46.710280 | controller | Wednesday 03 December 2025 18:27:46 +0000 (0:00:00.021) 0:01:16.380 **** 2025-12-03 18:27:46.710300 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-12-03 18:27:46.734013 | controller | 2025-12-03 18:27:46.734072 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-12-03 18:27:46.734089 | controller | Wednesday 03 December 2025 18:27:46 +0000 (0:00:00.117) 0:01:16.498 **** 2025-12-03 18:27:46.734106 | controller | skipping: [instance] 2025-12-03 18:27:47.117522 | controller | 2025-12-03 18:27:47.117551 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-12-03 18:27:47.117558 | controller | Wednesday 03 December 2025 18:27:46 +0000 (0:00:00.023) 0:01:16.521 **** 2025-12-03 18:27:47.117568 | controller | changed: [instance] 2025-12-03 18:27:47.600158 | controller | 2025-12-03 18:27:47.600191 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-12-03 18:27:47.600199 | controller | Wednesday 03 December 2025 18:27:47 +0000 (0:00:00.383) 0:01:16.905 **** 2025-12-03 18:27:47.600210 | controller | changed: [instance] 2025-12-03 18:27:48.003497 | controller | 2025-12-03 18:27:48.003528 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-12-03 18:27:48.003536 | controller | Wednesday 03 December 2025 18:27:47 +0000 (0:00:00.471) 0:01:17.377 **** 2025-12-03 18:27:48.003541 | controller | 2025-12-03 18:27:48.003546 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-03 18:27:48.003551 | controller | Wednesday 03 December 2025 18:27:47 +0000 (0:00:00.010) 0:01:17.387 **** 2025-12-03 18:27:48.003560 | controller | changed: [instance] 2025-12-03 18:27:48.003584 | controller | 2025-12-03 18:27:48.003773 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-03 18:27:48.774132 | controller | Wednesday 03 December 2025 18:27:48 +0000 (0:00:00.404) 0:01:17.791 **** 2025-12-03 18:27:48.774169 | controller | changed: [instance] 2025-12-03 18:27:48.804924 | controller | 2025-12-03 18:27:48.804963 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-12-03 18:27:48.804991 | controller | Wednesday 03 December 2025 18:27:48 +0000 (0:00:00.770) 0:01:18.561 **** 2025-12-03 18:27:48.805005 | controller | skipping: [instance] 2025-12-03 18:27:48.834181 | controller | 2025-12-03 18:27:48.834213 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-12-03 18:27:48.834222 | controller | Wednesday 03 December 2025 18:27:48 +0000 (0:00:00.031) 0:01:18.592 **** 2025-12-03 18:27:48.834234 | controller | skipping: [instance] 2025-12-03 18:27:48.834450 | controller | 2025-12-03 18:27:48.834482 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-12-03 18:27:49.368667 | controller | Wednesday 03 December 2025 18:27:48 +0000 (0:00:00.029) 0:01:18.622 **** 2025-12-03 18:27:49.368697 | controller | changed: [instance] => (item=workload) 2025-12-03 18:27:49.757116 | controller | changed: [instance] => (item=reproducer-inventory) 2025-12-03 18:27:49.757146 | controller | ok: [instance] => (item=volumes) 2025-12-03 18:27:49.757155 | controller | 2025-12-03 18:27:49.757161 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-12-03 18:27:49.757168 | controller | Wednesday 03 December 2025 18:27:49 +0000 (0:00:00.533) 0:01:19.156 **** 2025-12-03 18:27:49.757178 | controller | changed: [instance] => (item=workload) 2025-12-03 18:27:49.757203 | controller | changed: [instance] => (item=volumes) 2025-12-03 18:27:49.757493 | controller | 2025-12-03 18:27:49.782934 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-12-03 18:27:49.782950 | controller | Wednesday 03 December 2025 18:27:49 +0000 (0:00:00.389) 0:01:19.545 **** 2025-12-03 18:27:49.782959 | controller | skipping: [instance] 2025-12-03 18:27:50.758124 | controller | 2025-12-03 18:27:50.758155 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-12-03 18:27:50.758167 | controller | Wednesday 03 December 2025 18:27:49 +0000 (0:00:00.025) 0:01:19.571 **** 2025-12-03 18:27:50.758176 | controller | changed: [instance] => (item=compute) 2025-12-03 18:27:50.758201 | controller | changed: [instance] => (item=controller) 2025-12-03 18:27:50.758207 | controller | changed: [instance] => (item=crc) 2025-12-03 18:27:50.758214 | controller | 2025-12-03 18:27:50.758468 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-12-03 18:27:51.120168 | controller | Wednesday 03 December 2025 18:27:50 +0000 (0:00:00.974) 0:01:20.545 **** 2025-12-03 18:27:51.120211 | controller | changed: [instance] 2025-12-03 18:27:51.120278 | controller | 2025-12-03 18:27:51.120310 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-12-03 18:27:51.120326 | controller | Wednesday 03 December 2025 18:27:51 +0000 (0:00:00.362) 0:01:20.907 **** 2025-12-03 18:27:51.159724 | controller | skipping: [instance] 2025-12-03 18:27:51.218128 | controller | 2025-12-03 18:27:51.218165 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-12-03 18:27:51.218174 | controller | Wednesday 03 December 2025 18:27:51 +0000 (0:00:00.039) 0:01:20.947 **** 2025-12-03 18:27:51.218187 | controller | skipping: [instance] => (item=crc) 2025-12-03 18:27:51.218720 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-12-03 18:27:51.218741 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-12-03 18:27:51.413148 | controller | 2025-12-03 18:27:51.413177 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-03 18:27:51.413186 | controller | Wednesday 03 December 2025 18:27:51 +0000 (0:00:00.058) 0:01:21.006 **** 2025-12-03 18:27:51.413198 | controller | changed: [instance] 2025-12-03 18:27:51.413227 | controller | 2025-12-03 18:27:51.413438 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-03 18:27:51.579189 | controller | Wednesday 03 December 2025 18:27:51 +0000 (0:00:00.195) 0:01:21.201 **** 2025-12-03 18:27:51.579230 | controller | ok: [instance] 2025-12-03 18:27:51.579262 | controller | 2025-12-03 18:27:51.579270 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-03 18:27:51.579278 | controller | Wednesday 03 December 2025 18:27:51 +0000 (0:00:00.165) 0:01:21.367 **** 2025-12-03 18:28:19.246013 | controller | changed: [instance] 2025-12-03 18:28:19.439763 | controller | 2025-12-03 18:28:19.439801 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-03 18:28:19.439811 | controller | Wednesday 03 December 2025 18:28:19 +0000 (0:00:27.666) 0:01:49.033 **** 2025-12-03 18:28:19.439823 | controller | ok: [instance] 2025-12-03 18:28:19.480635 | controller | 2025-12-03 18:28:19.480658 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-03 18:28:19.480673 | controller | Wednesday 03 December 2025 18:28:19 +0000 (0:00:00.193) 0:01:49.227 **** 2025-12-03 18:28:19.480683 | controller | ok: [instance] => changed=false 2025-12-03 18:28:19.690848 | controller | msg: All assertions passed 2025-12-03 18:28:19.690881 | controller | 2025-12-03 18:28:19.690901 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-03 18:28:19.690911 | controller | Wednesday 03 December 2025 18:28:19 +0000 (0:00:00.041) 0:01:49.268 **** 2025-12-03 18:28:19.690925 | controller | changed: [instance] 2025-12-03 18:28:19.892146 | controller | 2025-12-03 18:28:19.892183 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-03 18:28:19.892191 | controller | Wednesday 03 December 2025 18:28:19 +0000 (0:00:00.209) 0:01:49.478 **** 2025-12-03 18:28:19.892202 | controller | ok: [instance] 2025-12-03 18:28:19.892233 | controller | 2025-12-03 18:28:19.892374 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-03 18:28:19.892400 | controller | Wednesday 03 December 2025 18:28:19 +0000 (0:00:00.201) 0:01:49.680 **** 2025-12-03 18:28:20.083626 | controller | ok: [instance] 2025-12-03 18:28:20.106095 | controller | 2025-12-03 18:28:20.106129 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-03 18:28:20.106139 | controller | Wednesday 03 December 2025 18:28:20 +0000 (0:00:00.191) 0:01:49.871 **** 2025-12-03 18:28:20.106150 | controller | skipping: [instance] 2025-12-03 18:28:20.106382 | controller | 2025-12-03 18:28:20.106400 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-03 18:28:20.290893 | controller | Wednesday 03 December 2025 18:28:20 +0000 (0:00:00.022) 0:01:49.894 **** 2025-12-03 18:28:20.290915 | controller | ok: [instance] 2025-12-03 18:28:20.331070 | controller | 2025-12-03 18:28:20.331088 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-03 18:28:20.331095 | controller | Wednesday 03 December 2025 18:28:20 +0000 (0:00:00.183) 0:01:50.078 **** 2025-12-03 18:28:20.331115 | controller | ok: [instance] => changed=false 2025-12-03 18:28:20.527598 | controller | msg: All assertions passed 2025-12-03 18:28:20.527617 | controller | 2025-12-03 18:28:20.527624 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-03 18:28:20.527630 | controller | Wednesday 03 December 2025 18:28:20 +0000 (0:00:00.040) 0:01:50.118 **** 2025-12-03 18:28:20.527641 | controller | ok: [instance] 2025-12-03 18:28:20.698203 | controller | 2025-12-03 18:28:20.698236 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-12-03 18:28:20.698250 | controller | Wednesday 03 December 2025 18:28:20 +0000 (0:00:00.196) 0:01:50.315 **** 2025-12-03 18:28:20.698266 | controller | ok: [instance] 2025-12-03 18:28:20.698521 | controller | 2025-12-03 18:28:20.698688 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-12-03 18:28:20.698812 | controller | Wednesday 03 December 2025 18:28:20 +0000 (0:00:00.170) 0:01:50.486 **** 2025-12-03 18:28:21.066387 | controller | changed: [instance] 2025-12-03 18:28:21.066539 | controller | 2025-12-03 18:28:21.066677 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-12-03 18:28:21.066809 | controller | Wednesday 03 December 2025 18:28:21 +0000 (0:00:00.368) 0:01:50.854 **** 2025-12-03 18:28:21.234060 | controller | ok: [instance] 2025-12-03 18:28:21.234252 | controller | 2025-12-03 18:28:21.234417 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-12-03 18:28:21.234571 | controller | Wednesday 03 December 2025 18:28:21 +0000 (0:00:00.167) 0:01:51.022 **** 2025-12-03 18:28:21.399190 | controller | ok: [instance] 2025-12-03 18:28:21.399250 | controller | 2025-12-03 18:28:21.399264 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-12-03 18:28:21.399276 | controller | Wednesday 03 December 2025 18:28:21 +0000 (0:00:00.164) 0:01:51.187 **** 2025-12-03 18:28:21.773909 | controller | changed: [instance] 2025-12-03 18:28:21.794756 | controller | 2025-12-03 18:28:21.794773 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-12-03 18:28:21.794780 | controller | Wednesday 03 December 2025 18:28:21 +0000 (0:00:00.374) 0:01:51.562 **** 2025-12-03 18:28:21.794792 | controller | ok: [instance] 2025-12-03 18:28:22.013558 | controller | 2025-12-03 18:28:22.013576 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-12-03 18:28:22.013583 | controller | Wednesday 03 December 2025 18:28:21 +0000 (0:00:00.020) 0:01:51.583 **** 2025-12-03 18:28:22.013591 | controller | ok: [instance] 2025-12-03 18:28:22.466178 | controller | 2025-12-03 18:28:22.466210 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-12-03 18:28:22.466219 | controller | Wednesday 03 December 2025 18:28:22 +0000 (0:00:00.218) 0:01:51.801 **** 2025-12-03 18:28:22.466231 | controller | ok: [instance] 2025-12-03 18:28:22.578949 | controller | 2025-12-03 18:28:22.578978 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-12-03 18:28:22.578985 | controller | Wednesday 03 December 2025 18:28:22 +0000 (0:00:00.452) 0:01:52.254 **** 2025-12-03 18:28:22.578996 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 18:28:22.826674 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 18:28:22.826698 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 18:28:22.826706 | controller | 2025-12-03 18:28:22.826712 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-12-03 18:28:22.826717 | controller | Wednesday 03 December 2025 18:28:22 +0000 (0:00:00.112) 0:01:52.366 **** 2025-12-03 18:28:22.826726 | controller | changed: [instance] 2025-12-03 18:28:23.035840 | controller | 2025-12-03 18:28:23.035862 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-12-03 18:28:23.035870 | controller | Wednesday 03 December 2025 18:28:22 +0000 (0:00:00.248) 0:01:52.614 **** 2025-12-03 18:28:23.035879 | controller | changed: [instance] 2025-12-03 18:28:23.334979 | controller | 2025-12-03 18:28:23.335003 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-12-03 18:28:23.335010 | controller | Wednesday 03 December 2025 18:28:23 +0000 (0:00:00.209) 0:01:52.824 **** 2025-12-03 18:28:23.335019 | controller | changed: [instance] 2025-12-03 18:28:23.361935 | controller | 2025-12-03 18:28:23.361963 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-12-03 18:28:23.361974 | controller | Wednesday 03 December 2025 18:28:23 +0000 (0:00:00.299) 0:01:53.123 **** 2025-12-03 18:28:23.361987 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-03 18:28:23.403876 | controller | 2025-12-03 18:28:23.403892 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-03 18:28:23.403899 | controller | Wednesday 03 December 2025 18:28:23 +0000 (0:00:00.026) 0:01:53.149 **** 2025-12-03 18:28:23.403907 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-03 18:28:23.622883 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-03 18:28:23.622901 | controller | 2025-12-03 18:28:23.622908 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 18:28:23.622913 | controller | Wednesday 03 December 2025 18:28:23 +0000 (0:00:00.041) 0:01:53.191 **** 2025-12-03 18:28:23.622921 | controller | ok: [instance] 2025-12-03 18:28:23.662254 | controller | 2025-12-03 18:28:23.662303 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 18:28:23.662319 | controller | Wednesday 03 December 2025 18:28:23 +0000 (0:00:00.219) 0:01:53.410 **** 2025-12-03 18:28:23.662334 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 18:28:23.883976 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:28:23.884003 | controller | 2025-12-03 18:28:23.884011 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 18:28:23.884017 | controller | Wednesday 03 December 2025 18:28:23 +0000 (0:00:00.039) 0:01:53.450 **** 2025-12-03 18:28:23.884026 | controller | ok: [instance] 2025-12-03 18:28:24.077600 | controller | 2025-12-03 18:28:24.077618 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 18:28:24.077625 | controller | Wednesday 03 December 2025 18:28:23 +0000 (0:00:00.221) 0:01:53.672 **** 2025-12-03 18:28:24.077633 | controller | ok: [instance] 2025-12-03 18:28:25.348461 | controller | 2025-12-03 18:28:25.348481 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-12-03 18:28:25.348487 | controller | Wednesday 03 December 2025 18:28:24 +0000 (0:00:00.193) 0:01:53.865 **** 2025-12-03 18:28:25.348496 | controller | changed: [instance] 2025-12-03 18:28:25.566538 | controller | 2025-12-03 18:28:25.566555 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 18:28:25.566562 | controller | Wednesday 03 December 2025 18:28:25 +0000 (0:00:01.270) 0:01:55.136 **** 2025-12-03 18:28:25.566570 | controller | ok: [instance] 2025-12-03 18:28:25.608179 | controller | 2025-12-03 18:28:25.608215 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 18:28:25.608224 | controller | Wednesday 03 December 2025 18:28:25 +0000 (0:00:00.218) 0:01:55.354 **** 2025-12-03 18:28:25.608237 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 18:28:25.825576 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:28:25.825601 | controller | 2025-12-03 18:28:25.825608 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 18:28:25.825614 | controller | Wednesday 03 December 2025 18:28:25 +0000 (0:00:00.041) 0:01:55.396 **** 2025-12-03 18:28:25.825631 | controller | ok: [instance] 2025-12-03 18:28:25.825648 | controller | 2025-12-03 18:28:25.825743 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 18:28:25.825836 | controller | Wednesday 03 December 2025 18:28:25 +0000 (0:00:00.217) 0:01:55.614 **** 2025-12-03 18:28:26.016101 | controller | ok: [instance] 2025-12-03 18:28:26.289880 | controller | 2025-12-03 18:28:26.289903 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-12-03 18:28:26.289911 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.189) 0:01:55.803 **** 2025-12-03 18:28:26.289920 | controller | changed: [instance] 2025-12-03 18:28:26.310970 | controller | 2025-12-03 18:28:26.310994 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-12-03 18:28:26.311002 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.273) 0:01:56.077 **** 2025-12-03 18:28:26.311011 | controller | skipping: [instance] 2025-12-03 18:28:26.340733 | controller | 2025-12-03 18:28:26.340765 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-12-03 18:28:26.340775 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.021) 0:01:56.099 **** 2025-12-03 18:28:26.340787 | controller | skipping: [instance] 2025-12-03 18:28:26.369566 | controller | 2025-12-03 18:28:26.369598 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-12-03 18:28:26.369606 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.029) 0:01:56.128 **** 2025-12-03 18:28:26.369617 | controller | skipping: [instance] 2025-12-03 18:28:26.397192 | controller | 2025-12-03 18:28:26.397229 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-12-03 18:28:26.397239 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.028) 0:01:56.157 **** 2025-12-03 18:28:26.397251 | controller | skipping: [instance] 2025-12-03 18:28:26.397325 | controller | 2025-12-03 18:28:26.397351 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-03 18:28:26.397363 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.027) 0:01:56.185 **** 2025-12-03 18:28:26.613113 | controller | changed: [instance] 2025-12-03 18:28:26.649603 | controller | 2025-12-03 18:28:26.649626 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-03 18:28:26.649638 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.215) 0:01:56.400 **** 2025-12-03 18:28:26.649648 | controller | ok: [instance] 2025-12-03 18:28:26.704688 | controller | 2025-12-03 18:28:26.704709 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-03 18:28:26.704717 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.036) 0:01:56.437 **** 2025-12-03 18:28:26.704730 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-03 18:28:26.704875 | controller | 2025-12-03 18:28:26.705020 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-03 18:28:26.705210 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.055) 0:01:56.493 **** 2025-12-03 18:28:26.902523 | controller | ok: [instance] 2025-12-03 18:28:26.902721 | controller | 2025-12-03 18:28:26.902892 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-03 18:28:26.903088 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.197) 0:01:56.690 **** 2025-12-03 18:28:26.965164 | controller | ok: [instance] 2025-12-03 18:28:26.965322 | controller | 2025-12-03 18:28:26.965464 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-03 18:28:26.965599 | controller | Wednesday 03 December 2025 18:28:26 +0000 (0:00:00.062) 0:01:56.753 **** 2025-12-03 18:28:27.013292 | controller | ok: [instance] 2025-12-03 18:28:27.013473 | controller | 2025-12-03 18:28:27.013615 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-03 18:28:27.013748 | controller | Wednesday 03 December 2025 18:28:27 +0000 (0:00:00.048) 0:01:56.801 **** 2025-12-03 18:28:27.056582 | controller | skipping: [instance] 2025-12-03 18:28:27.056735 | controller | 2025-12-03 18:28:27.056890 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-03 18:28:27.057027 | controller | Wednesday 03 December 2025 18:28:27 +0000 (0:00:00.043) 0:01:56.845 **** 2025-12-03 18:28:27.099902 | controller | skipping: [instance] 2025-12-03 18:28:27.100252 | controller | 2025-12-03 18:28:27.100519 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-03 18:28:27.100739 | controller | Wednesday 03 December 2025 18:28:27 +0000 (0:00:00.043) 0:01:56.888 **** 2025-12-03 18:28:27.160197 | controller | 2025-12-03 18:28:27.160511 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-03 18:28:27.160778 | controller | Wednesday 03 December 2025 18:28:27 +0000 (0:00:00.060) 0:01:56.948 **** 2025-12-03 18:28:27.543986 | controller | ok: [instance] => (item=artifacts) 2025-12-03 18:28:28.682748 | controller | ok: [instance] => (item=logs) 2025-12-03 18:28:28.682779 | controller | 2025-12-03 18:28:28.682789 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-03 18:28:28.682797 | controller | Wednesday 03 December 2025 18:28:27 +0000 (0:00:00.383) 0:01:57.331 **** 2025-12-03 18:28:28.682808 | controller | ok: [instance] 2025-12-03 18:28:28.888106 | controller | 2025-12-03 18:28:28.888132 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-03 18:28:28.888140 | controller | Wednesday 03 December 2025 18:28:28 +0000 (0:00:01.138) 0:01:58.470 **** 2025-12-03 18:28:28.888162 | controller | changed: [instance] 2025-12-03 18:28:29.251081 | controller | 2025-12-03 18:28:29.251108 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-03 18:28:29.251116 | controller | Wednesday 03 December 2025 18:28:28 +0000 (0:00:00.205) 0:01:58.676 **** 2025-12-03 18:28:29.251126 | controller | changed: [instance] 2025-12-03 18:28:29.603635 | controller | 2025-12-03 18:28:29.603663 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-03 18:28:29.603670 | controller | Wednesday 03 December 2025 18:28:29 +0000 (0:00:00.362) 0:01:59.038 **** 2025-12-03 18:28:29.603680 | controller | changed: [instance] 2025-12-03 18:28:29.644938 | controller | 2025-12-03 18:28:29.644962 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-03 18:28:29.644971 | controller | Wednesday 03 December 2025 18:28:29 +0000 (0:00:00.352) 0:01:59.391 **** 2025-12-03 18:28:29.644988 | controller | skipping: [instance] 2025-12-03 18:28:29.837989 | controller | 2025-12-03 18:28:29.838024 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-03 18:28:29.838032 | controller | Wednesday 03 December 2025 18:28:29 +0000 (0:00:00.041) 0:01:59.433 **** 2025-12-03 18:28:29.838061 | controller | ok: [instance] 2025-12-03 18:28:29.838296 | controller | 2025-12-03 18:28:29.838330 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-03 18:28:29.880209 | controller | Wednesday 03 December 2025 18:28:29 +0000 (0:00:00.193) 0:01:59.626 **** 2025-12-03 18:28:29.880252 | controller | skipping: [instance] 2025-12-03 18:28:30.109887 | controller | 2025-12-03 18:28:30.109912 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-03 18:28:30.109920 | controller | Wednesday 03 December 2025 18:28:29 +0000 (0:00:00.041) 0:01:59.667 **** 2025-12-03 18:28:30.109929 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-12-03 18:28:30.377542 | controller | changed: [instance] 2025-12-03 18:28:30.377573 | controller | 2025-12-03 18:28:30.377586 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-03 18:28:30.377593 | controller | Wednesday 03 December 2025 18:28:30 +0000 (0:00:00.229) 0:01:59.897 **** 2025-12-03 18:28:30.377603 | controller | changed: [instance] 2025-12-03 18:28:30.424615 | controller | 2025-12-03 18:28:30.424644 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-03 18:28:30.424654 | controller | Wednesday 03 December 2025 18:28:30 +0000 (0:00:00.267) 0:02:00.165 **** 2025-12-03 18:28:30.424666 | controller | skipping: [instance] 2025-12-03 18:28:30.452134 | controller | 2025-12-03 18:28:30.452177 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2025-12-03 18:28:30.452187 | controller | Wednesday 03 December 2025 18:28:30 +0000 (0:00:00.047) 0:02:00.212 **** 2025-12-03 18:28:30.452199 | controller | skipping: [instance] 2025-12-03 18:28:30.696883 | controller | 2025-12-03 18:28:30.696913 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-12-03 18:28:30.696921 | controller | Wednesday 03 December 2025 18:28:30 +0000 (0:00:00.027) 0:02:00.240 **** 2025-12-03 18:28:30.696931 | controller | changed: [instance] 2025-12-03 18:28:30.916896 | controller | 2025-12-03 18:28:30.916932 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-12-03 18:28:30.916941 | controller | Wednesday 03 December 2025 18:28:30 +0000 (0:00:00.244) 0:02:00.484 **** 2025-12-03 18:28:30.916951 | controller | changed: [instance] 2025-12-03 18:28:31.245091 | controller | 2025-12-03 18:28:31.245124 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-12-03 18:28:31.245133 | controller | Wednesday 03 December 2025 18:28:30 +0000 (0:00:00.219) 0:02:00.704 **** 2025-12-03 18:28:31.245143 | controller | changed: [instance] 2025-12-03 18:28:31.274133 | controller | 2025-12-03 18:28:31.274180 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-12-03 18:28:31.274191 | controller | Wednesday 03 December 2025 18:28:31 +0000 (0:00:00.328) 0:02:01.033 **** 2025-12-03 18:28:31.274209 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-03 18:28:31.274329 | controller | 2025-12-03 18:28:31.274358 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-03 18:28:31.274375 | controller | Wednesday 03 December 2025 18:28:31 +0000 (0:00:00.029) 0:02:01.062 **** 2025-12-03 18:28:31.320193 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-03 18:28:31.320422 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-03 18:28:31.320450 | controller | 2025-12-03 18:28:31.320463 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 18:28:31.557790 | controller | Wednesday 03 December 2025 18:28:31 +0000 (0:00:00.046) 0:02:01.108 **** 2025-12-03 18:28:31.557847 | controller | ok: [instance] 2025-12-03 18:28:31.602818 | controller | 2025-12-03 18:28:31.602841 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 18:28:31.602851 | controller | Wednesday 03 December 2025 18:28:31 +0000 (0:00:00.237) 0:02:01.345 **** 2025-12-03 18:28:31.602862 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 18:28:31.828199 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:28:31.828234 | controller | 2025-12-03 18:28:31.828244 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 18:28:31.828252 | controller | Wednesday 03 December 2025 18:28:31 +0000 (0:00:00.045) 0:02:01.390 **** 2025-12-03 18:28:31.828264 | controller | ok: [instance] 2025-12-03 18:28:31.828298 | controller | 2025-12-03 18:28:31.828489 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 18:28:32.022917 | controller | Wednesday 03 December 2025 18:28:31 +0000 (0:00:00.225) 0:02:01.616 **** 2025-12-03 18:28:32.022945 | controller | ok: [instance] 2025-12-03 18:28:32.311147 | controller | 2025-12-03 18:28:32.311225 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-12-03 18:28:32.311234 | controller | Wednesday 03 December 2025 18:28:32 +0000 (0:00:00.194) 0:02:01.810 **** 2025-12-03 18:28:32.311246 | controller | changed: [instance] 2025-12-03 18:28:32.532119 | controller | 2025-12-03 18:28:32.532151 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 18:28:32.532168 | controller | Wednesday 03 December 2025 18:28:32 +0000 (0:00:00.288) 0:02:02.098 **** 2025-12-03 18:28:32.532179 | controller | ok: [instance] 2025-12-03 18:28:32.532544 | controller | 2025-12-03 18:28:32.575228 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 18:28:32.575272 | controller | Wednesday 03 December 2025 18:28:32 +0000 (0:00:00.221) 0:02:02.320 **** 2025-12-03 18:28:32.575292 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 18:28:32.799675 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:28:32.799707 | controller | 2025-12-03 18:28:32.799715 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 18:28:32.799722 | controller | Wednesday 03 December 2025 18:28:32 +0000 (0:00:00.042) 0:02:02.362 **** 2025-12-03 18:28:32.799737 | controller | ok: [instance] 2025-12-03 18:28:32.997748 | controller | 2025-12-03 18:28:32.997779 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 18:28:32.997787 | controller | Wednesday 03 December 2025 18:28:32 +0000 (0:00:00.224) 0:02:02.587 **** 2025-12-03 18:28:32.997797 | controller | ok: [instance] 2025-12-03 18:28:33.284997 | controller | 2025-12-03 18:28:33.285029 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-12-03 18:28:33.285131 | controller | Wednesday 03 December 2025 18:28:32 +0000 (0:00:00.198) 0:02:02.785 **** 2025-12-03 18:28:33.285147 | controller | changed: [instance] 2025-12-03 18:28:33.304670 | controller | 2025-12-03 18:28:33.304695 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-12-03 18:28:33.304703 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.287) 0:02:03.072 **** 2025-12-03 18:28:33.304713 | controller | skipping: [instance] 2025-12-03 18:28:33.331000 | controller | 2025-12-03 18:28:33.331025 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-12-03 18:28:33.331054 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.019) 0:02:03.092 **** 2025-12-03 18:28:33.331069 | controller | skipping: [instance] 2025-12-03 18:28:33.357574 | controller | 2025-12-03 18:28:33.357596 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-12-03 18:28:33.357603 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.026) 0:02:03.119 **** 2025-12-03 18:28:33.357613 | controller | skipping: [instance] 2025-12-03 18:28:33.382012 | controller | 2025-12-03 18:28:33.382054 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-12-03 18:28:33.382067 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.026) 0:02:03.145 **** 2025-12-03 18:28:33.382083 | controller | skipping: [instance] 2025-12-03 18:28:33.585139 | controller | 2025-12-03 18:28:33.585182 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-03 18:28:33.585192 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.024) 0:02:03.170 **** 2025-12-03 18:28:33.585203 | controller | changed: [instance] 2025-12-03 18:28:33.618968 | controller | 2025-12-03 18:28:33.618994 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-03 18:28:33.619003 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.202) 0:02:03.373 **** 2025-12-03 18:28:33.619014 | controller | ok: [instance] 2025-12-03 18:28:33.667740 | controller | 2025-12-03 18:28:33.667768 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-03 18:28:33.667777 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.033) 0:02:03.407 **** 2025-12-03 18:28:33.667788 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-03 18:28:33.847680 | controller | 2025-12-03 18:28:33.847711 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-03 18:28:33.847719 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.048) 0:02:03.455 **** 2025-12-03 18:28:33.847728 | controller | ok: [instance] 2025-12-03 18:28:33.905144 | controller | 2025-12-03 18:28:33.905195 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-03 18:28:33.905205 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.179) 0:02:03.635 **** 2025-12-03 18:28:33.905225 | controller | ok: [instance] 2025-12-03 18:28:33.948031 | controller | 2025-12-03 18:28:33.948083 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-03 18:28:33.948093 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.057) 0:02:03.693 **** 2025-12-03 18:28:33.948105 | controller | ok: [instance] 2025-12-03 18:28:33.988320 | controller | 2025-12-03 18:28:33.988350 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-03 18:28:33.988359 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.042) 0:02:03.735 **** 2025-12-03 18:28:33.988370 | controller | skipping: [instance] 2025-12-03 18:28:33.988531 | controller | 2025-12-03 18:28:33.988689 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-03 18:28:33.988829 | controller | Wednesday 03 December 2025 18:28:33 +0000 (0:00:00.040) 0:02:03.776 **** 2025-12-03 18:28:34.027657 | controller | skipping: [instance] 2025-12-03 18:28:34.027834 | controller | 2025-12-03 18:28:34.027981 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-03 18:28:34.028133 | controller | Wednesday 03 December 2025 18:28:34 +0000 (0:00:00.039) 0:02:03.816 **** 2025-12-03 18:28:34.081073 | controller | 2025-12-03 18:28:34.081295 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-03 18:28:34.081458 | controller | Wednesday 03 December 2025 18:28:34 +0000 (0:00:00.053) 0:02:03.869 **** 2025-12-03 18:28:34.457882 | controller | ok: [instance] => (item=artifacts) 2025-12-03 18:28:35.591128 | controller | ok: [instance] => (item=logs) 2025-12-03 18:28:35.591161 | controller | 2025-12-03 18:28:35.591170 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-03 18:28:35.591190 | controller | Wednesday 03 December 2025 18:28:34 +0000 (0:00:00.376) 0:02:04.245 **** 2025-12-03 18:28:35.591202 | controller | ok: [instance] 2025-12-03 18:28:35.591235 | controller | 2025-12-03 18:28:35.591245 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-03 18:28:35.591360 | controller | Wednesday 03 December 2025 18:28:35 +0000 (0:00:01.133) 0:02:05.379 **** 2025-12-03 18:28:35.790168 | controller | changed: [instance] 2025-12-03 18:28:35.790231 | controller | 2025-12-03 18:28:35.790244 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-03 18:28:35.790335 | controller | Wednesday 03 December 2025 18:28:35 +0000 (0:00:00.199) 0:02:05.578 **** 2025-12-03 18:28:36.133103 | controller | changed: [instance] 2025-12-03 18:28:36.489144 | controller | 2025-12-03 18:28:36.489194 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-03 18:28:36.489212 | controller | Wednesday 03 December 2025 18:28:36 +0000 (0:00:00.342) 0:02:05.921 **** 2025-12-03 18:28:36.489225 | controller | changed: [instance] 2025-12-03 18:28:36.532163 | controller | 2025-12-03 18:28:36.532193 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-03 18:28:36.532202 | controller | Wednesday 03 December 2025 18:28:36 +0000 (0:00:00.356) 0:02:06.277 **** 2025-12-03 18:28:36.532213 | controller | skipping: [instance] 2025-12-03 18:28:36.728643 | controller | 2025-12-03 18:28:36.728675 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-03 18:28:36.728685 | controller | Wednesday 03 December 2025 18:28:36 +0000 (0:00:00.043) 0:02:06.320 **** 2025-12-03 18:28:36.728696 | controller | ok: [instance] 2025-12-03 18:28:36.777535 | controller | 2025-12-03 18:28:36.777557 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-03 18:28:36.777567 | controller | Wednesday 03 December 2025 18:28:36 +0000 (0:00:00.195) 0:02:06.515 **** 2025-12-03 18:28:36.777578 | controller | skipping: [instance] 2025-12-03 18:28:37.015817 | controller | 2025-12-03 18:28:37.015845 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-03 18:28:37.015853 | controller | Wednesday 03 December 2025 18:28:36 +0000 (0:00:00.049) 0:02:06.565 **** 2025-12-03 18:28:37.015862 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-12-03 18:28:37.304795 | controller | changed: [instance] 2025-12-03 18:28:37.304825 | controller | 2025-12-03 18:28:37.304832 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-03 18:28:37.304839 | controller | Wednesday 03 December 2025 18:28:37 +0000 (0:00:00.238) 0:02:06.803 **** 2025-12-03 18:28:37.304848 | controller | changed: [instance] 2025-12-03 18:28:37.351170 | controller | 2025-12-03 18:28:37.351216 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-03 18:28:37.351225 | controller | Wednesday 03 December 2025 18:28:37 +0000 (0:00:00.289) 0:02:07.092 **** 2025-12-03 18:28:37.351237 | controller | skipping: [instance] 2025-12-03 18:28:37.379981 | controller | 2025-12-03 18:28:37.380013 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2025-12-03 18:28:37.380022 | controller | Wednesday 03 December 2025 18:28:37 +0000 (0:00:00.046) 0:02:07.139 **** 2025-12-03 18:28:37.380054 | controller | skipping: [instance] 2025-12-03 18:28:37.625555 | controller | 2025-12-03 18:28:37.625586 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-12-03 18:28:37.625594 | controller | Wednesday 03 December 2025 18:28:37 +0000 (0:00:00.028) 0:02:07.168 **** 2025-12-03 18:28:37.625605 | controller | changed: [instance] 2025-12-03 18:28:37.859160 | controller | 2025-12-03 18:28:37.859214 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-12-03 18:28:37.859225 | controller | Wednesday 03 December 2025 18:28:37 +0000 (0:00:00.245) 0:02:07.413 **** 2025-12-03 18:28:37.859239 | controller | changed: [instance] 2025-12-03 18:28:38.156244 | controller | 2025-12-03 18:28:38.156281 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-12-03 18:28:38.156291 | controller | Wednesday 03 December 2025 18:28:37 +0000 (0:00:00.233) 0:02:07.646 **** 2025-12-03 18:28:38.156317 | controller | changed: [instance] 2025-12-03 18:28:38.156349 | controller | 2025-12-03 18:28:38.156359 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-12-03 18:28:38.185165 | controller | Wednesday 03 December 2025 18:28:38 +0000 (0:00:00.297) 0:02:07.944 **** 2025-12-03 18:28:38.185220 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-03 18:28:38.185252 | controller | 2025-12-03 18:28:38.185417 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-03 18:28:38.229144 | controller | Wednesday 03 December 2025 18:28:38 +0000 (0:00:00.029) 0:02:07.973 **** 2025-12-03 18:28:38.229169 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-03 18:28:38.229315 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-03 18:28:38.229353 | controller | 2025-12-03 18:28:38.229396 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 18:28:38.229546 | controller | Wednesday 03 December 2025 18:28:38 +0000 (0:00:00.043) 0:02:08.017 **** 2025-12-03 18:28:38.461601 | controller | ok: [instance] 2025-12-03 18:28:38.509147 | controller | 2025-12-03 18:28:38.509181 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 18:28:38.509199 | controller | Wednesday 03 December 2025 18:28:38 +0000 (0:00:00.231) 0:02:08.249 **** 2025-12-03 18:28:38.509212 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 18:28:38.509457 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:28:38.509477 | controller | 2025-12-03 18:28:38.509490 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 18:28:38.509559 | controller | Wednesday 03 December 2025 18:28:38 +0000 (0:00:00.047) 0:02:08.297 **** 2025-12-03 18:28:38.743909 | controller | ok: [instance] 2025-12-03 18:28:38.940761 | controller | 2025-12-03 18:28:38.940790 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 18:28:38.940799 | controller | Wednesday 03 December 2025 18:28:38 +0000 (0:00:00.234) 0:02:08.531 **** 2025-12-03 18:28:38.940810 | controller | ok: [instance] 2025-12-03 18:28:40.215108 | controller | 2025-12-03 18:28:40.215139 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-12-03 18:28:40.215149 | controller | Wednesday 03 December 2025 18:28:38 +0000 (0:00:00.196) 0:02:08.728 **** 2025-12-03 18:28:40.215160 | controller | changed: [instance] 2025-12-03 18:28:40.440819 | controller | 2025-12-03 18:28:40.440848 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 18:28:40.440858 | controller | Wednesday 03 December 2025 18:28:40 +0000 (0:00:01.274) 0:02:10.002 **** 2025-12-03 18:28:40.440869 | controller | ok: [instance] 2025-12-03 18:28:40.485793 | controller | 2025-12-03 18:28:40.485816 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 18:28:40.485825 | controller | Wednesday 03 December 2025 18:28:40 +0000 (0:00:00.225) 0:02:10.228 **** 2025-12-03 18:28:40.485835 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 18:28:40.704620 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 18:28:40.704640 | controller | 2025-12-03 18:28:40.704648 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 18:28:40.704653 | controller | Wednesday 03 December 2025 18:28:40 +0000 (0:00:00.044) 0:02:10.273 **** 2025-12-03 18:28:40.704662 | controller | ok: [instance] 2025-12-03 18:28:40.904116 | controller | 2025-12-03 18:28:40.904139 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 18:28:40.904146 | controller | Wednesday 03 December 2025 18:28:40 +0000 (0:00:00.218) 0:02:10.492 **** 2025-12-03 18:28:40.904155 | controller | ok: [instance] 2025-12-03 18:28:41.185506 | controller | 2025-12-03 18:28:41.185534 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-12-03 18:28:41.185541 | controller | Wednesday 03 December 2025 18:28:40 +0000 (0:00:00.199) 0:02:10.692 **** 2025-12-03 18:28:41.185551 | controller | changed: [instance] 2025-12-03 18:28:41.206425 | controller | 2025-12-03 18:28:41.206455 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-12-03 18:28:41.206468 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.281) 0:02:10.973 **** 2025-12-03 18:28:41.206482 | controller | skipping: [instance] 2025-12-03 18:28:41.231161 | controller | 2025-12-03 18:28:41.231182 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-12-03 18:28:41.231190 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.020) 0:02:10.994 **** 2025-12-03 18:28:41.231210 | controller | skipping: [instance] 2025-12-03 18:28:41.231239 | controller | 2025-12-03 18:28:41.231456 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-12-03 18:28:41.257672 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.025) 0:02:11.019 **** 2025-12-03 18:28:41.257708 | controller | skipping: [instance] 2025-12-03 18:28:41.282238 | controller | 2025-12-03 18:28:41.282276 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-12-03 18:28:41.282290 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.025) 0:02:11.045 **** 2025-12-03 18:28:41.282302 | controller | skipping: [instance] 2025-12-03 18:28:41.282333 | controller | 2025-12-03 18:28:41.282340 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-03 18:28:41.282348 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.024) 0:02:11.070 **** 2025-12-03 18:28:41.505864 | controller | changed: [instance] 2025-12-03 18:28:41.541480 | controller | 2025-12-03 18:28:41.541504 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-03 18:28:41.541513 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.223) 0:02:11.293 **** 2025-12-03 18:28:41.541524 | controller | ok: [instance] 2025-12-03 18:28:41.567942 | controller | 2025-12-03 18:28:41.567963 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-03 18:28:41.567973 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.035) 0:02:11.329 **** 2025-12-03 18:28:41.567985 | controller | skipping: [instance] 2025-12-03 18:28:41.592153 | controller | 2025-12-03 18:28:41.592175 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-03 18:28:41.592184 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.026) 0:02:11.356 **** 2025-12-03 18:28:41.592194 | controller | skipping: [instance] 2025-12-03 18:28:41.592233 | controller | 2025-12-03 18:28:41.592243 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-03 18:28:41.592328 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.024) 0:02:11.380 **** 2025-12-03 18:28:41.633142 | controller | skipping: [instance] 2025-12-03 18:28:41.633347 | controller | 2025-12-03 18:28:41.633364 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2025-12-03 18:28:41.657147 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.040) 0:02:11.421 **** 2025-12-03 18:28:41.657173 | controller | skipping: [instance] 2025-12-03 18:28:41.657251 | controller | 2025-12-03 18:28:41.657274 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-12-03 18:28:41.657285 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.023) 0:02:11.445 **** 2025-12-03 18:28:41.714194 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-12-03 18:28:41.714439 | controller | 2025-12-03 18:28:41.714456 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-12-03 18:28:41.945191 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.057) 0:02:11.502 **** 2025-12-03 18:28:41.945291 | controller | ok: [instance] => (item=crc) 2025-12-03 18:28:41.945480 | controller | 2025-12-03 18:28:41.945662 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-12-03 18:28:41.945832 | controller | Wednesday 03 December 2025 18:28:41 +0000 (0:00:00.230) 0:02:11.733 **** 2025-12-03 18:28:44.013743 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 18:28:44.013933 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 18:28:44.014113 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 18:28:44.014264 | controller | 2025-12-03 18:28:44.014419 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-03 18:28:44.014557 | controller | Wednesday 03 December 2025 18:28:44 +0000 (0:00:02.068) 0:02:13.801 **** 2025-12-03 18:28:44.877613 | controller | changed: [instance] 2025-12-03 18:28:44.877694 | controller | 2025-12-03 18:28:44.877707 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-03 18:28:44.877814 | controller | Wednesday 03 December 2025 18:28:44 +0000 (0:00:00.863) 0:02:14.665 **** 2025-12-03 18:28:45.656570 | controller | changed: [instance] 2025-12-03 18:28:46.476470 | controller | 2025-12-03 18:28:46.476506 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-03 18:28:46.476515 | controller | Wednesday 03 December 2025 18:28:45 +0000 (0:00:00.778) 0:02:15.444 **** 2025-12-03 18:28:46.476525 | controller | changed: [instance] 2025-12-03 18:28:47.225726 | controller | 2025-12-03 18:28:47.225765 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-12-03 18:28:47.225775 | controller | Wednesday 03 December 2025 18:28:46 +0000 (0:00:00.819) 0:02:16.263 **** 2025-12-03 18:28:47.225789 | controller | changed: [instance] => (item=compute-0.utility) 2025-12-03 18:28:47.225812 | controller | changed: [instance] => (item=controller-0.utility) 2025-12-03 18:28:47.225822 | controller | changed: [instance] => (item=crc-0.utility) 2025-12-03 18:28:47.225914 | controller | 2025-12-03 18:28:47.225925 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-12-03 18:28:47.226014 | controller | Wednesday 03 December 2025 18:28:47 +0000 (0:00:00.748) 0:02:17.012 **** 2025-12-03 18:29:06.990198 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-03 18:29:06.990244 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-12-03 18:29:06.990315 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-12-03 18:29:06.990409 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-12-03 18:29:06.990493 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-12-03 18:29:06.990604 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j277207442625.23901', 'results_file': '/home/zuul/.ansible_async/j277207442625.23901', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-12-03 18:29:06.990702 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j538218895872.23918', 'results_file': '/home/zuul/.ansible_async/j538218895872.23918', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-12-03 18:29:06.990796 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-03 18:29:06.990908 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j595027280240.23934', 'results_file': '/home/zuul/.ansible_async/j595027280240.23934', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-12-03 18:29:06.990988 | controller | 2025-12-03 18:29:06.991103 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-12-03 18:29:06.991199 | controller | Wednesday 03 December 2025 18:29:06 +0000 (0:00:19.765) 0:02:36.778 **** 2025-12-03 18:29:07.102694 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 18:29:07.129397 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 18:29:07.129441 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 18:29:07.129449 | controller | 2025-12-03 18:29:07.129455 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 18:29:07.129461 | controller | Wednesday 03 December 2025 18:29:07 +0000 (0:00:00.112) 0:02:36.890 **** 2025-12-03 18:29:07.129471 | controller | skipping: [instance] 2025-12-03 18:29:07.129511 | controller | 2025-12-03 18:29:07.129518 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-12-03 18:29:07.170729 | controller | Wednesday 03 December 2025 18:29:07 +0000 (0:00:00.027) 0:02:36.917 **** 2025-12-03 18:29:07.170759 | controller | 2025-12-03 18:29:07.170964 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-03 18:29:07.254934 | controller | Wednesday 03 December 2025 18:29:07 +0000 (0:00:00.041) 0:02:36.958 **** 2025-12-03 18:29:07.254970 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-03 18:29:07.254988 | controller | 2025-12-03 18:29:07.254996 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-03 18:29:07.255031 | controller | Wednesday 03 December 2025 18:29:07 +0000 (0:00:00.083) 0:02:37.042 **** 2025-12-03 18:29:07.476834 | controller | changed: [instance] 2025-12-03 18:29:07.721970 | controller | 2025-12-03 18:29:07.722003 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-03 18:29:07.722011 | controller | Wednesday 03 December 2025 18:29:07 +0000 (0:00:00.221) 0:02:37.264 **** 2025-12-03 18:29:07.722022 | controller | changed: [instance] 2025-12-03 18:29:07.722265 | controller | 2025-12-03 18:29:07.722452 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-12-03 18:29:08.136726 | controller | Wednesday 03 December 2025 18:29:07 +0000 (0:00:00.245) 0:02:37.509 **** 2025-12-03 18:29:08.136778 | controller | changed: [instance] 2025-12-03 18:29:08.165451 | controller | 2025-12-03 18:29:08.165485 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-12-03 18:29:08.165494 | controller | Wednesday 03 December 2025 18:29:08 +0000 (0:00:00.414) 0:02:37.924 **** 2025-12-03 18:29:08.165507 | controller | skipping: [instance] 2025-12-03 18:29:08.192734 | controller | 2025-12-03 18:29:08.192763 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-03 18:29:08.192771 | controller | Wednesday 03 December 2025 18:29:08 +0000 (0:00:00.029) 0:02:37.953 **** 2025-12-03 18:29:08.192780 | controller | skipping: [instance] 2025-12-03 18:29:08.242339 | controller | 2025-12-03 18:29:08.242373 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-12-03 18:29:08.242382 | controller | Wednesday 03 December 2025 18:29:08 +0000 (0:00:00.027) 0:02:37.980 **** 2025-12-03 18:29:08.242392 | controller | skipping: [instance] 2025-12-03 18:29:08.290844 | controller | 2025-12-03 18:29:08.290891 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-12-03 18:29:08.290899 | controller | Wednesday 03 December 2025 18:29:08 +0000 (0:00:00.049) 0:02:38.030 **** 2025-12-03 18:29:08.290910 | controller | skipping: [instance] 2025-12-03 18:29:08.290928 | controller | 2025-12-03 18:29:08.290935 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 18:29:08.290989 | controller | Wednesday 03 December 2025 18:29:08 +0000 (0:00:00.048) 0:02:38.078 **** 2025-12-03 18:29:08.325692 | controller | skipping: [instance] 2025-12-03 18:29:08.325778 | controller | 2025-12-03 18:29:08.325898 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-12-03 18:29:08.326027 | controller | Wednesday 03 December 2025 18:29:08 +0000 (0:00:00.035) 0:02:38.113 **** 2025-12-03 18:29:08.369787 | controller | 2025-12-03 18:29:08.467408 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-03 18:29:08.467456 | controller | Wednesday 03 December 2025 18:29:08 +0000 (0:00:00.043) 0:02:38.157 **** 2025-12-03 18:29:08.467470 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-03 18:29:08.467498 | controller | 2025-12-03 18:29:08.467507 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-03 18:29:08.467591 | controller | Wednesday 03 December 2025 18:29:08 +0000 (0:00:00.097) 0:02:38.255 **** 2025-12-03 18:29:08.711664 | controller | ok: [instance] 2025-12-03 18:29:08.711723 | controller | 2025-12-03 18:29:08.711855 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-03 18:29:08.711964 | controller | Wednesday 03 December 2025 18:29:08 +0000 (0:00:00.244) 0:02:38.499 **** 2025-12-03 18:29:08.932595 | controller | ok: [instance] 2025-12-03 18:29:09.370605 | controller | 2025-12-03 18:29:09.370651 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-12-03 18:29:09.370665 | controller | Wednesday 03 December 2025 18:29:08 +0000 (0:00:00.220) 0:02:38.719 **** 2025-12-03 18:29:09.370677 | controller | changed: [instance] 2025-12-03 18:29:09.370695 | controller | 2025-12-03 18:29:09.370703 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-12-03 18:29:09.370779 | controller | Wednesday 03 December 2025 18:29:09 +0000 (0:00:00.438) 0:02:39.158 **** 2025-12-03 18:29:09.412351 | controller | skipping: [instance] 2025-12-03 18:29:09.412444 | controller | 2025-12-03 18:29:09.412549 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-03 18:29:09.412663 | controller | Wednesday 03 December 2025 18:29:09 +0000 (0:00:00.042) 0:02:39.200 **** 2025-12-03 18:29:09.443946 | controller | skipping: [instance] 2025-12-03 18:29:09.444056 | controller | 2025-12-03 18:29:09.444167 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-12-03 18:29:09.444266 | controller | Wednesday 03 December 2025 18:29:09 +0000 (0:00:00.031) 0:02:39.232 **** 2025-12-03 18:29:11.204633 | controller | changed: [instance -> controller-0.instance] 2025-12-03 18:29:11.204684 | controller | 2025-12-03 18:29:11.204772 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-12-03 18:29:11.204869 | controller | Wednesday 03 December 2025 18:29:11 +0000 (0:00:01.754) 0:02:40.986 **** 2025-12-03 18:29:12.384000 | controller | changed: [instance -> controller-0.instance] 2025-12-03 18:29:12.384066 | controller | 2025-12-03 18:29:12.384141 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 18:29:12.384236 | controller | Wednesday 03 December 2025 18:29:12 +0000 (0:00:01.185) 0:02:42.172 **** 2025-12-03 18:29:12.423484 | controller | 2025-12-03 18:29:12.423585 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-03 18:29:12.423704 | controller | Wednesday 03 December 2025 18:29:12 +0000 (0:00:00.039) 0:02:42.211 **** 2025-12-03 18:29:12.657086 | controller | ok: [instance] 2025-12-03 18:29:12.657186 | controller | 2025-12-03 18:29:12.657302 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-03 18:29:12.657424 | controller | Wednesday 03 December 2025 18:29:12 +0000 (0:00:00.232) 0:02:42.444 **** 2025-12-03 18:29:12.685746 | controller | ok: [instance] 2025-12-03 18:29:12.685845 | controller | 2025-12-03 18:29:12.685950 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-03 18:29:12.686066 | controller | Wednesday 03 December 2025 18:29:12 +0000 (0:00:00.029) 0:02:42.474 **** 2025-12-03 18:29:12.716691 | controller | skipping: [instance] 2025-12-03 18:29:12.716791 | controller | 2025-12-03 18:29:12.716901 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-12-03 18:29:12.716992 | controller | Wednesday 03 December 2025 18:29:12 +0000 (0:00:00.030) 0:02:42.505 **** 2025-12-03 18:29:12.796674 | controller | 2025-12-03 18:29:12.796786 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-03 18:29:12.796878 | controller | Wednesday 03 December 2025 18:29:12 +0000 (0:00:00.079) 0:02:42.584 **** 2025-12-03 18:29:12.881868 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-12-03 18:29:12.881958 | controller | 2025-12-03 18:29:12.882082 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-03 18:29:12.882178 | controller | Wednesday 03 December 2025 18:29:12 +0000 (0:00:00.085) 0:02:42.670 **** 2025-12-03 18:29:13.143999 | controller | ok: [instance] 2025-12-03 18:29:13.144096 | controller | 2025-12-03 18:29:13.144210 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-03 18:29:13.144223 | controller | Wednesday 03 December 2025 18:29:13 +0000 (0:00:00.261) 0:02:42.931 **** 2025-12-03 18:29:13.389815 | controller | ok: [instance] 2025-12-03 18:29:13.389900 | controller | 2025-12-03 18:29:13.389969 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-12-03 18:29:13.389983 | controller | Wednesday 03 December 2025 18:29:13 +0000 (0:00:00.245) 0:02:43.177 **** 2025-12-03 18:29:13.784290 | controller | changed: [instance] 2025-12-03 18:29:13.784378 | controller | 2025-12-03 18:29:13.784445 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-12-03 18:29:13.784529 | controller | Wednesday 03 December 2025 18:29:13 +0000 (0:00:00.394) 0:02:43.572 **** 2025-12-03 18:29:14.620564 | controller | changed: [instance] 2025-12-03 18:29:14.620661 | controller | 2025-12-03 18:29:14.620737 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-03 18:29:14.620750 | controller | Wednesday 03 December 2025 18:29:14 +0000 (0:00:00.836) 0:02:44.408 **** 2025-12-03 18:29:14.659933 | controller | skipping: [instance] 2025-12-03 18:29:14.660022 | controller | 2025-12-03 18:29:14.660161 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-12-03 18:29:14.660263 | controller | Wednesday 03 December 2025 18:29:14 +0000 (0:00:00.039) 0:02:44.448 **** 2025-12-03 18:29:14.722587 | controller | skipping: [instance] 2025-12-03 18:29:14.722672 | controller | 2025-12-03 18:29:14.722772 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-12-03 18:29:14.722891 | controller | Wednesday 03 December 2025 18:29:14 +0000 (0:00:00.062) 0:02:44.510 **** 2025-12-03 18:29:14.780843 | controller | skipping: [instance] 2025-12-03 18:29:14.780949 | controller | 2025-12-03 18:29:14.781075 | controller | TASK [Create VBMC entity] ****************************************************** 2025-12-03 18:29:14.781193 | controller | Wednesday 03 December 2025 18:29:14 +0000 (0:00:00.058) 0:02:44.568 **** 2025-12-03 18:29:14.844054 | controller | skipping: [instance] => (item=compute-0) 2025-12-03 18:29:14.844127 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 18:29:14.844261 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 18:29:14.844275 | controller | skipping: [instance] 2025-12-03 18:29:14.844364 | controller | 2025-12-03 18:29:14.844461 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-12-03 18:29:14.844558 | controller | Wednesday 03 December 2025 18:29:14 +0000 (0:00:00.063) 0:02:44.632 **** 2025-12-03 18:29:15.106788 | controller | ok: [instance] 2025-12-03 18:29:15.106851 | controller | 2025-12-03 18:29:15.106904 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-12-03 18:29:15.107017 | controller | Wednesday 03 December 2025 18:29:15 +0000 (0:00:00.262) 0:02:44.894 **** 2025-12-03 18:29:15.514673 | controller | changed: [instance] 2025-12-03 18:29:15.514749 | controller | 2025-12-03 18:29:15.514789 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-12-03 18:29:15.515138 | controller | Wednesday 03 December 2025 18:29:15 +0000 (0:00:00.402) 0:02:45.297 **** 2025-12-03 18:29:15.557505 | controller | skipping: [instance] 2025-12-03 18:29:15.557591 | controller | 2025-12-03 18:29:15.557692 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-12-03 18:29:15.557824 | controller | Wednesday 03 December 2025 18:29:15 +0000 (0:00:00.048) 0:02:45.345 **** 2025-12-03 18:29:15.597344 | controller | skipping: [instance] 2025-12-03 18:29:15.597440 | controller | 2025-12-03 18:29:15.597541 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-12-03 18:29:15.597638 | controller | Wednesday 03 December 2025 18:29:15 +0000 (0:00:00.039) 0:02:45.385 **** 2025-12-03 18:29:15.641689 | controller | skipping: [instance] 2025-12-03 18:29:15.641774 | controller | 2025-12-03 18:29:15.641891 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-12-03 18:29:15.642064 | controller | Wednesday 03 December 2025 18:29:15 +0000 (0:00:00.044) 0:02:45.430 **** 2025-12-03 18:29:16.312870 | controller | changed: [instance] 2025-12-03 18:29:16.312960 | controller | 2025-12-03 18:29:16.312991 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-12-03 18:29:16.313004 | controller | Wednesday 03 December 2025 18:29:16 +0000 (0:00:00.670) 0:02:46.100 **** 2025-12-03 18:29:16.965602 | controller | changed: [instance] 2025-12-03 18:29:17.010194 | controller | 2025-12-03 18:29:17.010228 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-12-03 18:29:17.010236 | controller | Wednesday 03 December 2025 18:29:16 +0000 (0:00:00.652) 0:02:46.753 **** 2025-12-03 18:29:17.010247 | controller | skipping: [instance] 2025-12-03 18:29:17.076635 | controller | 2025-12-03 18:29:17.076673 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-12-03 18:29:17.076682 | controller | Wednesday 03 December 2025 18:29:17 +0000 (0:00:00.045) 0:02:46.798 **** 2025-12-03 18:29:17.076692 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-12-03 18:29:17.122874 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-12-03 18:29:17.122896 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-12-03 18:29:17.122904 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-12-03 18:29:17.122909 | controller | 2025-12-03 18:29:17.122915 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-12-03 18:29:17.122920 | controller | Wednesday 03 December 2025 18:29:17 +0000 (0:00:00.065) 0:02:46.864 **** 2025-12-03 18:29:17.122929 | controller | skipping: [instance] 2025-12-03 18:29:17.161505 | controller | 2025-12-03 18:29:17.161575 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-12-03 18:29:17.161584 | controller | Wednesday 03 December 2025 18:29:17 +0000 (0:00:00.046) 0:02:46.910 **** 2025-12-03 18:29:17.161599 | controller | skipping: [instance] 2025-12-03 18:29:17.198538 | controller | 2025-12-03 18:29:17.198555 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-12-03 18:29:17.198563 | controller | Wednesday 03 December 2025 18:29:17 +0000 (0:00:00.038) 0:02:46.949 **** 2025-12-03 18:29:17.198571 | controller | skipping: [instance] 2025-12-03 18:29:17.198635 | controller | 2025-12-03 18:29:17.198748 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-12-03 18:29:17.198865 | controller | Wednesday 03 December 2025 18:29:17 +0000 (0:00:00.037) 0:02:46.986 **** 2025-12-03 18:29:17.235930 | controller | skipping: [instance] 2025-12-03 18:29:17.236014 | controller | 2025-12-03 18:29:17.236132 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-12-03 18:29:17.236243 | controller | Wednesday 03 December 2025 18:29:17 +0000 (0:00:00.037) 0:02:47.024 **** 2025-12-03 18:29:17.918780 | controller | changed: [instance] 2025-12-03 18:29:17.918948 | controller | 2025-12-03 18:29:17.919152 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-12-03 18:29:17.919302 | controller | Wednesday 03 December 2025 18:29:17 +0000 (0:00:00.682) 0:02:47.706 **** 2025-12-03 18:29:17.958891 | controller | skipping: [instance] 2025-12-03 18:29:17.959155 | controller | 2025-12-03 18:29:17.959392 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-12-03 18:29:17.995790 | controller | Wednesday 03 December 2025 18:29:17 +0000 (0:00:00.040) 0:02:47.747 **** 2025-12-03 18:29:17.995827 | controller | skipping: [instance] 2025-12-03 18:29:18.032380 | controller | 2025-12-03 18:29:18.032405 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-12-03 18:29:18.032413 | controller | Wednesday 03 December 2025 18:29:17 +0000 (0:00:00.036) 0:02:47.783 **** 2025-12-03 18:29:18.032423 | controller | skipping: [instance] 2025-12-03 18:29:18.072756 | controller | 2025-12-03 18:29:18.072780 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-03 18:29:18.072788 | controller | Wednesday 03 December 2025 18:29:18 +0000 (0:00:00.036) 0:02:47.819 **** 2025-12-03 18:29:18.072798 | controller | skipping: [instance] 2025-12-03 18:29:18.113662 | controller | 2025-12-03 18:29:18.113703 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-03 18:29:18.113712 | controller | Wednesday 03 December 2025 18:29:18 +0000 (0:00:00.041) 0:02:47.860 **** 2025-12-03 18:29:18.113723 | controller | skipping: [instance] 2025-12-03 18:29:18.113821 | controller | 2025-12-03 18:29:18.113843 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-03 18:29:18.148153 | controller | Wednesday 03 December 2025 18:29:18 +0000 (0:00:00.040) 0:02:47.901 **** 2025-12-03 18:29:18.148199 | controller | skipping: [instance] 2025-12-03 18:29:18.182141 | controller | 2025-12-03 18:29:18.182184 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-03 18:29:18.182200 | controller | Wednesday 03 December 2025 18:29:18 +0000 (0:00:00.034) 0:02:47.936 **** 2025-12-03 18:29:18.182222 | controller | skipping: [instance] 2025-12-03 18:29:18.182243 | controller | 2025-12-03 18:29:18.182379 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-03 18:29:18.182461 | controller | Wednesday 03 December 2025 18:29:18 +0000 (0:00:00.034) 0:02:47.970 **** 2025-12-03 18:29:18.217651 | controller | skipping: [instance] 2025-12-03 18:29:18.217853 | controller | 2025-12-03 18:29:18.217874 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-03 18:29:18.252344 | controller | Wednesday 03 December 2025 18:29:18 +0000 (0:00:00.035) 0:02:48.005 **** 2025-12-03 18:29:18.252370 | controller | skipping: [instance] 2025-12-03 18:29:18.252391 | controller | 2025-12-03 18:29:18.252510 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-03 18:29:18.252599 | controller | Wednesday 03 December 2025 18:29:18 +0000 (0:00:00.034) 0:02:48.040 **** 2025-12-03 18:29:18.300689 | controller | skipping: [instance] 2025-12-03 18:29:18.333984 | controller | 2025-12-03 18:29:18.334015 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-12-03 18:29:18.334024 | controller | Wednesday 03 December 2025 18:29:18 +0000 (0:00:00.047) 0:02:48.088 **** 2025-12-03 18:29:18.334051 | controller | skipping: [instance] 2025-12-03 18:29:18.482492 | controller | 2025-12-03 18:29:18.482511 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-12-03 18:29:18.482519 | controller | Wednesday 03 December 2025 18:29:18 +0000 (0:00:00.033) 0:02:48.121 **** 2025-12-03 18:29:18.482528 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-12-03 18:29:19.841830 | controller | 2025-12-03 18:29:19.841864 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-03 18:29:19.841872 | controller | Wednesday 03 December 2025 18:29:18 +0000 (0:00:00.148) 0:02:48.270 **** 2025-12-03 18:29:19.841882 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-03 18:29:19.862863 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-03 18:29:19.862880 | controller | 2025-12-03 18:29:19.862888 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-03 18:29:19.862899 | controller | Wednesday 03 December 2025 18:29:19 +0000 (0:00:01.358) 0:02:49.629 **** 2025-12-03 18:29:19.862907 | controller | skipping: [instance] 2025-12-03 18:29:20.492705 | controller | 2025-12-03 18:29:20.492740 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-03 18:29:20.492750 | controller | Wednesday 03 December 2025 18:29:19 +0000 (0:00:00.021) 0:02:49.650 **** 2025-12-03 18:29:20.492761 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:20.526267 | controller | 2025-12-03 18:29:20.526337 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-03 18:29:20.526362 | controller | Wednesday 03 December 2025 18:29:20 +0000 (0:00:00.629) 0:02:50.280 **** 2025-12-03 18:29:20.526380 | controller | skipping: [instance] 2025-12-03 18:29:20.562595 | controller | 2025-12-03 18:29:20.562652 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-03 18:29:20.562665 | controller | Wednesday 03 December 2025 18:29:20 +0000 (0:00:00.033) 0:02:50.314 **** 2025-12-03 18:29:20.562680 | controller | skipping: [instance] 2025-12-03 18:29:20.562804 | controller | 2025-12-03 18:29:20.562853 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-03 18:29:20.562866 | controller | Wednesday 03 December 2025 18:29:20 +0000 (0:00:00.036) 0:02:50.350 **** 2025-12-03 18:29:20.596768 | controller | skipping: [instance] 2025-12-03 18:29:22.175198 | controller | 2025-12-03 18:29:22.175231 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-03 18:29:22.175239 | controller | Wednesday 03 December 2025 18:29:20 +0000 (0:00:00.033) 0:02:50.384 **** 2025-12-03 18:29:22.175250 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:22.207195 | controller | 2025-12-03 18:29:22.207236 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-12-03 18:29:22.207246 | controller | Wednesday 03 December 2025 18:29:22 +0000 (0:00:01.578) 0:02:51.962 **** 2025-12-03 18:29:22.207258 | controller | skipping: [instance] 2025-12-03 18:29:22.237958 | controller | 2025-12-03 18:29:22.237981 | controller | TASK [reproducer : Install repos] ********************************************** 2025-12-03 18:29:22.237989 | controller | Wednesday 03 December 2025 18:29:22 +0000 (0:00:00.032) 0:02:51.995 **** 2025-12-03 18:29:22.238000 | controller | skipping: [instance] 2025-12-03 18:29:22.268185 | controller | 2025-12-03 18:29:22.268219 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-12-03 18:29:22.268228 | controller | Wednesday 03 December 2025 18:29:22 +0000 (0:00:00.030) 0:02:52.026 **** 2025-12-03 18:29:22.268240 | controller | skipping: [instance] 2025-12-03 18:29:22.268248 | controller | 2025-12-03 18:29:22.268254 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-12-03 18:29:22.268262 | controller | Wednesday 03 December 2025 18:29:22 +0000 (0:00:00.030) 0:02:52.056 **** 2025-12-03 18:29:22.301871 | controller | skipping: [instance] 2025-12-03 18:29:22.301978 | controller | 2025-12-03 18:29:22.302144 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-12-03 18:29:22.302289 | controller | Wednesday 03 December 2025 18:29:22 +0000 (0:00:00.033) 0:02:52.090 **** 2025-12-03 18:29:23.324600 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:23.324661 | controller | 2025-12-03 18:29:23.324848 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-12-03 18:29:24.379379 | controller | Wednesday 03 December 2025 18:29:23 +0000 (0:00:01.022) 0:02:53.112 **** 2025-12-03 18:29:24.379424 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:24.379453 | controller | 2025-12-03 18:29:24.379462 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-12-03 18:29:24.941757 | controller | Wednesday 03 December 2025 18:29:24 +0000 (0:00:01.054) 0:02:54.167 **** 2025-12-03 18:29:24.941790 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:25.923542 | controller | 2025-12-03 18:29:25.923573 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-12-03 18:29:25.923580 | controller | Wednesday 03 December 2025 18:29:24 +0000 (0:00:00.562) 0:02:54.729 **** 2025-12-03 18:29:25.923590 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:27.031572 | controller | 2025-12-03 18:29:27.031605 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-12-03 18:29:27.031613 | controller | Wednesday 03 December 2025 18:29:25 +0000 (0:00:00.981) 0:02:55.711 **** 2025-12-03 18:29:27.031624 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-03 18:29:27.682593 | controller | skipping: [instance] => (item=compute-0) 2025-12-03 18:29:27.682628 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 18:29:27.682636 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 18:29:27.682642 | controller | 2025-12-03 18:29:27.682648 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-12-03 18:29:27.682654 | controller | Wednesday 03 December 2025 18:29:27 +0000 (0:00:01.107) 0:02:56.818 **** 2025-12-03 18:29:27.682669 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-03 18:29:29.399632 | controller | skipping: [instance] => (item=compute-0) 2025-12-03 18:29:29.399664 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 18:29:29.399671 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 18:29:29.399677 | controller | 2025-12-03 18:29:29.399683 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-12-03 18:29:29.399689 | controller | Wednesday 03 December 2025 18:29:27 +0000 (0:00:00.651) 0:02:57.470 **** 2025-12-03 18:29:29.399699 | controller | skipping: [instance] => (item=instance) 2025-12-03 18:29:29.960719 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-12-03 18:29:29.960753 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-03 18:29:29.960760 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-12-03 18:29:29.960765 | controller | 2025-12-03 18:29:29.960771 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-12-03 18:29:29.960775 | controller | Wednesday 03 December 2025 18:29:29 +0000 (0:00:01.716) 0:02:59.187 **** 2025-12-03 18:29:29.960785 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:30.910086 | controller | 2025-12-03 18:29:30.910114 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-12-03 18:29:30.910121 | controller | Wednesday 03 December 2025 18:29:29 +0000 (0:00:00.561) 0:02:59.748 **** 2025-12-03 18:29:30.910131 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:31.839252 | controller | 2025-12-03 18:29:31.839281 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-12-03 18:29:31.839289 | controller | Wednesday 03 December 2025 18:29:30 +0000 (0:00:00.949) 0:03:00.698 **** 2025-12-03 18:29:31.839299 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:31.870778 | controller | 2025-12-03 18:29:31.870804 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-12-03 18:29:31.870812 | controller | Wednesday 03 December 2025 18:29:31 +0000 (0:00:00.928) 0:03:01.627 **** 2025-12-03 18:29:31.870821 | controller | skipping: [instance] 2025-12-03 18:29:32.432132 | controller | 2025-12-03 18:29:32.432163 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-12-03 18:29:32.432171 | controller | Wednesday 03 December 2025 18:29:31 +0000 (0:00:00.031) 0:03:01.658 **** 2025-12-03 18:29:32.432182 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:33.014502 | controller | 2025-12-03 18:29:33.014535 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-12-03 18:29:33.014545 | controller | Wednesday 03 December 2025 18:29:32 +0000 (0:00:00.561) 0:03:02.220 **** 2025-12-03 18:29:33.014557 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:33.059559 | controller | 2025-12-03 18:29:33.059585 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-12-03 18:29:33.059593 | controller | Wednesday 03 December 2025 18:29:33 +0000 (0:00:00.582) 0:03:02.802 **** 2025-12-03 18:29:33.059603 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:33.130340 | controller | 2025-12-03 18:29:33.130367 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-12-03 18:29:33.130374 | controller | Wednesday 03 December 2025 18:29:33 +0000 (0:00:00.045) 0:03:02.847 **** 2025-12-03 18:29:33.130397 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-12-03 18:29:33.193864 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-12-03 18:29:33.193891 | controller | 2025-12-03 18:29:33.193899 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-03 18:29:33.193905 | controller | Wednesday 03 December 2025 18:29:33 +0000 (0:00:00.070) 0:03:02.918 **** 2025-12-03 18:29:33.193915 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 18:29:33.248740 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-12-03 18:29:33.248766 | controller | 2025-12-03 18:29:33.248773 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-03 18:29:33.248779 | controller | Wednesday 03 December 2025 18:29:33 +0000 (0:00:00.063) 0:03:02.981 **** 2025-12-03 18:29:33.248789 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 18:29:33.304605 | controller | _secret_file: '' 2025-12-03 18:29:33.304630 | controller | 2025-12-03 18:29:33.304637 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-03 18:29:33.304643 | controller | Wednesday 03 December 2025 18:29:33 +0000 (0:00:00.055) 0:03:03.036 **** 2025-12-03 18:29:33.304652 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 18:29:33.353151 | controller | _secret_content: my-default-location-place 2025-12-03 18:29:33.353174 | controller | 2025-12-03 18:29:33.353181 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-03 18:29:33.353187 | controller | Wednesday 03 December 2025 18:29:33 +0000 (0:00:00.055) 0:03:03.092 **** 2025-12-03 18:29:33.353196 | controller | skipping: [instance] 2025-12-03 18:29:33.405273 | controller | 2025-12-03 18:29:33.405302 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-03 18:29:33.405310 | controller | Wednesday 03 December 2025 18:29:33 +0000 (0:00:00.048) 0:03:03.141 **** 2025-12-03 18:29:33.405320 | controller | skipping: [instance] 2025-12-03 18:29:33.452795 | controller | 2025-12-03 18:29:33.452813 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-03 18:29:33.452821 | controller | Wednesday 03 December 2025 18:29:33 +0000 (0:00:00.051) 0:03:03.192 **** 2025-12-03 18:29:33.452834 | controller | skipping: [instance] 2025-12-03 18:29:34.415947 | controller | 2025-12-03 18:29:34.415981 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-03 18:29:34.415989 | controller | Wednesday 03 December 2025 18:29:33 +0000 (0:00:00.048) 0:03:03.240 **** 2025-12-03 18:29:34.415999 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:34.484009 | controller | 2025-12-03 18:29:34.484093 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-03 18:29:34.484105 | controller | Wednesday 03 December 2025 18:29:34 +0000 (0:00:00.961) 0:03:04.202 **** 2025-12-03 18:29:34.484116 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 18:29:34.534630 | controller | _secret_dest: /home/zuul/ipmi-things 2025-12-03 18:29:34.534654 | controller | 2025-12-03 18:29:34.534662 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-03 18:29:34.534668 | controller | Wednesday 03 December 2025 18:29:34 +0000 (0:00:00.069) 0:03:04.271 **** 2025-12-03 18:29:34.534677 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 18:29:34.586064 | controller | _secret_file: /tmp/ipmi-things 2025-12-03 18:29:34.586088 | controller | 2025-12-03 18:29:34.586095 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-03 18:29:34.586105 | controller | Wednesday 03 December 2025 18:29:34 +0000 (0:00:00.050) 0:03:04.322 **** 2025-12-03 18:29:34.586115 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 18:29:34.642593 | controller | _secret_content: '' 2025-12-03 18:29:34.642618 | controller | 2025-12-03 18:29:34.642646 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-03 18:29:34.642654 | controller | Wednesday 03 December 2025 18:29:34 +0000 (0:00:00.051) 0:03:04.374 **** 2025-12-03 18:29:34.642664 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-12-03 18:29:35.210564 | controller | msg: All assertions passed 2025-12-03 18:29:35.210596 | controller | 2025-12-03 18:29:35.210604 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-03 18:29:35.210610 | controller | Wednesday 03 December 2025 18:29:34 +0000 (0:00:00.056) 0:03:04.430 **** 2025-12-03 18:29:35.210619 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:36.157186 | controller | 2025-12-03 18:29:36.157213 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-03 18:29:36.157221 | controller | Wednesday 03 December 2025 18:29:35 +0000 (0:00:00.567) 0:03:04.998 **** 2025-12-03 18:29:36.157230 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:36.209706 | controller | 2025-12-03 18:29:36.209736 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-03 18:29:36.209744 | controller | Wednesday 03 December 2025 18:29:36 +0000 (0:00:00.946) 0:03:05.944 **** 2025-12-03 18:29:36.209753 | controller | skipping: [instance] 2025-12-03 18:29:36.767480 | controller | 2025-12-03 18:29:36.767513 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-12-03 18:29:36.767522 | controller | Wednesday 03 December 2025 18:29:36 +0000 (0:00:00.052) 0:03:05.997 **** 2025-12-03 18:29:36.767532 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:29:37.350478 | controller | 2025-12-03 18:29:37.350509 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-12-03 18:29:37.350517 | controller | Wednesday 03 December 2025 18:29:36 +0000 (0:00:00.557) 0:03:06.555 **** 2025-12-03 18:29:37.350527 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:32.833091 | controller | 2025-12-03 18:30:32.833136 | controller | TASK [reproducer : Check package install status] ******************************* 2025-12-03 18:30:32.833144 | controller | Wednesday 03 December 2025 18:29:37 +0000 (0:00:00.583) 0:03:07.138 **** 2025-12-03 18:30:32.833155 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-12-03 18:30:33.484364 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-12-03 18:30:33.484397 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-12-03 18:30:33.484405 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-12-03 18:30:33.484410 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-12-03 18:30:33.484416 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-12-03 18:30:33.484421 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-12-03 18:30:33.484426 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-12-03 18:30:33.484431 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-12-03 18:30:33.484436 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). 2025-12-03 18:30:33.484447 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:33.484454 | controller | 2025-12-03 18:30:33.484460 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-12-03 18:30:33.484465 | controller | Wednesday 03 December 2025 18:30:32 +0000 (0:00:55.481) 0:04:02.619 **** 2025-12-03 18:30:33.484480 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:35.734025 | controller | 2025-12-03 18:30:35.734099 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-12-03 18:30:35.734108 | controller | Wednesday 03 December 2025 18:30:33 +0000 (0:00:00.650) 0:04:03.270 **** 2025-12-03 18:30:35.734118 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:35.779070 | controller | 2025-12-03 18:30:35.779089 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-12-03 18:30:35.779097 | controller | Wednesday 03 December 2025 18:30:35 +0000 (0:00:02.251) 0:04:05.521 **** 2025-12-03 18:30:35.779106 | controller | skipping: [instance] 2025-12-03 18:30:35.821965 | controller | 2025-12-03 18:30:35.821988 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-12-03 18:30:35.821996 | controller | Wednesday 03 December 2025 18:30:35 +0000 (0:00:00.045) 0:04:05.567 **** 2025-12-03 18:30:35.822005 | controller | skipping: [instance] 2025-12-03 18:30:36.448566 | controller | 2025-12-03 18:30:36.448629 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-12-03 18:30:36.448639 | controller | Wednesday 03 December 2025 18:30:35 +0000 (0:00:00.042) 0:04:05.610 **** 2025-12-03 18:30:36.448654 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:37.087890 | controller | 2025-12-03 18:30:37.087952 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-12-03 18:30:37.087963 | controller | Wednesday 03 December 2025 18:30:36 +0000 (0:00:00.625) 0:04:06.235 **** 2025-12-03 18:30:37.087978 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:37.417987 | controller | 2025-12-03 18:30:37.418071 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-12-03 18:30:37.418083 | controller | Wednesday 03 December 2025 18:30:37 +0000 (0:00:00.637) 0:04:06.873 **** 2025-12-03 18:30:37.418098 | controller | changed: [instance] 2025-12-03 18:30:38.088714 | controller | 2025-12-03 18:30:38.088777 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-12-03 18:30:38.088787 | controller | Wednesday 03 December 2025 18:30:37 +0000 (0:00:00.332) 0:04:07.205 **** 2025-12-03 18:30:38.088803 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:39.039063 | controller | 2025-12-03 18:30:39.039135 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-12-03 18:30:39.039144 | controller | Wednesday 03 December 2025 18:30:38 +0000 (0:00:00.670) 0:04:07.875 **** 2025-12-03 18:30:39.039159 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:39.085885 | controller | 2025-12-03 18:30:39.085912 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-03 18:30:39.085921 | controller | Wednesday 03 December 2025 18:30:39 +0000 (0:00:00.950) 0:04:08.826 **** 2025-12-03 18:30:39.085932 | controller | skipping: [instance] 2025-12-03 18:30:39.126578 | controller | 2025-12-03 18:30:39.126597 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-03 18:30:39.126605 | controller | Wednesday 03 December 2025 18:30:39 +0000 (0:00:00.047) 0:04:08.873 **** 2025-12-03 18:30:39.126615 | controller | skipping: [instance] 2025-12-03 18:30:39.164820 | controller | 2025-12-03 18:30:39.164840 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-03 18:30:39.164848 | controller | Wednesday 03 December 2025 18:30:39 +0000 (0:00:00.040) 0:04:08.914 **** 2025-12-03 18:30:39.164858 | controller | skipping: [instance] 2025-12-03 18:30:39.212969 | controller | 2025-12-03 18:30:39.212989 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-12-03 18:30:39.212997 | controller | Wednesday 03 December 2025 18:30:39 +0000 (0:00:00.038) 0:04:08.952 **** 2025-12-03 18:30:39.213006 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:39.248359 | controller | 2025-12-03 18:30:39.248379 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-12-03 18:30:39.248398 | controller | Wednesday 03 December 2025 18:30:39 +0000 (0:00:00.047) 0:04:09.000 **** 2025-12-03 18:30:39.248407 | controller | skipping: [instance] 2025-12-03 18:30:39.283964 | controller | 2025-12-03 18:30:39.283983 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-12-03 18:30:39.283990 | controller | Wednesday 03 December 2025 18:30:39 +0000 (0:00:00.035) 0:04:09.036 **** 2025-12-03 18:30:39.283998 | controller | skipping: [instance] 2025-12-03 18:30:39.320953 | controller | 2025-12-03 18:30:39.320971 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-12-03 18:30:39.320978 | controller | Wednesday 03 December 2025 18:30:39 +0000 (0:00:00.035) 0:04:09.072 **** 2025-12-03 18:30:39.320987 | controller | skipping: [instance] 2025-12-03 18:30:39.321157 | controller | 2025-12-03 18:30:39.321309 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-12-03 18:30:39.321459 | controller | Wednesday 03 December 2025 18:30:39 +0000 (0:00:00.037) 0:04:09.109 **** 2025-12-03 18:30:39.861996 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:39.953501 | controller | 2025-12-03 18:30:39.953527 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-12-03 18:30:39.953536 | controller | Wednesday 03 December 2025 18:30:39 +0000 (0:00:00.539) 0:04:09.649 **** 2025-12-03 18:30:39.953547 | controller | skipping: [instance] => (item=secret) 2025-12-03 18:30:40.913662 | controller | skipping: [instance] => (item=configmap) 2025-12-03 18:30:40.913730 | controller | skipping: [instance] => (item=pod) 2025-12-03 18:30:40.913738 | controller | skipping: [instance] => (item=service) 2025-12-03 18:30:40.913744 | controller | skipping: [instance] => (item=route) 2025-12-03 18:30:40.913749 | controller | skipping: [instance] 2025-12-03 18:30:40.913757 | controller | 2025-12-03 18:30:40.913763 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-12-03 18:30:40.913770 | controller | Wednesday 03 December 2025 18:30:39 +0000 (0:00:00.091) 0:04:09.741 **** 2025-12-03 18:30:40.913784 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:41.861523 | controller | 2025-12-03 18:30:41.861602 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-12-03 18:30:41.861613 | controller | Wednesday 03 December 2025 18:30:40 +0000 (0:00:00.959) 0:04:10.700 **** 2025-12-03 18:30:41.861629 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:41.895826 | controller | 2025-12-03 18:30:41.895845 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-12-03 18:30:41.895853 | controller | Wednesday 03 December 2025 18:30:41 +0000 (0:00:00.943) 0:04:11.644 **** 2025-12-03 18:30:41.895862 | controller | skipping: [instance] 2025-12-03 18:30:41.929651 | controller | 2025-12-03 18:30:41.929671 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-12-03 18:30:41.929679 | controller | Wednesday 03 December 2025 18:30:41 +0000 (0:00:00.039) 0:04:11.683 **** 2025-12-03 18:30:41.929688 | controller | skipping: [instance] 2025-12-03 18:30:42.001646 | controller | 2025-12-03 18:30:42.001701 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-12-03 18:30:42.001710 | controller | Wednesday 03 December 2025 18:30:41 +0000 (0:00:00.033) 0:04:11.717 **** 2025-12-03 18:30:42.001722 | controller | skipping: [instance] => (item=secret) 2025-12-03 18:30:42.042111 | controller | skipping: [instance] => (item=configmap) 2025-12-03 18:30:42.042150 | controller | skipping: [instance] => (item=service) 2025-12-03 18:30:42.042158 | controller | skipping: [instance] => (item=route) 2025-12-03 18:30:42.042164 | controller | skipping: [instance] 2025-12-03 18:30:42.042171 | controller | 2025-12-03 18:30:42.042177 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-12-03 18:30:42.042183 | controller | Wednesday 03 December 2025 18:30:41 +0000 (0:00:00.070) 0:04:11.788 **** 2025-12-03 18:30:42.042194 | controller | skipping: [instance] 2025-12-03 18:30:43.596726 | controller | 2025-12-03 18:30:43.596797 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-12-03 18:30:43.596807 | controller | Wednesday 03 December 2025 18:30:42 +0000 (0:00:00.041) 0:04:11.830 **** 2025-12-03 18:30:43.596831 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:44.370845 | controller | 2025-12-03 18:30:44.370916 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-12-03 18:30:44.370926 | controller | Wednesday 03 December 2025 18:30:43 +0000 (0:00:01.553) 0:04:13.383 **** 2025-12-03 18:30:44.370940 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:44.408277 | controller | 2025-12-03 18:30:44.408309 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-12-03 18:30:44.408317 | controller | Wednesday 03 December 2025 18:30:44 +0000 (0:00:00.770) 0:04:14.154 **** 2025-12-03 18:30:44.408329 | controller | skipping: [instance] 2025-12-03 18:30:44.446249 | controller | 2025-12-03 18:30:44.446270 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-12-03 18:30:44.446278 | controller | Wednesday 03 December 2025 18:30:44 +0000 (0:00:00.041) 0:04:14.196 **** 2025-12-03 18:30:44.446288 | controller | skipping: [instance] 2025-12-03 18:30:44.486885 | controller | 2025-12-03 18:30:44.486907 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-12-03 18:30:44.486914 | controller | Wednesday 03 December 2025 18:30:44 +0000 (0:00:00.038) 0:04:14.234 **** 2025-12-03 18:30:44.486924 | controller | skipping: [instance] 2025-12-03 18:30:55.265341 | controller | 2025-12-03 18:30:55.265372 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-12-03 18:30:55.265380 | controller | Wednesday 03 December 2025 18:30:44 +0000 (0:00:00.040) 0:04:14.274 **** 2025-12-03 18:30:55.265389 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:55.265527 | controller | 2025-12-03 18:30:55.265675 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-12-03 18:30:55.265816 | controller | Wednesday 03 December 2025 18:30:55 +0000 (0:00:10.778) 0:04:25.053 **** 2025-12-03 18:30:56.678761 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:56.678951 | controller | 2025-12-03 18:30:56.679133 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-03 18:30:56.679287 | controller | Wednesday 03 December 2025 18:30:56 +0000 (0:00:01.412) 0:04:26.466 **** 2025-12-03 18:30:57.893387 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-03 18:30:57.893572 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-03 18:30:57.893725 | controller | 2025-12-03 18:30:57.893890 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-12-03 18:30:57.894052 | controller | Wednesday 03 December 2025 18:30:57 +0000 (0:00:01.215) 0:04:27.681 **** 2025-12-03 18:30:57.951889 | controller | skipping: [instance] 2025-12-03 18:30:57.952073 | controller | 2025-12-03 18:30:57.952232 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-12-03 18:30:57.952375 | controller | Wednesday 03 December 2025 18:30:57 +0000 (0:00:00.058) 0:04:27.740 **** 2025-12-03 18:30:58.624638 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:58.666690 | controller | 2025-12-03 18:30:58.666722 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-12-03 18:30:58.666731 | controller | Wednesday 03 December 2025 18:30:58 +0000 (0:00:00.672) 0:04:28.412 **** 2025-12-03 18:30:58.666741 | controller | skipping: [instance] 2025-12-03 18:30:58.715819 | controller | 2025-12-03 18:30:58.715839 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-12-03 18:30:58.715846 | controller | Wednesday 03 December 2025 18:30:58 +0000 (0:00:00.042) 0:04:28.454 **** 2025-12-03 18:30:58.715855 | controller | skipping: [instance] 2025-12-03 18:30:58.761020 | controller | 2025-12-03 18:30:58.761055 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-03 18:30:58.761065 | controller | Wednesday 03 December 2025 18:30:58 +0000 (0:00:00.049) 0:04:28.503 **** 2025-12-03 18:30:58.761074 | controller | skipping: [instance] 2025-12-03 18:30:58.799810 | controller | 2025-12-03 18:30:58.799830 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-03 18:30:58.799837 | controller | Wednesday 03 December 2025 18:30:58 +0000 (0:00:00.045) 0:04:28.549 **** 2025-12-03 18:30:58.799846 | controller | skipping: [instance] 2025-12-03 18:30:58.925393 | controller | 2025-12-03 18:30:58.925412 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-12-03 18:30:58.925419 | controller | Wednesday 03 December 2025 18:30:58 +0000 (0:00:00.038) 0:04:28.587 **** 2025-12-03 18:30:58.925429 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '9e31e9a1-0014-4f7b-88e4-6748ec26259b'}) 2025-12-03 18:30:59.938180 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': 'd6be6911-fe60-4098-aad1-54026d79ee71'}) 2025-12-03 18:30:59.938214 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '505e5fbd-850d-41d9-a445-bf69993e8255'}) 2025-12-03 18:30:59.938221 | controller | 2025-12-03 18:30:59.938227 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-12-03 18:30:59.938232 | controller | Wednesday 03 December 2025 18:30:58 +0000 (0:00:00.125) 0:04:28.713 **** 2025-12-03 18:30:59.938241 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:30:59.977235 | controller | 2025-12-03 18:30:59.977264 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-12-03 18:30:59.977272 | controller | Wednesday 03 December 2025 18:30:59 +0000 (0:00:01.012) 0:04:29.725 **** 2025-12-03 18:30:59.977282 | controller | skipping: [instance] 2025-12-03 18:30:59.977581 | controller | 2025-12-03 18:31:00.119707 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-12-03 18:31:00.119740 | controller | Wednesday 03 December 2025 18:30:59 +0000 (0:00:00.039) 0:04:29.765 **** 2025-12-03 18:31:00.119750 | controller | 2025-12-03 18:31:00.173596 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-12-03 18:31:00.173632 | controller | Wednesday 03 December 2025 18:31:00 +0000 (0:00:00.142) 0:04:29.907 **** 2025-12-03 18:31:00.173644 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:00.218874 | controller | 2025-12-03 18:31:00.218895 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-03 18:31:00.218903 | controller | Wednesday 03 December 2025 18:31:00 +0000 (0:00:00.053) 0:04:29.961 **** 2025-12-03 18:31:00.218913 | controller | skipping: [instance] 2025-12-03 18:31:00.261008 | controller | 2025-12-03 18:31:00.261033 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-03 18:31:00.261059 | controller | Wednesday 03 December 2025 18:31:00 +0000 (0:00:00.045) 0:04:30.006 **** 2025-12-03 18:31:00.261068 | controller | skipping: [instance] 2025-12-03 18:31:01.704453 | controller | 2025-12-03 18:31:01.704484 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-12-03 18:31:01.704493 | controller | Wednesday 03 December 2025 18:31:00 +0000 (0:00:00.041) 0:04:30.048 **** 2025-12-03 18:31:01.704504 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:06.316189 | controller | 2025-12-03 18:31:06.316219 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-12-03 18:31:06.316227 | controller | Wednesday 03 December 2025 18:31:01 +0000 (0:00:01.443) 0:04:31.492 **** 2025-12-03 18:31:06.316238 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=9e31e9a1-0014-4f7b-88e4-6748ec26259b) 2025-12-03 18:31:06.316571 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=d6be6911-fe60-4098-aad1-54026d79ee71) 2025-12-03 18:31:06.316583 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=505e5fbd-850d-41d9-a445-bf69993e8255) 2025-12-03 18:31:06.316592 | controller | 2025-12-03 18:31:06.483555 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-12-03 18:31:06.483589 | controller | Wednesday 03 December 2025 18:31:06 +0000 (0:00:04.611) 0:04:36.103 **** 2025-12-03 18:31:06.483600 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-12-03 18:31:06.711673 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-12-03 18:31:06.711703 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-12-03 18:31:06.711711 | controller | 2025-12-03 18:31:06.711717 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-12-03 18:31:06.711722 | controller | Wednesday 03 December 2025 18:31:06 +0000 (0:00:00.167) 0:04:36.271 **** 2025-12-03 18:31:06.711736 | controller | ok: [instance -> localhost] 2025-12-03 18:31:08.668359 | controller | 2025-12-03 18:31:08.668390 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-12-03 18:31:08.668398 | controller | Wednesday 03 December 2025 18:31:06 +0000 (0:00:00.228) 0:04:36.499 **** 2025-12-03 18:31:08.668408 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-12-03 18:31:09.238805 | controller | 2025-12-03 18:31:09.238841 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-12-03 18:31:09.238849 | controller | Wednesday 03 December 2025 18:31:08 +0000 (0:00:01.956) 0:04:38.456 **** 2025-12-03 18:31:09.238860 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:09.979843 | controller | 2025-12-03 18:31:09.979875 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-12-03 18:31:09.979884 | controller | Wednesday 03 December 2025 18:31:09 +0000 (0:00:00.570) 0:04:39.026 **** 2025-12-03 18:31:09.979894 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:11.015750 | controller | 2025-12-03 18:31:11.015785 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-12-03 18:31:11.015793 | controller | Wednesday 03 December 2025 18:31:09 +0000 (0:00:00.741) 0:04:39.767 **** 2025-12-03 18:31:11.015804 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:11.627022 | controller | 2025-12-03 18:31:11.627070 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-12-03 18:31:11.627078 | controller | Wednesday 03 December 2025 18:31:11 +0000 (0:00:01.035) 0:04:40.803 **** 2025-12-03 18:31:11.627088 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:12.633896 | controller | 2025-12-03 18:31:12.633931 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-12-03 18:31:12.633939 | controller | Wednesday 03 December 2025 18:31:11 +0000 (0:00:00.611) 0:04:41.414 **** 2025-12-03 18:31:12.633948 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:13.291460 | controller | 2025-12-03 18:31:13.291492 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-12-03 18:31:13.291500 | controller | Wednesday 03 December 2025 18:31:12 +0000 (0:00:01.006) 0:04:42.421 **** 2025-12-03 18:31:13.291510 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:13.959878 | controller | 2025-12-03 18:31:13.959911 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-12-03 18:31:13.959919 | controller | Wednesday 03 December 2025 18:31:13 +0000 (0:00:00.657) 0:04:43.079 **** 2025-12-03 18:31:13.959929 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:15.298937 | controller | 2025-12-03 18:31:15.298970 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-12-03 18:31:15.298978 | controller | Wednesday 03 December 2025 18:31:13 +0000 (0:00:00.668) 0:04:43.747 **** 2025-12-03 18:31:15.298989 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-03 18:31:15.336661 | controller | 2025-12-03 18:31:15.336696 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-03 18:31:15.336705 | controller | Wednesday 03 December 2025 18:31:15 +0000 (0:00:01.338) 0:04:45.086 **** 2025-12-03 18:31:15.336718 | controller | skipping: [instance] 2025-12-03 18:31:15.376847 | controller | 2025-12-03 18:31:15.376877 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 18:31:15.376884 | controller | Wednesday 03 December 2025 18:31:15 +0000 (0:00:00.037) 0:04:45.124 **** 2025-12-03 18:31:15.376894 | controller | skipping: [instance] 2025-12-03 18:31:15.415424 | controller | 2025-12-03 18:31:15.415447 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-03 18:31:15.415455 | controller | Wednesday 03 December 2025 18:31:15 +0000 (0:00:00.040) 0:04:45.164 **** 2025-12-03 18:31:15.415464 | controller | skipping: [instance] 2025-12-03 18:31:15.451165 | controller | 2025-12-03 18:31:15.451184 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-03 18:31:15.451191 | controller | Wednesday 03 December 2025 18:31:15 +0000 (0:00:00.038) 0:04:45.203 **** 2025-12-03 18:31:15.451200 | controller | skipping: [instance] 2025-12-03 18:31:15.486893 | controller | 2025-12-03 18:31:15.486911 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-03 18:31:15.486919 | controller | Wednesday 03 December 2025 18:31:15 +0000 (0:00:00.035) 0:04:45.239 **** 2025-12-03 18:31:15.486927 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:15.669234 | controller | 2025-12-03 18:31:15.669254 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-03 18:31:15.669262 | controller | Wednesday 03 December 2025 18:31:15 +0000 (0:00:00.035) 0:04:45.275 **** 2025-12-03 18:31:15.669273 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-03 18:31:15.716140 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-12-03 18:31:15.716159 | controller | 2025-12-03 18:31:15.716166 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-03 18:31:15.716175 | controller | Wednesday 03 December 2025 18:31:15 +0000 (0:00:00.182) 0:04:45.457 **** 2025-12-03 18:31:15.716188 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-12-03 18:31:19.066594 | controller | 2025-12-03 18:31:19.066625 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-12-03 18:31:19.066633 | controller | Wednesday 03 December 2025 18:31:15 +0000 (0:00:00.046) 0:04:45.504 **** 2025-12-03 18:31:19.066643 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-03 18:31:20.056854 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-12-03 18:31:20.056888 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-03 18:31:20.056895 | controller | 2025-12-03 18:31:20.056901 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-12-03 18:31:20.056906 | controller | Wednesday 03 December 2025 18:31:19 +0000 (0:00:03.349) 0:04:48.854 **** 2025-12-03 18:31:20.056916 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:20.592540 | controller | 2025-12-03 18:31:20.592573 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-03 18:31:20.592582 | controller | Wednesday 03 December 2025 18:31:20 +0000 (0:00:00.990) 0:04:49.844 **** 2025-12-03 18:31:20.592592 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:21.603679 | controller | 2025-12-03 18:31:21.603711 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-03 18:31:21.603718 | controller | Wednesday 03 December 2025 18:31:20 +0000 (0:00:00.535) 0:04:50.380 **** 2025-12-03 18:31:21.603728 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:21.680256 | controller | 2025-12-03 18:31:21.680283 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-03 18:31:21.680291 | controller | Wednesday 03 December 2025 18:31:21 +0000 (0:00:01.011) 0:04:51.391 **** 2025-12-03 18:31:21.680301 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:21.732752 | controller | 2025-12-03 18:31:21.732779 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-03 18:31:21.732787 | controller | Wednesday 03 December 2025 18:31:21 +0000 (0:00:00.076) 0:04:51.468 **** 2025-12-03 18:31:21.732797 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:22.667149 | controller | 2025-12-03 18:31:22.667181 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-03 18:31:22.667189 | controller | Wednesday 03 December 2025 18:31:21 +0000 (0:00:00.052) 0:04:51.520 **** 2025-12-03 18:31:22.667199 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:23.529439 | controller | 2025-12-03 18:31:23.529474 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-12-03 18:31:23.529482 | controller | Wednesday 03 December 2025 18:31:22 +0000 (0:00:00.934) 0:04:52.455 **** 2025-12-03 18:31:23.529492 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:29.433696 | controller | 2025-12-03 18:31:29.433728 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-12-03 18:31:29.433735 | controller | Wednesday 03 December 2025 18:31:23 +0000 (0:00:00.862) 0:04:53.317 **** 2025-12-03 18:31:29.433745 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-12-03 18:31:29.626660 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:29.626702 | controller | 2025-12-03 18:31:29.626710 | controller | TASK [Configure ntp service] *************************************************** 2025-12-03 18:31:29.626716 | controller | Wednesday 03 December 2025 18:31:29 +0000 (0:00:05.904) 0:04:59.221 **** 2025-12-03 18:31:29.626725 | controller | 2025-12-03 18:31:30.542914 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-12-03 18:31:30.542944 | controller | Wednesday 03 December 2025 18:31:29 +0000 (0:00:00.193) 0:04:59.414 **** 2025-12-03 18:31:30.542961 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:31.418597 | controller | 2025-12-03 18:31:31.418628 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-12-03 18:31:31.418637 | controller | Wednesday 03 December 2025 18:31:30 +0000 (0:00:00.916) 0:05:00.330 **** 2025-12-03 18:31:31.418648 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-12-03 18:31:32.284757 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-12-03 18:31:32.284789 | controller | 2025-12-03 18:31:32.284797 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-12-03 18:31:32.284804 | controller | Wednesday 03 December 2025 18:31:31 +0000 (0:00:00.875) 0:05:01.206 **** 2025-12-03 18:31:32.284813 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:32.904740 | controller | 2025-12-03 18:31:32.904778 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-12-03 18:31:32.904788 | controller | Wednesday 03 December 2025 18:31:32 +0000 (0:00:00.862) 0:05:02.068 **** 2025-12-03 18:31:32.904801 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:33.036948 | controller | 2025-12-03 18:31:33.036977 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-12-03 18:31:33.036987 | controller | Wednesday 03 December 2025 18:31:32 +0000 (0:00:00.623) 0:05:02.692 **** 2025-12-03 18:31:33.037005 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-12-03 18:31:33.458262 | controller | 2025-12-03 18:31:33.458294 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-12-03 18:31:33.458302 | controller | Wednesday 03 December 2025 18:31:33 +0000 (0:00:00.132) 0:05:02.824 **** 2025-12-03 18:31:33.458312 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:33.902680 | controller | 2025-12-03 18:31:33.902722 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-12-03 18:31:33.902730 | controller | Wednesday 03 December 2025 18:31:33 +0000 (0:00:00.420) 0:05:03.245 **** 2025-12-03 18:31:33.902739 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-03 18:31:34.483402 | controller | 2025-12-03 18:31:34.483434 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-12-03 18:31:34.483442 | controller | Wednesday 03 December 2025 18:31:33 +0000 (0:00:00.445) 0:05:03.690 **** 2025-12-03 18:31:34.483452 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-03 18:31:34.989640 | controller | 2025-12-03 18:31:34.989672 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-12-03 18:31:34.989680 | controller | Wednesday 03 December 2025 18:31:34 +0000 (0:00:00.576) 0:05:04.267 **** 2025-12-03 18:31:34.989690 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-03 18:31:34.989954 | controller | 2025-12-03 18:31:34.989969 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-12-03 18:31:35.039062 | controller | Wednesday 03 December 2025 18:31:34 +0000 (0:00:00.510) 0:05:04.777 **** 2025-12-03 18:31:35.039084 | controller | 2025-12-03 18:31:35.498958 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-12-03 18:31:35.498989 | controller | Wednesday 03 December 2025 18:31:35 +0000 (0:00:00.049) 0:05:04.826 **** 2025-12-03 18:31:35.499000 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-03 18:31:36.203894 | controller | 2025-12-03 18:31:36.203927 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-12-03 18:31:36.203935 | controller | Wednesday 03 December 2025 18:31:35 +0000 (0:00:00.459) 0:05:05.286 **** 2025-12-03 18:31:36.203945 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-03 18:31:36.234011 | controller | 2025-12-03 18:31:36.234070 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-12-03 18:31:36.234085 | controller | Wednesday 03 December 2025 18:31:36 +0000 (0:00:00.704) 0:05:05.991 **** 2025-12-03 18:31:36.234106 | controller | skipping: [instance] 2025-12-03 18:31:36.268177 | controller | 2025-12-03 18:31:36.268200 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-12-03 18:31:36.268209 | controller | Wednesday 03 December 2025 18:31:36 +0000 (0:00:00.030) 0:05:06.021 **** 2025-12-03 18:31:36.268220 | controller | skipping: [instance] 2025-12-03 18:31:36.485420 | controller | 2025-12-03 18:31:36.485440 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-12-03 18:31:36.485447 | controller | Wednesday 03 December 2025 18:31:36 +0000 (0:00:00.034) 0:05:06.056 **** 2025-12-03 18:31:36.485455 | controller | changed: [instance] 2025-12-03 18:31:36.557090 | controller | 2025-12-03 18:31:36.557108 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-12-03 18:31:36.557115 | controller | Wednesday 03 December 2025 18:31:36 +0000 (0:00:00.217) 0:05:06.273 **** 2025-12-03 18:31:36.557123 | controller | skipping: [instance] => (item=) 2025-12-03 18:31:36.557272 | controller | 2025-12-03 18:31:36.557282 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-12-03 18:31:36.557290 | controller | Wednesday 03 December 2025 18:31:36 +0000 (0:00:00.071) 0:05:06.345 **** 2025-12-03 18:31:36.589304 | controller | ok: [instance] 2025-12-03 18:31:36.660286 | controller | 2025-12-03 18:31:36.660313 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 18:31:36.660321 | controller | Wednesday 03 December 2025 18:31:36 +0000 (0:00:00.032) 0:05:06.377 **** 2025-12-03 18:31:36.660330 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-03 18:31:36.660654 | controller | 2025-12-03 18:31:36.914242 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 18:31:36.914272 | controller | Wednesday 03 December 2025 18:31:36 +0000 (0:00:00.070) 0:05:06.448 **** 2025-12-03 18:31:36.914284 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-03 18:31:36.961229 | controller | 2025-12-03 18:31:36.961255 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-12-03 18:31:36.961264 | controller | Wednesday 03 December 2025 18:31:36 +0000 (0:00:00.253) 0:05:06.702 **** 2025-12-03 18:31:36.961276 | controller | 2025-12-03 18:31:37.019485 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-03 18:31:37.019502 | controller | Wednesday 03 December 2025 18:31:36 +0000 (0:00:00.047) 0:05:06.749 **** 2025-12-03 18:31:37.019516 | controller | ok: [instance] 2025-12-03 18:31:37.073597 | controller | 2025-12-03 18:31:37.073617 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 18:31:37.073625 | controller | Wednesday 03 December 2025 18:31:37 +0000 (0:00:00.058) 0:05:06.807 **** 2025-12-03 18:31:37.073633 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-03 18:31:37.324442 | controller | 2025-12-03 18:31:37.324471 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 18:31:37.324479 | controller | Wednesday 03 December 2025 18:31:37 +0000 (0:00:00.054) 0:05:06.861 **** 2025-12-03 18:31:37.324489 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-03 18:31:37.712806 | controller | 2025-12-03 18:31:37.712840 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-12-03 18:31:37.712848 | controller | Wednesday 03 December 2025 18:31:37 +0000 (0:00:00.250) 0:05:07.112 **** 2025-12-03 18:31:37.712859 | controller | changed: [instance] 2025-12-03 18:31:38.375865 | controller | 2025-12-03 18:31:38.375900 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-03 18:31:38.375908 | controller | Wednesday 03 December 2025 18:31:37 +0000 (0:00:00.376) 0:05:07.488 **** 2025-12-03 18:31:38.375914 | controller | 2025-12-03 18:31:38.375919 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-12-03 18:31:38.375931 | controller | Wednesday 03 December 2025 18:31:37 +0000 (0:00:00.011) 0:05:07.500 **** 2025-12-03 18:31:38.375941 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:38.737623 | controller | 2025-12-03 18:31:38.737653 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-03 18:31:38.737661 | controller | Wednesday 03 December 2025 18:31:38 +0000 (0:00:00.661) 0:05:08.161 **** 2025-12-03 18:31:38.737671 | controller | changed: [instance] 2025-12-03 18:31:38.910491 | controller | 2025-12-03 18:31:38.910523 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-12-03 18:31:38.910531 | controller | Wednesday 03 December 2025 18:31:38 +0000 (0:00:00.363) 0:05:08.525 **** 2025-12-03 18:31:38.910541 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 18:31:40.371561 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 18:31:40.371596 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-12-03 18:31:40.371604 | controller | 2025-12-03 18:31:40.371610 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-12-03 18:31:40.371615 | controller | Wednesday 03 December 2025 18:31:38 +0000 (0:00:00.172) 0:05:08.698 **** 2025-12-03 18:31:40.371624 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-03 18:31:40.398863 | controller | 2025-12-03 18:31:40.398900 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-03 18:31:40.398910 | controller | Wednesday 03 December 2025 18:31:40 +0000 (0:00:01.461) 0:05:10.159 **** 2025-12-03 18:31:40.398931 | controller | skipping: [instance] 2025-12-03 18:31:40.398953 | controller | 2025-12-03 18:31:40.398961 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-03 18:31:40.398969 | controller | Wednesday 03 December 2025 18:31:40 +0000 (0:00:00.027) 0:05:10.186 **** 2025-12-03 18:31:40.942156 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-12-03 18:31:40.942208 | controller | 2025-12-03 18:31:40.942286 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-03 18:31:40.942385 | controller | Wednesday 03 December 2025 18:31:40 +0000 (0:00:00.543) 0:05:10.730 **** 2025-12-03 18:31:40.977626 | controller | skipping: [instance] 2025-12-03 18:31:40.977700 | controller | 2025-12-03 18:31:40.977813 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-03 18:31:40.977910 | controller | Wednesday 03 December 2025 18:31:40 +0000 (0:00:00.035) 0:05:10.766 **** 2025-12-03 18:31:41.010918 | controller | skipping: [instance] 2025-12-03 18:31:41.011000 | controller | 2025-12-03 18:31:41.011137 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-03 18:31:41.011233 | controller | Wednesday 03 December 2025 18:31:41 +0000 (0:00:00.033) 0:05:10.799 **** 2025-12-03 18:31:41.044943 | controller | skipping: [instance] 2025-12-03 18:31:41.045029 | controller | 2025-12-03 18:31:41.045151 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-03 18:31:41.045245 | controller | Wednesday 03 December 2025 18:31:41 +0000 (0:00:00.034) 0:05:10.833 **** 2025-12-03 18:31:42.497145 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-03 18:31:42.497261 | controller | 2025-12-03 18:31:42.497271 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-12-03 18:31:42.497280 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:01.451) 0:05:12.285 **** 2025-12-03 18:31:42.531782 | controller | skipping: [instance] 2025-12-03 18:31:42.551106 | controller | 2025-12-03 18:31:42.551143 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-12-03 18:31:42.551152 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:00.034) 0:05:12.319 **** 2025-12-03 18:31:42.551162 | controller | skipping: [instance] 2025-12-03 18:31:42.581568 | controller | 2025-12-03 18:31:42.581595 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-12-03 18:31:42.581603 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:00.019) 0:05:12.339 **** 2025-12-03 18:31:42.581623 | controller | skipping: [instance] 2025-12-03 18:31:42.654708 | controller | 2025-12-03 18:31:42.654756 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-12-03 18:31:42.654766 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:00.030) 0:05:12.369 **** 2025-12-03 18:31:42.654777 | controller | ok: [instance] 2025-12-03 18:31:42.654807 | controller | 2025-12-03 18:31:42.654950 | controller | TASK [reproducer : Push local code] ******************************************** 2025-12-03 18:31:42.655049 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:00.073) 0:05:12.443 **** 2025-12-03 18:31:42.759740 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-12-03 18:31:42.799994 | controller | 2025-12-03 18:31:42.800027 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-12-03 18:31:42.800049 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:00.103) 0:05:12.546 **** 2025-12-03 18:31:42.800063 | controller | skipping: [instance] 2025-12-03 18:31:42.840916 | controller | 2025-12-03 18:31:42.840947 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-12-03 18:31:42.840956 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:00.041) 0:05:12.588 **** 2025-12-03 18:31:42.840968 | controller | skipping: [instance] 2025-12-03 18:31:42.877423 | controller | 2025-12-03 18:31:42.877455 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-12-03 18:31:42.877464 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:00.040) 0:05:12.628 **** 2025-12-03 18:31:42.877476 | controller | skipping: [instance] 2025-12-03 18:31:42.918232 | controller | 2025-12-03 18:31:42.918263 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-12-03 18:31:42.918272 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:00.036) 0:05:12.665 **** 2025-12-03 18:31:42.918284 | controller | skipping: [instance] 2025-12-03 18:31:42.918380 | controller | 2025-12-03 18:31:42.918390 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-12-03 18:31:42.918399 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:00.040) 0:05:12.706 **** 2025-12-03 18:31:42.953175 | controller | skipping: [instance] 2025-12-03 18:31:42.953308 | controller | 2025-12-03 18:31:42.953320 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-12-03 18:31:42.953331 | controller | Wednesday 03 December 2025 18:31:42 +0000 (0:00:00.035) 0:05:12.741 **** 2025-12-03 18:31:43.428929 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-12-03 18:31:43.428963 | controller | 2025-12-03 18:31:43.428972 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-12-03 18:31:43.429058 | controller | Wednesday 03 December 2025 18:31:43 +0000 (0:00:00.475) 0:05:13.216 **** 2025-12-03 18:31:44.011308 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-12-03 18:31:44.011366 | controller | 2025-12-03 18:31:44.011585 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-12-03 18:31:44.066887 | controller | Wednesday 03 December 2025 18:31:44 +0000 (0:00:00.582) 0:05:13.799 **** 2025-12-03 18:31:44.066924 | controller | skipping: [instance] => (item=ci-framework) 2025-12-03 18:31:44.147141 | controller | skipping: [instance] 2025-12-03 18:31:44.147172 | controller | 2025-12-03 18:31:44.147181 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-12-03 18:31:44.147188 | controller | Wednesday 03 December 2025 18:31:44 +0000 (0:00:00.055) 0:05:13.854 **** 2025-12-03 18:31:44.147199 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-12-03 18:31:44.147517 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-12-03 18:31:44.147540 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-12-03 18:31:44.147556 | controller | 2025-12-03 18:31:44.606617 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-12-03 18:31:44.606652 | controller | Wednesday 03 December 2025 18:31:44 +0000 (0:00:00.080) 0:05:13.935 **** 2025-12-03 18:31:44.606665 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:44.606671 | controller | 2025-12-03 18:31:44.606678 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-12-03 18:31:44.606759 | controller | Wednesday 03 December 2025 18:31:44 +0000 (0:00:00.459) 0:05:14.394 **** 2025-12-03 18:31:44.644609 | controller | skipping: [instance] 2025-12-03 18:31:45.169151 | controller | 2025-12-03 18:31:45.169190 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-12-03 18:31:45.169198 | controller | Wednesday 03 December 2025 18:31:44 +0000 (0:00:00.038) 0:05:14.432 **** 2025-12-03 18:31:45.169212 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:45.169229 | controller | 2025-12-03 18:31:45.169360 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-12-03 18:31:45.169462 | controller | Wednesday 03 December 2025 18:31:45 +0000 (0:00:00.524) 0:05:14.957 **** 2025-12-03 18:31:45.209948 | controller | skipping: [instance] 2025-12-03 18:31:45.209998 | controller | 2025-12-03 18:31:45.210121 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-12-03 18:31:45.210219 | controller | Wednesday 03 December 2025 18:31:45 +0000 (0:00:00.041) 0:05:14.998 **** 2025-12-03 18:31:45.676585 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:45.676642 | controller | 2025-12-03 18:31:45.676779 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-12-03 18:31:45.676894 | controller | Wednesday 03 December 2025 18:31:45 +0000 (0:00:00.466) 0:05:15.464 **** 2025-12-03 18:31:47.965477 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:31:47.965543 | controller | 2025-12-03 18:31:47.965648 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-12-03 18:31:47.965763 | controller | Wednesday 03 December 2025 18:31:47 +0000 (0:00:02.289) 0:05:17.753 **** 2025-12-03 18:32:07.275869 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:07.276005 | controller | 2025-12-03 18:32:07.276142 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-12-03 18:32:07.276179 | controller | Wednesday 03 December 2025 18:32:07 +0000 (0:00:19.309) 0:05:37.063 **** 2025-12-03 18:32:08.315173 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:08.315223 | controller | 2025-12-03 18:32:08.315466 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-12-03 18:32:08.414780 | controller | Wednesday 03 December 2025 18:32:08 +0000 (0:00:01.039) 0:05:38.103 **** 2025-12-03 18:32:08.414833 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-12-03 18:32:08.853833 | controller | 2025-12-03 18:32:08.853870 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-12-03 18:32:08.853879 | controller | Wednesday 03 December 2025 18:32:08 +0000 (0:00:00.099) 0:05:38.202 **** 2025-12-03 18:32:08.853891 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:08.854004 | controller | 2025-12-03 18:32:08.854015 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-12-03 18:32:08.854168 | controller | Wednesday 03 December 2025 18:32:08 +0000 (0:00:00.439) 0:05:38.641 **** 2025-12-03 18:32:08.888484 | controller | skipping: [instance] 2025-12-03 18:32:08.888564 | controller | 2025-12-03 18:32:08.888670 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-12-03 18:32:08.888773 | controller | Wednesday 03 December 2025 18:32:08 +0000 (0:00:00.035) 0:05:38.676 **** 2025-12-03 18:32:08.930953 | controller | skipping: [instance] 2025-12-03 18:32:08.931077 | controller | 2025-12-03 18:32:08.931177 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-12-03 18:32:08.931289 | controller | Wednesday 03 December 2025 18:32:08 +0000 (0:00:00.042) 0:05:38.719 **** 2025-12-03 18:32:09.020300 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:09.020375 | controller | 2025-12-03 18:32:09.020486 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-03 18:32:09.020585 | controller | Wednesday 03 December 2025 18:32:09 +0000 (0:00:00.089) 0:05:38.808 **** 2025-12-03 18:32:09.493714 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:09.493794 | controller | 2025-12-03 18:32:09.493907 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-03 18:32:09.494009 | controller | Wednesday 03 December 2025 18:32:09 +0000 (0:00:00.473) 0:05:39.281 **** 2025-12-03 18:32:09.529398 | controller | skipping: [instance] 2025-12-03 18:32:09.529492 | controller | 2025-12-03 18:32:09.529618 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-03 18:32:09.529695 | controller | Wednesday 03 December 2025 18:32:09 +0000 (0:00:00.035) 0:05:39.317 **** 2025-12-03 18:32:09.567119 | controller | skipping: [instance] 2025-12-03 18:32:09.567217 | controller | 2025-12-03 18:32:09.567231 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-03 18:32:09.567324 | controller | Wednesday 03 December 2025 18:32:09 +0000 (0:00:00.037) 0:05:39.354 **** 2025-12-03 18:32:09.601407 | controller | skipping: [instance] 2025-12-03 18:32:09.601517 | controller | 2025-12-03 18:32:09.601649 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-03 18:32:09.601751 | controller | Wednesday 03 December 2025 18:32:09 +0000 (0:00:00.034) 0:05:39.389 **** 2025-12-03 18:32:11.066773 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:11.067474 | controller | 2025-12-03 18:32:12.476393 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-03 18:32:12.476449 | controller | Wednesday 03 December 2025 18:32:11 +0000 (0:00:01.465) 0:05:40.854 **** 2025-12-03 18:32:12.476466 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:32:13.411613 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:32:13.411648 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:32:13.411656 | controller | changed: [instance -> controller-0] 2025-12-03 18:32:13.411662 | controller | 2025-12-03 18:32:13.411668 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-03 18:32:13.411674 | controller | Wednesday 03 December 2025 18:32:12 +0000 (0:00:01.408) 0:05:42.263 **** 2025-12-03 18:32:13.411684 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:14.658195 | controller | 2025-12-03 18:32:14.658229 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-03 18:32:14.658237 | controller | Wednesday 03 December 2025 18:32:13 +0000 (0:00:00.935) 0:05:43.199 **** 2025-12-03 18:32:14.658248 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:22.447748 | controller | 2025-12-03 18:32:22.447786 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-03 18:32:22.447794 | controller | Wednesday 03 December 2025 18:32:14 +0000 (0:00:01.246) 0:05:44.445 **** 2025-12-03 18:32:22.447805 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:23.384565 | controller | 2025-12-03 18:32:23.384631 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-03 18:32:23.384641 | controller | Wednesday 03 December 2025 18:32:22 +0000 (0:00:07.789) 0:05:52.235 **** 2025-12-03 18:32:23.384653 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:23.422814 | controller | 2025-12-03 18:32:23.422851 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-03 18:32:23.422859 | controller | Wednesday 03 December 2025 18:32:23 +0000 (0:00:00.936) 0:05:53.171 **** 2025-12-03 18:32:23.422873 | controller | skipping: [instance] 2025-12-03 18:32:23.422910 | controller | 2025-12-03 18:32:23.423020 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-03 18:32:23.423342 | controller | Wednesday 03 December 2025 18:32:23 +0000 (0:00:00.039) 0:05:53.211 **** 2025-12-03 18:32:24.505796 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:24.505855 | controller | 2025-12-03 18:32:24.505944 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-03 18:32:24.506030 | controller | Wednesday 03 December 2025 18:32:24 +0000 (0:00:01.082) 0:05:54.293 **** 2025-12-03 18:32:24.560879 | controller | skipping: [instance] 2025-12-03 18:32:24.560965 | controller | 2025-12-03 18:32:24.561101 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-03 18:32:24.561203 | controller | Wednesday 03 December 2025 18:32:24 +0000 (0:00:00.055) 0:05:54.349 **** 2025-12-03 18:32:24.616653 | controller | skipping: [instance] 2025-12-03 18:32:24.616752 | controller | 2025-12-03 18:32:24.616856 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-03 18:32:24.616963 | controller | Wednesday 03 December 2025 18:32:24 +0000 (0:00:00.055) 0:05:54.404 **** 2025-12-03 18:32:24.674024 | controller | skipping: [instance] 2025-12-03 18:32:24.674132 | controller | 2025-12-03 18:32:24.674237 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-03 18:32:24.674338 | controller | Wednesday 03 December 2025 18:32:24 +0000 (0:00:00.057) 0:05:54.462 **** 2025-12-03 18:32:25.480199 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:25.480255 | controller | 2025-12-03 18:32:25.480359 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-03 18:32:25.480466 | controller | Wednesday 03 December 2025 18:32:25 +0000 (0:00:00.805) 0:05:55.268 **** 2025-12-03 18:32:26.340504 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:26.340555 | controller | 2025-12-03 18:32:26.340815 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-03 18:32:26.379140 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.860) 0:05:56.128 **** 2025-12-03 18:32:26.379170 | controller | skipping: [instance] 2025-12-03 18:32:26.379387 | controller | 2025-12-03 18:32:26.379422 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-03 18:32:26.416824 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.038) 0:05:56.167 **** 2025-12-03 18:32:26.416859 | controller | skipping: [instance] 2025-12-03 18:32:26.416890 | controller | 2025-12-03 18:32:26.416899 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-03 18:32:26.417009 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.037) 0:05:56.205 **** 2025-12-03 18:32:26.455921 | controller | skipping: [instance] 2025-12-03 18:32:26.456018 | controller | 2025-12-03 18:32:26.456148 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-03 18:32:26.456250 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.039) 0:05:56.244 **** 2025-12-03 18:32:26.504600 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:26.504679 | controller | 2025-12-03 18:32:26.504775 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-03 18:32:26.504888 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.048) 0:05:56.292 **** 2025-12-03 18:32:26.543885 | controller | skipping: [instance] 2025-12-03 18:32:26.543977 | controller | 2025-12-03 18:32:26.544089 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-03 18:32:26.544182 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.039) 0:05:56.332 **** 2025-12-03 18:32:26.580603 | controller | skipping: [instance] 2025-12-03 18:32:26.580689 | controller | 2025-12-03 18:32:26.580784 | controller | TASK [Download the RPM] ******************************************************** 2025-12-03 18:32:26.580880 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.036) 0:05:56.368 **** 2025-12-03 18:32:26.615395 | controller | skipping: [instance] 2025-12-03 18:32:26.615480 | controller | 2025-12-03 18:32:26.615575 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-03 18:32:26.615675 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.034) 0:05:56.403 **** 2025-12-03 18:32:26.652224 | controller | skipping: [instance] 2025-12-03 18:32:26.652331 | controller | 2025-12-03 18:32:26.652434 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-03 18:32:26.652534 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.036) 0:05:56.440 **** 2025-12-03 18:32:26.687758 | controller | skipping: [instance] 2025-12-03 18:32:26.687866 | controller | 2025-12-03 18:32:26.687975 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-03 18:32:26.688100 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.035) 0:05:56.476 **** 2025-12-03 18:32:26.725552 | controller | skipping: [instance] 2025-12-03 18:32:26.725658 | controller | 2025-12-03 18:32:26.725716 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-03 18:32:26.725890 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.037) 0:05:56.513 **** 2025-12-03 18:32:26.763014 | controller | skipping: [instance] 2025-12-03 18:32:26.763460 | controller | 2025-12-03 18:32:26.763642 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-03 18:32:26.763978 | controller | Wednesday 03 December 2025 18:32:26 +0000 (0:00:00.037) 0:05:56.551 **** 2025-12-03 18:32:27.194671 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:27.194734 | controller | 2025-12-03 18:32:27.194817 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-03 18:32:27.194939 | controller | Wednesday 03 December 2025 18:32:27 +0000 (0:00:00.431) 0:05:56.982 **** 2025-12-03 18:32:27.247420 | controller | skipping: [instance] 2025-12-03 18:32:27.247495 | controller | 2025-12-03 18:32:27.247608 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-03 18:32:27.247711 | controller | Wednesday 03 December 2025 18:32:27 +0000 (0:00:00.052) 0:05:57.035 **** 2025-12-03 18:32:27.297607 | controller | skipping: [instance] 2025-12-03 18:32:27.297691 | controller | 2025-12-03 18:32:27.297800 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-03 18:32:27.297921 | controller | Wednesday 03 December 2025 18:32:27 +0000 (0:00:00.050) 0:05:57.085 **** 2025-12-03 18:32:27.335859 | controller | skipping: [instance] 2025-12-03 18:32:27.335953 | controller | 2025-12-03 18:32:27.336106 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-03 18:32:27.336240 | controller | Wednesday 03 December 2025 18:32:27 +0000 (0:00:00.037) 0:05:57.123 **** 2025-12-03 18:32:27.391127 | controller | skipping: [instance] 2025-12-03 18:32:27.391212 | controller | 2025-12-03 18:32:27.391320 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-03 18:32:27.391423 | controller | Wednesday 03 December 2025 18:32:27 +0000 (0:00:00.055) 0:05:57.179 **** 2025-12-03 18:32:27.445083 | controller | skipping: [instance] 2025-12-03 18:32:27.445209 | controller | 2025-12-03 18:32:27.445323 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-03 18:32:27.445429 | controller | Wednesday 03 December 2025 18:32:27 +0000 (0:00:00.053) 0:05:57.232 **** 2025-12-03 18:32:27.500378 | controller | skipping: [instance] 2025-12-03 18:32:27.500468 | controller | 2025-12-03 18:32:27.500581 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-03 18:32:27.500669 | controller | Wednesday 03 December 2025 18:32:27 +0000 (0:00:00.055) 0:05:57.288 **** 2025-12-03 18:32:27.550485 | controller | skipping: [instance] 2025-12-03 18:32:27.550571 | controller | 2025-12-03 18:32:27.550686 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-03 18:32:27.550785 | controller | Wednesday 03 December 2025 18:32:27 +0000 (0:00:00.050) 0:05:57.338 **** 2025-12-03 18:32:27.599900 | controller | skipping: [instance] 2025-12-03 18:32:27.600064 | controller | 2025-12-03 18:32:27.600189 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-03 18:32:27.600333 | controller | Wednesday 03 December 2025 18:32:27 +0000 (0:00:00.049) 0:05:57.388 **** 2025-12-03 18:32:28.202240 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:28.202292 | controller | 2025-12-03 18:32:28.202403 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-03 18:32:28.202525 | controller | Wednesday 03 December 2025 18:32:28 +0000 (0:00:00.602) 0:05:57.990 **** 2025-12-03 18:32:29.195737 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:32:29.195810 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:32:29.195937 | controller | changed: [instance -> controller-0] 2025-12-03 18:32:29.196048 | controller | 2025-12-03 18:32:29.196197 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-03 18:32:29.196296 | controller | Wednesday 03 December 2025 18:32:29 +0000 (0:00:00.993) 0:05:58.983 **** 2025-12-03 18:32:29.958706 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:29.958765 | controller | 2025-12-03 18:32:29.958855 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-03 18:32:29.958961 | controller | Wednesday 03 December 2025 18:32:29 +0000 (0:00:00.763) 0:05:59.746 **** 2025-12-03 18:32:30.458782 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:30.458904 | controller | 2025-12-03 18:32:30.459049 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-03 18:32:30.459189 | controller | Wednesday 03 December 2025 18:32:30 +0000 (0:00:00.499) 0:06:00.246 **** 2025-12-03 18:32:30.517497 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:32:30.517604 | controller | ok: [instance -> controller-0] 2025-12-03 18:32:30.517691 | controller | 2025-12-03 18:32:30.517808 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-03 18:32:30.517922 | controller | Wednesday 03 December 2025 18:32:30 +0000 (0:00:00.059) 0:06:00.305 **** 2025-12-03 18:32:30.560156 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:32:30.560496 | controller | 2025-12-03 18:33:00.529922 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-03 18:33:00.529989 | controller | Wednesday 03 December 2025 18:32:30 +0000 (0:00:00.042) 0:06:00.348 **** 2025-12-03 18:33:00.530014 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:00.530067 | controller | 2025-12-03 18:33:00.530198 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-03 18:33:00.530239 | controller | Wednesday 03 December 2025 18:33:00 +0000 (0:00:29.969) 0:06:30.317 **** 2025-12-03 18:33:01.047429 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:01.047472 | controller | 2025-12-03 18:33:01.047481 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-03 18:33:01.047489 | controller | Wednesday 03 December 2025 18:33:01 +0000 (0:00:00.517) 0:06:30.834 **** 2025-12-03 18:33:01.544991 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:07.676184 | controller | 2025-12-03 18:33:07.676226 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-03 18:33:07.676234 | controller | Wednesday 03 December 2025 18:33:01 +0000 (0:00:00.497) 0:06:31.332 **** 2025-12-03 18:33:07.676245 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:07.676262 | controller | 2025-12-03 18:33:07.676271 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-03 18:33:07.676337 | controller | Wednesday 03 December 2025 18:33:07 +0000 (0:00:06.131) 0:06:37.463 **** 2025-12-03 18:33:07.729350 | controller | skipping: [instance] 2025-12-03 18:33:07.729671 | controller | 2025-12-03 18:33:07.729714 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-03 18:33:08.407161 | controller | Wednesday 03 December 2025 18:33:07 +0000 (0:00:00.053) 0:06:37.517 **** 2025-12-03 18:33:08.407208 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:08.887050 | controller | 2025-12-03 18:33:08.887085 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-03 18:33:08.887094 | controller | Wednesday 03 December 2025 18:33:08 +0000 (0:00:00.677) 0:06:38.194 **** 2025-12-03 18:33:08.887104 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:08.887281 | controller | 2025-12-03 18:33:08.887296 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-03 18:33:08.887453 | controller | Wednesday 03 December 2025 18:33:08 +0000 (0:00:00.479) 0:06:38.674 **** 2025-12-03 18:33:08.944768 | controller | skipping: [instance] 2025-12-03 18:33:08.994758 | controller | 2025-12-03 18:33:08.994802 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-03 18:33:08.994811 | controller | Wednesday 03 December 2025 18:33:08 +0000 (0:00:00.057) 0:06:38.732 **** 2025-12-03 18:33:08.994822 | controller | skipping: [instance] 2025-12-03 18:33:08.994909 | controller | 2025-12-03 18:33:08.994922 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-03 18:33:09.045325 | controller | Wednesday 03 December 2025 18:33:08 +0000 (0:00:00.049) 0:06:38.782 **** 2025-12-03 18:33:09.045358 | controller | skipping: [instance] 2025-12-03 18:33:09.045553 | controller | 2025-12-03 18:33:09.045626 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-03 18:33:09.045645 | controller | Wednesday 03 December 2025 18:33:09 +0000 (0:00:00.050) 0:06:38.833 **** 2025-12-03 18:33:09.094188 | controller | skipping: [instance] 2025-12-03 18:33:09.094304 | controller | 2025-12-03 18:33:09.094329 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-03 18:33:09.094370 | controller | Wednesday 03 December 2025 18:33:09 +0000 (0:00:00.048) 0:06:38.882 **** 2025-12-03 18:33:09.138290 | controller | skipping: [instance] 2025-12-03 18:33:09.138478 | controller | 2025-12-03 18:33:09.138497 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-03 18:33:09.183443 | controller | Wednesday 03 December 2025 18:33:09 +0000 (0:00:00.043) 0:06:38.926 **** 2025-12-03 18:33:09.183480 | controller | skipping: [instance] 2025-12-03 18:33:11.748755 | controller | 2025-12-03 18:33:11.748802 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-03 18:33:11.748810 | controller | Wednesday 03 December 2025 18:33:09 +0000 (0:00:00.045) 0:06:38.971 **** 2025-12-03 18:33:11.748820 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:33:11.748844 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:33:11.748917 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:33:11.749018 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:33:11.749154 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:33:11.749267 | controller | changed: [instance -> controller-0] 2025-12-03 18:33:11.749597 | controller | 2025-12-03 18:33:11.903055 | controller | TASK [Prepare install_yamls make targets] ************************************** 2025-12-03 18:33:11.903095 | controller | Wednesday 03 December 2025 18:33:11 +0000 (0:00:02.565) 0:06:41.536 **** 2025-12-03 18:33:11.903108 | controller | 2025-12-03 18:33:13.381190 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2025-12-03 18:33:13.381228 | controller | Wednesday 03 December 2025 18:33:11 +0000 (0:00:00.153) 0:06:41.690 **** 2025-12-03 18:33:13.381242 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:33:13.381272 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:33:13.381729 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:33:13.439673 | controller | changed: [instance -> controller-0] 2025-12-03 18:33:13.439697 | controller | 2025-12-03 18:33:13.439706 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2025-12-03 18:33:13.439715 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:01.478) 0:06:43.169 **** 2025-12-03 18:33:13.439732 | controller | 2025-12-03 18:33:13.480332 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2025-12-03 18:33:13.480400 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:00.058) 0:06:43.227 **** 2025-12-03 18:33:13.480426 | controller | skipping: [instance] 2025-12-03 18:33:13.527246 | controller | 2025-12-03 18:33:13.527278 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2025-12-03 18:33:13.527287 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:00.041) 0:06:43.268 **** 2025-12-03 18:33:13.527297 | controller | skipping: [instance] 2025-12-03 18:33:13.527577 | controller | 2025-12-03 18:33:13.596867 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2025-12-03 18:33:13.596887 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:00.046) 0:06:43.315 **** 2025-12-03 18:33:13.596898 | controller | 2025-12-03 18:33:13.637154 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 18:33:13.637191 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:00.069) 0:06:43.385 **** 2025-12-03 18:33:13.637206 | controller | skipping: [instance] 2025-12-03 18:33:13.637229 | controller | 2025-12-03 18:33:13.637238 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 18:33:13.637313 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:00.040) 0:06:43.425 **** 2025-12-03 18:33:13.678537 | controller | skipping: [instance] 2025-12-03 18:33:13.678678 | controller | 2025-12-03 18:33:13.678902 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 18:33:13.679173 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:00.041) 0:06:43.466 **** 2025-12-03 18:33:13.717158 | controller | skipping: [instance] 2025-12-03 18:33:13.717213 | controller | 2025-12-03 18:33:13.717224 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 18:33:13.717366 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:00.038) 0:06:43.505 **** 2025-12-03 18:33:13.761466 | controller | skipping: [instance] 2025-12-03 18:33:13.761517 | controller | 2025-12-03 18:33:13.761587 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2025-12-03 18:33:13.761690 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:00.044) 0:06:43.549 **** 2025-12-03 18:33:13.849784 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 18:33:13.849834 | controller | ok: [instance -> controller-0] 2025-12-03 18:33:13.849977 | controller | 2025-12-03 18:33:13.850234 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2025-12-03 18:33:13.850299 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:00.088) 0:06:43.637 **** 2025-12-03 18:33:13.935008 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:13.935320 | controller | 2025-12-03 18:33:13.935353 | controller | TASK [install_yamls : Get environment structure] ******************************* 2025-12-03 18:33:14.928558 | controller | Wednesday 03 December 2025 18:33:13 +0000 (0:00:00.085) 0:06:43.722 **** 2025-12-03 18:33:14.928605 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:14.966794 | controller | 2025-12-03 18:33:14.966813 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2025-12-03 18:33:14.966820 | controller | Wednesday 03 December 2025 18:33:14 +0000 (0:00:00.993) 0:06:44.716 **** 2025-12-03 18:33:14.966829 | controller | skipping: [instance] 2025-12-03 18:33:15.018559 | controller | 2025-12-03 18:33:15.018582 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2025-12-03 18:33:15.018591 | controller | Wednesday 03 December 2025 18:33:14 +0000 (0:00:00.038) 0:06:44.754 **** 2025-12-03 18:33:15.018602 | controller | skipping: [instance] 2025-12-03 18:33:15.057949 | controller | 2025-12-03 18:33:15.058000 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2025-12-03 18:33:15.058010 | controller | Wednesday 03 December 2025 18:33:15 +0000 (0:00:00.051) 0:06:44.806 **** 2025-12-03 18:33:15.058027 | controller | skipping: [instance] 2025-12-03 18:33:15.058063 | controller | 2025-12-03 18:33:15.058074 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2025-12-03 18:33:15.058371 | controller | Wednesday 03 December 2025 18:33:15 +0000 (0:00:00.039) 0:06:44.846 **** 2025-12-03 18:33:15.116947 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:15.158844 | controller | 2025-12-03 18:33:15.158863 | controller | TASK [install_yamls : Show the env structure] ********************************** 2025-12-03 18:33:15.158870 | controller | Wednesday 03 December 2025 18:33:15 +0000 (0:00:00.058) 0:06:44.905 **** 2025-12-03 18:33:15.158878 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:15.230836 | controller | 2025-12-03 18:33:15.230861 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2025-12-03 18:33:15.230872 | controller | Wednesday 03 December 2025 18:33:15 +0000 (0:00:00.041) 0:06:44.947 **** 2025-12-03 18:33:15.230893 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:15.230916 | controller | 2025-12-03 18:33:15.231205 | controller | TASK [install_yamls : Generate make targets] *********************************** 2025-12-03 18:33:15.933453 | controller | Wednesday 03 December 2025 18:33:15 +0000 (0:00:00.071) 0:06:45.018 **** 2025-12-03 18:33:15.933492 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:15.998018 | controller | 2025-12-03 18:33:15.998063 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2025-12-03 18:33:15.998073 | controller | Wednesday 03 December 2025 18:33:15 +0000 (0:00:00.702) 0:06:45.721 **** 2025-12-03 18:33:15.998084 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:16.956088 | controller | 2025-12-03 18:33:16.956123 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2025-12-03 18:33:16.956132 | controller | Wednesday 03 December 2025 18:33:15 +0000 (0:00:00.065) 0:06:45.786 **** 2025-12-03 18:33:16.956143 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:17.004295 | controller | 2025-12-03 18:33:17.004388 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2025-12-03 18:33:17.004398 | controller | Wednesday 03 December 2025 18:33:16 +0000 (0:00:00.957) 0:06:46.743 **** 2025-12-03 18:33:17.004417 | controller | skipping: [instance] 2025-12-03 18:33:17.004439 | controller | 2025-12-03 18:33:17.004446 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-03 18:33:17.004453 | controller | Wednesday 03 December 2025 18:33:17 +0000 (0:00:00.048) 0:06:46.792 **** 2025-12-03 18:33:17.721763 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:17.722225 | controller | 2025-12-03 18:33:17.722347 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-03 18:33:17.722361 | controller | Wednesday 03 December 2025 18:33:17 +0000 (0:00:00.717) 0:06:47.509 **** 2025-12-03 18:33:17.777344 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:18.680279 | controller | 2025-12-03 18:33:18.680313 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2025-12-03 18:33:18.680321 | controller | Wednesday 03 December 2025 18:33:17 +0000 (0:00:00.055) 0:06:47.565 **** 2025-12-03 18:33:18.680331 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:19.211956 | controller | 2025-12-03 18:33:19.211995 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2025-12-03 18:33:19.212019 | controller | Wednesday 03 December 2025 18:33:18 +0000 (0:00:00.902) 0:06:48.468 **** 2025-12-03 18:33:19.212031 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:19.359822 | controller | 2025-12-03 18:33:19.359861 | controller | TASK [Configure CRC network if needed] ***************************************** 2025-12-03 18:33:19.359869 | controller | Wednesday 03 December 2025 18:33:19 +0000 (0:00:00.531) 0:06:48.999 **** 2025-12-03 18:33:19.359880 | controller | 2025-12-03 18:33:20.565778 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2025-12-03 18:33:20.565826 | controller | Wednesday 03 December 2025 18:33:19 +0000 (0:00:00.147) 0:06:49.147 **** 2025-12-03 18:33:20.565856 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:20.565874 | controller | 2025-12-03 18:33:20.565880 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2025-12-03 18:33:20.565887 | controller | Wednesday 03 December 2025 18:33:20 +0000 (0:00:01.205) 0:06:50.353 **** 2025-12-03 18:33:21.786274 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:21.786550 | controller | 2025-12-03 18:33:21.786591 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2025-12-03 18:33:21.818511 | controller | Wednesday 03 December 2025 18:33:21 +0000 (0:00:01.220) 0:06:51.574 **** 2025-12-03 18:33:21.818560 | controller | skipping: [instance] 2025-12-03 18:33:21.818582 | controller | 2025-12-03 18:33:21.818698 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2025-12-03 18:33:21.819286 | controller | Wednesday 03 December 2025 18:33:21 +0000 (0:00:00.032) 0:06:51.606 **** 2025-12-03 18:33:21.859934 | controller | skipping: [instance] 2025-12-03 18:33:21.859984 | controller | 2025-12-03 18:33:21.860121 | controller | TASK [reproducer : Prepare architecture-based deployment] ********************** 2025-12-03 18:33:21.860204 | controller | Wednesday 03 December 2025 18:33:21 +0000 (0:00:00.041) 0:06:51.648 **** 2025-12-03 18:33:21.900511 | controller | skipping: [instance] 2025-12-03 18:33:21.900587 | controller | 2025-12-03 18:33:21.900701 | controller | TASK [reproducer : Prepare architecture-based post deployment] ***************** 2025-12-03 18:33:21.900806 | controller | Wednesday 03 December 2025 18:33:21 +0000 (0:00:00.040) 0:06:51.688 **** 2025-12-03 18:33:21.938808 | controller | skipping: [instance] 2025-12-03 18:33:21.938888 | controller | 2025-12-03 18:33:21.938997 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** 2025-12-03 18:33:21.939136 | controller | Wednesday 03 December 2025 18:33:21 +0000 (0:00:00.038) 0:06:51.726 **** 2025-12-03 18:33:22.882809 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:22.882862 | controller | 2025-12-03 18:33:22.882953 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** 2025-12-03 18:33:22.883065 | controller | Wednesday 03 December 2025 18:33:22 +0000 (0:00:00.943) 0:06:52.670 **** 2025-12-03 18:33:23.388754 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:23.388823 | controller | 2025-12-03 18:33:23.388981 | controller | TASK [Ensure we have needed inventory files] *********************************** 2025-12-03 18:33:23.389177 | controller | Wednesday 03 December 2025 18:33:23 +0000 (0:00:00.505) 0:06:53.176 **** 2025-12-03 18:33:23.889344 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:23.889399 | controller | 2025-12-03 18:33:23.889465 | controller | TASK [Ensure we have CRC ssh key] ********************************************** 2025-12-03 18:33:23.889565 | controller | Wednesday 03 December 2025 18:33:23 +0000 (0:00:00.500) 0:06:53.677 **** 2025-12-03 18:33:24.410360 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:24.410411 | controller | 2025-12-03 18:33:24.410512 | controller | TASK [Ensure we have the MAC mapping file] ************************************* 2025-12-03 18:33:24.410612 | controller | Wednesday 03 December 2025 18:33:24 +0000 (0:00:00.521) 0:06:54.198 **** 2025-12-03 18:33:24.904191 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:24.904247 | controller | 2025-12-03 18:33:24.904336 | controller | TASK [Load crc inventory] ****************************************************** 2025-12-03 18:33:24.904434 | controller | Wednesday 03 December 2025 18:33:24 +0000 (0:00:00.493) 0:06:54.692 **** 2025-12-03 18:33:25.376708 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:25.376760 | controller | 2025-12-03 18:33:25.376923 | controller | TASK [Load compute inventory] ************************************************** 2025-12-03 18:33:25.377026 | controller | Wednesday 03 December 2025 18:33:25 +0000 (0:00:00.472) 0:06:55.164 **** 2025-12-03 18:33:25.846946 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:25.847006 | controller | 2025-12-03 18:33:25.847201 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** 2025-12-03 18:33:25.847285 | controller | Wednesday 03 December 2025 18:33:25 +0000 (0:00:00.470) 0:06:55.635 **** 2025-12-03 18:33:26.323139 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:26.323198 | controller | 2025-12-03 18:33:26.323298 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* 2025-12-03 18:33:26.323398 | controller | Wednesday 03 December 2025 18:33:26 +0000 (0:00:00.475) 0:06:56.110 **** 2025-12-03 18:33:26.801203 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:26.801258 | controller | 2025-12-03 18:33:26.801370 | controller | TASK [Check default location secret file] ************************************** 2025-12-03 18:33:26.801469 | controller | Wednesday 03 December 2025 18:33:26 +0000 (0:00:00.478) 0:06:56.589 **** 2025-12-03 18:33:27.288975 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:27.289065 | controller | 2025-12-03 18:33:27.289177 | controller | TASK [Check non-default location secret] *************************************** 2025-12-03 18:33:27.289294 | controller | Wednesday 03 December 2025 18:33:27 +0000 (0:00:00.487) 0:06:57.077 **** 2025-12-03 18:33:27.785997 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 18:33:27.786264 | controller | 2025-12-03 18:33:27.786304 | controller | TASK [Assert all of the tests] ************************************************* 2025-12-03 18:33:27.786314 | controller | Wednesday 03 December 2025 18:33:27 +0000 (0:00:00.496) 0:06:57.574 **** 2025-12-03 18:33:27.828648 | controller | ok: [instance] 2025-12-03 18:33:27.828756 | controller | 2025-12-03 18:33:27.828787 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-12-03 18:33:27.828801 | controller | Wednesday 03 December 2025 18:33:27 +0000 (0:00:00.042) 0:06:57.616 **** 2025-12-03 18:33:28.041423 | controller | changed: [instance] 2025-12-03 18:33:28.041624 | controller | 2025-12-03 18:33:28.041654 | controller | TASK [Get journalctl in a file] ************************************************ 2025-12-03 18:33:28.279211 | controller | Wednesday 03 December 2025 18:33:28 +0000 (0:00:00.212) 0:06:57.829 **** 2025-12-03 18:33:28.279249 | controller | changed: [instance] 2025-12-03 18:33:28.658324 | controller | 2025-12-03 18:33:28.658356 | controller | TASK [Dump journalctl output] ************************************************** 2025-12-03 18:33:28.658364 | controller | Wednesday 03 December 2025 18:33:28 +0000 (0:00:00.237) 0:06:58.066 **** 2025-12-03 18:33:28.658376 | controller | changed: [instance] 2025-12-03 18:33:29.147126 | controller | 2025-12-03 18:33:29.147161 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-12-03 18:33:29.147170 | controller | Wednesday 03 December 2025 18:33:28 +0000 (0:00:00.379) 0:06:58.446 **** 2025-12-03 18:33:29.147182 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-03 18:33:29.147217 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-12-03 18:33:29.147532 | controller | 2025-12-03 18:33:29.344138 | controller | TASK [Create log directory] **************************************************** 2025-12-03 18:33:29.344178 | controller | Wednesday 03 December 2025 18:33:29 +0000 (0:00:00.489) 0:06:58.935 **** 2025-12-03 18:33:29.344193 | controller | changed: [instance] 2025-12-03 18:33:30.248195 | controller | 2025-12-03 18:33:30.248228 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-12-03 18:33:30.248237 | controller | Wednesday 03 December 2025 18:33:29 +0000 (0:00:00.196) 0:06:59.132 **** 2025-12-03 18:33:30.248247 | controller | changed: [instance] 2025-12-03 18:33:30.248274 | controller | 2025-12-03 18:33:30.248521 | controller | PLAY RECAP ********************************************************************* 2025-12-03 18:33:30.248574 | controller | instance : ok=540 changed=203 unreachable=0 failed=0 skipped=226 rescued=0 ignored=0 2025-12-03 18:33:30.248588 | controller | 2025-12-03 18:33:30.248627 | controller | Wednesday 03 December 2025 18:33:30 +0000 (0:00:00.902) 0:07:00.034 **** 2025-12-03 18:33:30.248739 | controller | =============================================================================== 2025-12-03 18:33:30.248831 | controller | reproducer : Check package install status ------------------------------ 55.48s 2025-12-03 18:33:30.248921 | controller | ci_setup : Install needed packages ------------------------------------- 29.97s 2025-12-03 18:33:30.249016 | controller | libvirt_manager : Download base image ---------------------------------- 27.67s 2025-12-03 18:33:30.249152 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.77s 2025-12-03 18:33:30.249245 | controller | reproducer : Install collections on controller-0 ----------------------- 19.31s 2025-12-03 18:33:30.249331 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.78s 2025-12-03 18:33:30.249435 | controller | libvirt_manager : Install packages required for using KVM --------------- 7.81s 2025-12-03 18:33:30.249527 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.79s 2025-12-03 18:33:30.249604 | controller | ci_setup : Install openshift client ------------------------------------- 6.13s 2025-12-03 18:33:30.249705 | controller | reproducer : Ensure we have all dependencies installed ------------------ 5.90s 2025-12-03 18:33:30.249797 | controller | ci_nmstate : Install required packages on localhost --------------------- 4.91s 2025-12-03 18:33:30.249893 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 4.61s 2025-12-03 18:33:30.250021 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.48s 2025-12-03 18:33:30.250162 | controller | networking_mapper : Gather the facts ------------------------------------ 3.35s 2025-12-03 18:33:30.250246 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.04s 2025-12-03 18:33:30.250338 | controller | ci_setup : Manage directories ------------------------------------------- 2.57s 2025-12-03 18:33:30.250429 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.29s 2025-12-03 18:33:30.250519 | controller | sushy_emulator : Install required packages ------------------------------ 2.25s 2025-12-03 18:33:30.250604 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2025-12-03 18:33:30.250705 | controller | reproducer : Sync local repositories to other hosts if present ---------- 1.96s 2025-12-03 18:33:30.371567 | controller | INFO Running crc_layout > cleanup 2025-12-03 18:33:30.372015 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-03 18:33:30.379566 | controller | INFO Running job_uri > prepare 2025-12-03 18:33:30.379935 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-03 18:33:30.387899 | controller | INFO Running job_uri > converge 2025-12-03 18:33:30.811482 | controller | 2025-12-03 18:33:30.811554 | controller | PLAY [Prepare] ***************************************************************** 2025-12-03 18:33:30.811640 | controller | 2025-12-03 18:33:30.811737 | controller | TASK [Call task file in loop] ************************************************** 2025-12-03 18:33:30.811851 | controller | Wednesday 03 December 2025 18:33:30 +0000 (0:00:00.032) 0:00:00.032 **** 2025-12-03 18:33:30.876639 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) 2025-12-03 18:33:30.876747 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-12-03 18:33:30.876870 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-12-03 18:33:30.876994 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) 2025-12-03 18:33:30.877158 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-12-03 18:33:30.877254 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-12-03 18:33:30.877364 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) 2025-12-03 18:33:30.877470 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) 2025-12-03 18:33:30.877594 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) 2025-12-03 18:33:30.877708 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) 2025-12-03 18:33:30.877800 | controller | 2025-12-03 18:33:30.877904 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** 2025-12-03 18:33:30.877996 | controller | Wednesday 03 December 2025 18:33:30 +0000 (0:00:00.065) 0:00:00.098 **** 2025-12-03 18:33:30.916717 | controller | 2025-12-03 18:33:30.916783 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 18:33:30.916901 | controller | Wednesday 03 December 2025 18:33:30 +0000 (0:00:00.039) 0:00:00.138 **** 2025-12-03 18:33:30.950998 | controller | ok: [instance] 2025-12-03 18:33:30.951141 | controller | 2025-12-03 18:33:30.951257 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 18:33:30.951366 | controller | Wednesday 03 December 2025 18:33:30 +0000 (0:00:00.034) 0:00:00.172 **** 2025-12-03 18:33:30.993215 | controller | ok: [instance] 2025-12-03 18:33:30.993299 | controller | 2025-12-03 18:33:30.993413 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 18:33:30.993543 | controller | Wednesday 03 December 2025 18:33:30 +0000 (0:00:00.040) 0:00:00.212 **** 2025-12-03 18:33:31.040401 | controller | ok: [instance] 2025-12-03 18:33:31.040479 | controller | 2025-12-03 18:33:31.040599 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 18:33:31.040708 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.049) 0:00:00.261 **** 2025-12-03 18:33:31.064465 | controller | skipping: [instance] 2025-12-03 18:33:31.064558 | controller | 2025-12-03 18:33:31.064675 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 18:33:31.064776 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.024) 0:00:00.286 **** 2025-12-03 18:33:31.120401 | controller | ok: [instance] => changed=false 2025-12-03 18:33:31.120468 | controller | msg: All assertions passed 2025-12-03 18:33:31.120564 | controller | 2025-12-03 18:33:31.120685 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-12-03 18:33:31.120788 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.055) 0:00:00.341 **** 2025-12-03 18:33:31.155999 | controller | 2025-12-03 18:33:31.156121 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 18:33:31.156243 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.035) 0:00:00.377 **** 2025-12-03 18:33:31.190237 | controller | ok: [instance] 2025-12-03 18:33:31.190297 | controller | 2025-12-03 18:33:31.190426 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 18:33:31.190517 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.034) 0:00:00.411 **** 2025-12-03 18:33:31.224806 | controller | ok: [instance] 2025-12-03 18:33:31.224864 | controller | 2025-12-03 18:33:31.224977 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 18:33:31.226745 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.034) 0:00:00.446 **** 2025-12-03 18:33:31.258973 | controller | ok: [instance] 2025-12-03 18:33:31.259056 | controller | 2025-12-03 18:33:31.259193 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 18:33:31.259286 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.033) 0:00:00.480 **** 2025-12-03 18:33:31.285400 | controller | skipping: [instance] 2025-12-03 18:33:31.285497 | controller | 2025-12-03 18:33:31.285608 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 18:33:31.285711 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.026) 0:00:00.506 **** 2025-12-03 18:33:31.320301 | controller | ok: [instance] => changed=false 2025-12-03 18:33:31.320394 | controller | msg: All assertions passed 2025-12-03 18:33:31.320491 | controller | 2025-12-03 18:33:31.320623 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-12-03 18:33:31.320720 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.034) 0:00:00.541 **** 2025-12-03 18:33:31.356784 | controller | 2025-12-03 18:33:31.356883 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 18:33:31.357005 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.036) 0:00:00.578 **** 2025-12-03 18:33:31.389423 | controller | ok: [instance] 2025-12-03 18:33:31.389512 | controller | 2025-12-03 18:33:31.389618 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 18:33:31.389724 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.032) 0:00:00.611 **** 2025-12-03 18:33:31.427389 | controller | ok: [instance] 2025-12-03 18:33:31.427470 | controller | 2025-12-03 18:33:31.427572 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 18:33:31.427703 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.037) 0:00:00.649 **** 2025-12-03 18:33:31.463425 | controller | ok: [instance] 2025-12-03 18:33:31.463518 | controller | 2025-12-03 18:33:31.463632 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 18:33:31.463741 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.035) 0:00:00.684 **** 2025-12-03 18:33:31.490264 | controller | skipping: [instance] 2025-12-03 18:33:31.490351 | controller | 2025-12-03 18:33:31.490484 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 18:33:31.490570 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.026) 0:00:00.711 **** 2025-12-03 18:33:31.529365 | controller | ok: [instance] => changed=false 2025-12-03 18:33:31.529509 | controller | msg: All assertions passed 2025-12-03 18:33:31.529643 | controller | 2025-12-03 18:33:31.529823 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** 2025-12-03 18:33:31.529987 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.038) 0:00:00.750 **** 2025-12-03 18:33:31.565151 | controller | 2025-12-03 18:33:31.565258 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 18:33:31.565370 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.035) 0:00:00.786 **** 2025-12-03 18:33:31.598740 | controller | ok: [instance] 2025-12-03 18:33:31.598801 | controller | 2025-12-03 18:33:31.598904 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 18:33:31.599019 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.033) 0:00:00.820 **** 2025-12-03 18:33:31.637861 | controller | ok: [instance] 2025-12-03 18:33:31.637920 | controller | 2025-12-03 18:33:31.638062 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 18:33:31.638182 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.039) 0:00:00.859 **** 2025-12-03 18:33:31.676599 | controller | ok: [instance] 2025-12-03 18:33:31.676653 | controller | 2025-12-03 18:33:31.676776 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 18:33:31.676918 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.038) 0:00:00.897 **** 2025-12-03 18:33:31.701754 | controller | skipping: [instance] 2025-12-03 18:33:31.701854 | controller | 2025-12-03 18:33:31.701992 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 18:33:31.702147 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.025) 0:00:00.923 **** 2025-12-03 18:33:31.736257 | controller | ok: [instance] => changed=false 2025-12-03 18:33:31.736362 | controller | msg: All assertions passed 2025-12-03 18:33:31.736463 | controller | 2025-12-03 18:33:31.736586 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-12-03 18:33:31.736680 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.034) 0:00:00.957 **** 2025-12-03 18:33:31.790816 | controller | 2025-12-03 18:33:31.790872 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 18:33:31.790993 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.054) 0:00:01.012 **** 2025-12-03 18:33:31.824529 | controller | ok: [instance] 2025-12-03 18:33:31.824623 | controller | 2025-12-03 18:33:31.824735 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 18:33:31.824842 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.033) 0:00:01.046 **** 2025-12-03 18:33:31.852752 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:31.852851 | controller | assertion: _matched_url | default('') | length > 0 2025-12-03 18:33:31.852973 | controller | evaluated_to: false 2025-12-03 18:33:31.853134 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-03 18:33:31.878795 | controller | 2025-12-03 18:33:31.878898 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-03 18:33:31.879030 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.037) 0:00:01.083 **** 2025-12-03 18:33:31.879191 | controller | 2025-12-03 18:33:31.879285 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-03 18:33:31.879399 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.016) 0:00:01.100 **** 2025-12-03 18:33:31.911553 | controller | skipping: [instance] 2025-12-03 18:33:31.911643 | controller | 2025-12-03 18:33:31.911757 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-03 18:33:31.911858 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.032) 0:00:01.133 **** 2025-12-03 18:33:31.947606 | controller | skipping: [instance] 2025-12-03 18:33:31.947698 | controller | 2025-12-03 18:33:31.947816 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-12-03 18:33:31.947925 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.035) 0:00:01.169 **** 2025-12-03 18:33:31.983203 | controller | 2025-12-03 18:33:31.983311 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 18:33:31.983421 | controller | Wednesday 03 December 2025 18:33:31 +0000 (0:00:00.035) 0:00:01.204 **** 2025-12-03 18:33:32.016080 | controller | ok: [instance] 2025-12-03 18:33:32.016179 | controller | 2025-12-03 18:33:32.016290 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 18:33:32.016403 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.032) 0:00:01.237 **** 2025-12-03 18:33:32.043695 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:32.043816 | controller | assertion: _matched_url | default('') | length > 0 2025-12-03 18:33:32.043916 | controller | evaluated_to: false 2025-12-03 18:33:32.044065 | controller | msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-03 18:33:32.070516 | controller | 2025-12-03 18:33:32.070610 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-03 18:33:32.070712 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.038) 0:00:01.276 **** 2025-12-03 18:33:32.070818 | controller | 2025-12-03 18:33:32.070919 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-03 18:33:32.071024 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.015) 0:00:01.292 **** 2025-12-03 18:33:32.105341 | controller | skipping: [instance] 2025-12-03 18:33:32.105435 | controller | 2025-12-03 18:33:32.105551 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-03 18:33:32.105652 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.034) 0:00:01.326 **** 2025-12-03 18:33:32.139732 | controller | skipping: [instance] 2025-12-03 18:33:32.139786 | controller | 2025-12-03 18:33:32.139898 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** 2025-12-03 18:33:32.140022 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.034) 0:00:01.361 **** 2025-12-03 18:33:32.175789 | controller | 2025-12-03 18:33:32.176320 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 18:33:32.176434 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.036) 0:00:01.397 **** 2025-12-03 18:33:32.209895 | controller | ok: [instance] 2025-12-03 18:33:32.209996 | controller | 2025-12-03 18:33:32.210209 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 18:33:32.210272 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.034) 0:00:01.431 **** 2025-12-03 18:33:32.249471 | controller | ok: [instance] 2025-12-03 18:33:32.249555 | controller | 2025-12-03 18:33:32.249657 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 18:33:32.249761 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.039) 0:00:01.471 **** 2025-12-03 18:33:32.286288 | controller | ok: [instance] 2025-12-03 18:33:32.286427 | controller | 2025-12-03 18:33:32.286553 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 18:33:32.286666 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.036) 0:00:01.507 **** 2025-12-03 18:33:32.312511 | controller | skipping: [instance] 2025-12-03 18:33:32.312607 | controller | 2025-12-03 18:33:32.312727 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 18:33:32.312828 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.026) 0:00:01.534 **** 2025-12-03 18:33:32.350702 | controller | ok: [instance] => changed=false 2025-12-03 18:33:32.350839 | controller | msg: All assertions passed 2025-12-03 18:33:32.350969 | controller | 2025-12-03 18:33:32.351161 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** 2025-12-03 18:33:32.351297 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.038) 0:00:01.572 **** 2025-12-03 18:33:32.406431 | controller | 2025-12-03 18:33:32.406486 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 18:33:32.406598 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.055) 0:00:01.628 **** 2025-12-03 18:33:32.441621 | controller | ok: [instance] 2025-12-03 18:33:32.441690 | controller | 2025-12-03 18:33:32.441802 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 18:33:32.441900 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.035) 0:00:01.663 **** 2025-12-03 18:33:32.480343 | controller | ok: [instance] 2025-12-03 18:33:32.480423 | controller | 2025-12-03 18:33:32.480517 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-03 18:33:32.480623 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.038) 0:00:01.702 **** 2025-12-03 18:33:32.515188 | controller | ok: [instance] 2025-12-03 18:33:32.515274 | controller | 2025-12-03 18:33:32.515386 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-03 18:33:32.515503 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.034) 0:00:01.736 **** 2025-12-03 18:33:32.543980 | controller | skipping: [instance] 2025-12-03 18:33:32.544126 | controller | 2025-12-03 18:33:32.544262 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-03 18:33:32.544351 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.028) 0:00:01.765 **** 2025-12-03 18:33:32.578173 | controller | ok: [instance] => changed=false 2025-12-03 18:33:32.578258 | controller | msg: All assertions passed 2025-12-03 18:33:32.578373 | controller | 2025-12-03 18:33:32.578474 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** 2025-12-03 18:33:32.578558 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.034) 0:00:01.799 **** 2025-12-03 18:33:32.616566 | controller | 2025-12-03 18:33:32.616646 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 18:33:32.616748 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.038) 0:00:01.838 **** 2025-12-03 18:33:32.651664 | controller | ok: [instance] 2025-12-03 18:33:32.651750 | controller | 2025-12-03 18:33:32.651852 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 18:33:32.651966 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.035) 0:00:01.873 **** 2025-12-03 18:33:32.679379 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:32.679528 | controller | assertion: _matched_url | default('') | length > 0 2025-12-03 18:33:32.679564 | controller | evaluated_to: false 2025-12-03 18:33:32.679707 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-03 18:33:32.708766 | controller | 2025-12-03 18:33:32.708881 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-03 18:33:32.709024 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.039) 0:00:01.912 **** 2025-12-03 18:33:32.709142 | controller | 2025-12-03 18:33:32.709249 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-03 18:33:32.709411 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.017) 0:00:01.929 **** 2025-12-03 18:33:32.743539 | controller | skipping: [instance] 2025-12-03 18:33:32.743623 | controller | 2025-12-03 18:33:32.743738 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-03 18:33:32.743845 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.035) 0:00:01.965 **** 2025-12-03 18:33:32.776066 | controller | skipping: [instance] 2025-12-03 18:33:32.776182 | controller | 2025-12-03 18:33:32.776283 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** 2025-12-03 18:33:32.776390 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.032) 0:00:01.997 **** 2025-12-03 18:33:32.811634 | controller | 2025-12-03 18:33:32.811726 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-03 18:33:32.811841 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.035) 0:00:02.033 **** 2025-12-03 18:33:32.845208 | controller | ok: [instance] 2025-12-03 18:33:32.845297 | controller | 2025-12-03 18:33:32.845405 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-03 18:33:32.845546 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.033) 0:00:02.066 **** 2025-12-03 18:33:32.873279 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:32.873370 | controller | assertion: _matched_url | default('') | length > 0 2025-12-03 18:33:32.873480 | controller | evaluated_to: false 2025-12-03 18:33:32.873610 | controller | msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-03 18:33:32.899569 | controller | 2025-12-03 18:33:32.899669 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-03 18:33:32.899770 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.038) 0:00:02.105 **** 2025-12-03 18:33:32.899862 | controller | 2025-12-03 18:33:32.899963 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-03 18:33:32.900118 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.015) 0:00:02.121 **** 2025-12-03 18:33:32.932095 | controller | skipping: [instance] 2025-12-03 18:33:32.932241 | controller | 2025-12-03 18:33:32.932405 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-03 18:33:32.932524 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.032) 0:00:02.153 **** 2025-12-03 18:33:32.963450 | controller | skipping: [instance] 2025-12-03 18:33:32.963542 | controller | 2025-12-03 18:33:32.963671 | controller | TASK [Print success message] *************************************************** 2025-12-03 18:33:32.963797 | controller | Wednesday 03 December 2025 18:33:32 +0000 (0:00:00.031) 0:00:02.185 **** 2025-12-03 18:33:33.036184 | controller | ok: [instance] => 2025-12-03 18:33:33.036265 | controller | msg: All strings passed! 2025-12-03 18:33:33.036368 | controller | 2025-12-03 18:33:33.036984 | controller | PLAY RECAP ********************************************************************* 2025-12-03 18:33:33.037239 | controller | instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 2025-12-03 18:33:33.037267 | controller | 2025-12-03 18:33:33.037275 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.072) 0:00:02.257 **** 2025-12-03 18:33:33.037290 | controller | =============================================================================== 2025-12-03 18:33:33.037300 | controller | Print success message --------------------------------------------------- 0.07s 2025-12-03 18:33:33.037357 | controller | Call task file in loop -------------------------------------------------- 0.07s 2025-12-03 18:33:33.037368 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.06s 2025-12-03 18:33:33.037375 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.06s 2025-12-03 18:33:33.037384 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.05s 2025-12-03 18:33:33.037505 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2025-12-03 18:33:33.037540 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 18:33:33.037653 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything///// --- 0.04s 2025-12-03 18:33:33.037814 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 18:33:33.037833 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 18:33:33.037926 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 18:33:33.038148 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.04s 2025-12-03 18:33:33.038223 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 18:33:33.038233 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 18:33:33.038317 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 18:33:33.038430 | controller | reproducer : Extract job id for later reference ------------------------- 0.04s 2025-12-03 18:33:33.038519 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 --- 0.04s 2025-12-03 18:33:33.038630 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.04s 2025-12-03 18:33:33.038702 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 18:33:33.038787 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-12-03 18:33:33.095847 | controller | INFO Running job_uri > cleanup 2025-12-03 18:33:33.096313 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-03 18:33:33.104025 | controller | INFO Running network_validations > prepare 2025-12-03 18:33:33.104482 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-03 18:33:33.112973 | controller | INFO Running network_validations > converge 2025-12-03 18:33:33.540030 | controller | 2025-12-03 18:33:33.540391 | controller | PLAY [Prepare] ***************************************************************** 2025-12-03 18:33:33.540814 | controller | 2025-12-03 18:33:33.543806 | controller | TASK [Set failed fact] ********************************************************* 2025-12-03 18:33:33.564234 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.033) 0:00:00.033 **** 2025-12-03 18:33:33.564261 | controller | ok: [instance] 2025-12-03 18:33:33.564349 | controller | 2025-12-03 18:33:33.564458 | controller | TASK [Load scenarios] ********************************************************** 2025-12-03 18:33:33.564562 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.024) 0:00:00.058 **** 2025-12-03 18:33:33.587255 | controller | ok: [instance] 2025-12-03 18:33:33.587356 | controller | 2025-12-03 18:33:33.587442 | controller | TASK [Test network validations] ************************************************ 2025-12-03 18:33:33.587561 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.023) 0:00:00.081 **** 2025-12-03 18:33:33.648947 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) 2025-12-03 18:33:33.649063 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) 2025-12-03 18:33:33.649189 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) 2025-12-03 18:33:33.649304 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) 2025-12-03 18:33:33.649412 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) 2025-12-03 18:33:33.649520 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) 2025-12-03 18:33:33.649606 | controller | 2025-12-03 18:33:33.649712 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:33.649813 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.061) 0:00:00.143 **** 2025-12-03 18:33:33.671190 | controller | ok: [instance] 2025-12-03 18:33:33.671292 | controller | 2025-12-03 18:33:33.671397 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:33.671502 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.022) 0:00:00.165 **** 2025-12-03 18:33:33.697064 | controller | ok: [instance] 2025-12-03 18:33:33.697174 | controller | 2025-12-03 18:33:33.697281 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:33.697397 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.025) 0:00:00.191 **** 2025-12-03 18:33:33.721174 | controller | ok: [instance] => 2025-12-03 18:33:33.721287 | controller | msg: 'Running: Default nets only' 2025-12-03 18:33:33.721407 | controller | 2025-12-03 18:33:33.721499 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:33.721600 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.024) 0:00:00.215 **** 2025-12-03 18:33:33.763628 | controller | 2025-12-03 18:33:33.763729 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 18:33:33.763839 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.042) 0:00:00.257 **** 2025-12-03 18:33:33.791189 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 18:33:33.791295 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 18:33:33.791467 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 18:33:33.840064 | controller | collisions and unexpected behavior. 2025-12-03 18:33:33.840101 | controller | ok: [instance] => (item=controller) 2025-12-03 18:33:33.840164 | controller | 2025-12-03 18:33:33.840268 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 18:33:33.840378 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.076) 0:00:00.334 **** 2025-12-03 18:33:33.896512 | controller | ok: [instance] 2025-12-03 18:33:33.896596 | controller | 2025-12-03 18:33:33.896709 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-03 18:33:33.896813 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.055) 0:00:00.389 **** 2025-12-03 18:33:33.959018 | controller | ok: [instance] => changed=false 2025-12-03 18:33:33.959146 | controller | msg: All assertions passed 2025-12-03 18:33:33.959246 | controller | 2025-12-03 18:33:33.959349 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:33.959450 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.063) 0:00:00.453 **** 2025-12-03 18:33:33.996060 | controller | skipping: [instance] 2025-12-03 18:33:33.996175 | controller | 2025-12-03 18:33:33.996299 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:33.996402 | controller | Wednesday 03 December 2025 18:33:33 +0000 (0:00:00.037) 0:00:00.490 **** 2025-12-03 18:33:34.027972 | controller | skipping: [instance] 2025-12-03 18:33:34.028117 | controller | 2025-12-03 18:33:34.028229 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:34.028333 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.032) 0:00:00.522 **** 2025-12-03 18:33:34.061502 | controller | skipping: [instance] 2025-12-03 18:33:34.061591 | controller | 2025-12-03 18:33:34.061695 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:34.061798 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.033) 0:00:00.555 **** 2025-12-03 18:33:34.083485 | controller | ok: [instance] 2025-12-03 18:33:34.083740 | controller | 2025-12-03 18:33:34.107505 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:34.107549 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.021) 0:00:00.577 **** 2025-12-03 18:33:34.107563 | controller | ok: [instance] 2025-12-03 18:33:34.107583 | controller | 2025-12-03 18:33:34.107620 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:34.107741 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.024) 0:00:00.601 **** 2025-12-03 18:33:34.134470 | controller | ok: [instance] => 2025-12-03 18:33:34.134553 | controller | msg: 'Running: Default nets and spine/leaf' 2025-12-03 18:33:34.134644 | controller | 2025-12-03 18:33:34.134751 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:34.134849 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.027) 0:00:00.628 **** 2025-12-03 18:33:34.171887 | controller | 2025-12-03 18:33:34.172006 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 18:33:34.172386 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.037) 0:00:00.666 **** 2025-12-03 18:33:34.196625 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 18:33:34.196708 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 18:33:34.196813 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 18:33:34.196915 | controller | collisions and unexpected behavior. 2025-12-03 18:33:34.214973 | controller | ok: [instance] => (item=controller) 2025-12-03 18:33:34.215137 | controller | 2025-12-03 18:33:34.215215 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 18:33:34.215597 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.043) 0:00:00.709 **** 2025-12-03 18:33:34.269682 | controller | ok: [instance] 2025-12-03 18:33:34.269821 | controller | 2025-12-03 18:33:34.269979 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-03 18:33:34.270176 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.054) 0:00:00.763 **** 2025-12-03 18:33:34.328613 | controller | ok: [instance] => changed=false 2025-12-03 18:33:34.328696 | controller | msg: All assertions passed 2025-12-03 18:33:34.328787 | controller | 2025-12-03 18:33:34.328885 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:34.328983 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.058) 0:00:00.822 **** 2025-12-03 18:33:34.365406 | controller | skipping: [instance] 2025-12-03 18:33:34.365491 | controller | 2025-12-03 18:33:34.365603 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:34.365710 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.036) 0:00:00.859 **** 2025-12-03 18:33:34.394852 | controller | skipping: [instance] 2025-12-03 18:33:34.394957 | controller | 2025-12-03 18:33:34.395095 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:34.395196 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.029) 0:00:00.889 **** 2025-12-03 18:33:34.427729 | controller | skipping: [instance] 2025-12-03 18:33:34.427822 | controller | 2025-12-03 18:33:34.427946 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:34.428071 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.032) 0:00:00.921 **** 2025-12-03 18:33:34.448107 | controller | ok: [instance] 2025-12-03 18:33:34.448203 | controller | 2025-12-03 18:33:34.448311 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:34.448413 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.020) 0:00:00.942 **** 2025-12-03 18:33:34.473625 | controller | ok: [instance] 2025-12-03 18:33:34.473713 | controller | 2025-12-03 18:33:34.473817 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:34.473915 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.025) 0:00:00.967 **** 2025-12-03 18:33:34.497409 | controller | ok: [instance] => 2025-12-03 18:33:34.497533 | controller | msg: 'Running: Default nets with extra defined net' 2025-12-03 18:33:34.497631 | controller | 2025-12-03 18:33:34.497730 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:34.497837 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.023) 0:00:00.991 **** 2025-12-03 18:33:34.538691 | controller | 2025-12-03 18:33:34.538786 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 18:33:34.538896 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.041) 0:00:01.032 **** 2025-12-03 18:33:34.562353 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 18:33:34.562458 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 18:33:34.562565 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 18:33:34.563000 | controller | collisions and unexpected behavior. 2025-12-03 18:33:34.602436 | controller | ok: [instance] => (item=controller) 2025-12-03 18:33:34.602594 | controller | 2025-12-03 18:33:34.602630 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 18:33:34.602737 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.063) 0:00:01.096 **** 2025-12-03 18:33:34.654753 | controller | ok: [instance] 2025-12-03 18:33:34.654836 | controller | 2025-12-03 18:33:34.654959 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-03 18:33:34.655089 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.052) 0:00:01.148 **** 2025-12-03 18:33:34.696840 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:34.696872 | controller | assertion: _defined | difference(_all_nets) | length == 0 2025-12-03 18:33:34.697081 | controller | evaluated_to: false 2025-12-03 18:33:34.707713 | controller | msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' 2025-12-03 18:33:34.707734 | controller | 2025-12-03 18:33:34.707818 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-03 18:33:34.707926 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.053) 0:00:01.201 **** 2025-12-03 18:33:34.737411 | controller | ok: [instance] => 2025-12-03 18:33:34.737524 | controller | cifmw_libvirt_manager_configuration: 2025-12-03 18:33:34.737624 | controller | networks: 2025-12-03 18:33:34.737724 | controller | public: defined 2025-12-03 18:33:34.737816 | controller | vms: 2025-12-03 18:33:34.737922 | controller | controller: 2025-12-03 18:33:34.738020 | controller | nets: 2025-12-03 18:33:34.738162 | controller | - public 2025-12-03 18:33:34.738241 | controller | 2025-12-03 18:33:34.738345 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-03 18:33:34.738436 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.029) 0:00:01.231 **** 2025-12-03 18:33:34.763669 | controller | skipping: [instance] 2025-12-03 18:33:34.763761 | controller | 2025-12-03 18:33:34.763870 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-03 18:33:34.764007 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.026) 0:00:01.257 **** 2025-12-03 18:33:34.834698 | controller | skipping: [instance] 2025-12-03 18:33:34.834766 | controller | 2025-12-03 18:33:34.834895 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-03 18:33:34.835003 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.070) 0:00:01.328 **** 2025-12-03 18:33:34.872263 | controller | ok: [instance] => 2025-12-03 18:33:34.872357 | controller | _cifmw_libvirt_manager_layout: 2025-12-03 18:33:34.872462 | controller | networks: 2025-12-03 18:33:34.872570 | controller | extra_net_1: defined 2025-12-03 18:33:34.872663 | controller | public: defined 2025-12-03 18:33:34.872761 | controller | vms: 2025-12-03 18:33:34.872861 | controller | controller: 2025-12-03 18:33:34.872961 | controller | nets: 2025-12-03 18:33:34.873110 | controller | - public 2025-12-03 18:33:34.873206 | controller | 2025-12-03 18:33:34.873309 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-03 18:33:34.873415 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.037) 0:00:01.366 **** 2025-12-03 18:33:34.884551 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:34.884660 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-03 18:33:34.911283 | controller | 2025-12-03 18:33:34.911396 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:34.911520 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.023) 0:00:01.389 **** 2025-12-03 18:33:34.911621 | controller | 2025-12-03 18:33:34.911706 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:34.911806 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.015) 0:00:01.405 **** 2025-12-03 18:33:34.932499 | controller | ok: [instance] 2025-12-03 18:33:34.932585 | controller | 2025-12-03 18:33:34.932696 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:34.932800 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.021) 0:00:01.426 **** 2025-12-03 18:33:34.967397 | controller | skipping: [instance] 2025-12-03 18:33:34.967474 | controller | 2025-12-03 18:33:34.967580 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:34.967686 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.034) 0:00:01.461 **** 2025-12-03 18:33:35.000445 | controller | skipping: [instance] 2025-12-03 18:33:35.000530 | controller | 2025-12-03 18:33:35.000657 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:35.000746 | controller | Wednesday 03 December 2025 18:33:34 +0000 (0:00:00.033) 0:00:01.494 **** 2025-12-03 18:33:35.033170 | controller | skipping: [instance] 2025-12-03 18:33:35.033273 | controller | 2025-12-03 18:33:35.033385 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:35.033489 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.032) 0:00:01.527 **** 2025-12-03 18:33:35.058180 | controller | ok: [instance] 2025-12-03 18:33:35.058261 | controller | 2025-12-03 18:33:35.058361 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:35.058495 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.024) 0:00:01.552 **** 2025-12-03 18:33:35.084603 | controller | ok: [instance] 2025-12-03 18:33:35.084681 | controller | 2025-12-03 18:33:35.084786 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:35.084893 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.026) 0:00:01.578 **** 2025-12-03 18:33:35.110848 | controller | ok: [instance] => 2025-12-03 18:33:35.110943 | controller | msg: 'Running: Missing default net definition' 2025-12-03 18:33:35.111071 | controller | 2025-12-03 18:33:35.111172 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:35.111285 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.026) 0:00:01.605 **** 2025-12-03 18:33:35.148999 | controller | 2025-12-03 18:33:35.149144 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 18:33:35.149250 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.038) 0:00:01.643 **** 2025-12-03 18:33:35.174823 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 18:33:35.175220 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 18:33:35.194990 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 18:33:35.195009 | controller | collisions and unexpected behavior. 2025-12-03 18:33:35.195019 | controller | ok: [instance] => (item=controller) 2025-12-03 18:33:35.195120 | controller | 2025-12-03 18:33:35.195223 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 18:33:35.195323 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.045) 0:00:01.689 **** 2025-12-03 18:33:35.238074 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:35.238192 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-12-03 18:33:35.238295 | controller | evaluated_to: false 2025-12-03 18:33:35.238412 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' 2025-12-03 18:33:35.248954 | controller | 2025-12-03 18:33:35.249121 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-03 18:33:35.249232 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.053) 0:00:01.743 **** 2025-12-03 18:33:35.279618 | controller | ok: [instance] => 2025-12-03 18:33:35.279726 | controller | cifmw_libvirt_manager_configuration: 2025-12-03 18:33:35.279832 | controller | networks: 2025-12-03 18:33:35.279934 | controller | public: defined 2025-12-03 18:33:35.280061 | controller | vms: 2025-12-03 18:33:35.280184 | controller | controller: 2025-12-03 18:33:35.280287 | controller | nets: 2025-12-03 18:33:35.280376 | controller | - public 2025-12-03 18:33:35.280468 | controller | 2025-12-03 18:33:35.280574 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-03 18:33:35.280675 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.030) 0:00:01.773 **** 2025-12-03 18:33:35.309246 | controller | skipping: [instance] 2025-12-03 18:33:35.309355 | controller | 2025-12-03 18:33:35.309444 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-03 18:33:35.309560 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.029) 0:00:01.803 **** 2025-12-03 18:33:35.405380 | controller | skipping: [instance] 2025-12-03 18:33:35.405437 | controller | 2025-12-03 18:33:35.405521 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-03 18:33:35.405623 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.095) 0:00:01.899 **** 2025-12-03 18:33:35.443023 | controller | ok: [instance] => 2025-12-03 18:33:35.443958 | controller | _cifmw_libvirt_manager_layout: 2025-12-03 18:33:35.443986 | controller | networks: 2025-12-03 18:33:35.443994 | controller | public: defined 2025-12-03 18:33:35.444000 | controller | vms: 2025-12-03 18:33:35.444006 | controller | controller: 2025-12-03 18:33:35.444011 | controller | nets: 2025-12-03 18:33:35.444016 | controller | - public 2025-12-03 18:33:35.444021 | controller | - foo 2025-12-03 18:33:35.444027 | controller | 2025-12-03 18:33:35.444072 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-03 18:33:35.444209 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.037) 0:00:01.937 **** 2025-12-03 18:33:35.458848 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:35.458944 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-03 18:33:35.506447 | controller | 2025-12-03 18:33:35.506499 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:35.506607 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.046) 0:00:01.984 **** 2025-12-03 18:33:35.506693 | controller | 2025-12-03 18:33:35.506790 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:35.506915 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.016) 0:00:02.000 **** 2025-12-03 18:33:35.528917 | controller | ok: [instance] 2025-12-03 18:33:35.529013 | controller | 2025-12-03 18:33:35.529159 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:35.529254 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.022) 0:00:02.022 **** 2025-12-03 18:33:35.563880 | controller | skipping: [instance] 2025-12-03 18:33:35.563989 | controller | 2025-12-03 18:33:35.564160 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:35.564252 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.035) 0:00:02.058 **** 2025-12-03 18:33:35.596202 | controller | skipping: [instance] 2025-12-03 18:33:35.596317 | controller | 2025-12-03 18:33:35.596456 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:35.596564 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.032) 0:00:02.090 **** 2025-12-03 18:33:35.628426 | controller | skipping: [instance] 2025-12-03 18:33:35.628499 | controller | 2025-12-03 18:33:35.628620 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:35.628740 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.031) 0:00:02.122 **** 2025-12-03 18:33:35.649358 | controller | ok: [instance] 2025-12-03 18:33:35.649436 | controller | 2025-12-03 18:33:35.649566 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:35.649660 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.021) 0:00:02.143 **** 2025-12-03 18:33:35.674959 | controller | ok: [instance] 2025-12-03 18:33:35.675123 | controller | 2025-12-03 18:33:35.675265 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:35.675391 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.025) 0:00:02.168 **** 2025-12-03 18:33:35.700457 | controller | ok: [instance] => 2025-12-03 18:33:35.737511 | controller | msg: 'Running: Missing spine/leaf net definition' 2025-12-03 18:33:35.737546 | controller | 2025-12-03 18:33:35.737554 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:35.737561 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.025) 0:00:02.194 **** 2025-12-03 18:33:35.737571 | controller | 2025-12-03 18:33:35.737605 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 18:33:35.737743 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.037) 0:00:02.231 **** 2025-12-03 18:33:35.760882 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 18:33:35.761099 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 18:33:35.761129 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 18:33:35.762228 | controller | collisions and unexpected behavior. 2025-12-03 18:33:35.780877 | controller | ok: [instance] => (item=controller) 2025-12-03 18:33:35.780964 | controller | 2025-12-03 18:33:35.781125 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 18:33:35.781228 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.043) 0:00:02.274 **** 2025-12-03 18:33:35.823761 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:35.823824 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-12-03 18:33:35.823935 | controller | evaluated_to: false 2025-12-03 18:33:35.824084 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' 2025-12-03 18:33:35.835678 | controller | 2025-12-03 18:33:35.835773 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-03 18:33:35.835895 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.054) 0:00:02.329 **** 2025-12-03 18:33:35.864454 | controller | ok: [instance] => 2025-12-03 18:33:35.864567 | controller | cifmw_libvirt_manager_configuration: 2025-12-03 18:33:35.864696 | controller | networks: 2025-12-03 18:33:35.864818 | controller | l00-s0: defined 2025-12-03 18:33:35.864941 | controller | public: defined 2025-12-03 18:33:35.865100 | controller | vms: 2025-12-03 18:33:35.865213 | controller | controller: 2025-12-03 18:33:35.865310 | controller | nets: 2025-12-03 18:33:35.865404 | controller | - public 2025-12-03 18:33:35.865498 | controller | spineleafnets: 2025-12-03 18:33:35.865589 | controller | - l00-s0 2025-12-03 18:33:35.865678 | controller | 2025-12-03 18:33:35.865778 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-03 18:33:35.865879 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.028) 0:00:02.358 **** 2025-12-03 18:33:35.891139 | controller | skipping: [instance] 2025-12-03 18:33:35.891207 | controller | 2025-12-03 18:33:35.891328 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-03 18:33:35.891424 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.026) 0:00:02.385 **** 2025-12-03 18:33:35.957223 | controller | skipping: [instance] 2025-12-03 18:33:35.957290 | controller | 2025-12-03 18:33:35.957474 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-03 18:33:35.957493 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.066) 0:00:02.451 **** 2025-12-03 18:33:35.993067 | controller | ok: [instance] => 2025-12-03 18:33:35.993154 | controller | _cifmw_libvirt_manager_layout: 2025-12-03 18:33:35.993263 | controller | networks: 2025-12-03 18:33:35.993361 | controller | l00-s0: defined 2025-12-03 18:33:35.993448 | controller | public: defined 2025-12-03 18:33:35.993535 | controller | vms: 2025-12-03 18:33:35.993725 | controller | controller: 2025-12-03 18:33:35.993746 | controller | nets: 2025-12-03 18:33:35.993828 | controller | - public 2025-12-03 18:33:35.993922 | controller | spineleafnets: 2025-12-03 18:33:35.994082 | controller | - l00-s0 2025-12-03 18:33:35.994156 | controller | - l00-s1 2025-12-03 18:33:35.994244 | controller | 2025-12-03 18:33:35.994338 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-03 18:33:35.994434 | controller | Wednesday 03 December 2025 18:33:35 +0000 (0:00:00.035) 0:00:02.487 **** 2025-12-03 18:33:36.003873 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:36.003991 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-03 18:33:36.029877 | controller | 2025-12-03 18:33:36.029990 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:36.030147 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.021) 0:00:02.508 **** 2025-12-03 18:33:36.030252 | controller | 2025-12-03 18:33:36.030350 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:36.030450 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.015) 0:00:02.524 **** 2025-12-03 18:33:36.050530 | controller | ok: [instance] 2025-12-03 18:33:36.050622 | controller | 2025-12-03 18:33:36.050726 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:36.050833 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.020) 0:00:02.544 **** 2025-12-03 18:33:36.085001 | controller | skipping: [instance] 2025-12-03 18:33:36.085135 | controller | 2025-12-03 18:33:36.085237 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:36.085345 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.034) 0:00:02.579 **** 2025-12-03 18:33:36.119310 | controller | skipping: [instance] 2025-12-03 18:33:36.119358 | controller | 2025-12-03 18:33:36.119481 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:36.119637 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.034) 0:00:02.613 **** 2025-12-03 18:33:36.148914 | controller | skipping: [instance] 2025-12-03 18:33:36.149426 | controller | 2025-12-03 18:33:36.149451 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:36.149559 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.029) 0:00:02.643 **** 2025-12-03 18:33:36.192308 | controller | ok: [instance] 2025-12-03 18:33:36.192358 | controller | 2025-12-03 18:33:36.192472 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:36.192583 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.043) 0:00:02.686 **** 2025-12-03 18:33:36.217217 | controller | ok: [instance] 2025-12-03 18:33:36.217269 | controller | 2025-12-03 18:33:36.217388 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:36.217486 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.024) 0:00:02.711 **** 2025-12-03 18:33:36.243712 | controller | ok: [instance] => 2025-12-03 18:33:36.243817 | controller | msg: 'Running: No network for a VM' 2025-12-03 18:33:36.243916 | controller | 2025-12-03 18:33:36.244023 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:36.244162 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.026) 0:00:02.737 **** 2025-12-03 18:33:36.280764 | controller | 2025-12-03 18:33:36.280872 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 18:33:36.280995 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.037) 0:00:02.775 **** 2025-12-03 18:33:36.305611 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-03 18:33:36.305720 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-03 18:33:36.305829 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-03 18:33:36.305944 | controller | collisions and unexpected behavior. 2025-12-03 18:33:36.321225 | controller | failed: [instance] (item=foo) => changed=false 2025-12-03 18:33:36.321322 | controller | ansible_loop_var: item 2025-12-03 18:33:36.321424 | controller | assertion: item.value.nets is defined 2025-12-03 18:33:36.321525 | controller | evaluated_to: false 2025-12-03 18:33:36.321623 | controller | item: 2025-12-03 18:33:36.321719 | controller | key: foo 2025-12-03 18:33:36.321836 | controller | value: 2025-12-03 18:33:36.321934 | controller | disksize: 10 2025-12-03 18:33:36.322026 | controller | msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' 2025-12-03 18:33:36.332716 | controller | ok: [instance] => (item=controller) 2025-12-03 18:33:36.332807 | controller | 2025-12-03 18:33:36.332910 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-03 18:33:36.333060 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.051) 0:00:02.826 **** 2025-12-03 18:33:36.363541 | controller | ok: [instance] => 2025-12-03 18:33:36.363625 | controller | cifmw_libvirt_manager_configuration: 2025-12-03 18:33:36.363729 | controller | networks: 2025-12-03 18:33:36.363838 | controller | public: defined 2025-12-03 18:33:36.364523 | controller | vms: 2025-12-03 18:33:36.364558 | controller | controller: 2025-12-03 18:33:36.364566 | controller | nets: 2025-12-03 18:33:36.364572 | controller | - public 2025-12-03 18:33:36.364578 | controller | 2025-12-03 18:33:36.364583 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-03 18:33:36.364590 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.030) 0:00:02.857 **** 2025-12-03 18:33:36.392399 | controller | skipping: [instance] 2025-12-03 18:33:36.392488 | controller | 2025-12-03 18:33:36.392585 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-03 18:33:36.392680 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.028) 0:00:02.886 **** 2025-12-03 18:33:36.462582 | controller | skipping: [instance] 2025-12-03 18:33:36.462665 | controller | 2025-12-03 18:33:36.462772 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-03 18:33:36.462882 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.070) 0:00:02.956 **** 2025-12-03 18:33:36.503691 | controller | ok: [instance] => 2025-12-03 18:33:36.503807 | controller | _cifmw_libvirt_manager_layout: 2025-12-03 18:33:36.503944 | controller | networks: 2025-12-03 18:33:36.504105 | controller | public: defined 2025-12-03 18:33:36.504207 | controller | vms: 2025-12-03 18:33:36.504326 | controller | controller: 2025-12-03 18:33:36.504416 | controller | nets: 2025-12-03 18:33:36.504514 | controller | - public 2025-12-03 18:33:36.504610 | controller | foo: 2025-12-03 18:33:36.504698 | controller | disksize: 10 2025-12-03 18:33:36.504786 | controller | 2025-12-03 18:33:36.504903 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-03 18:33:36.505001 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.039) 0:00:02.995 **** 2025-12-03 18:33:36.513645 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:36.513752 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-03 18:33:36.541233 | controller | 2025-12-03 18:33:36.541331 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:36.541439 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.023) 0:00:03.018 **** 2025-12-03 18:33:36.541539 | controller | 2025-12-03 18:33:36.541632 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:36.541736 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.016) 0:00:03.035 **** 2025-12-03 18:33:36.562943 | controller | ok: [instance] 2025-12-03 18:33:36.563043 | controller | 2025-12-03 18:33:36.563186 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:36.563290 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.022) 0:00:03.057 **** 2025-12-03 18:33:36.600431 | controller | skipping: [instance] 2025-12-03 18:33:36.600525 | controller | 2025-12-03 18:33:36.600628 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:36.600730 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.037) 0:00:03.094 **** 2025-12-03 18:33:36.631651 | controller | skipping: [instance] 2025-12-03 18:33:36.631763 | controller | 2025-12-03 18:33:36.631993 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:36.632173 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.031) 0:00:03.125 **** 2025-12-03 18:33:36.665838 | controller | skipping: [instance] 2025-12-03 18:33:36.665995 | controller | 2025-12-03 18:33:36.666164 | controller | TASK [Fail if needed] ********************************************************** 2025-12-03 18:33:36.666275 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.033) 0:00:03.159 **** 2025-12-03 18:33:36.723169 | controller | skipping: [instance] 2025-12-03 18:33:36.723303 | controller | 2025-12-03 18:33:36.723450 | controller | PLAY RECAP ********************************************************************* 2025-12-03 18:33:36.723625 | controller | instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 2025-12-03 18:33:36.723738 | controller | 2025-12-03 18:33:36.723866 | controller | Wednesday 03 December 2025 18:33:36 +0000 (0:00:00.057) 0:00:03.216 **** 2025-12-03 18:33:36.723971 | controller | =============================================================================== 2025-12-03 18:33:36.724181 | controller | reproducer : Dump layout patches ---------------------------------------- 0.10s 2025-12-03 18:33:36.724286 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.08s 2025-12-03 18:33:36.724376 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-12-03 18:33:36.724469 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-12-03 18:33:36.724569 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-12-03 18:33:36.724668 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.06s 2025-12-03 18:33:36.724764 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-12-03 18:33:36.724864 | controller | Test network validations ------------------------------------------------ 0.06s 2025-12-03 18:33:36.724967 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-12-03 18:33:36.725096 | controller | Fail if needed ---------------------------------------------------------- 0.06s 2025-12-03 18:33:36.725195 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-12-03 18:33:36.725285 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2025-12-03 18:33:36.725380 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2025-12-03 18:33:36.725481 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2025-12-03 18:33:36.725572 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.05s 2025-12-03 18:33:36.725669 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2025-12-03 18:33:36.725763 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s 2025-12-03 18:33:36.725858 | controller | reproducer : Fail for good ---------------------------------------------- 0.05s 2025-12-03 18:33:36.725952 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s 2025-12-03 18:33:36.726091 | controller | Mark run as failed ------------------------------------------------------ 0.04s 2025-12-03 18:33:36.787794 | controller | INFO Running network_validations > cleanup 2025-12-03 18:33:36.788202 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-03 18:33:36.795661 | controller | INFO Running ocp_validations > prepare 2025-12-03 18:33:36.796066 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-03 18:33:36.804262 | controller | INFO Running ocp_validations > converge 2025-12-03 18:33:37.231733 | controller | 2025-12-03 18:33:37.231795 | controller | PLAY [Prepare] ***************************************************************** 2025-12-03 18:33:37.231889 | controller | 2025-12-03 18:33:37.231986 | controller | TASK [Set failed fact] ********************************************************* 2025-12-03 18:33:37.232132 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.032) 0:00:00.032 **** 2025-12-03 18:33:37.254296 | controller | ok: [instance] 2025-12-03 18:33:37.254338 | controller | 2025-12-03 18:33:37.254456 | controller | TASK [Load scenarios] ********************************************************** 2025-12-03 18:33:37.254561 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.022) 0:00:00.055 **** 2025-12-03 18:33:37.277617 | controller | ok: [instance] 2025-12-03 18:33:37.277707 | controller | 2025-12-03 18:33:37.277817 | controller | TASK [Test no volumes] ********************************************************* 2025-12-03 18:33:37.277926 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.023) 0:00:00.078 **** 2025-12-03 18:33:37.375025 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) 2025-12-03 18:33:37.375168 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) 2025-12-03 18:33:37.375280 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) 2025-12-03 18:33:37.375394 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) 2025-12-03 18:33:37.375518 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) 2025-12-03 18:33:37.375629 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) 2025-12-03 18:33:37.375743 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) 2025-12-03 18:33:37.375859 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) 2025-12-03 18:33:37.375960 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) 2025-12-03 18:33:37.376098 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) 2025-12-03 18:33:37.376206 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) 2025-12-03 18:33:37.376314 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) 2025-12-03 18:33:37.376419 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) 2025-12-03 18:33:37.376517 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) 2025-12-03 18:33:37.376612 | controller | 2025-12-03 18:33:37.376706 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:37.376805 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.097) 0:00:00.176 **** 2025-12-03 18:33:37.399882 | controller | ok: [instance] 2025-12-03 18:33:37.400010 | controller | 2025-12-03 18:33:37.400172 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:37.400280 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.024) 0:00:00.200 **** 2025-12-03 18:33:37.434473 | controller | ok: [instance] 2025-12-03 18:33:37.434557 | controller | 2025-12-03 18:33:37.434672 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:37.434780 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.034) 0:00:00.235 **** 2025-12-03 18:33:37.464231 | controller | ok: [instance] => 2025-12-03 18:33:37.464335 | controller | msg: 'Running: No volume, no worker' 2025-12-03 18:33:37.464439 | controller | 2025-12-03 18:33:37.464554 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:37.464658 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.030) 0:00:00.265 **** 2025-12-03 18:33:37.527101 | controller | 2025-12-03 18:33:37.527191 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:37.527299 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.062) 0:00:00.328 **** 2025-12-03 18:33:37.587028 | controller | ok: [instance] 2025-12-03 18:33:37.587170 | controller | 2025-12-03 18:33:37.587311 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:37.587441 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.059) 0:00:00.387 **** 2025-12-03 18:33:37.634064 | controller | ok: [instance] 2025-12-03 18:33:37.634167 | controller | 2025-12-03 18:33:37.634276 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:37.634394 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.046) 0:00:00.434 **** 2025-12-03 18:33:37.704018 | controller | ok: [instance] 2025-12-03 18:33:37.704155 | controller | 2025-12-03 18:33:37.704257 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:37.704362 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.069) 0:00:00.504 **** 2025-12-03 18:33:37.744514 | controller | skipping: [instance] 2025-12-03 18:33:37.744659 | controller | 2025-12-03 18:33:37.744798 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:37.744908 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.040) 0:00:00.545 **** 2025-12-03 18:33:37.793965 | controller | ok: [instance] 2025-12-03 18:33:37.794095 | controller | 2025-12-03 18:33:37.794233 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 18:33:37.794319 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.049) 0:00:00.594 **** 2025-12-03 18:33:37.836479 | controller | skipping: [instance] 2025-12-03 18:33:37.836583 | controller | 2025-12-03 18:33:37.836694 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 18:33:37.836808 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.042) 0:00:00.637 **** 2025-12-03 18:33:37.874981 | controller | skipping: [instance] 2025-12-03 18:33:37.875117 | controller | 2025-12-03 18:33:37.875227 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 18:33:37.875332 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.038) 0:00:00.676 **** 2025-12-03 18:33:37.917687 | controller | skipping: [instance] 2025-12-03 18:33:37.917784 | controller | 2025-12-03 18:33:37.917908 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 18:33:37.918065 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.041) 0:00:00.717 **** 2025-12-03 18:33:37.958697 | controller | skipping: [instance] 2025-12-03 18:33:37.958786 | controller | 2025-12-03 18:33:37.958891 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 18:33:37.959013 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.042) 0:00:00.759 **** 2025-12-03 18:33:38.000763 | controller | skipping: [instance] 2025-12-03 18:33:38.000821 | controller | 2025-12-03 18:33:38.000950 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 18:33:38.001079 | controller | Wednesday 03 December 2025 18:33:37 +0000 (0:00:00.042) 0:00:00.802 **** 2025-12-03 18:33:38.051397 | controller | skipping: [instance] 2025-12-03 18:33:38.051478 | controller | 2025-12-03 18:33:38.051584 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:38.051691 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.050) 0:00:00.852 **** 2025-12-03 18:33:38.088616 | controller | skipping: [instance] 2025-12-03 18:33:38.088675 | controller | 2025-12-03 18:33:38.088807 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:38.088906 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.037) 0:00:00.889 **** 2025-12-03 18:33:38.119004 | controller | skipping: [instance] 2025-12-03 18:33:38.119120 | controller | 2025-12-03 18:33:38.119225 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:38.119319 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.030) 0:00:00.920 **** 2025-12-03 18:33:38.151956 | controller | skipping: [instance] 2025-12-03 18:33:38.152084 | controller | 2025-12-03 18:33:38.152194 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:38.152296 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.032) 0:00:00.953 **** 2025-12-03 18:33:38.174288 | controller | ok: [instance] 2025-12-03 18:33:38.174384 | controller | 2025-12-03 18:33:38.174497 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:38.174602 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.022) 0:00:00.975 **** 2025-12-03 18:33:38.201103 | controller | ok: [instance] 2025-12-03 18:33:38.201176 | controller | 2025-12-03 18:33:38.201271 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:38.201367 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.026) 0:00:01.002 **** 2025-12-03 18:33:38.223884 | controller | ok: [instance] => 2025-12-03 18:33:38.223992 | controller | msg: 'Running: No volume, with worker' 2025-12-03 18:33:38.224161 | controller | 2025-12-03 18:33:38.224254 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:38.224360 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.022) 0:00:01.025 **** 2025-12-03 18:33:38.263840 | controller | 2025-12-03 18:33:38.263955 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:38.264122 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.039) 0:00:01.065 **** 2025-12-03 18:33:38.319684 | controller | ok: [instance] 2025-12-03 18:33:38.319770 | controller | 2025-12-03 18:33:38.319896 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:38.320011 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.055) 0:00:01.120 **** 2025-12-03 18:33:38.360367 | controller | ok: [instance] 2025-12-03 18:33:38.360451 | controller | 2025-12-03 18:33:38.360567 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:38.360669 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.040) 0:00:01.161 **** 2025-12-03 18:33:38.455411 | controller | ok: [instance] 2025-12-03 18:33:38.455507 | controller | 2025-12-03 18:33:38.455642 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:38.455768 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.094) 0:00:01.256 **** 2025-12-03 18:33:38.525973 | controller | ok: [instance] 2025-12-03 18:33:38.526087 | controller | 2025-12-03 18:33:38.526210 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:38.526313 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.070) 0:00:01.327 **** 2025-12-03 18:33:38.577367 | controller | ok: [instance] 2025-12-03 18:33:38.577459 | controller | 2025-12-03 18:33:38.577562 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 18:33:38.577676 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.051) 0:00:01.378 **** 2025-12-03 18:33:38.614777 | controller | skipping: [instance] 2025-12-03 18:33:38.614869 | controller | 2025-12-03 18:33:38.614975 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 18:33:38.615110 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.037) 0:00:01.416 **** 2025-12-03 18:33:38.653265 | controller | skipping: [instance] 2025-12-03 18:33:38.653358 | controller | 2025-12-03 18:33:38.653460 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 18:33:38.653557 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.038) 0:00:01.454 **** 2025-12-03 18:33:38.693256 | controller | skipping: [instance] 2025-12-03 18:33:38.693350 | controller | 2025-12-03 18:33:38.693462 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 18:33:38.693567 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.039) 0:00:01.494 **** 2025-12-03 18:33:38.733576 | controller | skipping: [instance] 2025-12-03 18:33:38.733661 | controller | 2025-12-03 18:33:38.733756 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 18:33:38.733852 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.040) 0:00:01.534 **** 2025-12-03 18:33:38.771879 | controller | skipping: [instance] 2025-12-03 18:33:38.771989 | controller | 2025-12-03 18:33:38.772137 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 18:33:38.772235 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.038) 0:00:01.573 **** 2025-12-03 18:33:38.820089 | controller | skipping: [instance] 2025-12-03 18:33:38.820178 | controller | 2025-12-03 18:33:38.820279 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:38.820379 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.048) 0:00:01.621 **** 2025-12-03 18:33:38.855049 | controller | skipping: [instance] 2025-12-03 18:33:38.855191 | controller | 2025-12-03 18:33:38.855334 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:38.855475 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.035) 0:00:01.656 **** 2025-12-03 18:33:38.887239 | controller | skipping: [instance] 2025-12-03 18:33:38.887316 | controller | 2025-12-03 18:33:38.887414 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:38.887514 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.032) 0:00:01.688 **** 2025-12-03 18:33:38.917600 | controller | skipping: [instance] 2025-12-03 18:33:38.918050 | controller | 2025-12-03 18:33:38.918169 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:38.918267 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.030) 0:00:01.718 **** 2025-12-03 18:33:38.940677 | controller | ok: [instance] 2025-12-03 18:33:38.940749 | controller | 2025-12-03 18:33:38.940864 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:38.940951 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.023) 0:00:01.741 **** 2025-12-03 18:33:38.966426 | controller | ok: [instance] 2025-12-03 18:33:38.966508 | controller | 2025-12-03 18:33:38.966621 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:38.966720 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.025) 0:00:01.767 **** 2025-12-03 18:33:38.990144 | controller | ok: [instance] => 2025-12-03 18:33:38.990243 | controller | msg: 'Running: Volume, no worker' 2025-12-03 18:33:38.990339 | controller | 2025-12-03 18:33:38.990441 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:38.990554 | controller | Wednesday 03 December 2025 18:33:38 +0000 (0:00:00.023) 0:00:01.791 **** 2025-12-03 18:33:39.031489 | controller | 2025-12-03 18:33:39.031655 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:39.031795 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.041) 0:00:01.832 **** 2025-12-03 18:33:39.091570 | controller | ok: [instance] 2025-12-03 18:33:39.091639 | controller | 2025-12-03 18:33:39.091755 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:39.091852 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.059) 0:00:01.892 **** 2025-12-03 18:33:39.133547 | controller | ok: [instance] 2025-12-03 18:33:39.133624 | controller | 2025-12-03 18:33:39.133734 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:39.133822 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.041) 0:00:01.934 **** 2025-12-03 18:33:39.203602 | controller | ok: [instance] 2025-12-03 18:33:39.203678 | controller | 2025-12-03 18:33:39.203782 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:39.203887 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.070) 0:00:02.004 **** 2025-12-03 18:33:39.242546 | controller | skipping: [instance] 2025-12-03 18:33:39.242623 | controller | 2025-12-03 18:33:39.242726 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:39.242839 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.038) 0:00:02.043 **** 2025-12-03 18:33:39.287089 | controller | skipping: [instance] 2025-12-03 18:33:39.287253 | controller | 2025-12-03 18:33:39.287288 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 18:33:39.287408 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.044) 0:00:02.088 **** 2025-12-03 18:33:39.332488 | controller | ok: [instance] 2025-12-03 18:33:39.332582 | controller | 2025-12-03 18:33:39.332687 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 18:33:39.332794 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.045) 0:00:02.133 **** 2025-12-03 18:33:39.427308 | controller | skipping: [instance] 2025-12-03 18:33:39.427372 | controller | 2025-12-03 18:33:39.427489 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 18:33:39.427599 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.094) 0:00:02.228 **** 2025-12-03 18:33:39.496454 | controller | ok: [instance] 2025-12-03 18:33:39.496541 | controller | 2025-12-03 18:33:39.496643 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 18:33:39.496740 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.068) 0:00:02.297 **** 2025-12-03 18:33:39.562780 | controller | ok: [instance] 2025-12-03 18:33:39.562860 | controller | 2025-12-03 18:33:39.562981 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 18:33:39.563137 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.066) 0:00:02.364 **** 2025-12-03 18:33:39.631074 | controller | ok: [instance] => changed=false 2025-12-03 18:33:39.631199 | controller | msg: All assertions passed 2025-12-03 18:33:39.631293 | controller | 2025-12-03 18:33:39.631414 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 18:33:39.631513 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.068) 0:00:02.432 **** 2025-12-03 18:33:39.712902 | controller | ok: [instance] => changed=false 2025-12-03 18:33:39.713009 | controller | msg: All assertions passed 2025-12-03 18:33:39.713141 | controller | 2025-12-03 18:33:39.713247 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:39.713341 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.081) 0:00:02.514 **** 2025-12-03 18:33:39.754396 | controller | skipping: [instance] 2025-12-03 18:33:39.754483 | controller | 2025-12-03 18:33:39.754604 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:39.754743 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.041) 0:00:02.555 **** 2025-12-03 18:33:39.784442 | controller | skipping: [instance] 2025-12-03 18:33:39.784531 | controller | 2025-12-03 18:33:39.784624 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:39.784715 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.030) 0:00:02.585 **** 2025-12-03 18:33:39.817297 | controller | skipping: [instance] 2025-12-03 18:33:39.817374 | controller | 2025-12-03 18:33:39.817477 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:39.817569 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.032) 0:00:02.618 **** 2025-12-03 18:33:39.838523 | controller | ok: [instance] 2025-12-03 18:33:39.838599 | controller | 2025-12-03 18:33:39.838708 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:39.838812 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.021) 0:00:02.639 **** 2025-12-03 18:33:39.865766 | controller | ok: [instance] 2025-12-03 18:33:39.865852 | controller | 2025-12-03 18:33:39.865982 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:39.866120 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.027) 0:00:02.667 **** 2025-12-03 18:33:39.893023 | controller | ok: [instance] => 2025-12-03 18:33:39.893166 | controller | msg: 'Running: Volume, with worker' 2025-12-03 18:33:39.893259 | controller | 2025-12-03 18:33:39.893344 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:39.893439 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.027) 0:00:02.694 **** 2025-12-03 18:33:39.934777 | controller | 2025-12-03 18:33:39.934882 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:39.935021 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.041) 0:00:02.736 **** 2025-12-03 18:33:39.994653 | controller | ok: [instance] 2025-12-03 18:33:39.994711 | controller | 2025-12-03 18:33:39.994826 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:39.994930 | controller | Wednesday 03 December 2025 18:33:39 +0000 (0:00:00.059) 0:00:02.795 **** 2025-12-03 18:33:40.035275 | controller | ok: [instance] 2025-12-03 18:33:40.035408 | controller | 2025-12-03 18:33:40.035554 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:40.035697 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.040) 0:00:02.836 **** 2025-12-03 18:33:40.106726 | controller | ok: [instance] 2025-12-03 18:33:40.106816 | controller | 2025-12-03 18:33:40.106926 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:40.107055 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.071) 0:00:02.908 **** 2025-12-03 18:33:40.176199 | controller | ok: [instance] 2025-12-03 18:33:40.176266 | controller | 2025-12-03 18:33:40.176406 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:40.176497 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.069) 0:00:02.977 **** 2025-12-03 18:33:40.218213 | controller | skipping: [instance] 2025-12-03 18:33:40.218247 | controller | 2025-12-03 18:33:40.218371 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 18:33:40.218539 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.041) 0:00:03.019 **** 2025-12-03 18:33:40.261460 | controller | ok: [instance] 2025-12-03 18:33:40.261562 | controller | 2025-12-03 18:33:40.261669 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 18:33:40.261766 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.043) 0:00:03.062 **** 2025-12-03 18:33:40.311571 | controller | ok: [instance] 2025-12-03 18:33:40.311654 | controller | 2025-12-03 18:33:40.311758 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 18:33:40.311856 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.050) 0:00:03.112 **** 2025-12-03 18:33:40.374501 | controller | ok: [instance] 2025-12-03 18:33:40.374558 | controller | 2025-12-03 18:33:40.374669 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 18:33:40.374761 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.062) 0:00:03.175 **** 2025-12-03 18:33:40.487401 | controller | ok: [instance] 2025-12-03 18:33:40.487451 | controller | 2025-12-03 18:33:40.487687 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 18:33:40.556894 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.112) 0:00:03.288 **** 2025-12-03 18:33:40.556924 | controller | ok: [instance] => changed=false 2025-12-03 18:33:40.557011 | controller | msg: All assertions passed 2025-12-03 18:33:40.557139 | controller | 2025-12-03 18:33:40.557263 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 18:33:40.557369 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.069) 0:00:03.358 **** 2025-12-03 18:33:40.636243 | controller | ok: [instance] => changed=false 2025-12-03 18:33:40.636377 | controller | msg: All assertions passed 2025-12-03 18:33:40.636495 | controller | 2025-12-03 18:33:40.636639 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:40.636804 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.079) 0:00:03.437 **** 2025-12-03 18:33:40.671647 | controller | skipping: [instance] 2025-12-03 18:33:40.671738 | controller | 2025-12-03 18:33:40.671828 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:40.671953 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.035) 0:00:03.472 **** 2025-12-03 18:33:40.703842 | controller | skipping: [instance] 2025-12-03 18:33:40.703949 | controller | 2025-12-03 18:33:40.704093 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:40.704187 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.032) 0:00:03.505 **** 2025-12-03 18:33:40.736148 | controller | skipping: [instance] 2025-12-03 18:33:40.736258 | controller | 2025-12-03 18:33:40.736359 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:40.736464 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.032) 0:00:03.537 **** 2025-12-03 18:33:40.757250 | controller | ok: [instance] 2025-12-03 18:33:40.757339 | controller | 2025-12-03 18:33:40.757442 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:40.757552 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.021) 0:00:03.558 **** 2025-12-03 18:33:40.781875 | controller | ok: [instance] 2025-12-03 18:33:40.781977 | controller | 2025-12-03 18:33:40.782129 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:40.782245 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.024) 0:00:03.583 **** 2025-12-03 18:33:40.807738 | controller | ok: [instance] => 2025-12-03 18:33:40.807824 | controller | msg: 'Running: Too many allocated volumes' 2025-12-03 18:33:40.807924 | controller | 2025-12-03 18:33:40.808029 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:40.808149 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.026) 0:00:03.609 **** 2025-12-03 18:33:40.848655 | controller | 2025-12-03 18:33:40.848767 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:40.848924 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.040) 0:00:03.649 **** 2025-12-03 18:33:40.904635 | controller | ok: [instance] 2025-12-03 18:33:40.904747 | controller | 2025-12-03 18:33:40.904882 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:40.905099 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.055) 0:00:03.705 **** 2025-12-03 18:33:40.946906 | controller | ok: [instance] 2025-12-03 18:33:40.947023 | controller | 2025-12-03 18:33:40.947220 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:40.947355 | controller | Wednesday 03 December 2025 18:33:40 +0000 (0:00:00.042) 0:00:03.748 **** 2025-12-03 18:33:41.015541 | controller | ok: [instance] 2025-12-03 18:33:41.015632 | controller | 2025-12-03 18:33:41.015743 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:41.015846 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.068) 0:00:03.816 **** 2025-12-03 18:33:41.055619 | controller | skipping: [instance] 2025-12-03 18:33:41.055714 | controller | 2025-12-03 18:33:41.055815 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:41.055930 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.040) 0:00:03.856 **** 2025-12-03 18:33:41.097095 | controller | skipping: [instance] 2025-12-03 18:33:41.097203 | controller | 2025-12-03 18:33:41.097313 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 18:33:41.097414 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.041) 0:00:03.898 **** 2025-12-03 18:33:41.144823 | controller | ok: [instance] 2025-12-03 18:33:41.144925 | controller | 2025-12-03 18:33:41.145030 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 18:33:41.145215 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.047) 0:00:03.946 **** 2025-12-03 18:33:41.186671 | controller | skipping: [instance] 2025-12-03 18:33:41.186771 | controller | 2025-12-03 18:33:41.186879 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 18:33:41.187005 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.041) 0:00:03.987 **** 2025-12-03 18:33:41.241908 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:41.242050 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-12-03 18:33:41.242147 | controller | evaluated_to: false 2025-12-03 18:33:41.242269 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' 2025-12-03 18:33:41.267716 | controller | 2025-12-03 18:33:41.267823 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:41.267947 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.066) 0:00:04.053 **** 2025-12-03 18:33:41.268081 | controller | 2025-12-03 18:33:41.268194 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:41.268327 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.015) 0:00:04.068 **** 2025-12-03 18:33:41.286736 | controller | ok: [instance] 2025-12-03 18:33:41.286834 | controller | 2025-12-03 18:33:41.286943 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:41.287082 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.019) 0:00:04.088 **** 2025-12-03 18:33:41.323255 | controller | skipping: [instance] 2025-12-03 18:33:41.323350 | controller | 2025-12-03 18:33:41.323450 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:41.323551 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.036) 0:00:04.124 **** 2025-12-03 18:33:41.379417 | controller | skipping: [instance] 2025-12-03 18:33:41.379500 | controller | 2025-12-03 18:33:41.379612 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:41.379723 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.056) 0:00:04.180 **** 2025-12-03 18:33:41.410947 | controller | skipping: [instance] 2025-12-03 18:33:41.411077 | controller | 2025-12-03 18:33:41.411216 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:41.411300 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.031) 0:00:04.212 **** 2025-12-03 18:33:41.436234 | controller | ok: [instance] 2025-12-03 18:33:41.436293 | controller | 2025-12-03 18:33:41.436403 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:41.436503 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.023) 0:00:04.236 **** 2025-12-03 18:33:41.460530 | controller | ok: [instance] 2025-12-03 18:33:41.460631 | controller | 2025-12-03 18:33:41.460733 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:41.460875 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.025) 0:00:04.261 **** 2025-12-03 18:33:41.484869 | controller | ok: [instance] => 2025-12-03 18:33:41.484981 | controller | msg: 'Running: Different volume amount' 2025-12-03 18:33:41.485104 | controller | 2025-12-03 18:33:41.485215 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:41.485316 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.024) 0:00:04.286 **** 2025-12-03 18:33:41.527410 | controller | 2025-12-03 18:33:41.527594 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:41.527733 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.042) 0:00:04.328 **** 2025-12-03 18:33:41.586086 | controller | ok: [instance] 2025-12-03 18:33:41.586195 | controller | 2025-12-03 18:33:41.586300 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:41.586403 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.058) 0:00:04.387 **** 2025-12-03 18:33:41.626638 | controller | ok: [instance] 2025-12-03 18:33:41.626727 | controller | 2025-12-03 18:33:41.626832 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:41.626945 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.040) 0:00:04.427 **** 2025-12-03 18:33:41.700498 | controller | ok: [instance] 2025-12-03 18:33:41.700580 | controller | 2025-12-03 18:33:41.700676 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:41.700775 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.073) 0:00:04.501 **** 2025-12-03 18:33:41.766713 | controller | ok: [instance] 2025-12-03 18:33:41.766796 | controller | 2025-12-03 18:33:41.766920 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:41.767044 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.066) 0:00:04.568 **** 2025-12-03 18:33:41.807499 | controller | skipping: [instance] 2025-12-03 18:33:41.807584 | controller | 2025-12-03 18:33:41.807686 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 18:33:41.807789 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.040) 0:00:04.608 **** 2025-12-03 18:33:41.853977 | controller | ok: [instance] 2025-12-03 18:33:41.854025 | controller | 2025-12-03 18:33:41.854163 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 18:33:41.854265 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.046) 0:00:04.655 **** 2025-12-03 18:33:41.897179 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:41.897315 | controller | assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 2025-12-03 18:33:41.897404 | controller | evaluated_to: false 2025-12-03 18:33:41.897529 | controller | msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' 2025-12-03 18:33:41.923922 | controller | 2025-12-03 18:33:41.924050 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:41.924180 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.053) 0:00:04.708 **** 2025-12-03 18:33:41.924267 | controller | 2025-12-03 18:33:41.924367 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:41.924456 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.016) 0:00:04.724 **** 2025-12-03 18:33:41.946746 | controller | ok: [instance] 2025-12-03 18:33:41.946873 | controller | 2025-12-03 18:33:41.947010 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:41.947202 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.023) 0:00:04.747 **** 2025-12-03 18:33:41.983115 | controller | skipping: [instance] 2025-12-03 18:33:41.983206 | controller | 2025-12-03 18:33:41.983319 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:41.983412 | controller | Wednesday 03 December 2025 18:33:41 +0000 (0:00:00.036) 0:00:04.784 **** 2025-12-03 18:33:42.014663 | controller | skipping: [instance] 2025-12-03 18:33:42.014753 | controller | 2025-12-03 18:33:42.014855 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:42.014975 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.031) 0:00:04.815 **** 2025-12-03 18:33:42.047903 | controller | skipping: [instance] 2025-12-03 18:33:42.048012 | controller | 2025-12-03 18:33:42.048147 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:42.048262 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.033) 0:00:04.849 **** 2025-12-03 18:33:42.069630 | controller | ok: [instance] 2025-12-03 18:33:42.069723 | controller | 2025-12-03 18:33:42.069826 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:42.069941 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.021) 0:00:04.870 **** 2025-12-03 18:33:42.094470 | controller | ok: [instance] 2025-12-03 18:33:42.094558 | controller | 2025-12-03 18:33:42.094664 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:42.094779 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.024) 0:00:04.895 **** 2025-12-03 18:33:42.119154 | controller | ok: [instance] => 2025-12-03 18:33:42.119262 | controller | msg: 'Running: Create LVM without volume' 2025-12-03 18:33:42.119350 | controller | 2025-12-03 18:33:42.119449 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:42.119548 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.024) 0:00:04.920 **** 2025-12-03 18:33:42.180615 | controller | 2025-12-03 18:33:42.180717 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:42.180815 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.061) 0:00:04.981 **** 2025-12-03 18:33:42.236179 | controller | ok: [instance] 2025-12-03 18:33:42.236268 | controller | 2025-12-03 18:33:42.236382 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:42.236479 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.055) 0:00:05.037 **** 2025-12-03 18:33:42.279846 | controller | ok: [instance] 2025-12-03 18:33:42.279918 | controller | 2025-12-03 18:33:42.280223 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:42.344914 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.043) 0:00:05.081 **** 2025-12-03 18:33:42.344945 | controller | ok: [instance] 2025-12-03 18:33:42.345062 | controller | 2025-12-03 18:33:42.345214 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:42.345335 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.064) 0:00:05.146 **** 2025-12-03 18:33:42.384972 | controller | skipping: [instance] 2025-12-03 18:33:42.385099 | controller | 2025-12-03 18:33:42.385213 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:42.385337 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.040) 0:00:05.186 **** 2025-12-03 18:33:42.419728 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:42.419825 | controller | assertion: not cifmw_devscripts_create_logical_volume | bool 2025-12-03 18:33:42.419931 | controller | evaluated_to: false 2025-12-03 18:33:42.420049 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-12-03 18:33:42.445391 | controller | 2025-12-03 18:33:42.445494 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:42.445607 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.044) 0:00:05.230 **** 2025-12-03 18:33:42.445713 | controller | 2025-12-03 18:33:42.445822 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:42.445941 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.016) 0:00:05.246 **** 2025-12-03 18:33:42.466883 | controller | ok: [instance] 2025-12-03 18:33:42.466978 | controller | 2025-12-03 18:33:42.467117 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:42.467258 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.021) 0:00:05.268 **** 2025-12-03 18:33:42.506009 | controller | skipping: [instance] 2025-12-03 18:33:42.506135 | controller | 2025-12-03 18:33:42.506240 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:42.506334 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.038) 0:00:05.307 **** 2025-12-03 18:33:42.539446 | controller | skipping: [instance] 2025-12-03 18:33:42.539541 | controller | 2025-12-03 18:33:42.539653 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:42.539773 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.033) 0:00:05.340 **** 2025-12-03 18:33:42.571946 | controller | skipping: [instance] 2025-12-03 18:33:42.572066 | controller | 2025-12-03 18:33:42.572206 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:42.572303 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.032) 0:00:05.373 **** 2025-12-03 18:33:42.594886 | controller | ok: [instance] 2025-12-03 18:33:42.595012 | controller | 2025-12-03 18:33:42.595163 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:42.595277 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.022) 0:00:05.395 **** 2025-12-03 18:33:42.618816 | controller | ok: [instance] 2025-12-03 18:33:42.618911 | controller | 2025-12-03 18:33:42.619019 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:42.619174 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.024) 0:00:05.420 **** 2025-12-03 18:33:42.641247 | controller | ok: [instance] => 2025-12-03 18:33:42.641332 | controller | msg: 'Running: Create LVMS without volume' 2025-12-03 18:33:42.641419 | controller | 2025-12-03 18:33:42.641514 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:42.641621 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.022) 0:00:05.442 **** 2025-12-03 18:33:42.679064 | controller | 2025-12-03 18:33:42.679189 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:42.679305 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.037) 0:00:05.480 **** 2025-12-03 18:33:42.734808 | controller | ok: [instance] 2025-12-03 18:33:42.734945 | controller | 2025-12-03 18:33:42.735155 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:42.735299 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.055) 0:00:05.535 **** 2025-12-03 18:33:42.774834 | controller | ok: [instance] 2025-12-03 18:33:42.774932 | controller | 2025-12-03 18:33:42.775057 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:42.775183 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.040) 0:00:05.576 **** 2025-12-03 18:33:42.842943 | controller | ok: [instance] 2025-12-03 18:33:42.843081 | controller | 2025-12-03 18:33:42.843187 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:42.843287 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.067) 0:00:05.644 **** 2025-12-03 18:33:42.880846 | controller | skipping: [instance] 2025-12-03 18:33:42.880942 | controller | 2025-12-03 18:33:42.881092 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:42.881212 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.037) 0:00:05.682 **** 2025-12-03 18:33:42.919103 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:42.919204 | controller | assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 2025-12-03 18:33:42.919297 | controller | evaluated_to: false 2025-12-03 18:33:42.919412 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-12-03 18:33:42.945553 | controller | 2025-12-03 18:33:42.945613 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:42.945727 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.047) 0:00:05.730 **** 2025-12-03 18:33:42.945833 | controller | 2025-12-03 18:33:42.945936 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:42.946068 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.016) 0:00:05.746 **** 2025-12-03 18:33:42.990357 | controller | ok: [instance] 2025-12-03 18:33:42.990447 | controller | 2025-12-03 18:33:42.990552 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:42.990652 | controller | Wednesday 03 December 2025 18:33:42 +0000 (0:00:00.045) 0:00:05.791 **** 2025-12-03 18:33:43.025985 | controller | skipping: [instance] 2025-12-03 18:33:43.026123 | controller | 2025-12-03 18:33:43.026205 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:43.026308 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.035) 0:00:05.827 **** 2025-12-03 18:33:43.059392 | controller | skipping: [instance] 2025-12-03 18:33:43.059457 | controller | 2025-12-03 18:33:43.059561 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:43.059663 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.033) 0:00:05.860 **** 2025-12-03 18:33:43.095105 | controller | skipping: [instance] 2025-12-03 18:33:43.095215 | controller | 2025-12-03 18:33:43.095320 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:43.095493 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.035) 0:00:05.896 **** 2025-12-03 18:33:43.116184 | controller | ok: [instance] 2025-12-03 18:33:43.116270 | controller | 2025-12-03 18:33:43.116378 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:43.116492 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.021) 0:00:05.917 **** 2025-12-03 18:33:43.141793 | controller | ok: [instance] 2025-12-03 18:33:43.141916 | controller | 2025-12-03 18:33:43.142001 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:43.142163 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.025) 0:00:05.943 **** 2025-12-03 18:33:43.165481 | controller | ok: [instance] => 2025-12-03 18:33:43.165593 | controller | msg: 'Running: Allocate same volume twice' 2025-12-03 18:33:43.165699 | controller | 2025-12-03 18:33:43.165801 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:43.165910 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.023) 0:00:05.966 **** 2025-12-03 18:33:43.207140 | controller | 2025-12-03 18:33:43.207260 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:43.207361 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.041) 0:00:06.008 **** 2025-12-03 18:33:43.265744 | controller | ok: [instance] 2025-12-03 18:33:43.265790 | controller | 2025-12-03 18:33:43.265915 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:43.266209 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.058) 0:00:06.067 **** 2025-12-03 18:33:43.305819 | controller | ok: [instance] 2025-12-03 18:33:43.305904 | controller | 2025-12-03 18:33:43.306053 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:43.306186 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.040) 0:00:06.107 **** 2025-12-03 18:33:43.374257 | controller | ok: [instance] 2025-12-03 18:33:43.374297 | controller | 2025-12-03 18:33:43.374403 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:43.374506 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.068) 0:00:06.175 **** 2025-12-03 18:33:43.409880 | controller | skipping: [instance] 2025-12-03 18:33:43.409962 | controller | 2025-12-03 18:33:43.410091 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:43.410224 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.035) 0:00:06.211 **** 2025-12-03 18:33:43.450684 | controller | skipping: [instance] 2025-12-03 18:33:43.450755 | controller | 2025-12-03 18:33:43.450858 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 18:33:43.450978 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.040) 0:00:06.251 **** 2025-12-03 18:33:43.495353 | controller | ok: [instance] 2025-12-03 18:33:43.495438 | controller | 2025-12-03 18:33:43.495540 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 18:33:43.495646 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.044) 0:00:06.296 **** 2025-12-03 18:33:43.536026 | controller | skipping: [instance] 2025-12-03 18:33:43.536160 | controller | 2025-12-03 18:33:43.536274 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 18:33:43.536383 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.040) 0:00:06.337 **** 2025-12-03 18:33:43.591476 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:43.591623 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-12-03 18:33:43.591636 | controller | evaluated_to: false 2025-12-03 18:33:43.591758 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' 2025-12-03 18:33:43.618846 | controller | 2025-12-03 18:33:43.618955 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:43.619049 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.066) 0:00:06.403 **** 2025-12-03 18:33:43.619179 | controller | 2025-12-03 18:33:43.619278 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:43.619378 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.016) 0:00:06.419 **** 2025-12-03 18:33:43.640924 | controller | ok: [instance] 2025-12-03 18:33:43.641018 | controller | 2025-12-03 18:33:43.641145 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:43.641251 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.022) 0:00:06.442 **** 2025-12-03 18:33:43.679935 | controller | skipping: [instance] 2025-12-03 18:33:43.680013 | controller | 2025-12-03 18:33:43.680190 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:43.680288 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.038) 0:00:06.481 **** 2025-12-03 18:33:43.712758 | controller | skipping: [instance] 2025-12-03 18:33:43.712864 | controller | 2025-12-03 18:33:43.713048 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:43.713129 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.032) 0:00:06.514 **** 2025-12-03 18:33:43.747319 | controller | skipping: [instance] 2025-12-03 18:33:43.747421 | controller | 2025-12-03 18:33:43.747531 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:43.747647 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.034) 0:00:06.548 **** 2025-12-03 18:33:43.769980 | controller | ok: [instance] 2025-12-03 18:33:43.770133 | controller | 2025-12-03 18:33:43.770281 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:43.770338 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.022) 0:00:06.571 **** 2025-12-03 18:33:43.798581 | controller | ok: [instance] 2025-12-03 18:33:43.798751 | controller | 2025-12-03 18:33:43.799168 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:43.850446 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.028) 0:00:06.599 **** 2025-12-03 18:33:43.850474 | controller | ok: [instance] => 2025-12-03 18:33:43.850605 | controller | msg: 'Running: Allocate same volume twice - no LVMS' 2025-12-03 18:33:43.850698 | controller | 2025-12-03 18:33:43.850794 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:43.850919 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.051) 0:00:06.651 **** 2025-12-03 18:33:43.890815 | controller | 2025-12-03 18:33:43.890993 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:43.891235 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.040) 0:00:06.691 **** 2025-12-03 18:33:43.949606 | controller | ok: [instance] 2025-12-03 18:33:43.949757 | controller | 2025-12-03 18:33:43.949938 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:43.950153 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.058) 0:00:06.750 **** 2025-12-03 18:33:43.994218 | controller | ok: [instance] 2025-12-03 18:33:43.994316 | controller | 2025-12-03 18:33:43.994408 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:43.994509 | controller | Wednesday 03 December 2025 18:33:43 +0000 (0:00:00.044) 0:00:06.795 **** 2025-12-03 18:33:44.063385 | controller | ok: [instance] 2025-12-03 18:33:44.063468 | controller | 2025-12-03 18:33:44.063572 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:44.063676 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.069) 0:00:06.864 **** 2025-12-03 18:33:44.103417 | controller | skipping: [instance] 2025-12-03 18:33:44.103488 | controller | 2025-12-03 18:33:44.103586 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:44.103753 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.040) 0:00:06.904 **** 2025-12-03 18:33:44.144192 | controller | skipping: [instance] 2025-12-03 18:33:44.144283 | controller | 2025-12-03 18:33:44.144385 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 18:33:44.144504 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.040) 0:00:06.945 **** 2025-12-03 18:33:44.190974 | controller | ok: [instance] 2025-12-03 18:33:44.191121 | controller | 2025-12-03 18:33:44.191345 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 18:33:44.233141 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.046) 0:00:06.992 **** 2025-12-03 18:33:44.233215 | controller | skipping: [instance] 2025-12-03 18:33:44.233226 | controller | 2025-12-03 18:33:44.233315 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 18:33:44.233405 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.042) 0:00:07.034 **** 2025-12-03 18:33:44.299890 | controller | ok: [instance] 2025-12-03 18:33:44.299987 | controller | 2025-12-03 18:33:44.300111 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 18:33:44.300237 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.066) 0:00:07.101 **** 2025-12-03 18:33:44.350761 | controller | skipping: [instance] 2025-12-03 18:33:44.350843 | controller | 2025-12-03 18:33:44.350955 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 18:33:44.351118 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.050) 0:00:07.151 **** 2025-12-03 18:33:44.419428 | controller | ok: [instance] => changed=false 2025-12-03 18:33:44.419524 | controller | msg: All assertions passed 2025-12-03 18:33:44.419616 | controller | 2025-12-03 18:33:44.419725 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 18:33:44.419837 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.068) 0:00:07.220 **** 2025-12-03 18:33:44.498045 | controller | ok: [instance] => changed=false 2025-12-03 18:33:44.498159 | controller | msg: All assertions passed 2025-12-03 18:33:44.498259 | controller | 2025-12-03 18:33:44.498364 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:44.498475 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.078) 0:00:07.298 **** 2025-12-03 18:33:44.535956 | controller | skipping: [instance] 2025-12-03 18:33:44.536102 | controller | 2025-12-03 18:33:44.536271 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:44.536331 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.037) 0:00:07.336 **** 2025-12-03 18:33:44.568524 | controller | skipping: [instance] 2025-12-03 18:33:44.568645 | controller | 2025-12-03 18:33:44.568745 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:44.568865 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.032) 0:00:07.369 **** 2025-12-03 18:33:44.599873 | controller | skipping: [instance] 2025-12-03 18:33:44.599992 | controller | 2025-12-03 18:33:44.600128 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:44.600240 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.031) 0:00:07.401 **** 2025-12-03 18:33:44.621537 | controller | ok: [instance] 2025-12-03 18:33:44.621613 | controller | 2025-12-03 18:33:44.621712 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:44.621818 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.021) 0:00:07.422 **** 2025-12-03 18:33:44.645189 | controller | ok: [instance] 2025-12-03 18:33:44.645292 | controller | 2025-12-03 18:33:44.645396 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:44.645506 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.023) 0:00:07.446 **** 2025-12-03 18:33:44.672682 | controller | ok: [instance] => 2025-12-03 18:33:44.672777 | controller | msg: 'Running: Allocate same volume twice - no cinder_lvm' 2025-12-03 18:33:44.672873 | controller | 2025-12-03 18:33:44.673008 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:44.673145 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.027) 0:00:07.473 **** 2025-12-03 18:33:44.715385 | controller | 2025-12-03 18:33:44.715493 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:44.715607 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.042) 0:00:07.516 **** 2025-12-03 18:33:44.824910 | controller | ok: [instance] 2025-12-03 18:33:44.824969 | controller | 2025-12-03 18:33:44.825136 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:44.825231 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.109) 0:00:07.626 **** 2025-12-03 18:33:44.868861 | controller | ok: [instance] 2025-12-03 18:33:44.868968 | controller | 2025-12-03 18:33:44.869109 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:44.869214 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.043) 0:00:07.670 **** 2025-12-03 18:33:44.942918 | controller | ok: [instance] 2025-12-03 18:33:44.943006 | controller | 2025-12-03 18:33:44.943153 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:44.943269 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.073) 0:00:07.744 **** 2025-12-03 18:33:44.982495 | controller | skipping: [instance] 2025-12-03 18:33:44.982596 | controller | 2025-12-03 18:33:44.983097 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:45.029578 | controller | Wednesday 03 December 2025 18:33:44 +0000 (0:00:00.039) 0:00:07.783 **** 2025-12-03 18:33:45.029606 | controller | skipping: [instance] 2025-12-03 18:33:45.029662 | controller | 2025-12-03 18:33:45.029768 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 18:33:45.029873 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.047) 0:00:07.830 **** 2025-12-03 18:33:45.073755 | controller | ok: [instance] 2025-12-03 18:33:45.073848 | controller | 2025-12-03 18:33:45.073973 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 18:33:45.074112 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.044) 0:00:07.874 **** 2025-12-03 18:33:45.118006 | controller | skipping: [instance] 2025-12-03 18:33:45.118105 | controller | 2025-12-03 18:33:45.118224 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 18:33:45.118324 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.044) 0:00:07.919 **** 2025-12-03 18:33:45.184519 | controller | ok: [instance] 2025-12-03 18:33:45.184565 | controller | 2025-12-03 18:33:45.184683 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 18:33:45.184791 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.066) 0:00:07.985 **** 2025-12-03 18:33:45.236716 | controller | skipping: [instance] 2025-12-03 18:33:45.236766 | controller | 2025-12-03 18:33:45.236935 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 18:33:45.237056 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.051) 0:00:08.036 **** 2025-12-03 18:33:45.301811 | controller | ok: [instance] => changed=false 2025-12-03 18:33:45.301886 | controller | msg: All assertions passed 2025-12-03 18:33:45.301992 | controller | 2025-12-03 18:33:45.302131 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 18:33:45.302227 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.066) 0:00:08.103 **** 2025-12-03 18:33:45.362283 | controller | skipping: [instance] 2025-12-03 18:33:45.362366 | controller | 2025-12-03 18:33:45.362378 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:45.362387 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.060) 0:00:08.163 **** 2025-12-03 18:33:45.399194 | controller | skipping: [instance] 2025-12-03 18:33:45.399265 | controller | 2025-12-03 18:33:45.399366 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:45.399464 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.037) 0:00:08.200 **** 2025-12-03 18:33:45.431186 | controller | skipping: [instance] 2025-12-03 18:33:45.431272 | controller | 2025-12-03 18:33:45.431387 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:45.431489 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.031) 0:00:08.231 **** 2025-12-03 18:33:45.462886 | controller | skipping: [instance] 2025-12-03 18:33:45.463020 | controller | 2025-12-03 18:33:45.463155 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:45.463250 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.032) 0:00:08.264 **** 2025-12-03 18:33:45.485775 | controller | ok: [instance] 2025-12-03 18:33:45.485859 | controller | 2025-12-03 18:33:45.485974 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:45.486103 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.022) 0:00:08.287 **** 2025-12-03 18:33:45.511195 | controller | ok: [instance] 2025-12-03 18:33:45.511300 | controller | 2025-12-03 18:33:45.511401 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:45.511504 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.025) 0:00:08.312 **** 2025-12-03 18:33:45.535401 | controller | ok: [instance] => 2025-12-03 18:33:45.535511 | controller | msg: 'Running: Config overrides via devscripts' 2025-12-03 18:33:45.535615 | controller | 2025-12-03 18:33:45.535711 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:45.535817 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.024) 0:00:08.336 **** 2025-12-03 18:33:45.575115 | controller | 2025-12-03 18:33:45.575226 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:45.575333 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.039) 0:00:08.376 **** 2025-12-03 18:33:45.605333 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:45.605448 | controller | assertion: cifmw_devscripts_config.master_memory is undefined 2025-12-03 18:33:45.605557 | controller | evaluated_to: false 2025-12-03 18:33:45.605673 | controller | msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' 2025-12-03 18:33:45.631624 | controller | 2025-12-03 18:33:45.631740 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:45.631847 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.040) 0:00:08.416 **** 2025-12-03 18:33:45.631941 | controller | 2025-12-03 18:33:45.632063 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:45.632183 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.016) 0:00:08.432 **** 2025-12-03 18:33:45.653699 | controller | ok: [instance] 2025-12-03 18:33:45.653787 | controller | 2025-12-03 18:33:45.653900 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:45.654055 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.022) 0:00:08.455 **** 2025-12-03 18:33:45.719587 | controller | skipping: [instance] 2025-12-03 18:33:45.719674 | controller | 2025-12-03 18:33:45.719796 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:45.719918 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.065) 0:00:08.520 **** 2025-12-03 18:33:45.751535 | controller | skipping: [instance] 2025-12-03 18:33:45.751622 | controller | 2025-12-03 18:33:45.751717 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:45.751813 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.031) 0:00:08.552 **** 2025-12-03 18:33:45.783603 | controller | skipping: [instance] 2025-12-03 18:33:45.783688 | controller | 2025-12-03 18:33:45.783793 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:45.783911 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.032) 0:00:08.585 **** 2025-12-03 18:33:45.804849 | controller | ok: [instance] 2025-12-03 18:33:45.804938 | controller | 2025-12-03 18:33:45.805056 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:45.805200 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.021) 0:00:08.606 **** 2025-12-03 18:33:45.828902 | controller | ok: [instance] 2025-12-03 18:33:45.829090 | controller | 2025-12-03 18:33:45.829144 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:45.829257 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.024) 0:00:08.630 **** 2025-12-03 18:33:45.851953 | controller | ok: [instance] => 2025-12-03 18:33:45.852053 | controller | msg: 'Running: Inject 10 dev-scripts extra_worker' 2025-12-03 18:33:45.852170 | controller | 2025-12-03 18:33:45.852264 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:45.852351 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.022) 0:00:08.653 **** 2025-12-03 18:33:45.892646 | controller | 2025-12-03 18:33:45.892737 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:45.892834 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.040) 0:00:08.693 **** 2025-12-03 18:33:45.948220 | controller | ok: [instance] 2025-12-03 18:33:45.948296 | controller | 2025-12-03 18:33:45.948415 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:45.948529 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.055) 0:00:08.749 **** 2025-12-03 18:33:45.980739 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-03 18:33:45.980853 | controller | assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 2025-12-03 18:33:45.980976 | controller | evaluated_to: false 2025-12-03 18:33:45.981124 | controller | msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' 2025-12-03 18:33:46.007278 | controller | 2025-12-03 18:33:46.007381 | controller | TASK [Clear host errors] ******************************************************* 2025-12-03 18:33:46.007486 | controller | Wednesday 03 December 2025 18:33:45 +0000 (0:00:00.042) 0:00:08.792 **** 2025-12-03 18:33:46.007579 | controller | 2025-12-03 18:33:46.007680 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:46.007776 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.016) 0:00:08.808 **** 2025-12-03 18:33:46.029116 | controller | ok: [instance] 2025-12-03 18:33:46.029210 | controller | 2025-12-03 18:33:46.029316 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:46.029433 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.022) 0:00:08.830 **** 2025-12-03 18:33:46.065225 | controller | skipping: [instance] 2025-12-03 18:33:46.065316 | controller | 2025-12-03 18:33:46.065410 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:46.065513 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.036) 0:00:08.866 **** 2025-12-03 18:33:46.097700 | controller | skipping: [instance] 2025-12-03 18:33:46.097725 | controller | 2025-12-03 18:33:46.097850 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:46.098008 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.032) 0:00:08.898 **** 2025-12-03 18:33:46.133446 | controller | skipping: [instance] 2025-12-03 18:33:46.133567 | controller | 2025-12-03 18:33:46.133584 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-03 18:33:46.133689 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.035) 0:00:08.934 **** 2025-12-03 18:33:46.154482 | controller | ok: [instance] 2025-12-03 18:33:46.154566 | controller | 2025-12-03 18:33:46.154691 | controller | TASK [Load environment file] *************************************************** 2025-12-03 18:33:46.154798 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.021) 0:00:08.955 **** 2025-12-03 18:33:46.178796 | controller | ok: [instance] 2025-12-03 18:33:46.178882 | controller | 2025-12-03 18:33:46.179006 | controller | TASK [Output scenario name] **************************************************** 2025-12-03 18:33:46.179137 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.024) 0:00:08.980 **** 2025-12-03 18:33:46.203021 | controller | ok: [instance] => 2025-12-03 18:33:46.203173 | controller | msg: 'Running: Inject 0 dev-scripts extra_worker' 2025-12-03 18:33:46.203257 | controller | 2025-12-03 18:33:46.203350 | controller | TASK [Validate data] *********************************************************** 2025-12-03 18:33:46.203451 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.024) 0:00:09.004 **** 2025-12-03 18:33:46.240434 | controller | 2025-12-03 18:33:46.240543 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-03 18:33:46.240648 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.037) 0:00:09.041 **** 2025-12-03 18:33:46.295030 | controller | ok: [instance] 2025-12-03 18:33:46.295152 | controller | 2025-12-03 18:33:46.295252 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-03 18:33:46.295371 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.054) 0:00:09.096 **** 2025-12-03 18:33:46.335218 | controller | ok: [instance] 2025-12-03 18:33:46.335302 | controller | 2025-12-03 18:33:46.335404 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-03 18:33:46.335505 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.040) 0:00:09.136 **** 2025-12-03 18:33:46.402690 | controller | ok: [instance] 2025-12-03 18:33:46.402765 | controller | 2025-12-03 18:33:46.402865 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-03 18:33:46.402996 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.067) 0:00:09.204 **** 2025-12-03 18:33:46.465900 | controller | skipping: [instance] 2025-12-03 18:33:46.466028 | controller | 2025-12-03 18:33:46.466163 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-03 18:33:46.466280 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.063) 0:00:09.267 **** 2025-12-03 18:33:46.515452 | controller | ok: [instance] 2025-12-03 18:33:46.515504 | controller | 2025-12-03 18:33:46.515616 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-03 18:33:46.515709 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.049) 0:00:09.316 **** 2025-12-03 18:33:46.555888 | controller | skipping: [instance] 2025-12-03 18:33:46.555992 | controller | 2025-12-03 18:33:46.556112 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-03 18:33:46.556219 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.040) 0:00:09.357 **** 2025-12-03 18:33:46.594836 | controller | skipping: [instance] 2025-12-03 18:33:46.594932 | controller | 2025-12-03 18:33:46.595063 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-03 18:33:46.595169 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.038) 0:00:09.395 **** 2025-12-03 18:33:46.633376 | controller | skipping: [instance] 2025-12-03 18:33:46.633479 | controller | 2025-12-03 18:33:46.633598 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-03 18:33:46.633712 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.038) 0:00:09.434 **** 2025-12-03 18:33:46.675448 | controller | skipping: [instance] 2025-12-03 18:33:46.675536 | controller | 2025-12-03 18:33:46.675630 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-03 18:33:46.675728 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.041) 0:00:09.476 **** 2025-12-03 18:33:46.715838 | controller | skipping: [instance] 2025-12-03 18:33:46.716055 | controller | 2025-12-03 18:33:46.716132 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-03 18:33:46.716222 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.041) 0:00:09.517 **** 2025-12-03 18:33:46.763110 | controller | skipping: [instance] 2025-12-03 18:33:46.763196 | controller | 2025-12-03 18:33:46.763294 | controller | TASK [Mark failure] ************************************************************ 2025-12-03 18:33:46.763391 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.047) 0:00:09.564 **** 2025-12-03 18:33:46.803011 | controller | skipping: [instance] 2025-12-03 18:33:46.803140 | controller | 2025-12-03 18:33:46.803273 | controller | TASK [Display error message] *************************************************** 2025-12-03 18:33:46.803347 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.039) 0:00:09.604 **** 2025-12-03 18:33:46.836107 | controller | skipping: [instance] 2025-12-03 18:33:46.836224 | controller | 2025-12-03 18:33:46.836330 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-03 18:33:46.836433 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.033) 0:00:09.637 **** 2025-12-03 18:33:46.871336 | controller | skipping: [instance] 2025-12-03 18:33:46.871429 | controller | 2025-12-03 18:33:46.871530 | controller | TASK [Fail if needed] ********************************************************** 2025-12-03 18:33:46.871635 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.035) 0:00:09.672 **** 2025-12-03 18:33:46.933655 | controller | skipping: [instance] 2025-12-03 18:33:46.933768 | controller | 2025-12-03 18:33:46.933879 | controller | PLAY RECAP ********************************************************************* 2025-12-03 18:33:46.934098 | controller | instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 2025-12-03 18:33:46.934232 | controller | 2025-12-03 18:33:46.934413 | controller | Wednesday 03 December 2025 18:33:46 +0000 (0:00:00.061) 0:00:09.734 **** 2025-12-03 18:33:46.934432 | controller | =============================================================================== 2025-12-03 18:33:46.934551 | controller | reproducer : Ensure no allocation overlap ------------------------------- 0.11s 2025-12-03 18:33:46.934637 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.11s 2025-12-03 18:33:46.934734 | controller | Test no volumes --------------------------------------------------------- 0.10s 2025-12-03 18:33:46.935104 | controller | reproducer : Ensure we get required data in the layout description ------ 0.09s 2025-12-03 18:33:46.935173 | controller | reproducer : Ensure same amount of disks are created -------------------- 0.09s 2025-12-03 18:33:46.935258 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-12-03 18:33:46.935347 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-12-03 18:33:46.935442 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-12-03 18:33:46.935543 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-12-03 18:33:46.935622 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-12-03 18:33:46.935712 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-12-03 18:33:46.935802 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.07s 2025-12-03 18:33:46.935894 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-12-03 18:33:46.936000 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-12-03 18:33:46.936110 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.07s 2025-12-03 18:33:46.936204 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.07s 2025-12-03 18:33:46.936320 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-12-03 18:33:46.936405 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.07s 2025-12-03 18:33:46.936498 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.07s 2025-12-03 18:33:46.936596 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-12-03 18:33:47.005506 | controller | INFO Running ocp_validations > cleanup 2025-12-03 18:33:47.005871 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-03 18:33:47.006475 | controller | INFO Writing /tmp/report.html report. 2025-12-03 18:33:47.169477 | [controller] Waiting on logger 2025-12-03 18:33:52.306295 | [controller] Waiting on logger 2025-12-03 18:34:02.738795 | [controller] Waiting on logger 2025-12-03 18:34:13.171216 | [controller] Waiting on logger 2025-12-03 18:34:17.139329 | [Zuul] Log Stream did not terminate 2025-12-03 18:34:17.139569 | controller | changed 2025-12-03 18:34:17.209620 | 2025-12-03 18:34:17.209709 | PLAY RECAP 2025-12-03 18:34:17.209758 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-03 18:34:17.209789 | 2025-12-03 18:34:17.273116 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-03 18:34:17.273989 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-03 18:34:17.798761 | 2025-12-03 18:34:17.798877 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-12-03 18:34:17.818822 | 2025-12-03 18:34:17.818930 | TASK [Filter out host if needed] 2025-12-03 18:34:17.827433 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-12-03 18:34:17.831860 | 2025-12-03 18:34:17.831944 | TASK [Ensure file is present] 2025-12-03 18:34:18.205458 | controller | ok 2025-12-03 18:34:18.212230 | 2025-12-03 18:34:18.212298 | TASK [Manage molecule report file] 2025-12-03 18:34:18.232451 | [controller] Waiting on logger 2025-12-03 18:34:27.570477 | [controller] Waiting on logger 2025-12-03 18:34:38.002382 | [controller] Waiting on logger 2025-12-03 18:34:47.346551 | [controller] Waiting on logger 2025-12-03 18:34:48.596002 | [Zuul] Log Stream did not terminate 2025-12-03 18:34:48.596209 | controller | changed 2025-12-03 18:34:48.602931 | 2025-12-03 18:34:48.602996 | TASK [Check if we get ci-framework-data basedir] 2025-12-03 18:34:48.853983 | controller | ok 2025-12-03 18:34:48.859061 | 2025-12-03 18:34:48.859124 | TASK [Create ci-framework-data log directory for zuul] 2025-12-03 18:34:49.233147 | controller | changed 2025-12-03 18:34:49.238335 | 2025-12-03 18:34:49.238402 | TASK [Copy ci-framework interesting files] 2025-12-03 18:34:49.259824 | [controller] Waiting on logger 2025-12-03 18:34:59.698377 | [controller] Waiting on logger 2025-12-03 18:35:10.130495 | [controller] Waiting on logger 2025-12-03 18:35:19.474553 | [controller] Waiting on logger 2025-12-03 18:35:19.521761 | [Zuul] Log Stream did not terminate 2025-12-03 18:35:19.522040 | controller | changed 2025-12-03 18:35:19.527289 | 2025-12-03 18:35:19.527358 | TASK [Get SELinux listing] 2025-12-03 18:35:20.563090 | [controller] Waiting on logger 2025-12-03 18:35:39.186421 | [controller] Waiting on logger 2025-12-03 18:35:40.274615 | [controller] Waiting on logger 2025-12-03 18:35:49.809344 | [Zuul] Log Stream did not terminate 2025-12-03 18:35:49.810124 | controller | changed 2025-12-03 18:35:49.815957 | 2025-12-03 18:35:49.816036 | TASK [Generate log index] 2025-12-03 18:35:50.914207 | controller | changed 2025-12-03 18:35:50.919210 | 2025-12-03 18:35:50.919277 | TASK [Get some env related data] 2025-12-03 18:35:54.802674 | [controller] Waiting on logger 2025-12-03 18:35:55.946447 | controller | changed 2025-12-03 18:35:55.952168 | 2025-12-03 18:35:55.952235 | TASK [Generate list of logs to collect in home directory] 2025-12-03 18:35:56.318385 | controller | ok: All paths examined 2025-12-03 18:35:56.323537 | 2025-12-03 18:35:56.323597 | LOOP [Copy logs from home directory] 2025-12-03 18:35:56.860847 | controller | changed: 2025-12-03 18:35:56.861167 | controller | { 2025-12-03 18:35:56.861196 | controller | "atime": 1743544925.4788878, 2025-12-03 18:35:56.861217 | controller | "ctime": 1743545329.1409318, 2025-12-03 18:35:56.861233 | controller | "dev": 64513, 2025-12-03 18:35:56.861248 | controller | "gid": 1000, 2025-12-03 18:35:56.861264 | controller | "gr_name": "zuul", 2025-12-03 18:35:56.861280 | controller | "inode": 4518807, 2025-12-03 18:35:56.861300 | controller | "isblk": false, 2025-12-03 18:35:56.861322 | controller | "ischr": false, 2025-12-03 18:35:56.861339 | controller | "isdir": false, 2025-12-03 18:35:56.861354 | controller | "isfifo": false, 2025-12-03 18:35:56.861368 | controller | "isgid": false, 2025-12-03 18:35:56.861382 | controller | "islnk": false, 2025-12-03 18:35:56.861397 | controller | "isreg": true, 2025-12-03 18:35:56.861411 | controller | "issock": false, 2025-12-03 18:35:56.861427 | controller | "isuid": false, 2025-12-03 18:35:56.861443 | controller | "mode": "0644", 2025-12-03 18:35:56.861457 | controller | "mtime": 1743545329.1409318, 2025-12-03 18:35:56.861471 | controller | "nlink": 1, 2025-12-03 18:35:56.861486 | controller | "path": "/home/zuul/crc-setup.log", 2025-12-03 18:35:56.861500 | controller | "pw_name": "zuul", 2025-12-03 18:35:56.861513 | controller | "rgrp": true, 2025-12-03 18:35:56.861527 | controller | "roth": true, 2025-12-03 18:35:56.861541 | controller | "rusr": true, 2025-12-03 18:35:56.861557 | controller | "size": 4108, 2025-12-03 18:35:56.861571 | controller | "uid": 1000, 2025-12-03 18:35:56.861585 | controller | "wgrp": false, 2025-12-03 18:35:56.861598 | controller | "woth": false, 2025-12-03 18:35:56.861610 | controller | "wusr": true, 2025-12-03 18:35:56.861623 | controller | "xgrp": false, 2025-12-03 18:35:56.861636 | controller | "xoth": false, 2025-12-03 18:35:56.861649 | controller | "xusr": false 2025-12-03 18:35:56.861662 | controller | } 2025-12-03 18:35:57.367992 | controller | changed: 2025-12-03 18:35:57.368097 | controller | { 2025-12-03 18:35:57.368125 | controller | "atime": 1743545331.0429637, 2025-12-03 18:35:57.368145 | controller | "ctime": 1743545842.0111232, 2025-12-03 18:35:57.368162 | controller | "dev": 64513, 2025-12-03 18:35:57.368179 | controller | "gid": 1000, 2025-12-03 18:35:57.368194 | controller | "gr_name": "zuul", 2025-12-03 18:35:57.368209 | controller | "inode": 4194437, 2025-12-03 18:35:57.368224 | controller | "isblk": false, 2025-12-03 18:35:57.368240 | controller | "ischr": false, 2025-12-03 18:35:57.368255 | controller | "isdir": false, 2025-12-03 18:35:57.368269 | controller | "isfifo": false, 2025-12-03 18:35:57.368283 | controller | "isgid": false, 2025-12-03 18:35:57.368296 | controller | "islnk": false, 2025-12-03 18:35:57.368309 | controller | "isreg": true, 2025-12-03 18:35:57.368322 | controller | "issock": false, 2025-12-03 18:35:57.368336 | controller | "isuid": false, 2025-12-03 18:35:57.368348 | controller | "mode": "0644", 2025-12-03 18:35:57.368361 | controller | "mtime": 1743545842.0111232, 2025-12-03 18:35:57.368375 | controller | "nlink": 1, 2025-12-03 18:35:57.368389 | controller | "path": "/home/zuul/crc-start.log", 2025-12-03 18:35:57.368403 | controller | "pw_name": "zuul", 2025-12-03 18:35:57.368417 | controller | "rgrp": true, 2025-12-03 18:35:57.368430 | controller | "roth": true, 2025-12-03 18:35:57.368442 | controller | "rusr": true, 2025-12-03 18:35:57.368455 | controller | "size": 4023, 2025-12-03 18:35:57.368468 | controller | "uid": 1000, 2025-12-03 18:35:57.368481 | controller | "wgrp": false, 2025-12-03 18:35:57.368495 | controller | "woth": false, 2025-12-03 18:35:57.368509 | controller | "wusr": true, 2025-12-03 18:35:57.368522 | controller | "xgrp": false, 2025-12-03 18:35:57.368536 | controller | "xoth": false, 2025-12-03 18:35:57.368549 | controller | "xusr": false 2025-12-03 18:35:57.368562 | controller | } 2025-12-03 18:35:57.879497 | controller | changed: 2025-12-03 18:35:57.879585 | controller | { 2025-12-03 18:35:57.879611 | controller | "atime": 1764786277.693951, 2025-12-03 18:35:57.879630 | controller | "ctime": 1764786292.6702068, 2025-12-03 18:35:57.879646 | controller | "dev": 64513, 2025-12-03 18:35:57.879661 | controller | "gid": 1000, 2025-12-03 18:35:57.879676 | controller | "gr_name": "zuul", 2025-12-03 18:35:57.879690 | controller | "inode": 4233415, 2025-12-03 18:35:57.879706 | controller | "isblk": false, 2025-12-03 18:35:57.879726 | controller | "ischr": false, 2025-12-03 18:35:57.879742 | controller | "isdir": false, 2025-12-03 18:35:57.879759 | controller | "isfifo": false, 2025-12-03 18:35:57.879773 | controller | "isgid": false, 2025-12-03 18:35:57.879788 | controller | "islnk": false, 2025-12-03 18:35:57.879807 | controller | "isreg": true, 2025-12-03 18:35:57.879820 | controller | "issock": false, 2025-12-03 18:35:57.879834 | controller | "isuid": false, 2025-12-03 18:35:57.879848 | controller | "mode": "0644", 2025-12-03 18:35:57.879873 | controller | "mtime": 1764786292.6702068, 2025-12-03 18:35:57.879888 | controller | "nlink": 1, 2025-12-03 18:35:57.879902 | controller | "path": "/home/zuul/ansible.log", 2025-12-03 18:35:57.879962 | controller | "pw_name": "zuul", 2025-12-03 18:35:57.879980 | controller | "rgrp": true, 2025-12-03 18:35:57.879995 | controller | "roth": true, 2025-12-03 18:35:57.880010 | controller | "rusr": true, 2025-12-03 18:35:57.880024 | controller | "size": 6749, 2025-12-03 18:35:57.880038 | controller | "uid": 1000, 2025-12-03 18:35:57.880052 | controller | "wgrp": false, 2025-12-03 18:35:57.880067 | controller | "woth": false, 2025-12-03 18:35:57.880081 | controller | "wusr": true, 2025-12-03 18:35:57.880096 | controller | "xgrp": false, 2025-12-03 18:35:57.880109 | controller | "xoth": false, 2025-12-03 18:35:57.880123 | controller | "xusr": false 2025-12-03 18:35:57.880136 | controller | } 2025-12-03 18:35:57.891487 | 2025-12-03 18:35:57.891599 | TASK [Copy crio stats log file] 2025-12-03 18:35:57.906109 | controller | skipping: Conditional result was False 2025-12-03 18:35:57.911525 | 2025-12-03 18:35:57.911588 | TASK [Get SELinux related data] 2025-12-03 18:36:02.938130 | controller | ERROR 2025-12-03 18:36:02.938377 | controller | { 2025-12-03 18:36:02.938415 | controller | "delta": "0:00:00.008288", 2025-12-03 18:36:02.938441 | controller | "end": "2025-12-03 18:35:58.168413", 2025-12-03 18:36:02.938464 | controller | "msg": "non-zero return code", 2025-12-03 18:36:02.938484 | controller | "rc": 1, 2025-12-03 18:36:02.938503 | controller | "start": "2025-12-03 18:35:58.160125" 2025-12-03 18:36:02.938521 | controller | } 2025-12-03 18:36:02.938548 | controller | ERROR: Ignoring Errors 2025-12-03 18:36:02.943868 | 2025-12-03 18:36:02.943947 | TASK [Create system configuration directory] 2025-12-03 18:36:03.196418 | controller | changed 2025-12-03 18:36:03.202188 | 2025-12-03 18:36:03.202270 | TASK [Get some of the system configurations] 2025-12-03 18:36:03.223408 | [controller] Waiting on logger 2025-12-03 18:36:13.618495 | [controller] Waiting on logger 2025-12-03 18:36:24.050583 | [controller] Waiting on logger 2025-12-03 18:36:33.395116 | [controller] Waiting on logger 2025-12-03 18:36:33.495516 | [Zuul] Log Stream did not terminate 2025-12-03 18:36:33.495680 | controller | changed 2025-12-03 18:36:33.501062 | 2025-12-03 18:36:33.501127 | TASK [Copy generated documentation if available] 2025-12-03 18:36:33.515389 | controller | skipping: Conditional result was False 2025-12-03 18:36:33.520623 | 2025-12-03 18:36:33.520686 | TASK [Copy generated AsciiDoc documentation if available] 2025-12-03 18:36:33.534234 | controller | skipping: Conditional result was False 2025-12-03 18:36:33.540017 | 2025-12-03 18:36:33.540086 | TASK [Compress logs bigger than 2MB] 2025-12-03 18:36:36.659341 | [controller] Waiting on logger 2025-12-03 18:36:51.222970 | [controller] Waiting on logger 2025-12-03 18:37:01.618492 | [controller] Waiting on logger 2025-12-03 18:37:03.812101 | [Zuul] Log Stream did not terminate 2025-12-03 18:37:03.812343 | controller | changed 2025-12-03 18:37:03.818604 | 2025-12-03 18:37:03.818669 | TASK [Copy files from workspace on node] 2025-12-03 18:37:03.836879 | controller | ok 2025-12-03 18:37:03.858756 | 2025-12-03 18:37:03.858825 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-03 18:37:03.872089 | controller | skipping: Conditional result was False 2025-12-03 18:37:03.878308 | 2025-12-03 18:37:03.878374 | TASK [fetch-output : Set log path for single node] 2025-12-03 18:37:03.905784 | controller | ok 2025-12-03 18:37:03.910592 | 2025-12-03 18:37:03.910653 | LOOP [fetch-output : Ensure local output dirs] 2025-12-03 18:37:04.100446 | controller -> localhost | ok: "/var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/logs" 2025-12-03 18:37:04.100693 | controller -> localhost | changed: All items complete 2025-12-03 18:37:04.100722 | 2025-12-03 18:37:04.273741 | controller -> localhost | changed: "/var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/artifacts" 2025-12-03 18:37:04.450308 | controller -> localhost | changed: "/var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/docs" 2025-12-03 18:37:04.467633 | 2025-12-03 18:37:04.467739 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-03 18:37:05.095127 | controller | changed: 2025-12-03 18:37:05.095312 | controller | .d..t...... ./ 2025-12-03 18:37:05.095343 | controller | >f+++++++++ README.html 2025-12-03 18:37:05.095368 | controller | >f+++++++++ ansible-execution.log 2025-12-03 18:37:05.095389 | controller | >f+++++++++ ansible.log 2025-12-03 18:37:05.095409 | controller | >f+++++++++ crc-setup.log 2025-12-03 18:37:05.095428 | controller | >f+++++++++ crc-start.log 2025-12-03 18:37:05.095447 | controller | >f+++++++++ dmesg.log 2025-12-03 18:37:05.095466 | controller | >f+++++++++ installed-pkgs.log 2025-12-03 18:37:05.095484 | controller | >f+++++++++ python.log 2025-12-03 18:37:05.095501 | controller | >f+++++++++ registries.conf 2025-12-03 18:37:05.095518 | controller | >f+++++++++ report.html 2025-12-03 18:37:05.095535 | controller | >f+++++++++ selinux-denials.log 2025-12-03 18:37:05.095551 | controller | >f+++++++++ selinux-listing.log 2025-12-03 18:37:05.095567 | controller | cd+++++++++ ci-framework-data/ 2025-12-03 18:37:05.095584 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-12-03 18:37:05.095601 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-12-03 18:37:05.095618 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-12-03 18:37:05.095634 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-12-03 18:37:05.095651 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-12-03 18:37:05.095668 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-12-03 18:37:05.095684 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-12-03 18:37:05.095700 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-12-03 18:37:05.095716 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-12-03 18:37:05.095732 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-12-03 18:37:05.095748 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-12-03 18:37:05.095764 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-12-03 18:37:05.095781 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-12-03 18:37:05.095798 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-12-03 18:37:05.095814 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:84:c2:bf 2025-12-03 18:37:05.095832 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:7e:67:f8 2025-12-03 18:37:05.095849 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:db:52:37 2025-12-03 18:37:05.095878 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:31:e9:23 2025-12-03 18:37:05.095897 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:46:1f:c9 2025-12-03 18:37:05.095937 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:9c:41:7d 2025-12-03 18:37:05.095967 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-12-03 18:37:05.095989 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-12-03 18:37:05.096007 | controller | cd+++++++++ ci-framework-data/logs/ 2025-12-03 18:37:05.096025 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-12-03 18:37:05.096043 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-12-03 18:37:05.096060 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-12-03 18:37:05.096077 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-12-03 18:37:05.096093 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-12-03 18:37:05.096110 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-12-03 18:37:05.096127 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-12-03 18:37:05.096144 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2025-12-03 18:37:05.096160 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2025-12-03 18:37:05.096177 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2025-12-03 18:37:05.096195 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2025-12-03 18:37:05.096213 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2025-12-03 18:37:05.096230 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2025-12-03 18:37:05.096246 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2025-12-03 18:37:05.096262 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2025-12-03 18:37:05.096279 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2025-12-03 18:37:05.096296 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2025-12-03 18:37:05.096312 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2025-12-03 18:37:05.096329 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2025-12-03 18:37:05.096345 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2025-12-03 18:37:05.096361 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2025-12-03 18:37:05.096377 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2025-12-03 18:37:05.096393 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-12-03 18:37:05.096409 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-12-03 18:37:05.096425 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-12-03 18:37:05.096441 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-12-03 18:37:05.096457 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2025-12-03 18:37:05.096473 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-12-03 18:37:05.096492 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-12-03 18:37:05.096509 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-12-03 18:37:05.096525 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-12-03 18:37:05.096541 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-12-03 18:37:05.096558 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-12-03 18:37:05.096574 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-12-03 18:37:05.096591 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2025-12-03 18:37:05.096608 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-12-03 18:37:05.096625 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-12-03 18:37:05.096641 | controller | cd+++++++++ registries.conf.d/ 2025-12-03 18:37:05.096658 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-12-03 18:37:05.096674 | controller | cd+++++++++ system-config/ 2025-12-03 18:37:05.096691 | controller | cd+++++++++ system-config/libvirt/ 2025-12-03 18:37:05.096707 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-12-03 18:37:05.096723 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-12-03 18:37:05.096740 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-12-03 18:37:05.096756 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-12-03 18:37:05.096773 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-12-03 18:37:05.096789 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-12-03 18:37:05.096805 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-12-03 18:37:05.096821 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-12-03 18:37:05.096836 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-12-03 18:37:05.096853 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-12-03 18:37:05.096878 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-12-03 18:37:05.096896 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-12-03 18:37:05.096938 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-12-03 18:37:05.096960 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-12-03 18:37:05.096979 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-12-03 18:37:05.096996 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-12-03 18:37:05.521600 | controller | changed: .d..t...... ./ 2025-12-03 18:37:05.942542 | controller | changed: .d..t...... ./ 2025-12-03 18:37:05.960519 | 2025-12-03 18:37:05.960641 | TASK [Return artifact to Zuul] 2025-12-03 18:37:05.990364 | controller | ok 2025-12-03 18:37:06.008975 | 2025-12-03 18:37:06.009032 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-12-03 18:37:06.009127 | 2025-12-03 18:37:06.009154 | PLAY RECAP 2025-12-03 18:37:06.009190 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-12-03 18:37:06.009211 | 2025-12-03 18:37:06.090824 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-03 18:37:06.091721 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-03 18:37:06.603599 | 2025-12-03 18:37:06.603766 | PLAY [all] 2025-12-03 18:37:06.622112 | 2025-12-03 18:37:06.622255 | TASK [include_role : fetch-output] 2025-12-03 18:37:06.651045 | controller | ok 2025-12-03 18:37:06.667856 | 2025-12-03 18:37:06.667964 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-03 18:37:06.712242 | controller | skipping: Conditional result was False 2025-12-03 18:37:06.717858 | 2025-12-03 18:37:06.717958 | TASK [fetch-output : Set log path for single node] 2025-12-03 18:37:06.746748 | controller | ok 2025-12-03 18:37:06.751724 | 2025-12-03 18:37:06.751795 | LOOP [fetch-output : Ensure local output dirs] 2025-12-03 18:37:07.064288 | controller -> localhost | ok: "/var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/logs" 2025-12-03 18:37:07.242491 | controller -> localhost | ok: "/var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/artifacts" 2025-12-03 18:37:07.418577 | controller -> localhost | ok: "/var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/docs" 2025-12-03 18:37:07.432613 | 2025-12-03 18:37:07.432763 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-03 18:37:08.006517 | controller | ok 2025-12-03 18:37:08.006698 | controller | ok: All items complete 2025-12-03 18:37:08.006727 | 2025-12-03 18:37:08.440667 | controller | ok 2025-12-03 18:37:08.867789 | controller | ok 2025-12-03 18:37:08.889226 | 2025-12-03 18:37:08.889349 | TASK [include_role : fetch-output-openshift] 2025-12-03 18:37:08.903354 | controller | skipping: Conditional result was False 2025-12-03 18:37:08.909017 | 2025-12-03 18:37:08.909091 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-12-03 18:37:09.240988 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.005962 2025-12-03 18:37:09.423791 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006169 2025-12-03 18:37:09.452635 | 2025-12-03 18:37:09.452695 | PLAY [all] 2025-12-03 18:37:09.466794 | 2025-12-03 18:37:09.466872 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-12-03 18:37:09.922868 | controller | changed 2025-12-03 18:37:09.943750 | 2025-12-03 18:37:09.943808 | PLAY RECAP 2025-12-03 18:37:09.943851 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-12-03 18:37:09.943890 | 2025-12-03 18:37:10.021779 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-03 18:37:10.022619 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-12-03 18:37:10.567616 | 2025-12-03 18:37:10.567784 | PLAY [localhost] 2025-12-03 18:37:10.585015 | 2025-12-03 18:37:10.585091 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-12-03 18:37:10.896744 | localhost | changed 2025-12-03 18:37:10.901234 | 2025-12-03 18:37:10.901312 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-12-03 18:37:10.929258 | localhost | ok 2025-12-03 18:37:10.936999 | 2025-12-03 18:37:10.937069 | TASK [add-fileserver : Create SSH private key tempfile] 2025-12-03 18:37:11.238380 | localhost | changed 2025-12-03 18:37:11.244397 | 2025-12-03 18:37:11.244474 | TASK [add-fileserver : Create SSH private key from secret] 2025-12-03 18:37:11.779902 | localhost | changed 2025-12-03 18:37:11.784959 | 2025-12-03 18:37:11.785029 | TASK [add-fileserver : Add fileserver ssh key] 2025-12-03 18:37:12.106553 | localhost | Identity added: /var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/tmp/ansible.qao0eqiz (/var/lib/zuul/builds/9a2d2770fc304b35ae064f6f714ac638/work/tmp/ansible.qao0eqiz) 2025-12-03 18:37:12.106729 | localhost | ok: Runtime: 0:00:00.005379 2025-12-03 18:37:12.110819 | 2025-12-03 18:37:12.110901 | TASK [add-fileserver : Remove SSH private key from disk] 2025-12-03 18:37:12.320300 | localhost | ok: Runtime: 0:00:00.004068 2025-12-03 18:37:12.324815 | 2025-12-03 18:37:12.324896 | TASK [add-fileserver : Add fileserver to inventory] 2025-12-03 18:37:12.372216 | localhost | changed 2025-12-03 18:37:12.376954 | 2025-12-03 18:37:12.377023 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-12-03 18:37:12.677128 | localhost | changed 2025-12-03 18:37:12.696566 | 2025-12-03 18:37:12.696623 | PLAY [localhost] 2025-12-03 18:37:12.707896 | 2025-12-03 18:37:12.707983 | TASK [Generate bulk log download script] 2025-12-03 18:37:12.726043 | localhost | ok 2025-12-03 18:37:12.737397 | 2025-12-03 18:37:12.737464 | TASK [local-log-download : Check API endpoint is defined] 2025-12-03 18:37:12.764704 | localhost | ok: All assertions passed 2025-12-03 18:37:12.769118 | 2025-12-03 18:37:12.769184 | TASK [local-log-download : Create download script] 2025-12-03 18:37:13.106161 | localhost -> localhost | changed 2025-12-03 18:37:13.114844 | 2025-12-03 18:37:13.114947 | TASK [Register quick-download link] 2025-12-03 18:37:13.132114 | localhost | ok 2025-12-03 18:37:13.167137 | 2025-12-03 18:37:13.167209 | PLAY [logserver.rdoproject.org] 2025-12-03 18:37:13.177273 | 2025-12-03 18:37:13.177334 | TASK [Set zuul-log-path fact] 2025-12-03 18:37:13.192859 | logserver.rdoproject.org | ok 2025-12-03 18:37:13.201679 | 2025-12-03 18:37:13.201747 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-03 18:37:13.227211 | logserver.rdoproject.org | ok 2025-12-03 18:37:13.232331 | 2025-12-03 18:37:13.232396 | TASK [upload-logs : Create log directories] 2025-12-03 18:37:14.734267 | logserver.rdoproject.org | changed 2025-12-03 18:37:14.737334 | 2025-12-03 18:37:14.737399 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-12-03 18:37:14.964057 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005708 2025-12-03 18:37:14.968332 | 2025-12-03 18:37:14.968397 | TASK [upload-logs : Upload logs to log server] 2025-12-03 18:37:16.502469 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-12-03 18:37:16.505319 | 2025-12-03 18:37:16.505385 | LOOP [upload-logs : Compress console log and json output] 2025-12-03 18:37:16.554141 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 18:37:16.562725 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 18:37:16.573428 | 2025-12-03 18:37:16.573501 | LOOP [upload-logs : Upload compressed console log and json output] 2025-12-03 18:37:16.619348 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 18:37:16.619582 | 2025-12-03 18:37:16.623008 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 18:37:16.634280 | 2025-12-03 18:37:16.634420 | LOOP [upload-logs : Upload console log and json output]