2026-03-16 10:17:10.284662 | Job console starting...
2026-03-16 10:17:10.502854 | Updating repositories
2026-03-16 10:17:10.543669 | Preparing job workspace
2026-03-16 10:17:17.784115 | Running Ansible setup...
2026-03-16 10:17:21.532493 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-16 10:17:22.052686 | 
2026-03-16 10:17:22.052784 | PLAY [localhost]
2026-03-16 10:17:22.061909 | 
2026-03-16 10:17:22.061986 | TASK [Gathering Facts]
2026-03-16 10:17:22.891868 | localhost | ok
2026-03-16 10:17:22.911094 | 
2026-03-16 10:17:22.911270 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-16 10:17:23.280666 | localhost -> localhost | changed
2026-03-16 10:17:23.287094 | 
2026-03-16 10:17:23.287185 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-16 10:17:24.042354 | localhost -> localhost | changed
2026-03-16 10:17:24.051498 | 
2026-03-16 10:17:24.051589 | TASK [Setup log path fact]
2026-03-16 10:17:24.071908 | localhost | ok
2026-03-16 10:17:24.083528 | 
2026-03-16 10:17:24.083607 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-16 10:17:24.113054 | localhost | ok
2026-03-16 10:17:24.127483 | 
2026-03-16 10:17:24.127665 | TASK [emit-job-header : Print job information]
2026-03-16 10:17:24.168454 | # Job Information
2026-03-16 10:17:24.168607 | Ansible Version: 2.15.12
2026-03-16 10:17:24.168638 | Job: cifmw-molecule-reproducer
2026-03-16 10:17:24.168660 | Pipeline: github-check
2026-03-16 10:17:24.168680 | Executor: ibm-bm4-ze.softwarefactory-project.io
2026-03-16 10:17:24.168699 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3129
2026-03-16 10:17:24.168718 | Log URL (when completed): https://logserver.rdoproject.org/bab/rdoproject.org/bab9642638d64476bf84f5e40b69cd8e/
2026-03-16 10:17:24.168738 | Event ID: 26296340-2121-11f1-98b0-03d397bb8f4d
2026-03-16 10:17:24.172543 | 
2026-03-16 10:17:24.172613 | LOOP [emit-job-header : Print node information]
2026-03-16 10:17:24.270371 | localhost | ok:
2026-03-16 10:17:24.270642 | localhost | # Node Information
2026-03-16 10:17:24.270673 | localhost | Inventory Hostname: controller
2026-03-16 10:17:24.270704 | localhost | Hostname: np0005648211
2026-03-16 10:17:24.270727 | localhost | Username: zuul
2026-03-16 10:17:24.270749 | localhost | Distro: CentOS 9
2026-03-16 10:17:24.270769 | localhost | Provider: ibm-bm4-nodepool
2026-03-16 10:17:24.270787 | localhost | Region: regionOne
2026-03-16 10:17:24.270805 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2026-03-16 10:17:24.270823 | localhost | Product Name: OpenStack Compute
2026-03-16 10:17:24.270853 | localhost | Interface IP: 192.168.26.112
2026-03-16 10:17:24.299978 | 
2026-03-16 10:17:24.300082 | PLAY [all]
2026-03-16 10:17:24.307006 | 
2026-03-16 10:17:24.307079 | TASK [Gather network facts]
2026-03-16 10:17:24.775273 | controller | ok
2026-03-16 10:17:24.789339 | 
2026-03-16 10:17:24.789408 | TASK [include_role : start-zuul-console]
2026-03-16 10:17:24.809484 | controller | ok
2026-03-16 10:17:24.821142 | 
2026-03-16 10:17:24.821207 | TASK [start-zuul-console : Start zuul_console daemon.]
2026-03-16 10:17:25.244666 | controller | ok
2026-03-16 10:17:25.253223 | 
2026-03-16 10:17:25.253326 | TASK [include_role : add-build-sshkey]
2026-03-16 10:17:25.272813 | controller | ok
2026-03-16 10:17:25.285561 | 
2026-03-16 10:17:25.285628 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-16 10:17:25.503052 | controller -> localhost | ok
2026-03-16 10:17:25.510041 | 
2026-03-16 10:17:25.510160 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-16 10:17:25.542664 | controller | ok
2026-03-16 10:17:25.556057 | controller | included: /var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-16 10:17:25.562320 | 
2026-03-16 10:17:25.562391 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-16 10:17:26.077595 | controller -> localhost | Generating public/private rsa key pair.
2026-03-16 10:17:26.077903 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/bab9642638d64476bf84f5e40b69cd8e_id_rsa.
2026-03-16 10:17:26.077949 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/bab9642638d64476bf84f5e40b69cd8e_id_rsa.pub.
2026-03-16 10:17:26.077975 | controller -> localhost | The key fingerprint is:
2026-03-16 10:17:26.077997 | controller -> localhost | SHA256:CYM/8yyAmvuPQBgQuYO01pvQFJ7Zo3VKJ9JG6qjAZXo zuul-build-sshkey
2026-03-16 10:17:26.078017 | controller -> localhost | The key's randomart image is:
2026-03-16 10:17:26.078037 | controller -> localhost | +---[RSA 3072]----+
2026-03-16 10:17:26.078056 | controller -> localhost | |oo ...           |
2026-03-16 10:17:26.078074 | controller -> localhost | |o...B.           |
2026-03-16 10:17:26.078091 | controller -> localhost | |+.=O.Ooo         |
2026-03-16 10:17:26.078109 | controller -> localhost | |*=*+*.*o .       |
2026-03-16 10:17:26.078127 | controller -> localhost | |+*oE+.+ S        |
2026-03-16 10:17:26.078143 | controller -> localhost | |+o.o . =         |
2026-03-16 10:17:26.078159 | controller -> localhost | |=     . o        |
2026-03-16 10:17:26.078178 | controller -> localhost | | o .   .         |
2026-03-16 10:17:26.078197 | controller -> localhost | |..o..            |
2026-03-16 10:17:26.078214 | controller -> localhost | +----[SHA256]-----+
2026-03-16 10:17:26.078267 | controller -> localhost | ok: Runtime: 0:00:00.131823
2026-03-16 10:17:26.085026 | 
2026-03-16 10:17:26.085099 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-16 10:17:26.115588 | controller | ok
2026-03-16 10:17:26.126139 | controller | included: /var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-16 10:17:26.134227 | 
2026-03-16 10:17:26.134318 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-16 10:17:26.159700 | controller | skipping: Conditional result was False
2026-03-16 10:17:26.166605 | 
2026-03-16 10:17:26.166690 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-16 10:17:26.687755 | controller | changed
2026-03-16 10:17:26.693225 | 
2026-03-16 10:17:26.693344 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-16 10:17:26.977916 | controller | ok
2026-03-16 10:17:26.983160 | 
2026-03-16 10:17:26.983266 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-16 10:17:28.207938 | controller | changed
2026-03-16 10:17:28.213491 | 
2026-03-16 10:17:28.213560 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-16 10:17:29.458933 | controller | changed
2026-03-16 10:17:29.464312 | 
2026-03-16 10:17:29.464383 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-16 10:17:29.489707 | controller | skipping: Conditional result was False
2026-03-16 10:17:29.495675 | 
2026-03-16 10:17:29.495741 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-16 10:17:29.837225 | controller -> localhost | changed
2026-03-16 10:17:29.847754 | 
2026-03-16 10:17:29.847855 | TASK [add-build-sshkey : Add back temp key]
2026-03-16 10:17:30.093233 | controller -> localhost | Identity added: /var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/bab9642638d64476bf84f5e40b69cd8e_id_rsa (zuul-build-sshkey)
2026-03-16 10:17:30.093798 | controller -> localhost | ok: Runtime: 0:00:00.007507
2026-03-16 10:17:30.101915 | 
2026-03-16 10:17:30.101998 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-16 10:17:30.487218 | controller | ok
2026-03-16 10:17:30.492217 | 
2026-03-16 10:17:30.492340 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-16 10:17:30.517553 | controller | skipping: Conditional result was False
2026-03-16 10:17:30.533824 | 
2026-03-16 10:17:30.533916 | TASK [include_role : validate-host]
2026-03-16 10:17:30.552386 | controller | ok
2026-03-16 10:17:30.578464 | 
2026-03-16 10:17:30.578593 | TASK [validate-host : Define zuul_info_dir fact]
2026-03-16 10:17:30.607566 | controller | ok
2026-03-16 10:17:30.612088 | 
2026-03-16 10:17:30.612150 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2026-03-16 10:17:30.821701 | controller -> localhost | ok
2026-03-16 10:17:30.860904 | 
2026-03-16 10:17:30.861035 | TASK [validate-host : Collect information about the host]
2026-03-16 10:17:31.569461 | controller | ok
2026-03-16 10:17:31.578144 | 
2026-03-16 10:17:31.578219 | TASK [validate-host : Sanitize hostname]
2026-03-16 10:17:31.629363 | controller | ok
2026-03-16 10:17:31.634737 | 
2026-03-16 10:17:31.634809 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2026-03-16 10:17:32.027233 | controller -> localhost | changed
2026-03-16 10:17:32.033279 | 
2026-03-16 10:17:32.033368 | TASK [validate-host : Collect information about zuul worker]
2026-03-16 10:17:32.449069 | controller | ok
2026-03-16 10:17:32.453683 | 
2026-03-16 10:17:32.453755 | TASK [validate-host : Write out all zuul information for each host]
2026-03-16 10:17:32.849619 | controller -> localhost | changed
2026-03-16 10:17:32.859179 | 
2026-03-16 10:17:32.859252 | TASK [include_role : prepare-workspace-openshift]
2026-03-16 10:17:32.884885 | controller | skipping: Conditional result was False
2026-03-16 10:17:32.890002 | 
2026-03-16 10:17:32.890061 | TASK [include_role : remove-zuul-sshkey]
2026-03-16 10:17:32.915744 | controller | skipping: Conditional result was False
2026-03-16 10:17:32.921237 | 
2026-03-16 10:17:32.921326 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-16 10:17:33.216012 | controller | ok: "logs"
2026-03-16 10:17:33.216472 | controller | ok: All items complete
2026-03-16 10:17:33.216506 | 
2026-03-16 10:17:33.461134 | controller | ok: "artifacts"
2026-03-16 10:17:33.713827 | controller | ok: "docs"
2026-03-16 10:17:33.723643 | 
2026-03-16 10:17:33.723720 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-16 10:17:34.021876 | controller | changed: "logs"
2026-03-16 10:17:34.279272 | controller | changed: "artifacts"
2026-03-16 10:17:34.535956 | controller | changed: "docs"
2026-03-16 10:17:34.560655 | 
2026-03-16 10:17:34.560762 | PLAY RECAP
2026-03-16 10:17:34.560814 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-16 10:17:34.560842 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-16 10:17:34.560980 | 
2026-03-16 10:17:34.664796 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-16 10:17:34.665555 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-03-16 10:17:35.244195 | 
2026-03-16 10:17:35.244352 | PLAY [all]
2026-03-16 10:17:35.264346 | 
2026-03-16 10:17:35.264422 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-03-16 10:17:35.314903 | controller | ok
2026-03-16 10:17:35.319872 | 
2026-03-16 10:17:35.319954 | TASK [mirror-info-fork : Create /etc/ci]
2026-03-16 10:17:35.755951 | controller | changed
2026-03-16 10:17:35.761488 | 
2026-03-16 10:17:35.761563 | TASK [mirror-info-fork : Install ci_mirror script]
2026-03-16 10:17:37.129479 | controller | changed
2026-03-16 10:17:37.141325 | 
2026-03-16 10:17:37.141436 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2026-03-16 10:17:37.659559 | controller | changed:
2026-03-16 10:17:37.659804 | controller | {
2026-03-16 10:17:37.659841 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2026-03-16 10:17:37.659894 | controller | }
2026-03-16 10:17:37.968260 | controller | changed:
2026-03-16 10:17:37.968403 | controller | {
2026-03-16 10:17:37.968444 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2026-03-16 10:17:37.968474 | controller | }
2026-03-16 10:17:38.277830 | controller | changed:
2026-03-16 10:17:38.277993 | controller | {
2026-03-16 10:17:38.278022 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2026-03-16 10:17:38.278044 | controller | }
2026-03-16 10:17:38.587890 | controller | changed:
2026-03-16 10:17:38.588139 | controller | {
2026-03-16 10:17:38.588180 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2026-03-16 10:17:38.588204 | controller | }
2026-03-16 10:17:38.903645 | controller | changed:
2026-03-16 10:17:38.903790 | controller | {
2026-03-16 10:17:38.903817 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2026-03-16 10:17:38.903837 | controller | }
2026-03-16 10:17:39.215398 | controller | changed:
2026-03-16 10:17:39.215511 | controller | {
2026-03-16 10:17:39.215539 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2026-03-16 10:17:39.215560 | controller | }
2026-03-16 10:17:39.510183 | controller | changed:
2026-03-16 10:17:39.510323 | controller | {
2026-03-16 10:17:39.510355 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2026-03-16 10:17:39.510377 | controller | }
2026-03-16 10:17:39.814046 | controller | changed:
2026-03-16 10:17:39.814163 | controller | {
2026-03-16 10:17:39.814192 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2026-03-16 10:17:39.814224 | controller | }
2026-03-16 10:17:40.137517 | controller | changed:
2026-03-16 10:17:40.137644 | controller | {
2026-03-16 10:17:40.137672 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2026-03-16 10:17:40.137692 | controller | }
2026-03-16 10:17:40.456727 | controller | changed:
2026-03-16 10:17:40.456833 | controller | {
2026-03-16 10:17:40.456872 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2026-03-16 10:17:40.456896 | controller | }
2026-03-16 10:17:40.794287 | controller | changed:
2026-03-16 10:17:40.794410 | controller | {
2026-03-16 10:17:40.794437 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2026-03-16 10:17:40.794456 | controller | }
2026-03-16 10:17:41.102354 | controller | changed:
2026-03-16 10:17:41.102487 | controller | {
2026-03-16 10:17:41.102513 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2026-03-16 10:17:41.102533 | controller | }
2026-03-16 10:17:41.421421 | controller | changed:
2026-03-16 10:17:41.421552 | controller | {
2026-03-16 10:17:41.421579 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com"
2026-03-16 10:17:41.421600 | controller | }
2026-03-16 10:17:41.724111 | controller | changed:
2026-03-16 10:17:41.724248 | controller | {
2026-03-16 10:17:41.724289 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2026-03-16 10:17:41.724337 | controller | }
2026-03-16 10:17:42.041872 | controller | changed:
2026-03-16 10:17:42.041962 | controller | {
2026-03-16 10:17:42.041990 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2026-03-16 10:17:42.042013 | controller | }
2026-03-16 10:17:42.352580 | controller | changed:
2026-03-16 10:17:42.352680 | controller | {
2026-03-16 10:17:42.352707 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2026-03-16 10:17:42.352726 | controller | }
2026-03-16 10:17:42.655472 | controller | changed:
2026-03-16 10:17:42.655579 | controller | {
2026-03-16 10:17:42.655607 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2026-03-16 10:17:42.655628 | controller | }
2026-03-16 10:17:42.960605 | controller | changed:
2026-03-16 10:17:42.960710 | controller | {
2026-03-16 10:17:42.960736 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2026-03-16 10:17:42.960765 | controller | }
2026-03-16 10:17:43.257344 | controller | changed:
2026-03-16 10:17:43.257450 | controller | {
2026-03-16 10:17:43.257476 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2026-03-16 10:17:43.257496 | controller | }
2026-03-16 10:17:43.556740 | controller | changed:
2026-03-16 10:17:43.556850 | controller | {
2026-03-16 10:17:43.556893 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2026-03-16 10:17:43.556916 | controller | }
2026-03-16 10:17:43.861384 | controller | changed:
2026-03-16 10:17:43.861484 | controller | {
2026-03-16 10:17:43.861513 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2026-03-16 10:17:43.861534 | controller | }
2026-03-16 10:17:44.152472 | controller | changed:
2026-03-16 10:17:44.152633 | controller | {
2026-03-16 10:17:44.152665 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2026-03-16 10:17:44.152689 | controller | }
2026-03-16 10:17:44.445423 | controller | changed:
2026-03-16 10:17:44.445525 | controller | {
2026-03-16 10:17:44.445554 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2026-03-16 10:17:44.445577 | controller | }
2026-03-16 10:17:44.750668 | controller | changed:
2026-03-16 10:17:44.750767 | controller | {
2026-03-16 10:17:44.750796 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2026-03-16 10:17:44.750818 | controller | }
2026-03-16 10:17:45.046229 | controller | changed:
2026-03-16 10:17:45.046353 | controller | {
2026-03-16 10:17:45.046383 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2026-03-16 10:17:45.046403 | controller | }
2026-03-16 10:17:45.338976 | controller | changed:
2026-03-16 10:17:45.339090 | controller | {
2026-03-16 10:17:45.339119 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2026-03-16 10:17:45.339139 | controller | }
2026-03-16 10:17:45.355836 | 
2026-03-16 10:17:45.355926 | TASK [Set timezone to UTC]
2026-03-16 10:17:45.887796 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2026-03-16 10:17:45.892633 | 
2026-03-16 10:17:45.892698 | TASK [Create nodepool directory]
2026-03-16 10:17:46.188235 | controller | changed
2026-03-16 10:17:46.193820 | 
2026-03-16 10:17:46.193900 | TASK [Create nodepool sub_nodes file]
2026-03-16 10:17:47.178153 | controller | changed
2026-03-16 10:17:47.183245 | 
2026-03-16 10:17:47.183336 | TASK [Create nodepool sub_nodes_private file]
2026-03-16 10:17:48.129591 | controller | changed
2026-03-16 10:17:48.134778 | 
2026-03-16 10:17:48.134862 | LOOP [Populate nodepool sub_nodes file]
2026-03-16 10:17:48.165282 | 
2026-03-16 10:17:48.165443 | LOOP [Populate nodepool sub_nodes_private file]
2026-03-16 10:17:48.195012 | 
2026-03-16 10:17:48.195140 | TASK [Create nodepool primary file]
2026-03-16 10:17:48.219156 | controller | skipping: Conditional result was False
2026-03-16 10:17:48.224593 | 
2026-03-16 10:17:48.224665 | TASK [Create nodepool node_private for this node]
2026-03-16 10:17:49.217733 | controller | changed
2026-03-16 10:17:49.223217 | 
2026-03-16 10:17:49.223322 | LOOP [Copy ssh keys to nodepool directory]
2026-03-16 10:17:49.621778 | controller | ok: Item: id_rsa Runtime: 0:00:00.005423
2026-03-16 10:17:49.622025 | 
2026-03-16 10:17:49.858212 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005055
2026-03-16 10:17:49.873214 | 
2026-03-16 10:17:49.873495 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2026-03-16 10:17:50.908587 | controller | changed
2026-03-16 10:17:50.913718 | 
2026-03-16 10:17:50.913805 | TASK [Validate sudoers config after edits]
2026-03-16 10:17:51.198234 | controller | /etc/sudoers: parsed OK
2026-03-16 10:17:51.198691 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2026-03-16 10:17:51.198705 | controller | /etc/sudoers.d/zuul: parsed OK
2026-03-16 10:17:51.198712 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2026-03-16 10:17:51.441387 | controller | ok: Runtime: 0:00:00.005967
2026-03-16 10:17:51.447530 | 
2026-03-16 10:17:51.447598 | TASK [Show the environment passed in to job shell scripts]
2026-03-16 10:17:51.730144 | controller | SHELL=/bin/bash
2026-03-16 10:17:51.730206 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2026-03-16 10:17:51.730266 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2026-03-16 10:17:51.730290 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/29/3129/c2709d1cdcee3a6980b7b435eb47c9ab4330b30b
2026-03-16 10:17:51.730297 | controller | PWD=/home/zuul
2026-03-16 10:17:51.730303 | controller | ZUUL_PIPELINE=github-check
2026-03-16 10:17:51.730308 | controller | LOGNAME=zuul
2026-03-16 10:17:51.730329 | controller | XDG_SESSION_TYPE=tty
2026-03-16 10:17:51.730335 | controller | _=/usr/bin/env
2026-03-16 10:17:51.730341 | controller | MOTD_SHOWN=pam
2026-03-16 10:17:51.730346 | controller | HOME=/home/zuul
2026-03-16 10:17:51.730351 | controller | LANG=en_US.UTF-8
2026-03-16 10:17:51.730357 | controller | SSH_CONNECTION=192.168.26.12 42452 192.168.26.112 22
2026-03-16 10:17:51.730362 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2026-03-16 10:17:51.730372 | controller | ZUUL_CHANGE_IDS=3129,c2709d1cdcee3a6980b7b435eb47c9ab4330b30b
2026-03-16 10:17:51.730378 | controller | WORKSPACE=/home/zuul/workspace
2026-03-16 10:17:51.730383 | controller | XDG_SESSION_CLASS=user
2026-03-16 10:17:51.730389 | controller | SELINUX_ROLE_REQUESTED=
2026-03-16 10:17:51.730394 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2026-03-16 10:17:51.730400 | controller | USER=zuul
2026-03-16 10:17:51.730405 | controller | ZUUL_VOTING=True
2026-03-16 10:17:51.730411 | controller | BUILD_TIMEOUT=5400000
2026-03-16 10:17:51.730416 | controller | SELINUX_USE_CURRENT_RANGE=
2026-03-16 10:17:51.730422 | controller | SHLVL=1
2026-03-16 10:17:51.730427 | controller | ZUUL_PATCHSET=c2709d1cdcee3a6980b7b435eb47c9ab4330b30b
2026-03-16 10:17:51.730433 | controller | XDG_SESSION_ID=1
2026-03-16 10:17:51.730438 | controller | ZUUL_BRANCH=main
2026-03-16 10:17:51.730443 | controller | XDG_RUNTIME_DIR=/run/user/1000
2026-03-16 10:17:51.730448 | controller | SSH_CLIENT=192.168.26.12 42452 22
2026-03-16 10:17:51.730454 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2026-03-16 10:17:51.730460 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2026-03-16 10:17:51.730466 | controller | which_declare=declare -f
2026-03-16 10:17:51.730473 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2026-03-16 10:17:51.730478 | controller | SELINUX_LEVEL_REQUESTED=
2026-03-16 10:17:51.730484 | controller | ZUUL_CHANGE=3129
2026-03-16 10:17:51.730489 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2026-03-16 10:17:51.730494 | controller | ZUUL_UUID=bab9642638d64476bf84f5e40b69cd8e
2026-03-16 10:17:51.730501 | controller | BASH_FUNC_which%%=() {  ( alias;
2026-03-16 10:17:51.730507 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2026-03-16 10:17:51.730513 | controller | }
2026-03-16 10:17:51.975464 | controller | ok: Runtime: 0:00:00.006008
2026-03-16 10:17:51.981411 | 
2026-03-16 10:17:51.981494 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2026-03-16 10:17:51.995177 | controller | skipping: Conditional result was False
2026-03-16 10:17:52.000985 | 
2026-03-16 10:17:52.001054 | TASK [Symlink /home/zuul-worker/workspace]
2026-03-16 10:17:52.551768 | controller | skipping: Conditional result was False
2026-03-16 10:17:52.558388 | 
2026-03-16 10:17:52.558488 | TASK [Ensure legacy workspace directory]
2026-03-16 10:17:52.820554 | controller | changed
2026-03-16 10:17:52.839404 | 
2026-03-16 10:17:52.839484 | PLAY RECAP
2026-03-16 10:17:52.839532 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-16 10:17:52.839557 | 
2026-03-16 10:17:52.924427 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-03-16 10:17:52.925160 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-03-16 10:17:53.443119 | 
2026-03-16 10:17:53.443232 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2026-03-16 10:17:53.464078 | 
2026-03-16 10:17:53.464162 | TASK [Create zuul-output directory]
2026-03-16 10:17:53.849259 | controller | changed
2026-03-16 10:17:53.854581 | 
2026-03-16 10:17:53.854663 | TASK [Slurp Zuul inventory test]
2026-03-16 10:17:54.135675 | controller -> localhost | ok
2026-03-16 10:17:54.142262 | 
2026-03-16 10:17:54.142348 | TASK [Save zuul inventory]
2026-03-16 10:17:55.505205 | controller | changed
2026-03-16 10:17:55.510950 | 
2026-03-16 10:17:55.511020 | TASK [Save zuul vars without the change_message]
2026-03-16 10:17:56.694912 | controller | changed
2026-03-16 10:17:56.713455 | 
2026-03-16 10:17:56.713515 | PLAY RECAP
2026-03-16 10:17:56.713563 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-16 10:17:56.713585 | 
2026-03-16 10:17:56.786194 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-03-16 10:17:56.786918 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-03-16 10:17:57.338897 | 
2026-03-16 10:17:57.339016 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2026-03-16 10:17:57.359639 | 
2026-03-16 10:17:57.359711 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2026-03-16 10:17:57.379135 | controller | ok
2026-03-16 10:17:57.395705 | 
2026-03-16 10:17:57.395792 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-03-16 10:17:57.419387 | controller | skipping: Conditional result was False
2026-03-16 10:17:57.425124 | 
2026-03-16 10:17:57.425197 | TASK [mirror-info-fork : Create /etc/ci]
2026-03-16 10:17:57.829156 | controller | ok
2026-03-16 10:17:57.834788 | 
2026-03-16 10:17:57.834872 | TASK [mirror-info-fork : Install ci_mirror script]
2026-03-16 10:17:58.871240 | controller | ok
2026-03-16 10:17:58.880559 | 
2026-03-16 10:17:58.880626 | TASK [Prepare workspace]
2026-03-16 10:17:58.901936 | controller | ok
2026-03-16 10:17:58.918405 | 
2026-03-16 10:17:58.918477 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-16 10:17:59.303145 | controller | ok
2026-03-16 10:17:59.309030 | 
2026-03-16 10:17:59.309097 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-16 10:18:01.796077 | controller | Output suppressed because no_log was given
2026-03-16 10:18:01.805699 | 
2026-03-16 10:18:01.805767 | LOOP [Create zuul-output directory]
2026-03-16 10:18:02.088726 | controller | changed: "/home/zuul/ci-framework-data/logs"
2026-03-16 10:18:02.341063 | controller | ok: "/home/zuul/zuul-output/logs"
2026-03-16 10:18:02.356756 | 
2026-03-16 10:18:02.356968 | TASK [Install required packages]
2026-03-16 10:18:21.197948 | controller | ok: Nothing to do
2026-03-16 10:18:21.203478 | 
2026-03-16 10:18:21.203559 | TASK [Install venv]
2026-03-16 10:19:20.698054 | controller | changed
2026-03-16 10:19:20.725219 | 
2026-03-16 10:19:20.725391 | PLAY RECAP
2026-03-16 10:19:20.725446 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-16 10:19:20.725472 | 
2026-03-16 10:19:20.798316 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-03-16 10:19:20.799762 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-03-16 10:19:21.319253 | 
2026-03-16 10:19:21.319365 | PLAY [Run ci/playbooks/molecule-test.yml]
2026-03-16 10:19:21.339596 | 
2026-03-16 10:19:21.339666 | TASK [Gather required facts]
2026-03-16 10:19:21.866364 | controller | ok
2026-03-16 10:19:21.871627 | 
2026-03-16 10:19:21.871715 | TASK [Load environment var if instructed to]
2026-03-16 10:19:21.895934 | controller | skipping: Conditional result was False
2026-03-16 10:19:21.901289 | 
2026-03-16 10:19:21.901375 | TASK [Ensure group_vars dir exists]
2026-03-16 10:19:22.275155 | controller | ok
2026-03-16 10:19:22.280224 | 
2026-03-16 10:19:22.280291 | TASK [Print related variables]
2026-03-16 10:19:22.309380 | controller | ok:
2026-03-16 10:19:22.309486 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml
2026-03-16 10:19:22.309514 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer
2026-03-16 10:19:22.314420 | 
2026-03-16 10:19:22.314485 | TASK [Run molecule]
2026-03-16 10:19:23.336944 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2026-03-16 10:19:23.613274 | controller | INFO     Performing prerun with role_name_check=0...
2026-03-16 10:19:40.272858 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.273304 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.273777 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.274235 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.274759 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+c2709d1c was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+c2709d1c (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.275231 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.275696 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.276139 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.276615 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.277057 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.277542 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.278003 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.278465 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.278938 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.279408 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-16 10:19:40.289335 | controller | INFO     Running crc_layout > prepare
2026-03-16 10:19:40.955017 | controller |
2026-03-16 10:19:40.955109 | controller | PLAY [Prepare] *****************************************************************
2026-03-16 10:19:40.955216 | controller |
2026-03-16 10:19:40.955336 | controller | TASK [Gathering Facts] *********************************************************
2026-03-16 10:19:40.955466 | controller | Monday 16 March 2026  10:19:40 +0000 (0:00:00.019)       0:00:00.019 **********
2026-03-16 10:19:41.787293 | controller | ok: [instance]
2026-03-16 10:19:41.787393 | controller |
2026-03-16 10:19:41.787521 | controller | TASK [Create custom basedir] ***************************************************
2026-03-16 10:19:41.787653 | controller | Monday 16 March 2026  10:19:41 +0000 (0:00:00.832)       0:00:00.852 **********
2026-03-16 10:19:42.101496 | controller | changed: [instance]
2026-03-16 10:19:42.101539 | controller |
2026-03-16 10:19:42.101653 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2026-03-16 10:19:42.101748 | controller | Monday 16 March 2026  10:19:42 +0000 (0:00:00.314)       0:00:01.166 **********
2026-03-16 10:19:42.119519 | controller | skipping: [instance]
2026-03-16 10:19:42.119659 | controller |
2026-03-16 10:19:42.119749 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2026-03-16 10:19:42.119842 | controller | Monday 16 March 2026  10:19:42 +0000 (0:00:00.018)       0:00:01.185 **********
2026-03-16 10:19:42.160399 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2026-03-16 10:19:42.160485 | controller |
2026-03-16 10:19:42.160635 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2026-03-16 10:19:42.160724 | controller | Monday 16 March 2026  10:19:42 +0000 (0:00:00.040)       0:00:01.225 **********
2026-03-16 10:19:42.441718 | controller | ok: [instance]
2026-03-16 10:19:42.441792 | controller |
2026-03-16 10:19:42.441890 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2026-03-16 10:19:42.441988 | controller | Monday 16 March 2026  10:19:42 +0000 (0:00:00.281)       0:00:01.507 **********
2026-03-16 10:19:42.649439 | controller | ok: [instance]
2026-03-16 10:19:42.649487 | controller |
2026-03-16 10:19:42.649579 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2026-03-16 10:19:42.649685 | controller | Monday 16 March 2026  10:19:42 +0000 (0:00:00.207)       0:00:01.714 **********
2026-03-16 10:19:43.332114 | controller | ok: [instance] => (item=ubi-9-appstream)
2026-03-16 10:19:43.332166 | controller | ok: [instance] => (item=ubi-9-baseos)
2026-03-16 10:19:43.332494 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2026-03-16 10:19:43.332559 | controller |
2026-03-16 10:19:43.332571 | controller | TASK [Deploy repo-setup] *******************************************************
2026-03-16 10:19:43.332710 | controller | Monday 16 March 2026  10:19:43 +0000 (0:00:00.682)       0:00:02.397 **********
2026-03-16 10:19:43.391215 | controller |
2026-03-16 10:19:43.900429 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-03-16 10:19:43.900461 | controller | Monday 16 March 2026  10:19:43 +0000 (0:00:00.059)       0:00:02.456 **********
2026-03-16 10:19:43.900475 | controller | changed: [instance] => (item=tmp)
2026-03-16 10:19:43.900510 | controller | changed: [instance] => (item=artifacts/repositories)
2026-03-16 10:19:43.900518 | controller | changed: [instance] => (item=venv/repo_setup)
2026-03-16 10:19:43.900527 | controller |
2026-03-16 10:19:43.900727 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-03-16 10:19:44.730425 | controller | Monday 16 March 2026  10:19:43 +0000 (0:00:00.509)       0:00:02.965 **********
2026-03-16 10:19:44.730468 | controller | ok: [instance]
2026-03-16 10:19:44.730499 | controller |
2026-03-16 10:19:44.730516 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-03-16 10:19:44.730635 | controller | Monday 16 March 2026  10:19:44 +0000 (0:00:00.830)       0:00:03.795 **********
2026-03-16 10:19:45.847387 | controller | changed: [instance]
2026-03-16 10:19:45.847457 | controller |
2026-03-16 10:19:45.847728 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-03-16 10:19:53.475470 | controller | Monday 16 March 2026  10:19:45 +0000 (0:00:01.116)       0:00:04.912 **********
2026-03-16 10:19:53.475504 | controller | changed: [instance]
2026-03-16 10:19:53.475708 | controller |
2026-03-16 10:19:53.475743 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-03-16 10:19:54.168817 | controller | Monday 16 March 2026  10:19:53 +0000 (0:00:07.628)       0:00:12.540 **********
2026-03-16 10:19:54.168852 | controller | changed: [instance]
2026-03-16 10:19:54.189362 | controller |
2026-03-16 10:19:54.189399 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-03-16 10:19:54.189408 | controller | Monday 16 March 2026  10:19:54 +0000 (0:00:00.693)       0:00:13.233 **********
2026-03-16 10:19:54.189419 | controller | skipping: [instance]
2026-03-16 10:19:54.989911 | controller |
2026-03-16 10:19:54.989940 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-03-16 10:19:54.989950 | controller | Monday 16 March 2026  10:19:54 +0000 (0:00:00.020)       0:00:13.254 **********
2026-03-16 10:19:54.989959 | controller | changed: [instance]
2026-03-16 10:19:55.026430 | controller |
2026-03-16 10:19:55.026469 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-03-16 10:19:55.026478 | controller | Monday 16 March 2026  10:19:54 +0000 (0:00:00.800)       0:00:14.054 **********
2026-03-16 10:19:55.026490 | controller | skipping: [instance]
2026-03-16 10:19:55.063457 | controller |
2026-03-16 10:19:55.063492 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-03-16 10:19:55.063502 | controller | Monday 16 March 2026  10:19:55 +0000 (0:00:00.036)       0:00:14.091 **********
2026-03-16 10:19:55.063513 | controller | skipping: [instance]
2026-03-16 10:19:55.064152 | controller |
2026-03-16 10:19:55.099207 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-03-16 10:19:55.099226 | controller | Monday 16 March 2026  10:19:55 +0000 (0:00:00.037)       0:00:14.128 **********
2026-03-16 10:19:55.099237 | controller | skipping: [instance]
2026-03-16 10:19:55.637797 | controller |
2026-03-16 10:19:55.637830 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-03-16 10:19:55.637839 | controller | Monday 16 March 2026  10:19:55 +0000 (0:00:00.035)       0:00:14.164 **********
2026-03-16 10:19:55.637851 | controller | changed: [instance]
2026-03-16 10:19:56.079041 | controller |
2026-03-16 10:19:56.079095 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-03-16 10:19:56.079111 | controller | Monday 16 March 2026  10:19:55 +0000 (0:00:00.538)       0:00:14.702 **********
2026-03-16 10:19:56.079122 | controller | changed: [instance]
2026-03-16 10:19:56.107295 | controller |
2026-03-16 10:19:56.107339 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-03-16 10:19:56.107348 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.441)       0:00:15.144 **********
2026-03-16 10:19:56.107359 | controller | skipping: [instance]
2026-03-16 10:19:56.135412 | controller |
2026-03-16 10:19:56.135444 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-03-16 10:19:56.135452 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.028)       0:00:15.172 **********
2026-03-16 10:19:56.135466 | controller | skipping: [instance]
2026-03-16 10:19:56.135491 | controller |
2026-03-16 10:19:56.135499 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-03-16 10:19:56.135605 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.028)       0:00:15.200 **********
2026-03-16 10:19:56.165472 | controller | skipping: [instance]
2026-03-16 10:19:56.204109 | controller |
2026-03-16 10:19:56.204138 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-03-16 10:19:56.204146 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.029)       0:00:15.230 **********
2026-03-16 10:19:56.204155 | controller | ok: [instance]
2026-03-16 10:19:56.232231 | controller |
2026-03-16 10:19:56.232263 | controller | TASK [repo_setup : Create download directory] **********************************
2026-03-16 10:19:56.232271 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.038)       0:00:15.269 **********
2026-03-16 10:19:56.232295 | controller | skipping: [instance]
2026-03-16 10:19:56.261103 | controller |
2026-03-16 10:19:56.261129 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-03-16 10:19:56.261137 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.027)       0:00:15.297 **********
2026-03-16 10:19:56.261147 | controller | skipping: [instance]
2026-03-16 10:19:56.261285 | controller |
2026-03-16 10:19:56.261447 | controller | TASK [Download the RPM] ********************************************************
2026-03-16 10:19:56.261597 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.029)       0:00:15.326 **********
2026-03-16 10:19:56.288349 | controller | skipping: [instance]
2026-03-16 10:19:56.288460 | controller |
2026-03-16 10:19:56.288586 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-03-16 10:19:56.288699 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.027)       0:00:15.354 **********
2026-03-16 10:19:56.315234 | controller | skipping: [instance]
2026-03-16 10:19:56.315353 | controller |
2026-03-16 10:19:56.315474 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-03-16 10:19:56.315594 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.026)       0:00:15.380 **********
2026-03-16 10:19:56.342997 | controller | skipping: [instance]
2026-03-16 10:19:56.343102 | controller |
2026-03-16 10:19:56.343213 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-03-16 10:19:56.343328 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.027)       0:00:15.408 **********
2026-03-16 10:19:56.371178 | controller | skipping: [instance]
2026-03-16 10:19:56.371303 | controller |
2026-03-16 10:19:56.371460 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-03-16 10:19:56.371591 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.028)       0:00:15.436 **********
2026-03-16 10:19:56.397104 | controller | skipping: [instance]
2026-03-16 10:19:56.397230 | controller |
2026-03-16 10:19:56.397386 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-03-16 10:19:56.397521 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.025)       0:00:15.462 **********
2026-03-16 10:19:56.599051 | controller | ok: [instance]
2026-03-16 10:19:56.811207 | controller |
2026-03-16 10:19:56.811236 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-03-16 10:19:56.811244 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.201)       0:00:15.664 **********
2026-03-16 10:19:56.811254 | controller | changed: [instance]
2026-03-16 10:19:57.032256 | controller |
2026-03-16 10:19:57.032283 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-03-16 10:19:57.032291 | controller | Monday 16 March 2026  10:19:56 +0000 (0:00:00.212)       0:00:15.876 **********
2026-03-16 10:19:57.032301 | controller | changed: [instance]
2026-03-16 10:19:57.052954 | controller |
2026-03-16 10:19:57.052977 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-03-16 10:19:57.052986 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.220)       0:00:16.097 **********
2026-03-16 10:19:57.052998 | controller | skipping: [instance]
2026-03-16 10:19:57.074199 | controller |
2026-03-16 10:19:57.074221 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-03-16 10:19:57.074229 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.020)       0:00:16.118 **********
2026-03-16 10:19:57.074240 | controller | skipping: [instance]
2026-03-16 10:19:57.096008 | controller |
2026-03-16 10:19:57.096024 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-03-16 10:19:57.096031 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.021)       0:00:16.139 **********
2026-03-16 10:19:57.096040 | controller | skipping: [instance]
2026-03-16 10:19:57.116821 | controller |
2026-03-16 10:19:57.116839 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-03-16 10:19:57.116848 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.021)       0:00:16.161 **********
2026-03-16 10:19:57.116858 | controller | skipping: [instance]
2026-03-16 10:19:57.137840 | controller |
2026-03-16 10:19:57.137860 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-03-16 10:19:57.137882 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.020)       0:00:16.182 **********
2026-03-16 10:19:57.137893 | controller | skipping: [instance]
2026-03-16 10:19:57.159052 | controller |
2026-03-16 10:19:57.159067 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-03-16 10:19:57.159073 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.020)       0:00:16.203 **********
2026-03-16 10:19:57.159082 | controller | skipping: [instance]
2026-03-16 10:19:57.174676 | controller |
2026-03-16 10:19:57.174695 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-03-16 10:19:57.174704 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.021)       0:00:16.224 **********
2026-03-16 10:19:57.174714 | controller | skipping: [instance]
2026-03-16 10:19:57.174865 | controller |
2026-03-16 10:19:57.175022 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-03-16 10:19:57.175150 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.016)       0:00:16.240 **********
2026-03-16 10:19:57.202429 | controller | skipping: [instance]
2026-03-16 10:19:57.202613 | controller |
2026-03-16 10:19:57.202774 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-03-16 10:19:57.202937 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.027)       0:00:16.268 **********
2026-03-16 10:19:57.217498 | controller | skipping: [instance]
2026-03-16 10:19:57.217674 | controller |
2026-03-16 10:19:57.217830 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-03-16 10:19:57.217981 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.015)       0:00:16.283 **********
2026-03-16 10:19:57.236498 | controller | skipping: [instance]
2026-03-16 10:19:57.236640 | controller |
2026-03-16 10:19:57.236769 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2026-03-16 10:19:57.236894 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.019)       0:00:16.302 **********
2026-03-16 10:19:57.264703 | controller | skipping: [instance]
2026-03-16 10:19:57.264891 | controller |
2026-03-16 10:19:57.265053 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2026-03-16 10:19:57.265210 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.027)       0:00:16.330 **********
2026-03-16 10:19:57.292382 | controller | skipping: [instance]
2026-03-16 10:19:57.292562 | controller |
2026-03-16 10:19:57.292747 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2026-03-16 10:19:57.292905 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.027)       0:00:16.358 **********
2026-03-16 10:19:57.319962 | controller | skipping: [instance]
2026-03-16 10:19:57.320137 | controller |
2026-03-16 10:19:57.320301 | controller | TASK [test_deps : Install additional packages] *********************************
2026-03-16 10:19:57.320476 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.027)       0:00:16.385 **********
2026-03-16 10:19:57.349274 | controller | skipping: [instance]
2026-03-16 10:19:57.349457 | controller |
2026-03-16 10:19:57.349611 | controller | TASK [test_deps : Install selinux python libs] *********************************
2026-03-16 10:19:57.349742 | controller | Monday 16 March 2026  10:19:57 +0000 (0:00:00.029)       0:00:16.414 **********
2026-03-16 10:20:40.333260 | controller | ok: [instance]
2026-03-16 10:20:41.570286 | controller |
2026-03-16 10:20:41.570338 | controller | TASK [test_deps : Install python yaml libs] ************************************
2026-03-16 10:20:41.570349 | controller | Monday 16 March 2026  10:20:40 +0000 (0:00:42.983)       0:00:59.398 **********
2026-03-16 10:20:41.570360 | controller | ok: [instance]
2026-03-16 10:20:41.601726 | controller |
2026-03-16 10:20:41.601743 | controller | TASK [test_deps : Install extra packages] **************************************
2026-03-16 10:20:41.601750 | controller | Monday 16 March 2026  10:20:41 +0000 (0:00:01.237)       0:01:00.635 **********
2026-03-16 10:20:41.601759 | controller | skipping: [instance]
2026-03-16 10:20:41.643290 | controller |
2026-03-16 10:20:41.643327 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-03-16 10:20:41.643338 | controller | Monday 16 March 2026  10:20:41 +0000 (0:00:00.031)       0:01:00.667 **********
2026-03-16 10:20:41.643349 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2026-03-16 10:20:41.662398 | controller |
2026-03-16 10:20:41.662449 | controller | TASK [ci_setup : List packages to install] *************************************
2026-03-16 10:20:41.662461 | controller | Monday 16 March 2026  10:20:41 +0000 (0:00:00.041)       0:01:00.708 **********
2026-03-16 10:20:41.662478 | controller | ok: [instance] =>
2026-03-16 10:20:41.662520 | controller |   cifmw_ci_setup_packages:
2026-03-16 10:20:41.662530 | controller |   - bash-completion
2026-03-16 10:20:41.662537 | controller |   - ca-certificates
2026-03-16 10:20:41.662544 | controller |   - git-core
2026-03-16 10:20:41.662553 | controller |   - make
2026-03-16 10:20:41.662562 | controller |   - tar
2026-03-16 10:20:41.662591 | controller |   - tmux
2026-03-16 10:20:41.662911 | controller |   - python3-pip
2026-03-16 10:20:45.809806 | controller |
2026-03-16 10:20:45.809844 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-03-16 10:20:45.809853 | controller | Monday 16 March 2026  10:20:41 +0000 (0:00:00.018)       0:01:00.727 **********
2026-03-16 10:20:45.809864 | controller | changed: [instance]
2026-03-16 10:20:46.326204 | controller |
2026-03-16 10:20:46.326238 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-03-16 10:20:46.326246 | controller | Monday 16 March 2026  10:20:45 +0000 (0:00:04.147)       0:01:04.874 **********
2026-03-16 10:20:46.326256 | controller | ok: [instance]
2026-03-16 10:20:46.534992 | controller |
2026-03-16 10:20:46.535017 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-03-16 10:20:46.535025 | controller | Monday 16 March 2026  10:20:46 +0000 (0:00:00.516)       0:01:05.391 **********
2026-03-16 10:20:46.535035 | controller | changed: [instance]
2026-03-16 10:20:52.849030 | controller |
2026-03-16 10:20:52.849062 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-03-16 10:20:52.849070 | controller | Monday 16 March 2026  10:20:46 +0000 (0:00:00.208)       0:01:05.600 **********
2026-03-16 10:20:52.849080 | controller | changed: [instance]
2026-03-16 10:20:52.850039 | controller |
2026-03-16 10:20:52.850073 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-03-16 10:20:52.850405 | controller | Monday 16 March 2026  10:20:52 +0000 (0:00:06.312)       0:01:11.912 **********
2026-03-16 10:20:52.882432 | controller | ok: [instance]
2026-03-16 10:20:52.882484 | controller |
2026-03-16 10:20:52.882670 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-03-16 10:20:53.143191 | controller | Monday 16 March 2026  10:20:52 +0000 (0:00:00.035)       0:01:11.948 **********
2026-03-16 10:20:53.143216 | controller | changed: [instance]
2026-03-16 10:20:53.418082 | controller |
2026-03-16 10:20:53.418103 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-03-16 10:20:53.418110 | controller | Monday 16 March 2026  10:20:53 +0000 (0:00:00.260)       0:01:12.208 **********
2026-03-16 10:20:53.418120 | controller | changed: [instance]
2026-03-16 10:20:53.435781 | controller |
2026-03-16 10:20:53.435799 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-03-16 10:20:53.435806 | controller | Monday 16 March 2026  10:20:53 +0000 (0:00:00.274)       0:01:12.483 **********
2026-03-16 10:20:53.435815 | controller | skipping: [instance]
2026-03-16 10:20:53.452744 | controller |
2026-03-16 10:20:53.452762 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-03-16 10:20:53.452769 | controller | Monday 16 March 2026  10:20:53 +0000 (0:00:00.017)       0:01:12.501 **********
2026-03-16 10:20:53.452778 | controller | skipping: [instance]
2026-03-16 10:20:53.470497 | controller |
2026-03-16 10:20:53.470554 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-03-16 10:20:53.470564 | controller | Monday 16 March 2026  10:20:53 +0000 (0:00:00.016)       0:01:12.518 **********
2026-03-16 10:20:53.470578 | controller | skipping: [instance]
2026-03-16 10:20:53.470624 | controller |
2026-03-16 10:20:53.470634 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-03-16 10:20:53.470644 | controller | Monday 16 March 2026  10:20:53 +0000 (0:00:00.017)       0:01:12.536 **********
2026-03-16 10:20:53.487423 | controller | skipping: [instance]
2026-03-16 10:20:53.487725 | controller |
2026-03-16 10:20:53.504908 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-03-16 10:20:53.504932 | controller | Monday 16 March 2026  10:20:53 +0000 (0:00:00.017)       0:01:12.553 **********
2026-03-16 10:20:53.504943 | controller | skipping: [instance]
2026-03-16 10:20:53.528453 | controller |
2026-03-16 10:20:53.528489 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-03-16 10:20:53.528499 | controller | Monday 16 March 2026  10:20:53 +0000 (0:00:00.017)       0:01:12.570 **********
2026-03-16 10:20:53.528511 | controller | skipping: [instance]
2026-03-16 10:20:54.480436 | controller |
2026-03-16 10:20:54.480469 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-03-16 10:20:54.480479 | controller | Monday 16 March 2026  10:20:53 +0000 (0:00:00.023)       0:01:12.593 **********
2026-03-16 10:20:54.480492 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2026-03-16 10:20:54.480521 | controller | changed: [instance] => (item=/opt/basedir/logs)
2026-03-16 10:20:54.480528 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2026-03-16 10:20:54.480536 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2026-03-16 10:20:54.480542 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2026-03-16 10:20:54.480549 | controller |
2026-03-16 10:20:54.480558 | controller | TASK [Create secret file] ******************************************************
2026-03-16 10:20:54.480624 | controller | Monday 16 March 2026  10:20:54 +0000 (0:00:00.951)       0:01:13.545 **********
2026-03-16 10:20:54.809404 | controller | changed: [instance]
2026-03-16 10:20:54.809453 | controller |
2026-03-16 10:20:54.809464 | controller | PLAY RECAP *********************************************************************
2026-03-16 10:20:54.810416 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2026-03-16 10:20:54.811353 | controller |
2026-03-16 10:20:54.811368 | controller | Monday 16 March 2026  10:20:54 +0000 (0:00:00.329)       0:01:13.874 **********
2026-03-16 10:20:54.811375 | controller | ===============================================================================
2026-03-16 10:20:54.811380 | controller | test_deps : Install selinux python libs -------------------------------- 42.98s
2026-03-16 10:20:54.811385 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.63s
2026-03-16 10:20:54.811391 | controller | ci_setup : Install openshift client ------------------------------------- 6.31s
2026-03-16 10:20:54.811396 | controller | ci_setup : Install needed packages -------------------------------------- 4.15s
2026-03-16 10:20:54.811401 | controller | test_deps : Install python yaml libs ------------------------------------ 1.24s
2026-03-16 10:20:54.811406 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.12s
2026-03-16 10:20:54.811412 | controller | ci_setup : Manage directories ------------------------------------------- 0.95s
2026-03-16 10:20:54.811420 | controller | Gathering Facts --------------------------------------------------------- 0.83s
2026-03-16 10:20:54.811439 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.83s
2026-03-16 10:20:54.811445 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.80s
2026-03-16 10:20:54.811451 | controller | repo_setup : Install repo-setup package --------------------------------- 0.69s
2026-03-16 10:20:54.811456 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.68s
2026-03-16 10:20:54.811461 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.54s
2026-03-16 10:20:54.811467 | controller | ci_setup : Gather version of openshift client --------------------------- 0.52s
2026-03-16 10:20:54.811472 | controller | repo_setup : Ensure directories are present ----------------------------- 0.51s
2026-03-16 10:20:54.811479 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.44s
2026-03-16 10:20:54.811497 | controller | Create secret file ------------------------------------------------------ 0.33s
2026-03-16 10:20:54.811750 | controller | Create custom basedir --------------------------------------------------- 0.31s
2026-03-16 10:20:54.867677 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.28s
2026-03-16 10:20:54.867704 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.28s
2026-03-16 10:20:54.867716 | controller | INFO     Running crc_layout > converge
2026-03-16 10:20:55.471694 | controller |
2026-03-16 10:20:55.471872 | controller | PLAY [Converge] ****************************************************************
2026-03-16 10:20:55.471998 | controller |
2026-03-16 10:20:55.472126 | controller | TASK [Gathering Facts] *********************************************************
2026-03-16 10:20:55.472252 | controller | Monday 16 March 2026  10:20:55 +0000 (0:00:00.027)       0:00:00.027 **********
2026-03-16 10:20:56.277086 | controller | ok: [instance]
2026-03-16 10:20:56.296431 | controller |
2026-03-16 10:20:56.296457 | controller | TASK [Load networking definition from scenario file] ***************************
2026-03-16 10:20:56.296466 | controller | Monday 16 March 2026  10:20:56 +0000 (0:00:00.805)       0:00:00.833 **********
2026-03-16 10:20:56.296478 | controller | ok: [instance]
2026-03-16 10:20:56.312192 | controller |
2026-03-16 10:20:56.312207 | controller | TASK [discover_latest_image : Set the discovered image vars to empty/null] *****
2026-03-16 10:20:56.312214 | controller | Monday 16 March 2026  10:20:56 +0000 (0:00:00.019)       0:00:00.852 **********
2026-03-16 10:20:56.312222 | controller | ok: [instance]
2026-03-16 10:20:56.348453 | controller |
2026-03-16 10:20:56.348492 | controller | TASK [discover_latest_image : Discover images] *********************************
2026-03-16 10:20:56.348502 | controller | Monday 16 March 2026  10:20:56 +0000 (0:00:00.015)       0:00:00.868 **********
2026-03-16 10:20:56.348524 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/discover_latest_image/tasks/per-image.yml for instance => (item={'key': 'default', 'value': {'base_url': 'https://cloud.centos.org/centos/9-stream/x86_64/images/', 'qcow_prefix': 'CentOS-Stream-GenericCloud-', 'images_file': 'CHECKSUM'}})
2026-03-16 10:20:56.348565 | controller |
2026-03-16 10:20:56.348576 | controller | TASK [discover_latest_image : Ensure the current image dict entry has the expected data] ***
2026-03-16 10:20:56.348698 | controller | Monday 16 March 2026  10:20:56 +0000 (0:00:00.036)       0:00:00.905 **********
2026-03-16 10:20:56.388081 | controller | ok: [instance] => changed=false
2026-03-16 10:20:58.015341 | controller |   msg: All assertions passed
2026-03-16 10:20:58.015376 | controller |
2026-03-16 10:20:58.015387 | controller | TASK [discover_latest_image : Get latest image for the current entry] **********
2026-03-16 10:20:58.015393 | controller | Monday 16 March 2026  10:20:56 +0000 (0:00:00.039)       0:00:00.944 **********
2026-03-16 10:20:58.015403 | controller | changed: [instance]
2026-03-16 10:20:58.048441 | controller |
2026-03-16 10:20:58.048475 | controller | TASK [discover_latest_image : Append the current return value to the discovered images dict] ***
2026-03-16 10:20:58.048484 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:01.627)       0:00:02.571 **********
2026-03-16 10:20:58.048495 | controller | ok: [instance]
2026-03-16 10:20:58.048521 | controller |
2026-03-16 10:20:58.048529 | controller | TASK [discover_latest_image : Export single-image facts if an image with name 'default' was discovered] ***
2026-03-16 10:20:58.048887 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.033)       0:00:02.605 **********
2026-03-16 10:20:58.080417 | controller | ok: [instance]
2026-03-16 10:20:58.080742 | controller |
2026-03-16 10:20:58.102172 | controller | TASK [reproducer : Load CI job environment] ************************************
2026-03-16 10:20:58.102200 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.031)       0:00:02.637 **********
2026-03-16 10:20:58.102214 | controller | skipping: [instance]
2026-03-16 10:20:58.153418 | controller |
2026-03-16 10:20:58.153440 | controller | TASK [Build final libvirt layout] **********************************************
2026-03-16 10:20:58.153447 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.021)       0:00:02.658 **********
2026-03-16 10:20:58.153457 | controller |
2026-03-16 10:20:58.234827 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2026-03-16 10:20:58.234850 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.051)       0:00:02.709 **********
2026-03-16 10:20:58.234861 | controller | ok: [instance]
2026-03-16 10:20:58.302481 | controller |
2026-03-16 10:20:58.302523 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2026-03-16 10:20:58.302533 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.081)       0:00:02.791 **********
2026-03-16 10:20:58.302557 | controller | skipping: [instance]
2026-03-16 10:20:58.302645 | controller |
2026-03-16 10:20:58.302657 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2026-03-16 10:20:58.302667 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.067)       0:00:02.858 **********
2026-03-16 10:20:58.328878 | controller | ok: [instance]
2026-03-16 10:20:58.328999 | controller |
2026-03-16 10:20:58.329170 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2026-03-16 10:20:58.329272 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.026)       0:00:02.885 **********
2026-03-16 10:20:58.352329 | controller | ok: [instance] => changed=false
2026-03-16 10:20:58.352496 | controller |   msg: All assertions passed
2026-03-16 10:20:58.352605 | controller |
2026-03-16 10:20:58.352789 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2026-03-16 10:20:58.352901 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.023)       0:00:02.909 **********
2026-03-16 10:20:58.396184 | controller | ok: [instance]
2026-03-16 10:20:58.396207 | controller |
2026-03-16 10:20:58.396218 | controller | TASK [reproducer : Ensure directories are present] *****************************
2026-03-16 10:20:58.396333 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.043)       0:00:02.952 **********
2026-03-16 10:20:58.844980 | controller | ok: [instance] => (item=artifacts)
2026-03-16 10:20:58.920169 | controller | ok: [instance] => (item=logs)
2026-03-16 10:20:58.920204 | controller |
2026-03-16 10:20:58.920218 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2026-03-16 10:20:58.920229 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.448)       0:00:03.401 **********
2026-03-16 10:20:58.920245 | controller |
2026-03-16 10:20:59.103390 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2026-03-16 10:20:59.103424 | controller | Monday 16 March 2026  10:20:58 +0000 (0:00:00.075)       0:00:03.476 **********
2026-03-16 10:20:59.103438 | controller | ok: [instance]
2026-03-16 10:20:59.379913 | controller |
2026-03-16 10:20:59.379943 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2026-03-16 10:20:59.379951 | controller | Monday 16 March 2026  10:20:59 +0000 (0:00:00.183)       0:00:03.659 **********
2026-03-16 10:20:59.379961 | controller | changed: [instance]
2026-03-16 10:20:59.662462 | controller |
2026-03-16 10:20:59.662504 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2026-03-16 10:20:59.662514 | controller | Monday 16 March 2026  10:20:59 +0000 (0:00:00.276)       0:00:03.936 **********
2026-03-16 10:20:59.662528 | controller | ok: [instance]
2026-03-16 10:20:59.691705 | controller |
2026-03-16 10:20:59.691736 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2026-03-16 10:20:59.691744 | controller | Monday 16 March 2026  10:20:59 +0000 (0:00:00.282)       0:00:04.218 **********
2026-03-16 10:20:59.691760 | controller | skipping: [instance]
2026-03-16 10:20:59.709101 | controller |
2026-03-16 10:20:59.709123 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2026-03-16 10:20:59.709130 | controller | Monday 16 March 2026  10:20:59 +0000 (0:00:00.029)       0:00:04.248 **********
2026-03-16 10:20:59.709139 | controller | skipping: [instance]
2026-03-16 10:20:59.730482 | controller |
2026-03-16 10:20:59.730518 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2026-03-16 10:20:59.730526 | controller | Monday 16 March 2026  10:20:59 +0000 (0:00:00.017)       0:00:04.265 **********
2026-03-16 10:20:59.730537 | controller | ok: [instance]
2026-03-16 10:20:59.758428 | controller |
2026-03-16 10:20:59.758455 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2026-03-16 10:20:59.758465 | controller | Monday 16 March 2026  10:20:59 +0000 (0:00:00.021)       0:00:04.286 **********
2026-03-16 10:20:59.758477 | controller | skipping: [instance]
2026-03-16 10:21:08.404263 | controller |
2026-03-16 10:21:08.404297 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2026-03-16 10:21:08.404305 | controller | Monday 16 March 2026  10:20:59 +0000 (0:00:00.027)       0:00:04.314 **********
2026-03-16 10:21:08.404347 | controller | changed: [instance]
2026-03-16 10:21:08.615271 | controller |
2026-03-16 10:21:08.615301 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2026-03-16 10:21:08.615327 | controller | Monday 16 March 2026  10:21:08 +0000 (0:00:08.645)       0:00:12.960 **********
2026-03-16 10:21:08.615343 | controller | changed: [instance]
2026-03-16 10:21:08.615370 | controller |
2026-03-16 10:21:08.615378 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2026-03-16 10:21:08.615400 | controller | Monday 16 March 2026  10:21:08 +0000 (0:00:00.211)       0:00:13.171 **********
2026-03-16 10:21:09.096410 | controller | changed: [instance]
2026-03-16 10:21:09.096466 | controller |
2026-03-16 10:21:09.096647 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2026-03-16 10:21:09.673018 | controller | Monday 16 March 2026  10:21:09 +0000 (0:00:00.481)       0:00:13.652 **********
2026-03-16 10:21:09.673053 | controller | changed: [instance]
2026-03-16 10:21:09.864491 | controller |
2026-03-16 10:21:09.864527 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2026-03-16 10:21:09.864537 | controller | Monday 16 March 2026  10:21:09 +0000 (0:00:00.576)       0:00:14.229 **********
2026-03-16 10:21:09.864550 | controller | ok: [instance]
2026-03-16 10:21:10.527157 | controller |
2026-03-16 10:21:10.527187 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2026-03-16 10:21:10.527195 | controller | Monday 16 March 2026  10:21:09 +0000 (0:00:00.191)       0:00:14.420 **********
2026-03-16 10:21:10.527206 | controller | ok: [instance]
2026-03-16 10:21:11.294243 | controller |
2026-03-16 10:21:11.294277 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2026-03-16 10:21:11.294287 | controller | Monday 16 March 2026  10:21:10 +0000 (0:00:00.662)       0:00:15.083 **********
2026-03-16 10:21:11.294299 | controller | changed: [instance]
2026-03-16 10:21:11.396442 | controller |
2026-03-16 10:21:11.396480 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2026-03-16 10:21:11.396490 | controller | Monday 16 March 2026  10:21:11 +0000 (0:00:00.766)       0:00:15.850 **********
2026-03-16 10:21:11.396504 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2026-03-16 10:21:11.396537 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2026-03-16 10:21:11.396546 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2026-03-16 10:21:11.396553 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2026-03-16 10:21:11.396560 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2026-03-16 10:21:11.396567 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2026-03-16 10:21:11.396576 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2026-03-16 10:21:11.396606 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2026-03-16 10:21:11.396901 | controller |
2026-03-16 10:21:11.725220 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2026-03-16 10:21:11.725249 | controller | Monday 16 March 2026  10:21:11 +0000 (0:00:00.102)       0:00:15.952 **********
2026-03-16 10:21:11.725260 | controller | ok: [instance]
2026-03-16 10:21:12.047272 | controller |
2026-03-16 10:21:12.047301 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2026-03-16 10:21:12.047309 | controller | Monday 16 March 2026  10:21:11 +0000 (0:00:00.329)       0:00:16.281 **********
2026-03-16 10:21:12.047337 | controller | ok: [instance]
2026-03-16 10:21:12.369271 | controller |
2026-03-16 10:21:12.369300 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2026-03-16 10:21:12.369335 | controller | Monday 16 March 2026  10:21:12 +0000 (0:00:00.322)       0:00:16.603 **********
2026-03-16 10:21:12.369350 | controller | ok: [instance]
2026-03-16 10:21:12.685049 | controller |
2026-03-16 10:21:12.685077 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2026-03-16 10:21:12.685084 | controller | Monday 16 March 2026  10:21:12 +0000 (0:00:00.322)       0:00:16.925 **********
2026-03-16 10:21:12.685094 | controller | ok: [instance]
2026-03-16 10:21:13.004844 | controller |
2026-03-16 10:21:13.004872 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2026-03-16 10:21:13.004886 | controller | Monday 16 March 2026  10:21:12 +0000 (0:00:00.315)       0:00:17.241 **********
2026-03-16 10:21:13.004896 | controller | ok: [instance]
2026-03-16 10:21:13.324332 | controller |
2026-03-16 10:21:13.324364 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2026-03-16 10:21:13.324372 | controller | Monday 16 March 2026  10:21:13 +0000 (0:00:00.319)       0:00:17.561 **********
2026-03-16 10:21:13.324382 | controller | ok: [instance]
2026-03-16 10:21:13.648841 | controller |
2026-03-16 10:21:13.648906 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2026-03-16 10:21:13.648915 | controller | Monday 16 March 2026  10:21:13 +0000 (0:00:00.319)       0:00:17.880 **********
2026-03-16 10:21:13.648929 | controller | ok: [instance]
2026-03-16 10:21:13.963496 | controller |
2026-03-16 10:21:13.963547 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2026-03-16 10:21:13.963556 | controller | Monday 16 March 2026  10:21:13 +0000 (0:00:00.323)       0:00:18.204 **********
2026-03-16 10:21:13.963569 | controller | ok: [instance]
2026-03-16 10:21:14.280239 | controller |
2026-03-16 10:21:14.280286 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2026-03-16 10:21:14.280295 | controller | Monday 16 March 2026  10:21:13 +0000 (0:00:00.314)       0:00:18.518 **********
2026-03-16 10:21:14.280307 | controller | ok: [instance]
2026-03-16 10:21:14.594151 | controller |
2026-03-16 10:21:14.594214 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2026-03-16 10:21:14.594223 | controller | Monday 16 March 2026  10:21:14 +0000 (0:00:00.317)       0:00:18.835 **********
2026-03-16 10:21:14.594235 | controller | ok: [instance]
2026-03-16 10:21:14.906421 | controller |
2026-03-16 10:21:14.906460 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2026-03-16 10:21:14.906468 | controller | Monday 16 March 2026  10:21:14 +0000 (0:00:00.313)       0:00:19.149 **********
2026-03-16 10:21:14.906479 | controller | ok: [instance]
2026-03-16 10:21:14.906505 | controller |
2026-03-16 10:21:14.906703 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2026-03-16 10:21:15.220820 | controller | Monday 16 March 2026  10:21:14 +0000 (0:00:00.313)       0:00:19.462 **********
2026-03-16 10:21:15.220859 | controller | ok: [instance]
2026-03-16 10:21:15.538512 | controller |
2026-03-16 10:21:15.538544 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2026-03-16 10:21:15.538552 | controller | Monday 16 March 2026  10:21:15 +0000 (0:00:00.314)       0:00:19.776 **********
2026-03-16 10:21:15.538562 | controller | ok: [instance]
2026-03-16 10:21:15.852447 | controller |
2026-03-16 10:21:15.852487 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2026-03-16 10:21:15.852497 | controller | Monday 16 March 2026  10:21:15 +0000 (0:00:00.317)       0:00:20.094 **********
2026-03-16 10:21:15.852510 | controller | ok: [instance]
2026-03-16 10:21:15.852517 | controller |
2026-03-16 10:21:15.852524 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2026-03-16 10:21:15.852533 | controller | Monday 16 March 2026  10:21:15 +0000 (0:00:00.314)       0:00:20.408 **********
2026-03-16 10:21:16.167424 | controller | ok: [instance]
2026-03-16 10:21:16.167465 | controller |
2026-03-16 10:21:16.167478 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2026-03-16 10:21:16.167520 | controller | Monday 16 March 2026  10:21:16 +0000 (0:00:00.315)       0:00:20.723 **********
2026-03-16 10:21:16.483239 | controller | ok: [instance]
2026-03-16 10:21:16.798275 | controller |
2026-03-16 10:21:16.798309 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2026-03-16 10:21:16.798341 | controller | Monday 16 March 2026  10:21:16 +0000 (0:00:00.315)       0:00:21.039 **********
2026-03-16 10:21:16.798352 | controller | ok: [instance]
2026-03-16 10:21:17.116877 | controller |
2026-03-16 10:21:17.116910 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2026-03-16 10:21:17.116918 | controller | Monday 16 March 2026  10:21:16 +0000 (0:00:00.314)       0:00:21.354 **********
2026-03-16 10:21:17.116927 | controller | ok: [instance]
2026-03-16 10:21:17.434650 | controller |
2026-03-16 10:21:17.434685 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2026-03-16 10:21:17.434695 | controller | Monday 16 March 2026  10:21:17 +0000 (0:00:00.318)       0:00:21.673 **********
2026-03-16 10:21:17.434707 | controller | ok: [instance]
2026-03-16 10:21:17.751454 | controller |
2026-03-16 10:21:17.751493 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2026-03-16 10:21:17.751503 | controller | Monday 16 March 2026  10:21:17 +0000 (0:00:00.317)       0:00:21.990 **********
2026-03-16 10:21:17.751523 | controller | ok: [instance]
2026-03-16 10:21:17.751555 | controller |
2026-03-16 10:21:17.751767 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2026-03-16 10:21:18.067294 | controller | Monday 16 March 2026  10:21:17 +0000 (0:00:00.317)       0:00:22.307 **********
2026-03-16 10:21:18.067341 | controller | ok: [instance]
2026-03-16 10:21:18.384364 | controller |
2026-03-16 10:21:18.384390 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2026-03-16 10:21:18.384400 | controller | Monday 16 March 2026  10:21:18 +0000 (0:00:00.315)       0:00:22.623 **********
2026-03-16 10:21:18.384411 | controller | ok: [instance]
2026-03-16 10:21:18.698279 | controller |
2026-03-16 10:21:18.698334 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2026-03-16 10:21:18.698348 | controller | Monday 16 March 2026  10:21:18 +0000 (0:00:00.316)       0:00:22.940 **********
2026-03-16 10:21:18.698360 | controller | ok: [instance]
2026-03-16 10:21:19.012418 | controller |
2026-03-16 10:21:19.012451 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2026-03-16 10:21:19.012459 | controller | Monday 16 March 2026  10:21:18 +0000 (0:00:00.313)       0:00:23.254 **********
2026-03-16 10:21:19.012469 | controller | ok: [instance]
2026-03-16 10:21:19.012493 | controller |
2026-03-16 10:21:19.012501 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2026-03-16 10:21:19.012522 | controller | Monday 16 March 2026  10:21:19 +0000 (0:00:00.314)       0:00:23.568 **********
2026-03-16 10:21:19.032370 | controller | skipping: [instance]
2026-03-16 10:21:19.032606 | controller |
2026-03-16 10:21:19.032650 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2026-03-16 10:21:19.308865 | controller | Monday 16 March 2026  10:21:19 +0000 (0:00:00.020)       0:00:23.588 **********
2026-03-16 10:21:19.308892 | controller | ok: [instance]
2026-03-16 10:21:19.680445 | controller |
2026-03-16 10:21:19.680500 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2026-03-16 10:21:19.680511 | controller | Monday 16 March 2026  10:21:19 +0000 (0:00:00.276)       0:00:23.865 **********
2026-03-16 10:21:19.680527 | controller | ok: [instance]
2026-03-16 10:21:19.983766 | controller |
2026-03-16 10:21:19.983798 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2026-03-16 10:21:19.983806 | controller | Monday 16 March 2026  10:21:19 +0000 (0:00:00.371)       0:00:24.236 **********
2026-03-16 10:21:19.983816 | controller | changed: [instance]
2026-03-16 10:21:20.263945 | controller |
2026-03-16 10:21:20.263978 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2026-03-16 10:21:20.263986 | controller | Monday 16 March 2026  10:21:19 +0000 (0:00:00.303)       0:00:24.539 **********
2026-03-16 10:21:20.263996 | controller | [WARNING]: Reset is not implemented for this connection
2026-03-16 10:21:20.274098 | controller | changed: [instance]
2026-03-16 10:21:20.365450 | controller |
2026-03-16 10:21:20.365490 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2026-03-16 10:21:20.365499 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.274)       0:00:24.814 **********
2026-03-16 10:21:20.365505 | controller |
2026-03-16 10:21:20.365518 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2026-03-16 10:21:20.365524 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.015)       0:00:24.830 **********
2026-03-16 10:21:20.365534 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2026-03-16 10:21:20.365559 | controller |
2026-03-16 10:21:20.365568 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2026-03-16 10:21:20.365590 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.091)       0:00:24.922 **********
2026-03-16 10:21:20.407140 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2026-03-16 10:21:20.454460 | controller |
2026-03-16 10:21:20.454501 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-16 10:21:20.454511 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.041)       0:00:24.963 **********
2026-03-16 10:21:20.454523 | controller | ok: [instance] => (item=compute)
2026-03-16 10:21:20.454556 | controller | ok: [instance] => (item=controller)
2026-03-16 10:21:20.454955 | controller | ok: [instance] => (item=crc)
2026-03-16 10:21:20.496594 | controller |
2026-03-16 10:21:20.496617 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-16 10:21:20.496640 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.047)       0:00:25.011 **********
2026-03-16 10:21:20.496652 | controller | ok: [instance]
2026-03-16 10:21:20.496818 | controller |
2026-03-16 10:21:20.496957 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-16 10:21:20.497083 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.042)       0:00:25.053 **********
2026-03-16 10:21:20.539413 | controller | ok: [instance] => changed=false
2026-03-16 10:21:20.539598 | controller |   msg: All assertions passed
2026-03-16 10:21:20.539765 | controller |
2026-03-16 10:21:20.539922 | controller | TASK [Ensure we get latest OCP config] *****************************************
2026-03-16 10:21:20.540057 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.043)       0:00:25.096 **********
2026-03-16 10:21:20.582757 | controller |
2026-03-16 10:21:20.582946 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2026-03-16 10:21:20.583088 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.043)       0:00:25.139 **********
2026-03-16 10:21:20.663156 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.54', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2026-03-16 10:21:20.663328 | controller | ok: [instance] => (item={})
2026-03-16 10:21:20.663470 | controller |
2026-03-16 10:21:20.663602 | controller | TASK [devscripts : Check if num_masters is equal to 1 when cifmw_devscripts_sno] ***
2026-03-16 10:21:20.663742 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.080)       0:00:25.219 **********
2026-03-16 10:21:20.693069 | controller | skipping: [instance]
2026-03-16 10:21:20.693242 | controller |
2026-03-16 10:21:20.693407 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2026-03-16 10:21:20.693550 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.029)       0:00:25.249 **********
2026-03-16 10:21:20.711353 | controller | skipping: [instance]
2026-03-16 10:21:20.711540 | controller |
2026-03-16 10:21:20.711725 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2026-03-16 10:21:20.711880 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.018)       0:00:25.268 **********
2026-03-16 10:21:20.924931 | controller | ok: [instance]
2026-03-16 10:21:21.262450 | controller |
2026-03-16 10:21:21.262486 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2026-03-16 10:21:21.262504 | controller | Monday 16 March 2026  10:21:20 +0000 (0:00:00.212)       0:00:25.481 **********
2026-03-16 10:21:21.262516 | controller | changed: [instance]
2026-03-16 10:21:21.989866 | controller |
2026-03-16 10:21:21.989896 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2026-03-16 10:21:21.989904 | controller | Monday 16 March 2026  10:21:21 +0000 (0:00:00.337)       0:00:25.818 **********
2026-03-16 10:21:21.989914 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2026-03-16 10:21:21.989940 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2026-03-16 10:21:21.990412 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2026-03-16 10:21:21.990434 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2026-03-16 10:21:21.990443 | controller |
2026-03-16 10:21:21.990451 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2026-03-16 10:21:21.990460 | controller | Monday 16 March 2026  10:21:21 +0000 (0:00:00.727)       0:00:26.546 **********
2026-03-16 10:21:22.016142 | controller | skipping: [instance]
2026-03-16 10:21:22.381012 | controller |
2026-03-16 10:21:22.381041 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2026-03-16 10:21:22.381049 | controller | Monday 16 March 2026  10:21:22 +0000 (0:00:00.026)       0:00:26.572 **********
2026-03-16 10:21:22.381058 | controller | changed: [instance]
2026-03-16 10:21:22.803372 | controller |
2026-03-16 10:21:22.803402 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2026-03-16 10:21:22.803410 | controller | Monday 16 March 2026  10:21:22 +0000 (0:00:00.355)       0:00:26.928 **********
2026-03-16 10:21:22.803416 | controller |
2026-03-16 10:21:22.803421 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-16 10:21:22.803426 | controller | Monday 16 March 2026  10:21:22 +0000 (0:00:00.008)       0:00:26.937 **********
2026-03-16 10:21:22.803436 | controller | changed: [instance]
2026-03-16 10:21:22.877450 | controller |
2026-03-16 10:21:22.877482 | controller | TASK [Ensure no default networks exists] ***************************************
2026-03-16 10:21:22.877491 | controller | Monday 16 March 2026  10:21:22 +0000 (0:00:00.422)       0:00:27.359 **********
2026-03-16 10:21:22.877503 | controller |
2026-03-16 10:21:24.044814 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2026-03-16 10:21:24.044845 | controller | Monday 16 March 2026  10:21:22 +0000 (0:00:00.074)       0:00:27.433 **********
2026-03-16 10:21:24.044857 | controller | ok: [instance]
2026-03-16 10:21:24.273419 | controller |
2026-03-16 10:21:24.273464 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2026-03-16 10:21:24.273475 | controller | Monday 16 March 2026  10:21:24 +0000 (0:00:01.167)       0:00:28.600 **********
2026-03-16 10:21:24.273488 | controller | ok: [instance]
2026-03-16 10:21:24.273623 | controller |
2026-03-16 10:21:24.273666 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2026-03-16 10:21:24.790332 | controller | Monday 16 March 2026  10:21:24 +0000 (0:00:00.228)       0:00:28.829 **********
2026-03-16 10:21:24.790369 | controller | ok: [instance]
2026-03-16 10:21:25.018108 | controller |
2026-03-16 10:21:25.018137 | controller | TASK [libvirt_manager : Removing default] **************************************
2026-03-16 10:21:25.018145 | controller | Monday 16 March 2026  10:21:24 +0000 (0:00:00.516)       0:00:29.346 **********
2026-03-16 10:21:25.018155 | controller | ok: [instance]
2026-03-16 10:21:26.265125 | controller |
2026-03-16 10:21:26.265158 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2026-03-16 10:21:26.265166 | controller | Monday 16 March 2026  10:21:25 +0000 (0:00:00.227)       0:00:29.574 **********
2026-03-16 10:21:26.265177 | controller | ok: [instance]
2026-03-16 10:21:26.578653 | controller |
2026-03-16 10:21:26.578684 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2026-03-16 10:21:26.578692 | controller | Monday 16 March 2026  10:21:26 +0000 (0:00:01.246)       0:00:30.821 **********
2026-03-16 10:21:26.578703 | controller | ok: [instance]
2026-03-16 10:21:26.887477 | controller |
2026-03-16 10:21:26.887524 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2026-03-16 10:21:26.887548 | controller | Monday 16 March 2026  10:21:26 +0000 (0:00:00.313)       0:00:31.134 **********
2026-03-16 10:21:26.887565 | controller | changed: [instance]
2026-03-16 10:21:26.887645 | controller |
2026-03-16 10:21:26.887681 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2026-03-16 10:21:27.187401 | controller | Monday 16 March 2026  10:21:26 +0000 (0:00:00.308)       0:00:31.443 **********
2026-03-16 10:21:27.187439 | controller | changed: [instance]
2026-03-16 10:21:27.187721 | controller |
2026-03-16 10:21:27.759419 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2026-03-16 10:21:27.759448 | controller | Monday 16 March 2026  10:21:27 +0000 (0:00:00.299)       0:00:31.743 **********
2026-03-16 10:21:27.759460 | controller | changed: [instance] => (item=arptables)
2026-03-16 10:21:27.759487 | controller | changed: [instance] => (item=iptables)
2026-03-16 10:21:27.759493 | controller | changed: [instance] => (item=ip6tables)
2026-03-16 10:21:27.759498 | controller |
2026-03-16 10:21:27.759506 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2026-03-16 10:21:27.759588 | controller | Monday 16 March 2026  10:21:27 +0000 (0:00:00.571)       0:00:32.315 **********
2026-03-16 10:21:28.077980 | controller | ok: [instance]
2026-03-16 10:21:28.190388 | controller |
2026-03-16 10:21:28.190428 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2026-03-16 10:21:28.190437 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.318)       0:00:32.634 **********
2026-03-16 10:21:28.190448 | controller | ok: [instance]
2026-03-16 10:21:28.190474 | controller |
2026-03-16 10:21:28.190481 | controller | TASK [Ensure the required network configurations are applied] ******************
2026-03-16 10:21:28.190488 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.112)       0:00:32.746 **********
2026-03-16 10:21:28.249965 | controller |
2026-03-16 10:21:28.272234 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2026-03-16 10:21:28.272273 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.059)       0:00:32.806 **********
2026-03-16 10:21:28.272285 | controller | skipping: [instance]
2026-03-16 10:21:28.294927 | controller |
2026-03-16 10:21:28.294960 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2026-03-16 10:21:28.294968 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.022)       0:00:32.828 **********
2026-03-16 10:21:28.294979 | controller | skipping: [instance]
2026-03-16 10:21:28.316369 | controller |
2026-03-16 10:21:28.316397 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-16 10:21:28.316405 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.022)       0:00:32.851 **********
2026-03-16 10:21:28.316415 | controller | skipping: [instance]
2026-03-16 10:21:28.342791 | controller |
2026-03-16 10:21:28.342824 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2026-03-16 10:21:28.342834 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.021)       0:00:32.872 **********
2026-03-16 10:21:28.342847 | controller | skipping: [instance]
2026-03-16 10:21:28.342871 | controller |
2026-03-16 10:21:28.343042 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2026-03-16 10:21:28.343125 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.026)       0:00:32.899 **********
2026-03-16 10:21:28.385223 | controller | ok: [instance]
2026-03-16 10:21:28.385333 | controller |
2026-03-16 10:21:28.385478 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2026-03-16 10:21:28.385607 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.042)       0:00:32.942 **********
2026-03-16 10:21:28.419492 | controller | skipping: [instance]
2026-03-16 10:21:28.419593 | controller |
2026-03-16 10:21:28.419761 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2026-03-16 10:21:28.419869 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.034)       0:00:32.976 **********
2026-03-16 10:21:28.442731 | controller | skipping: [instance]
2026-03-16 10:21:28.442831 | controller |
2026-03-16 10:21:28.442942 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2026-03-16 10:21:28.443047 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.023)       0:00:32.999 **********
2026-03-16 10:21:28.498529 | controller | ok: [instance]
2026-03-16 10:21:28.498645 | controller |
2026-03-16 10:21:28.498758 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2026-03-16 10:21:28.498868 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.055)       0:00:33.055 **********
2026-03-16 10:21:28.522245 | controller | skipping: [instance]
2026-03-16 10:21:28.522373 | controller |
2026-03-16 10:21:28.522491 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2026-03-16 10:21:28.522598 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.023)       0:00:33.079 **********
2026-03-16 10:21:28.570843 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2026-03-16 10:21:28.570920 | controller |
2026-03-16 10:21:28.571077 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-03-16 10:21:28.571145 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.048)       0:00:33.127 **********
2026-03-16 10:21:28.885887 | controller | ok: [instance -> localhost]
2026-03-16 10:21:33.960943 | controller |
2026-03-16 10:21:33.960980 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2026-03-16 10:21:33.960989 | controller | Monday 16 March 2026  10:21:28 +0000 (0:00:00.314)       0:00:33.442 **********
2026-03-16 10:21:33.961005 | controller | changed: [instance -> localhost]
2026-03-16 10:21:34.150817 | controller |
2026-03-16 10:21:34.150844 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-03-16 10:21:34.150851 | controller | Monday 16 March 2026  10:21:33 +0000 (0:00:05.074)       0:00:38.517 **********
2026-03-16 10:21:34.150861 | controller | changed: [instance]
2026-03-16 10:21:34.490272 | controller |
2026-03-16 10:21:34.490301 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2026-03-16 10:21:34.490328 | controller | Monday 16 March 2026  10:21:34 +0000 (0:00:00.189)       0:00:38.707 **********
2026-03-16 10:21:34.490341 | controller | changed: [instance]
2026-03-16 10:21:36.113444 | controller |
2026-03-16 10:21:36.113486 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2026-03-16 10:21:36.113496 | controller | Monday 16 March 2026  10:21:34 +0000 (0:00:00.339)       0:00:39.046 **********
2026-03-16 10:21:36.113511 | controller | changed: [instance -> localhost]
2026-03-16 10:21:36.480269 | controller |
2026-03-16 10:21:36.480301 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2026-03-16 10:21:36.480309 | controller | Monday 16 March 2026  10:21:36 +0000 (0:00:01.623)       0:00:40.669 **********
2026-03-16 10:21:36.480349 | controller | changed: [instance]
2026-03-16 10:21:36.518461 | controller |
2026-03-16 10:21:36.518497 | controller | TASK [reproducer : Select right domain] ****************************************
2026-03-16 10:21:36.518505 | controller | Monday 16 March 2026  10:21:36 +0000 (0:00:00.366)       0:00:41.036 **********
2026-03-16 10:21:36.518517 | controller | ok: [instance]
2026-03-16 10:21:36.636523 | controller |
2026-03-16 10:21:36.636553 | controller | TASK [Create the virtual networks] *********************************************
2026-03-16 10:21:36.636561 | controller | Monday 16 March 2026  10:21:36 +0000 (0:00:00.038)       0:00:41.074 **********
2026-03-16 10:21:36.636572 | controller |
2026-03-16 10:21:36.661924 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2026-03-16 10:21:36.661942 | controller | Monday 16 March 2026  10:21:36 +0000 (0:00:00.117)       0:00:41.192 **********
2026-03-16 10:21:36.661953 | controller | ok: [instance]
2026-03-16 10:21:36.860358 | controller |
2026-03-16 10:21:36.860394 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2026-03-16 10:21:36.860402 | controller | Monday 16 March 2026  10:21:36 +0000 (0:00:00.025)       0:00:41.218 **********
2026-03-16 10:21:36.860413 | controller | ok: [instance]
2026-03-16 10:21:36.898432 | controller |
2026-03-16 10:21:36.898471 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2026-03-16 10:21:36.898481 | controller | Monday 16 March 2026  10:21:36 +0000 (0:00:00.198)       0:00:41.416 **********
2026-03-16 10:21:36.898493 | controller | skipping: [instance]
2026-03-16 10:21:36.898536 | controller |
2026-03-16 10:21:36.898547 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2026-03-16 10:21:36.898688 | controller | Monday 16 March 2026  10:21:36 +0000 (0:00:00.038)       0:00:41.454 **********
2026-03-16 10:21:36.936339 | controller | skipping: [instance]
2026-03-16 10:21:37.000029 | controller |
2026-03-16 10:21:37.000063 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2026-03-16 10:21:37.000071 | controller | Monday 16 March 2026  10:21:36 +0000 (0:00:00.037)       0:00:41.492 **********
2026-03-16 10:21:37.000082 | controller | ok: [instance]
2026-03-16 10:21:37.000223 | controller |
2026-03-16 10:21:37.000400 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2026-03-16 10:21:37.000547 | controller | Monday 16 March 2026  10:21:36 +0000 (0:00:00.063)       0:00:41.556 **********
2026-03-16 10:21:37.217793 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-16 10:21:37.217958 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-16 10:21:37.218103 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-16 10:21:37.218233 | controller |
2026-03-16 10:21:37.218391 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2026-03-16 10:21:37.218526 | controller | Monday 16 March 2026  10:21:37 +0000 (0:00:00.217)       0:00:41.774 **********
2026-03-16 10:21:37.258897 | controller | skipping: [instance]
2026-03-16 10:21:37.259072 | controller |
2026-03-16 10:21:37.259235 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2026-03-16 10:21:37.259422 | controller | Monday 16 March 2026  10:21:37 +0000 (0:00:00.041)       0:00:41.815 **********
2026-03-16 10:21:37.640365 | controller | changed: [instance]
2026-03-16 10:21:37.735454 | controller |
2026-03-16 10:21:37.735486 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2026-03-16 10:21:37.735499 | controller | Monday 16 March 2026  10:21:37 +0000 (0:00:00.380)       0:00:42.196 **********
2026-03-16 10:21:37.735510 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes)
2026-03-16 10:21:37.735828 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers)
2026-03-16 10:21:37.735847 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps)
2026-03-16 10:21:37.792348 | controller |
2026-03-16 10:21:37.792370 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-16 10:21:37.792380 | controller | Monday 16 March 2026  10:21:37 +0000 (0:00:00.095)       0:00:42.291 **********
2026-03-16 10:21:37.792391 | controller | changed: [instance]
2026-03-16 10:21:38.108759 | controller |
2026-03-16 10:21:38.108795 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-16 10:21:38.108804 | controller | Monday 16 March 2026  10:21:37 +0000 (0:00:00.056)       0:00:42.348 **********
2026-03-16 10:21:38.108816 | controller | changed: [instance]
2026-03-16 10:21:38.340078 | controller |
2026-03-16 10:21:38.340111 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-16 10:21:38.340119 | controller | Monday 16 March 2026  10:21:38 +0000 (0:00:00.316)       0:00:42.664 **********
2026-03-16 10:21:38.340130 | controller | changed: [instance]
2026-03-16 10:21:38.751005 | controller |
2026-03-16 10:21:38.751039 | controller | TASK [libvirt_manager : daniel debug] ******************************************
2026-03-16 10:21:38.751047 | controller | Monday 16 March 2026  10:21:38 +0000 (0:00:00.231)       0:00:42.895 **********
2026-03-16 10:21:38.751057 | controller | changed: [instance]
2026-03-16 10:21:38.809503 | controller |
2026-03-16 10:21:38.809537 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-16 10:21:38.809555 | controller | Monday 16 March 2026  10:21:38 +0000 (0:00:00.411)       0:00:43.307 **********
2026-03-16 10:21:38.809570 | controller | changed: [instance]
2026-03-16 10:21:39.031071 | controller |
2026-03-16 10:21:39.031108 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-16 10:21:39.031116 | controller | Monday 16 March 2026  10:21:38 +0000 (0:00:00.058)       0:00:43.365 **********
2026-03-16 10:21:39.031126 | controller | changed: [instance]
2026-03-16 10:21:39.265018 | controller |
2026-03-16 10:21:39.265054 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-16 10:21:39.265064 | controller | Monday 16 March 2026  10:21:39 +0000 (0:00:00.221)       0:00:43.587 **********
2026-03-16 10:21:39.265076 | controller | changed: [instance]
2026-03-16 10:21:39.662252 | controller |
2026-03-16 10:21:39.662286 | controller | TASK [libvirt_manager : daniel debug] ******************************************
2026-03-16 10:21:39.662294 | controller | Monday 16 March 2026  10:21:39 +0000 (0:00:00.233)       0:00:43.820 **********
2026-03-16 10:21:39.662304 | controller | changed: [instance]
2026-03-16 10:21:39.721414 | controller |
2026-03-16 10:21:39.721438 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-16 10:21:39.721447 | controller | Monday 16 March 2026  10:21:39 +0000 (0:00:00.396)       0:00:44.217 **********
2026-03-16 10:21:39.721458 | controller | changed: [instance]
2026-03-16 10:21:39.721487 | controller |
2026-03-16 10:21:39.721497 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-16 10:21:39.721624 | controller | Monday 16 March 2026  10:21:39 +0000 (0:00:00.059)       0:00:44.277 **********
2026-03-16 10:21:39.931404 | controller | changed: [instance]
2026-03-16 10:21:39.931432 | controller |
2026-03-16 10:21:39.931440 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-16 10:21:39.931448 | controller | Monday 16 March 2026  10:21:39 +0000 (0:00:00.209)       0:00:44.487 **********
2026-03-16 10:21:40.181210 | controller | changed: [instance]
2026-03-16 10:21:40.586617 | controller |
2026-03-16 10:21:40.586658 | controller | TASK [libvirt_manager : daniel debug] ******************************************
2026-03-16 10:21:40.586666 | controller | Monday 16 March 2026  10:21:40 +0000 (0:00:00.249)       0:00:44.737 **********
2026-03-16 10:21:40.586676 | controller | changed: [instance]
2026-03-16 10:21:40.806390 | controller |
2026-03-16 10:21:40.806422 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ********************
2026-03-16 10:21:40.806432 | controller | Monday 16 March 2026  10:21:40 +0000 (0:00:00.404)       0:00:45.142 **********
2026-03-16 10:21:40.806445 | controller | ok: [instance]
2026-03-16 10:21:40.806453 | controller |
2026-03-16 10:21:40.806459 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ******************
2026-03-16 10:21:40.806468 | controller | Monday 16 March 2026  10:21:40 +0000 (0:00:00.220)       0:00:45.362 **********
2026-03-16 10:21:41.343786 | controller | changed: [instance]
2026-03-16 10:21:41.374080 | controller |
2026-03-16 10:21:41.374100 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-16 10:21:41.374108 | controller | Monday 16 March 2026  10:21:41 +0000 (0:00:00.537)       0:00:45.899 **********
2026-03-16 10:21:41.374117 | controller | skipping: [instance]
2026-03-16 10:21:41.403213 | controller |
2026-03-16 10:21:41.403241 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-16 10:21:41.403250 | controller | Monday 16 March 2026  10:21:41 +0000 (0:00:00.030)       0:00:45.930 **********
2026-03-16 10:21:41.403261 | controller | skipping: [instance]
2026-03-16 10:21:41.432514 | controller |
2026-03-16 10:21:41.432621 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-16 10:21:41.432637 | controller | Monday 16 March 2026  10:21:41 +0000 (0:00:00.029)       0:00:45.959 **********
2026-03-16 10:21:41.432680 | controller | skipping: [instance]
2026-03-16 10:21:41.462425 | controller |
2026-03-16 10:21:41.462452 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-16 10:21:41.462461 | controller | Monday 16 March 2026  10:21:41 +0000 (0:00:00.029)       0:00:45.988 **********
2026-03-16 10:21:41.462474 | controller | skipping: [instance]
2026-03-16 10:21:41.462542 | controller |
2026-03-16 10:21:41.462570 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-16 10:21:41.462582 | controller | Monday 16 March 2026  10:21:41 +0000 (0:00:00.029)       0:00:46.018 **********
2026-03-16 10:21:41.486362 | controller | ok: [instance]
2026-03-16 10:21:41.581214 | controller |
2026-03-16 10:21:41.581244 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-16 10:21:41.581254 | controller | Monday 16 March 2026  10:21:41 +0000 (0:00:00.023)       0:00:46.042 **********
2026-03-16 10:21:41.581271 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-03-16 10:21:41.605632 | controller |
2026-03-16 10:21:41.605663 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-16 10:21:41.605671 | controller | Monday 16 March 2026  10:21:41 +0000 (0:00:00.094)       0:00:46.137 **********
2026-03-16 10:21:41.605680 | controller | skipping: [instance]
2026-03-16 10:21:41.605815 | controller |
2026-03-16 10:21:41.605958 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-16 10:21:41.606086 | controller | Monday 16 March 2026  10:21:41 +0000 (0:00:00.024)       0:00:46.162 **********
2026-03-16 10:21:41.826109 | controller | changed: [instance]
2026-03-16 10:21:42.253982 | controller |
2026-03-16 10:21:42.254016 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-16 10:21:42.254024 | controller | Monday 16 March 2026  10:21:41 +0000 (0:00:00.219)       0:00:46.382 **********
2026-03-16 10:21:42.254035 | controller | changed: [instance]
2026-03-16 10:21:42.318924 | controller |
2026-03-16 10:21:42.318953 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-16 10:21:42.318960 | controller | Monday 16 March 2026  10:21:42 +0000 (0:00:00.427)       0:00:46.809 **********
2026-03-16 10:21:42.318970 | controller | ok: [instance]
2026-03-16 10:21:42.353499 | controller |
2026-03-16 10:21:42.353529 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-16 10:21:42.353539 | controller | Monday 16 March 2026  10:21:42 +0000 (0:00:00.065)       0:00:46.875 **********
2026-03-16 10:21:42.353551 | controller | ok: [instance]
2026-03-16 10:21:42.353582 | controller |
2026-03-16 10:21:42.353592 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-16 10:21:42.353697 | controller | Monday 16 March 2026  10:21:42 +0000 (0:00:00.034)       0:00:46.909 **********
2026-03-16 10:21:42.777064 | controller | changed: [instance]
2026-03-16 10:21:42.918557 | controller |
2026-03-16 10:21:42.918599 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2026-03-16 10:21:42.918609 | controller | Monday 16 March 2026  10:21:42 +0000 (0:00:00.423)       0:00:47.333 **********
2026-03-16 10:21:42.918621 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2026-03-16 10:21:42.918642 | controller |
2026-03-16 10:21:42.918664 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2026-03-16 10:21:42.918674 | controller | Monday 16 March 2026  10:21:42 +0000 (0:00:00.141)       0:00:47.474 **********
2026-03-16 10:21:42.974055 | controller | ok: [instance] => (item=public)
2026-03-16 10:21:42.974144 | controller | ok: [instance] => (item=osp_trunk)
2026-03-16 10:21:42.974237 | controller |
2026-03-16 10:21:42.974484 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2026-03-16 10:21:43.443550 | controller | Monday 16 March 2026  10:21:42 +0000 (0:00:00.055)       0:00:47.530 **********
2026-03-16 10:21:43.443636 | controller | changed: [instance] => (item=cifmw-public)
2026-03-16 10:21:44.080264 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:21:44.080330 | controller |
2026-03-16 10:21:44.080343 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2026-03-16 10:21:44.080350 | controller | Monday 16 March 2026  10:21:43 +0000 (0:00:00.468)       0:00:47.999 **********
2026-03-16 10:21:44.080361 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 10:21:44.080395 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:21:44.080425 | controller |
2026-03-16 10:21:44.080703 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2026-03-16 10:21:44.576403 | controller | Monday 16 March 2026  10:21:44 +0000 (0:00:00.637)       0:00:48.636 **********
2026-03-16 10:21:44.576464 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 10:21:44.576539 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:21:44.576567 | controller |
2026-03-16 10:21:44.576575 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2026-03-16 10:21:44.576586 | controller | Monday 16 March 2026  10:21:44 +0000 (0:00:00.495)       0:00:49.132 **********
2026-03-16 10:21:45.068428 | controller | changed: [instance] => (item=cifmw-public)
2026-03-16 10:21:45.068483 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:21:45.068491 | controller |
2026-03-16 10:21:45.068499 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2026-03-16 10:21:45.068611 | controller | Monday 16 March 2026  10:21:45 +0000 (0:00:00.492)       0:00:49.624 **********
2026-03-16 10:21:45.133405 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2026-03-16 10:21:45.133612 | controller |
2026-03-16 10:21:45.133626 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2026-03-16 10:21:45.133636 | controller | Monday 16 March 2026  10:21:45 +0000 (0:00:00.064)       0:00:49.689 **********
2026-03-16 10:21:45.329195 | controller | ok: [instance]
2026-03-16 10:21:45.738486 | controller |
2026-03-16 10:21:45.738518 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2026-03-16 10:21:45.738526 | controller | Monday 16 March 2026  10:21:45 +0000 (0:00:00.196)       0:00:49.885 **********
2026-03-16 10:21:45.738536 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 10:21:45.815951 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:21:45.815970 | controller |
2026-03-16 10:21:45.815978 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2026-03-16 10:21:45.815984 | controller | Monday 16 March 2026  10:21:45 +0000 (0:00:00.409)       0:00:50.294 **********
2026-03-16 10:21:45.815992 | controller |
2026-03-16 10:21:45.855244 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-03-16 10:21:45.855266 | controller | Monday 16 March 2026  10:21:45 +0000 (0:00:00.077)       0:00:50.372 **********
2026-03-16 10:21:45.855285 | controller | skipping: [instance]
2026-03-16 10:21:47.236451 | controller |
2026-03-16 10:21:47.236491 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2026-03-16 10:21:47.236501 | controller | Monday 16 March 2026  10:21:45 +0000 (0:00:00.039)       0:00:50.411 **********
2026-03-16 10:21:47.236513 | controller | ok: [instance]
2026-03-16 10:21:47.438292 | controller |
2026-03-16 10:21:47.438346 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-03-16 10:21:47.438355 | controller | Monday 16 March 2026  10:21:47 +0000 (0:00:01.380)       0:00:51.792 **********
2026-03-16 10:21:47.438366 | controller | ok: [instance]
2026-03-16 10:21:47.833863 | controller |
2026-03-16 10:21:47.833906 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2026-03-16 10:21:47.833914 | controller | Monday 16 March 2026  10:21:47 +0000 (0:00:00.201)       0:00:51.994 **********
2026-03-16 10:21:47.833925 | controller | changed: [instance]
2026-03-16 10:21:49.565175 | controller |
2026-03-16 10:21:49.565207 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2026-03-16 10:21:49.565215 | controller | Monday 16 March 2026  10:21:47 +0000 (0:00:00.395)       0:00:52.389 **********
2026-03-16 10:21:49.565233 | controller | changed: [instance]
2026-03-16 10:21:49.936942 | controller |
2026-03-16 10:21:49.936969 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2026-03-16 10:21:49.936978 | controller | Monday 16 March 2026  10:21:49 +0000 (0:00:01.731)       0:00:54.121 **********
2026-03-16 10:21:49.936987 | controller | changed: [instance]
2026-03-16 10:21:49.971471 | controller |
2026-03-16 10:21:49.971508 | controller | TASK [Create extra network configuration] **************************************
2026-03-16 10:21:49.971518 | controller | Monday 16 March 2026  10:21:49 +0000 (0:00:00.372)       0:00:54.493 **********
2026-03-16 10:21:49.971530 | controller | skipping: [instance]
2026-03-16 10:21:49.971565 | controller |
2026-03-16 10:21:49.971574 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2026-03-16 10:21:49.971761 | controller | Monday 16 March 2026  10:21:49 +0000 (0:00:00.034)       0:00:54.527 **********
2026-03-16 10:21:50.004109 | controller | skipping: [instance]
2026-03-16 10:21:50.529902 | controller |
2026-03-16 10:21:50.529934 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2026-03-16 10:21:50.529942 | controller | Monday 16 March 2026  10:21:50 +0000 (0:00:00.032)       0:00:54.560 **********
2026-03-16 10:21:50.529953 | controller | ok: [instance]
2026-03-16 10:21:50.698220 | controller |
2026-03-16 10:21:50.698246 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2026-03-16 10:21:50.698254 | controller | Monday 16 March 2026  10:21:50 +0000 (0:00:00.525)       0:00:55.085 **********
2026-03-16 10:21:50.698263 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 10:21:52.064886 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:21:52.064920 | controller |
2026-03-16 10:21:52.064928 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2026-03-16 10:21:52.064934 | controller | Monday 16 March 2026  10:21:50 +0000 (0:00:00.168)       0:00:55.254 **********
2026-03-16 10:21:52.064943 | controller | ok: [instance]
2026-03-16 10:21:56.044081 | controller |
2026-03-16 10:21:56.044123 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2026-03-16 10:21:56.044133 | controller | Monday 16 March 2026  10:21:52 +0000 (0:00:01.366)       0:00:56.620 **********
2026-03-16 10:21:56.044145 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2026-03-16 10:21:56.305331 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2026-03-16 10:21:56.305367 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2026-03-16 10:21:56.305381 | controller |
2026-03-16 10:21:56.305387 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2026-03-16 10:21:56.305393 | controller | Monday 16 March 2026  10:21:56 +0000 (0:00:03.978)       0:01:00.599 **********
2026-03-16 10:21:56.305403 | controller | changed: [instance]
2026-03-16 10:21:56.706001 | controller |
2026-03-16 10:21:56.706040 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2026-03-16 10:21:56.706049 | controller | Monday 16 March 2026  10:21:56 +0000 (0:00:00.261)       0:01:00.861 **********
2026-03-16 10:21:56.706059 | controller | changed: [instance]
2026-03-16 10:21:57.170276 | controller |
2026-03-16 10:21:57.170339 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2026-03-16 10:21:57.170352 | controller | Monday 16 March 2026  10:21:56 +0000 (0:00:00.400)       0:01:01.261 **********
2026-03-16 10:21:57.170362 | controller | changed: [instance]
2026-03-16 10:21:57.204472 | controller |
2026-03-16 10:21:57.204510 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2026-03-16 10:21:57.204518 | controller | Monday 16 March 2026  10:21:57 +0000 (0:00:00.464)       0:01:01.726 **********
2026-03-16 10:21:57.204530 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2026-03-16 10:21:57.204555 | controller |
2026-03-16 10:21:57.204731 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2026-03-16 10:21:57.623826 | controller | Monday 16 March 2026  10:21:57 +0000 (0:00:00.034)       0:01:01.761 **********
2026-03-16 10:21:57.623868 | controller | changed: [instance]
2026-03-16 10:21:57.645532 | controller |
2026-03-16 10:21:57.645584 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2026-03-16 10:21:57.645598 | controller | Monday 16 March 2026  10:21:57 +0000 (0:00:00.418)       0:01:02.179 **********
2026-03-16 10:21:57.645616 | controller | skipping: [instance]
2026-03-16 10:21:57.645627 | controller |
2026-03-16 10:21:57.645640 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2026-03-16 10:21:57.682462 | controller | Monday 16 March 2026  10:21:57 +0000 (0:00:00.022)       0:01:02.202 **********
2026-03-16 10:21:57.682489 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2026-03-16 10:21:57.682709 | controller |
2026-03-16 10:21:57.682739 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2026-03-16 10:21:58.087061 | controller | Monday 16 March 2026  10:21:57 +0000 (0:00:00.036)       0:01:02.239 **********
2026-03-16 10:21:58.087103 | controller | changed: [instance]
2026-03-16 10:21:58.109085 | controller |
2026-03-16 10:21:58.109108 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2026-03-16 10:21:58.109117 | controller | Monday 16 March 2026  10:21:58 +0000 (0:00:00.404)       0:01:02.643 **********
2026-03-16 10:21:58.109128 | controller | skipping: [instance]
2026-03-16 10:21:58.361996 | controller |
2026-03-16 10:21:58.362024 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2026-03-16 10:21:58.362034 | controller | Monday 16 March 2026  10:21:58 +0000 (0:00:00.021)       0:01:02.665 **********
2026-03-16 10:21:58.362045 | controller | ok: [instance] => (item=127.0.0.2)
2026-03-16 10:21:59.116331 | controller |
2026-03-16 10:21:59.116365 | controller | TASK [dnsmasq : Enable and start service] **************************************
2026-03-16 10:21:59.116373 | controller | Monday 16 March 2026  10:21:58 +0000 (0:00:00.253)       0:01:02.918 **********
2026-03-16 10:21:59.116383 | controller | changed: [instance]
2026-03-16 10:21:59.138049 | controller |
2026-03-16 10:21:59.138075 | controller | TASK [dnsmasq : Stop service] **************************************************
2026-03-16 10:21:59.138082 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.754)       0:01:03.672 **********
2026-03-16 10:21:59.138092 | controller | skipping: [instance]
2026-03-16 10:21:59.156740 | controller |
2026-03-16 10:21:59.156763 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2026-03-16 10:21:59.156771 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.021)       0:01:03.694 **********
2026-03-16 10:21:59.156782 | controller | skipping: [instance]
2026-03-16 10:21:59.188448 | controller |
2026-03-16 10:21:59.188525 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2026-03-16 10:21:59.188535 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.018)       0:01:03.713 **********
2026-03-16 10:21:59.188555 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-03-16 10:21:59.311947 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2026-03-16 10:21:59.311982 | controller | skipping: [instance]
2026-03-16 10:21:59.311990 | controller |
2026-03-16 10:21:59.311996 | controller | TASK [Create dnsmasq networks] *************************************************
2026-03-16 10:21:59.312002 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.031)       0:01:03.744 **********
2026-03-16 10:21:59.312012 | controller |
2026-03-16 10:21:59.346032 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-03-16 10:21:59.346054 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.123)       0:01:03.868 **********
2026-03-16 10:21:59.346064 | controller | ok: [instance] => changed=false
2026-03-16 10:21:59.388002 | controller |   msg: All assertions passed
2026-03-16 10:21:59.388022 | controller |
2026-03-16 10:21:59.388029 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-03-16 10:21:59.388034 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.034)       0:01:03.902 **********
2026-03-16 10:21:59.388043 | controller | ok: [instance] => changed=false
2026-03-16 10:21:59.891897 | controller |   msg: All assertions passed
2026-03-16 10:21:59.891930 | controller |
2026-03-16 10:21:59.891938 | controller | TASK [dnsmasq : Create network] ************************************************
2026-03-16 10:21:59.891945 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.041)       0:01:03.944 **********
2026-03-16 10:21:59.891955 | controller | changed: [instance]
2026-03-16 10:21:59.916432 | controller |
2026-03-16 10:21:59.916476 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-03-16 10:21:59.916487 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.503)       0:01:04.447 **********
2026-03-16 10:21:59.916503 | controller | skipping: [instance]
2026-03-16 10:21:59.916554 | controller |
2026-03-16 10:21:59.916564 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-03-16 10:21:59.916604 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.024)       0:01:04.472 **********
2026-03-16 10:21:59.948330 | controller | skipping: [instance]
2026-03-16 10:21:59.988477 | controller |
2026-03-16 10:21:59.988530 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-03-16 10:21:59.988541 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.031)       0:01:04.504 **********
2026-03-16 10:21:59.988558 | controller | ok: [instance] => changed=false
2026-03-16 10:21:59.988610 | controller |   msg: All assertions passed
2026-03-16 10:21:59.988620 | controller |
2026-03-16 10:21:59.988873 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-03-16 10:22:00.034562 | controller | Monday 16 March 2026  10:21:59 +0000 (0:00:00.039)       0:01:04.544 **********
2026-03-16 10:22:00.034649 | controller | ok: [instance] => changed=false
2026-03-16 10:22:00.034720 | controller |   msg: All assertions passed
2026-03-16 10:22:00.034736 | controller |
2026-03-16 10:22:00.034747 | controller | TASK [dnsmasq : Create network] ************************************************
2026-03-16 10:22:00.034762 | controller | Monday 16 March 2026  10:22:00 +0000 (0:00:00.045)       0:01:04.590 **********
2026-03-16 10:22:00.527257 | controller | changed: [instance]
2026-03-16 10:22:00.549070 | controller |
2026-03-16 10:22:00.549092 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-03-16 10:22:00.549102 | controller | Monday 16 March 2026  10:22:00 +0000 (0:00:00.492)       0:01:05.083 **********
2026-03-16 10:22:00.549121 | controller | skipping: [instance]
2026-03-16 10:22:00.575486 | controller |
2026-03-16 10:22:00.575534 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-03-16 10:22:00.575544 | controller | Monday 16 March 2026  10:22:00 +0000 (0:00:00.022)       0:01:05.105 **********
2026-03-16 10:22:00.575558 | controller | skipping: [instance]
2026-03-16 10:22:00.611050 | controller |
2026-03-16 10:22:00.611081 | controller | TASK [Deploy radvd for IPv6 router advertisements] *****************************
2026-03-16 10:22:00.611090 | controller | Monday 16 March 2026  10:22:00 +0000 (0:00:00.026)       0:01:05.131 **********
2026-03-16 10:22:00.611100 | controller | skipping: [instance]
2026-03-16 10:22:01.193057 | controller |
2026-03-16 10:22:01.193099 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2026-03-16 10:22:01.193113 | controller | Monday 16 March 2026  10:22:00 +0000 (0:00:00.035)       0:01:05.166 **********
2026-03-16 10:22:01.193126 | controller | changed: [instance] => (item=cifmw-public)
2026-03-16 10:22:01.232782 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:22:01.232814 | controller |
2026-03-16 10:22:01.232822 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-16 10:22:01.232829 | controller | Monday 16 March 2026  10:22:01 +0000 (0:00:00.581)       0:01:05.748 **********
2026-03-16 10:22:01.232841 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2026-03-16 10:22:01.591438 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2026-03-16 10:22:01.591479 | controller |
2026-03-16 10:22:01.591488 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-16 10:22:01.591497 | controller | Monday 16 March 2026  10:22:01 +0000 (0:00:00.039)       0:01:05.788 **********
2026-03-16 10:22:01.591510 | controller | ok: [instance]
2026-03-16 10:22:01.640385 | controller |
2026-03-16 10:22:01.640407 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-03-16 10:22:01.640416 | controller | Monday 16 March 2026  10:22:01 +0000 (0:00:00.358)       0:01:06.147 **********
2026-03-16 10:22:01.640428 | controller | ok: [instance]
2026-03-16 10:22:01.864421 | controller |
2026-03-16 10:22:01.864464 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-16 10:22:01.864474 | controller | Monday 16 March 2026  10:22:01 +0000 (0:00:00.049)       0:01:06.196 **********
2026-03-16 10:22:01.864489 | controller | ok: [instance]
2026-03-16 10:22:01.864527 | controller |
2026-03-16 10:22:01.864861 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-03-16 10:22:01.908300 | controller | Monday 16 March 2026  10:22:01 +0000 (0:00:00.224)       0:01:06.420 **********
2026-03-16 10:22:01.908353 | controller | ok: [instance]
2026-03-16 10:22:02.294126 | controller |
2026-03-16 10:22:02.294155 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2026-03-16 10:22:02.294163 | controller | Monday 16 March 2026  10:22:01 +0000 (0:00:00.043)       0:01:06.464 **********
2026-03-16 10:22:02.294174 | controller | changed: [instance]
2026-03-16 10:22:02.677231 | controller |
2026-03-16 10:22:02.677270 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2026-03-16 10:22:02.677278 | controller | Monday 16 March 2026  10:22:02 +0000 (0:00:00.385)       0:01:06.850 **********
2026-03-16 10:22:02.677287 | controller | changed: [instance]
2026-03-16 10:22:03.060873 | controller |
2026-03-16 10:22:03.060902 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2026-03-16 10:22:03.060910 | controller | Monday 16 March 2026  10:22:02 +0000 (0:00:00.383)       0:01:07.233 **********
2026-03-16 10:22:03.060920 | controller | changed: [instance]
2026-03-16 10:22:03.169499 | controller |
2026-03-16 10:22:03.169539 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2026-03-16 10:22:03.169549 | controller | Monday 16 March 2026  10:22:03 +0000 (0:00:00.383)       0:01:07.617 **********
2026-03-16 10:22:03.169562 | controller | ok: [instance]
2026-03-16 10:22:03.559778 | controller |
2026-03-16 10:22:03.559818 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2026-03-16 10:22:03.559826 | controller | Monday 16 March 2026  10:22:03 +0000 (0:00:00.108)       0:01:07.725 **********
2026-03-16 10:22:03.559836 | controller | changed: [instance]
2026-03-16 10:22:03.589330 | controller |
2026-03-16 10:22:03.589359 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-16 10:22:03.589368 | controller | Monday 16 March 2026  10:22:03 +0000 (0:00:00.390)       0:01:08.115 **********
2026-03-16 10:22:03.589378 | controller | skipping: [instance]
2026-03-16 10:22:03.618931 | controller |
2026-03-16 10:22:03.618951 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-16 10:22:03.618960 | controller | Monday 16 March 2026  10:22:03 +0000 (0:00:00.029)       0:01:08.145 **********
2026-03-16 10:22:03.618978 | controller | skipping: [instance]
2026-03-16 10:22:03.649086 | controller |
2026-03-16 10:22:03.649106 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-16 10:22:03.649122 | controller | Monday 16 March 2026  10:22:03 +0000 (0:00:00.029)       0:01:08.175 **********
2026-03-16 10:22:03.649133 | controller | skipping: [instance]
2026-03-16 10:22:03.685087 | controller |
2026-03-16 10:22:03.685109 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-16 10:22:03.685118 | controller | Monday 16 March 2026  10:22:03 +0000 (0:00:00.030)       0:01:08.205 **********
2026-03-16 10:22:03.685129 | controller | skipping: [instance]
2026-03-16 10:22:03.708830 | controller |
2026-03-16 10:22:03.708849 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-16 10:22:03.708856 | controller | Monday 16 March 2026  10:22:03 +0000 (0:00:00.035)       0:01:08.241 **********
2026-03-16 10:22:03.708865 | controller | ok: [instance]
2026-03-16 10:22:03.814460 | controller |
2026-03-16 10:22:03.814497 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-16 10:22:03.814506 | controller | Monday 16 March 2026  10:22:03 +0000 (0:00:00.023)       0:01:08.265 **********
2026-03-16 10:22:03.814519 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-03-16 10:22:03.842061 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2026-03-16 10:22:03.842086 | controller |
2026-03-16 10:22:03.842094 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-16 10:22:03.842100 | controller | Monday 16 March 2026  10:22:03 +0000 (0:00:00.105)       0:01:08.370 **********
2026-03-16 10:22:03.842109 | controller | skipping: [instance]
2026-03-16 10:22:04.076430 | controller |
2026-03-16 10:22:04.076602 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-16 10:22:04.076616 | controller | Monday 16 March 2026  10:22:03 +0000 (0:00:00.027)       0:01:08.398 **********
2026-03-16 10:22:04.076636 | controller | ok: [instance]
2026-03-16 10:22:04.556755 | controller |
2026-03-16 10:22:04.556790 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-16 10:22:04.556798 | controller | Monday 16 March 2026  10:22:04 +0000 (0:00:00.234)       0:01:08.632 **********
2026-03-16 10:22:04.556809 | controller | changed: [instance]
2026-03-16 10:22:04.626617 | controller |
2026-03-16 10:22:04.626646 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-16 10:22:04.626654 | controller | Monday 16 March 2026  10:22:04 +0000 (0:00:00.480)       0:01:09.112 **********
2026-03-16 10:22:04.626674 | controller | ok: [instance]
2026-03-16 10:22:04.661514 | controller |
2026-03-16 10:22:04.661544 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-16 10:22:04.661554 | controller | Monday 16 March 2026  10:22:04 +0000 (0:00:00.070)       0:01:09.182 **********
2026-03-16 10:22:04.661566 | controller | ok: [instance]
2026-03-16 10:22:05.190140 | controller |
2026-03-16 10:22:05.190178 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-16 10:22:05.190188 | controller | Monday 16 March 2026  10:22:04 +0000 (0:00:00.034)       0:01:09.217 **********
2026-03-16 10:22:05.190201 | controller | changed: [instance]
2026-03-16 10:22:05.230406 | controller |
2026-03-16 10:22:05.230437 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2026-03-16 10:22:05.230448 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.528)       0:01:09.745 **********
2026-03-16 10:22:05.230461 | controller | ok: [instance]
2026-03-16 10:22:05.253094 | controller |
2026-03-16 10:22:05.253118 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2026-03-16 10:22:05.253127 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.040)       0:01:09.786 **********
2026-03-16 10:22:05.253139 | controller | ok: [instance]
2026-03-16 10:22:05.274291 | controller |
2026-03-16 10:22:05.274334 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2026-03-16 10:22:05.274349 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.022)       0:01:09.809 **********
2026-03-16 10:22:05.274360 | controller | ok: [instance]
2026-03-16 10:22:05.362484 | controller |
2026-03-16 10:22:05.362520 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2026-03-16 10:22:05.362530 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.021)       0:01:09.830 **********
2026-03-16 10:22:05.362543 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2026-03-16 10:22:05.362578 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2026-03-16 10:22:05.362586 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2026-03-16 10:22:05.362593 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2026-03-16 10:22:05.362599 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2026-03-16 10:22:05.362606 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2026-03-16 10:22:05.362613 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2026-03-16 10:22:05.362620 | controller |
2026-03-16 10:22:05.362629 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 10:22:05.362638 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.087)       0:01:09.918 **********
2026-03-16 10:22:05.511622 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2026-03-16 10:22:05.511731 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2026-03-16 10:22:05.511742 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2026-03-16 10:22:05.511750 | controller |
2026-03-16 10:22:05.511763 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 10:22:05.511875 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.149)       0:01:10.067 **********
2026-03-16 10:22:05.602754 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2026-03-16 10:22:05.602805 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2026-03-16 10:22:05.602989 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2026-03-16 10:22:05.603117 | controller | skipping: [instance]
2026-03-16 10:22:05.603231 | controller |
2026-03-16 10:22:05.603394 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 10:22:05.603496 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.091)       0:01:10.159 **********
2026-03-16 10:22:05.693513 | controller | skipping: [instance] => (item=compute-0 - storage)
2026-03-16 10:22:05.693594 | controller | skipping: [instance] => (item=controller-0 - storage)
2026-03-16 10:22:05.693756 | controller | skipping: [instance] => (item=crc-0 - storage)
2026-03-16 10:22:05.693850 | controller | skipping: [instance]
2026-03-16 10:22:05.693952 | controller |
2026-03-16 10:22:05.694063 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 10:22:05.694165 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.090)       0:01:10.249 **********
2026-03-16 10:22:05.787195 | controller | skipping: [instance] => (item=compute-0 - tenant)
2026-03-16 10:22:05.787356 | controller | skipping: [instance] => (item=controller-0 - tenant)
2026-03-16 10:22:05.787520 | controller | skipping: [instance] => (item=crc-0 - tenant)
2026-03-16 10:22:05.787636 | controller | skipping: [instance]
2026-03-16 10:22:05.787776 | controller |
2026-03-16 10:22:05.787879 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 10:22:05.787985 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.093)       0:01:10.343 **********
2026-03-16 10:22:05.882362 | controller | skipping: [instance] => (item=compute-0 - external)
2026-03-16 10:22:05.882501 | controller | skipping: [instance] => (item=controller-0 - external)
2026-03-16 10:22:05.882645 | controller | skipping: [instance] => (item=crc-0 - external)
2026-03-16 10:22:05.882794 | controller | skipping: [instance]
2026-03-16 10:22:05.882917 | controller |
2026-03-16 10:22:05.883012 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 10:22:05.883111 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.095)       0:01:10.438 **********
2026-03-16 10:22:05.973903 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2026-03-16 10:22:05.974018 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2026-03-16 10:22:05.974145 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2026-03-16 10:22:05.974257 | controller | skipping: [instance]
2026-03-16 10:22:05.974367 | controller |
2026-03-16 10:22:05.974521 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-16 10:22:05.974603 | controller | Monday 16 March 2026  10:22:05 +0000 (0:00:00.091)       0:01:10.530 **********
2026-03-16 10:22:06.126099 | controller | ok: [instance] => (item=compute-0 - public)
2026-03-16 10:22:06.126217 | controller | ok: [instance] => (item=controller-0 - public)
2026-03-16 10:22:06.126414 | controller | ok: [instance] => (item=crc-0 - public)
2026-03-16 10:22:06.126548 | controller |
2026-03-16 10:22:06.126644 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2026-03-16 10:22:06.126766 | controller | Monday 16 March 2026  10:22:06 +0000 (0:00:00.151)       0:01:10.682 **********
2026-03-16 10:22:06.248193 | controller |
2026-03-16 10:22:06.248293 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2026-03-16 10:22:06.248513 | controller | Monday 16 March 2026  10:22:06 +0000 (0:00:00.122)       0:01:10.804 **********
2026-03-16 10:22:06.299444 | controller | ok: [instance]
2026-03-16 10:22:06.299613 | controller |
2026-03-16 10:22:06.299754 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2026-03-16 10:22:06.299849 | controller | Monday 16 March 2026  10:22:06 +0000 (0:00:00.051)       0:01:10.855 **********
2026-03-16 10:22:06.407512 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:bd:8b:c6', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-03-16 10:22:06.407685 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:62:83:c6', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-03-16 10:22:06.407919 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:a8:6e:20', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-03-16 10:22:06.407993 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:11:16:a1', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-03-16 10:22:06.408115 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:f8:4c:2e', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-03-16 10:22:06.408231 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:27:03:be', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-03-16 10:22:06.408352 | controller |
2026-03-16 10:22:06.408491 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2026-03-16 10:22:06.408591 | controller | Monday 16 March 2026  10:22:06 +0000 (0:00:00.107)       0:01:10.963 **********
2026-03-16 10:22:06.467108 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2026-03-16 10:22:06.467307 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2026-03-16 10:22:06.467403 | controller |
2026-03-16 10:22:06.467614 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-03-16 10:22:06.467717 | controller | Monday 16 March 2026  10:22:06 +0000 (0:00:00.059)       0:01:11.023 **********
2026-03-16 10:22:06.663928 | controller | ok: [instance]
2026-03-16 10:22:06.693518 | controller |
2026-03-16 10:22:06.693586 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-03-16 10:22:06.693596 | controller | Monday 16 March 2026  10:22:06 +0000 (0:00:00.196)       0:01:11.219 **********
2026-03-16 10:22:06.693613 | controller | ok: [instance]
2026-03-16 10:22:06.889282 | controller |
2026-03-16 10:22:06.889357 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-03-16 10:22:06.889369 | controller | Monday 16 March 2026  10:22:06 +0000 (0:00:00.029)       0:01:11.249 **********
2026-03-16 10:22:06.889384 | controller | ok: [instance]
2026-03-16 10:22:06.918690 | controller |
2026-03-16 10:22:06.918715 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-03-16 10:22:06.918724 | controller | Monday 16 March 2026  10:22:06 +0000 (0:00:00.194)       0:01:11.444 **********
2026-03-16 10:22:06.918734 | controller | ok: [instance]
2026-03-16 10:22:06.942249 | controller |
2026-03-16 10:22:06.942273 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2026-03-16 10:22:06.942282 | controller | Monday 16 March 2026  10:22:06 +0000 (0:00:00.030)       0:01:11.475 **********
2026-03-16 10:22:06.942294 | controller | ok: [instance]
2026-03-16 10:22:07.132416 | controller |
2026-03-16 10:22:07.132462 | controller | TASK [dnsmasq : Compute entry] *************************************************
2026-03-16 10:22:07.132471 | controller | Monday 16 March 2026  10:22:06 +0000 (0:00:00.023)       0:01:11.498 **********
2026-03-16 10:22:07.132486 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:bd:8b:c6', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-03-16 10:22:07.176885 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:62:83:c6', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-03-16 10:22:07.176930 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:a8:6e:20', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-03-16 10:22:07.176947 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:11:16:a1', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-03-16 10:22:07.176955 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:f8:4c:2e', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-03-16 10:22:07.176963 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:27:03:be', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-03-16 10:22:07.176970 | controller |
2026-03-16 10:22:07.176978 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2026-03-16 10:22:07.176994 | controller | Monday 16 March 2026  10:22:07 +0000 (0:00:00.189)       0:01:11.687 **********
2026-03-16 10:22:07.177007 | controller | ok: [instance]
2026-03-16 10:22:09.409510 | controller |
2026-03-16 10:22:09.409560 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2026-03-16 10:22:09.409569 | controller | Monday 16 March 2026  10:22:07 +0000 (0:00:00.045)       0:01:11.732 **********
2026-03-16 10:22:09.409579 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:bd:8b:c6', 'entry': 'set:compute,52:54:00:bd:8b:c6,192.168.140.100,compute-0', 'state': 'present'})
2026-03-16 10:22:09.409612 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:62:83:c6', 'entry': 'set:controller,52:54:01:62:83:c6,192.168.140.9,controller-0', 'state': 'present'})
2026-03-16 10:22:09.409619 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:a8:6e:20', 'entry': 'set:ocp,52:54:02:a8:6e:20,192.168.140.10,crc-0', 'state': 'present'})
2026-03-16 10:22:09.409625 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:11:16:a1', 'entry': 'set:compute,52:54:00:11:16:a1,192.168.101.100,compute-0', 'state': 'present'})
2026-03-16 10:22:09.409632 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:f8:4c:2e', 'entry': 'set:controller,52:54:01:f8:4c:2e,192.168.101.9,controller-0', 'state': 'present'})
2026-03-16 10:22:09.409915 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:27:03:be', 'entry': 'set:ocp,52:54:02:27:03:be,192.168.101.10,crc-0', 'state': 'present'})
2026-03-16 10:22:09.409947 | controller |
2026-03-16 10:22:09.437997 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2026-03-16 10:22:09.438019 | controller | Monday 16 March 2026  10:22:09 +0000 (0:00:02.232)       0:01:13.965 **********
2026-03-16 10:22:09.438029 | controller | skipping: [instance]
2026-03-16 10:22:09.662161 | controller |
2026-03-16 10:22:09.662188 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2026-03-16 10:22:09.662196 | controller | Monday 16 March 2026  10:22:09 +0000 (0:00:00.028)       0:01:13.994 **********
2026-03-16 10:22:09.662206 | controller | ok: [instance] => (item=compute-0)
2026-03-16 10:22:09.840443 | controller | ok: [instance] => (item=controller-0)
2026-03-16 10:22:09.840474 | controller | ok: [instance] => (item=crc-0)
2026-03-16 10:22:09.840482 | controller |
2026-03-16 10:22:09.840489 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2026-03-16 10:22:09.840494 | controller | Monday 16 March 2026  10:22:09 +0000 (0:00:00.223)       0:01:14.218 **********
2026-03-16 10:22:09.840502 | controller |
2026-03-16 10:22:09.897523 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-16 10:22:09.897574 | controller | Monday 16 March 2026  10:22:09 +0000 (0:00:00.178)       0:01:14.396 **********
2026-03-16 10:22:09.897593 | controller | ok: [instance]
2026-03-16 10:22:09.897612 | controller |
2026-03-16 10:22:09.897624 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-16 10:22:10.124989 | controller | Monday 16 March 2026  10:22:09 +0000 (0:00:00.057)       0:01:14.453 **********
2026-03-16 10:22:10.125045 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 10:22:10.125066 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 10:22:10.125235 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-16 10:22:10.125330 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-16 10:22:10.125497 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-16 10:22:10.125570 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-16 10:22:10.125693 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-16 10:22:10.125799 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 10:22:10.125899 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 10:22:10.126003 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-16 10:22:10.126111 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 10:22:10.126212 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 10:22:10.126330 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-16 10:22:10.126463 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-16 10:22:10.126562 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-16 10:22:10.126672 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-16 10:22:10.126772 | controller |
2026-03-16 10:22:10.126874 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-16 10:22:10.126976 | controller | Monday 16 March 2026  10:22:10 +0000 (0:00:00.227)       0:01:14.681 **********
2026-03-16 10:22:13.607460 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 10:22:13.607523 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 10:22:13.607534 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-16 10:22:13.607541 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-16 10:22:13.607548 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-16 10:22:13.607556 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-16 10:22:13.607570 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-16 10:22:13.608686 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 10:22:13.979480 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 10:22:13.979515 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-16 10:22:13.979525 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 10:22:13.979532 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 10:22:13.979539 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-16 10:22:13.979546 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-16 10:22:13.979553 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-16 10:22:13.979560 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-16 10:22:13.979567 | controller |
2026-03-16 10:22:13.979574 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-16 10:22:13.979581 | controller | Monday 16 March 2026  10:22:13 +0000 (0:00:03.481)       0:01:18.163 **********
2026-03-16 10:22:13.979593 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 10:22:13.979629 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-16 10:22:13.979637 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-16 10:22:13.979646 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-16 10:22:13.979703 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-16 10:22:13.979716 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-16 10:22:13.980554 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-16 10:22:13.980638 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 10:22:13.980648 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 10:22:13.980655 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-16 10:22:13.980664 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 10:22:13.980680 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-16 10:22:13.980686 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-16 10:22:13.980692 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-16 10:22:13.980698 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-16 10:22:13.980706 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-16 10:22:13.980738 | controller |
2026-03-16 10:22:13.980747 | controller | TASK [dnsmasq : Remove crc.testing from host_records] **************************
2026-03-16 10:22:13.980874 | controller | Monday 16 March 2026  10:22:13 +0000 (0:00:00.372)       0:01:18.535 **********
2026-03-16 10:22:14.027366 | controller | skipping: [instance]
2026-03-16 10:22:14.052856 | controller |
2026-03-16 10:22:14.052879 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] ****************
2026-03-16 10:22:14.052889 | controller | Monday 16 March 2026  10:22:14 +0000 (0:00:00.047)       0:01:18.583 **********
2026-03-16 10:22:14.052899 | controller | ok: [instance]
2026-03-16 10:22:14.110460 | controller |
2026-03-16 10:22:14.110519 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] **************
2026-03-16 10:22:14.110531 | controller | Monday 16 March 2026  10:22:14 +0000 (0:00:00.025)       0:01:18.609 **********
2026-03-16 10:22:14.110547 | controller | skipping: [instance] => (item=compute)
2026-03-16 10:22:14.149920 | controller | skipping: [instance] => (item=controller)
2026-03-16 10:22:14.149938 | controller | skipping: [instance] => (item=crc)
2026-03-16 10:22:14.149947 | controller | skipping: [instance]
2026-03-16 10:22:14.149955 | controller |
2026-03-16 10:22:14.149963 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] *******
2026-03-16 10:22:14.149970 | controller | Monday 16 March 2026  10:22:14 +0000 (0:00:00.056)       0:01:18.665 **********
2026-03-16 10:22:14.149982 | controller | skipping: [instance]
2026-03-16 10:22:14.150070 | controller |
2026-03-16 10:22:14.150208 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2026-03-16 10:22:14.150371 | controller | Monday 16 March 2026  10:22:14 +0000 (0:00:00.040)       0:01:18.706 **********
2026-03-16 10:22:14.564533 | controller | changed: [instance]
2026-03-16 10:22:14.564598 | controller |
2026-03-16 10:22:14.564609 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2026-03-16 10:22:14.564618 | controller | Monday 16 March 2026  10:22:14 +0000 (0:00:00.401)       0:01:19.108 **********
2026-03-16 10:22:14.564625 | controller |
2026-03-16 10:22:14.564634 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-03-16 10:22:15.300135 | controller | Monday 16 March 2026  10:22:14 +0000 (0:00:00.011)       0:01:19.120 **********
2026-03-16 10:22:15.300170 | controller | changed: [instance]
2026-03-16 10:22:15.700020 | controller |
2026-03-16 10:22:15.700053 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-16 10:22:15.700061 | controller | Monday 16 March 2026  10:22:15 +0000 (0:00:00.735)       0:01:19.856 **********
2026-03-16 10:22:15.700077 | controller | changed: [instance]
2026-03-16 10:22:16.083167 | controller |
2026-03-16 10:22:16.083198 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2026-03-16 10:22:16.083206 | controller | Monday 16 March 2026  10:22:15 +0000 (0:00:00.400)       0:01:20.256 **********
2026-03-16 10:22:16.083217 | controller | changed: [instance]
2026-03-16 10:22:16.491466 | controller |
2026-03-16 10:22:16.491513 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2026-03-16 10:22:16.491523 | controller | Monday 16 March 2026  10:22:16 +0000 (0:00:00.383)       0:01:20.639 **********
2026-03-16 10:22:16.491536 | controller | changed: [instance]
2026-03-16 10:22:16.907095 | controller |
2026-03-16 10:22:16.907139 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2026-03-16 10:22:16.907148 | controller | Monday 16 March 2026  10:22:16 +0000 (0:00:00.408)       0:01:21.047 **********
2026-03-16 10:22:16.907161 | controller | changed: [instance]
2026-03-16 10:22:16.943956 | controller |
2026-03-16 10:22:16.943987 | controller | TASK [Build utility records dataset] *******************************************
2026-03-16 10:22:16.943997 | controller | Monday 16 March 2026  10:22:16 +0000 (0:00:00.415)       0:01:21.463 **********
2026-03-16 10:22:16.944011 | controller |
2026-03-16 10:22:17.040949 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-16 10:22:17.040967 | controller | Monday 16 March 2026  10:22:16 +0000 (0:00:00.037)       0:01:21.500 **********
2026-03-16 10:22:17.040978 | controller | ok: [instance]
2026-03-16 10:22:17.148693 | controller |
2026-03-16 10:22:17.148802 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-16 10:22:17.148820 | controller | Monday 16 March 2026  10:22:17 +0000 (0:00:00.096)       0:01:21.597 **********
2026-03-16 10:22:17.148846 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-16 10:22:17.676101 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 10:22:17.676147 | controller |
2026-03-16 10:22:17.676162 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-16 10:22:17.676170 | controller | Monday 16 March 2026  10:22:17 +0000 (0:00:00.107)       0:01:21.704 **********
2026-03-16 10:22:17.676182 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-16 10:22:17.974472 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 10:22:17.974522 | controller |
2026-03-16 10:22:17.974532 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-16 10:22:17.974540 | controller | Monday 16 March 2026  10:22:17 +0000 (0:00:00.527)       0:01:22.232 **********
2026-03-16 10:22:17.974554 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-16 10:22:17.974590 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-16 10:22:17.974821 | controller |
2026-03-16 10:22:17.974855 | controller | TASK [dnsmasq : Remove crc.testing from host_records] **************************
2026-03-16 10:22:18.029073 | controller | Monday 16 March 2026  10:22:17 +0000 (0:00:00.298)       0:01:22.530 **********
2026-03-16 10:22:18.029096 | controller | skipping: [instance]
2026-03-16 10:22:18.549920 | controller |
2026-03-16 10:22:18.549963 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-03-16 10:22:18.549972 | controller | Monday 16 March 2026  10:22:18 +0000 (0:00:00.042)       0:01:22.573 **********
2026-03-16 10:22:18.549978 | controller |
2026-03-16 10:22:18.549983 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-16 10:22:18.549988 | controller | Monday 16 March 2026  10:22:18 +0000 (0:00:00.011)       0:01:22.584 **********
2026-03-16 10:22:18.549999 | controller | changed: [instance]
2026-03-16 10:22:18.961075 | controller |
2026-03-16 10:22:18.961113 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-16 10:22:18.961122 | controller | Monday 16 March 2026  10:22:18 +0000 (0:00:00.520)       0:01:23.105 **********
2026-03-16 10:22:18.961133 | controller | changed: [instance]
2026-03-16 10:22:19.042249 | controller |
2026-03-16 10:22:19.042289 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2026-03-16 10:22:19.042300 | controller | Monday 16 March 2026  10:22:18 +0000 (0:00:00.411)       0:01:23.517 **********
2026-03-16 10:22:19.042335 | controller | skipping: [instance]
2026-03-16 10:22:19.129617 | controller |
2026-03-16 10:22:19.129725 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2026-03-16 10:22:19.129736 | controller | Monday 16 March 2026  10:22:19 +0000 (0:00:00.081)       0:01:23.598 **********
2026-03-16 10:22:19.129759 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2026-03-16 10:22:19.358993 | controller |
2026-03-16 10:22:19.359031 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2026-03-16 10:22:19.359042 | controller | Monday 16 March 2026  10:22:19 +0000 (0:00:00.087)       0:01:23.685 **********
2026-03-16 10:22:19.359055 | controller | ok: [instance]
2026-03-16 10:22:19.389141 | controller |
2026-03-16 10:22:19.389164 | controller | TASK [Deploy CRC if needed] ****************************************************
2026-03-16 10:22:19.389180 | controller | Monday 16 March 2026  10:22:19 +0000 (0:00:00.229)       0:01:23.914 **********
2026-03-16 10:22:19.389192 | controller | skipping: [instance]
2026-03-16 10:22:19.766061 | controller |
2026-03-16 10:22:19.766093 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2026-03-16 10:22:19.766102 | controller | Monday 16 March 2026  10:22:19 +0000 (0:00:00.030)       0:01:23.945 **********
2026-03-16 10:22:19.766112 | controller | ok: [instance]
2026-03-16 10:22:20.026368 | controller |
2026-03-16 10:22:20.026404 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2026-03-16 10:22:20.026412 | controller | Monday 16 March 2026  10:22:19 +0000 (0:00:00.376)       0:01:24.321 **********
2026-03-16 10:22:20.026423 | controller | ok: [instance]
2026-03-16 10:22:20.280295 | controller |
2026-03-16 10:22:20.280347 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2026-03-16 10:22:20.280356 | controller | Monday 16 March 2026  10:22:20 +0000 (0:00:00.260)       0:01:24.582 **********
2026-03-16 10:22:20.280366 | controller | ok: [instance]
2026-03-16 10:22:20.538233 | controller |
2026-03-16 10:22:20.538268 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2026-03-16 10:22:20.538276 | controller | Monday 16 March 2026  10:22:20 +0000 (0:00:00.253)       0:01:24.836 **********
2026-03-16 10:22:20.538286 | controller | ok: [instance]
2026-03-16 10:22:20.796779 | controller |
2026-03-16 10:22:20.796813 | controller | TASK [rhol_crc : Destroy default network] **************************************
2026-03-16 10:22:20.796821 | controller | Monday 16 March 2026  10:22:20 +0000 (0:00:00.257)       0:01:25.094 **********
2026-03-16 10:22:20.796832 | controller | ok: [instance]
2026-03-16 10:22:20.846998 | controller |
2026-03-16 10:22:20.847027 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-16 10:22:20.847037 | controller | Monday 16 March 2026  10:22:20 +0000 (0:00:00.258)       0:01:25.352 **********
2026-03-16 10:22:20.847050 | controller |
2026-03-16 10:22:21.070043 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-03-16 10:22:21.070284 | controller | Monday 16 March 2026  10:22:20 +0000 (0:00:00.050)       0:01:25.403 **********
2026-03-16 10:22:21.070295 | controller | ok: [instance]
2026-03-16 10:22:21.103713 | controller |
2026-03-16 10:22:21.103731 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-03-16 10:22:21.103738 | controller | Monday 16 March 2026  10:22:21 +0000 (0:00:00.223)       0:01:25.626 **********
2026-03-16 10:22:21.103748 | controller | ok: [instance]
2026-03-16 10:22:21.137465 | controller |
2026-03-16 10:22:21.137501 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-03-16 10:22:21.137510 | controller | Monday 16 March 2026  10:22:21 +0000 (0:00:00.033)       0:01:25.659 **********
2026-03-16 10:22:21.137523 | controller | skipping: [instance]
2026-03-16 10:22:21.137553 | controller |
2026-03-16 10:22:21.137563 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2026-03-16 10:22:21.137660 | controller | Monday 16 March 2026  10:22:21 +0000 (0:00:00.034)       0:01:25.694 **********
2026-03-16 10:22:21.457984 | controller | ok: [instance]
2026-03-16 10:22:21.713753 | controller |
2026-03-16 10:22:21.713779 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2026-03-16 10:22:21.713788 | controller | Monday 16 March 2026  10:22:21 +0000 (0:00:00.320)       0:01:26.014 **********
2026-03-16 10:22:21.713798 | controller | ok: [instance]
2026-03-16 10:22:21.917600 | controller |
2026-03-16 10:22:21.917706 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2026-03-16 10:22:21.917723 | controller | Monday 16 March 2026  10:22:21 +0000 (0:00:00.255)       0:01:26.270 **********
2026-03-16 10:22:21.917747 | controller | ok: [instance]
2026-03-16 10:22:21.983307 | controller |
2026-03-16 10:22:21.983377 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2026-03-16 10:22:21.983387 | controller | Monday 16 March 2026  10:22:21 +0000 (0:00:00.203)       0:01:26.473 **********
2026-03-16 10:22:21.983400 | controller |
2026-03-16 10:22:22.035474 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-16 10:22:22.035524 | controller | Monday 16 March 2026  10:22:21 +0000 (0:00:00.065)       0:01:26.539 **********
2026-03-16 10:22:22.035541 | controller | ok: [instance] => changed=false
2026-03-16 10:22:22.238251 | controller |   msg: All assertions passed
2026-03-16 10:22:22.238281 | controller |
2026-03-16 10:22:22.238289 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-16 10:22:22.238296 | controller | Monday 16 March 2026  10:22:22 +0000 (0:00:00.051)       0:01:26.591 **********
2026-03-16 10:22:22.238330 | controller | ok: [instance]
2026-03-16 10:22:22.465492 | controller |
2026-03-16 10:22:22.465534 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-16 10:22:22.465549 | controller | Monday 16 March 2026  10:22:22 +0000 (0:00:00.203)       0:01:26.794 **********
2026-03-16 10:22:22.465566 | controller | ok: [instance]
2026-03-16 10:22:22.465612 | controller |
2026-03-16 10:22:22.465628 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-16 10:22:22.465699 | controller | Monday 16 March 2026  10:22:22 +0000 (0:00:00.227)       0:01:27.021 **********
2026-03-16 10:22:22.496543 | controller | ok: [instance] => changed=false
2026-03-16 10:22:22.496642 | controller |   msg: All assertions passed
2026-03-16 10:22:22.496656 | controller |
2026-03-16 10:22:22.496763 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-16 10:22:22.496801 | controller | Monday 16 March 2026  10:22:22 +0000 (0:00:00.030)       0:01:27.052 **********
2026-03-16 10:22:22.711748 | controller | ok: [instance]
2026-03-16 10:22:22.914487 | controller |
2026-03-16 10:22:22.914537 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-16 10:22:22.914548 | controller | Monday 16 March 2026  10:22:22 +0000 (0:00:00.214)       0:01:27.267 **********
2026-03-16 10:22:22.914563 | controller | ok: [instance]
2026-03-16 10:22:22.968909 | controller |
2026-03-16 10:22:22.968948 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-16 10:22:22.968958 | controller | Monday 16 March 2026  10:22:22 +0000 (0:00:00.202)       0:01:27.470 **********
2026-03-16 10:22:22.968972 | controller | ok: [instance]
2026-03-16 10:22:23.419024 | controller |
2026-03-16 10:22:23.419065 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2026-03-16 10:22:23.419074 | controller | Monday 16 March 2026  10:22:22 +0000 (0:00:00.054)       0:01:27.525 **********
2026-03-16 10:22:23.419086 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2026-03-16 10:22:23.447478 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2026-03-16 10:22:23.447513 | controller |
2026-03-16 10:22:23.447523 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2026-03-16 10:22:23.447530 | controller | Monday 16 March 2026  10:22:23 +0000 (0:00:00.449)       0:01:27.974 **********
2026-03-16 10:22:23.447542 | controller | skipping: [instance]
2026-03-16 10:22:23.447811 | controller |
2026-03-16 10:22:23.447840 | controller | TASK [Load the architecture local kustomize patches] ***************************
2026-03-16 10:22:23.480155 | controller | Monday 16 March 2026  10:22:23 +0000 (0:00:00.029)       0:01:28.003 **********
2026-03-16 10:22:23.480190 | controller | skipping: [instance]
2026-03-16 10:22:23.626084 | controller |
2026-03-16 10:22:23.626106 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2026-03-16 10:22:23.626116 | controller | Monday 16 March 2026  10:22:23 +0000 (0:00:00.032)       0:01:28.036 **********
2026-03-16 10:22:23.626127 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2026-03-16 10:22:23.660538 | controller |
2026-03-16 10:22:23.660603 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2026-03-16 10:22:23.660614 | controller | Monday 16 March 2026  10:22:23 +0000 (0:00:00.145)       0:01:28.182 **********
2026-03-16 10:22:23.660629 | controller | skipping: [instance]
2026-03-16 10:22:23.660664 | controller |
2026-03-16 10:22:23.660686 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2026-03-16 10:22:24.128827 | controller | Monday 16 March 2026  10:22:23 +0000 (0:00:00.034)       0:01:28.216 **********
2026-03-16 10:22:24.128878 | controller | changed: [instance]
2026-03-16 10:22:24.779534 | controller |
2026-03-16 10:22:24.779612 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2026-03-16 10:22:24.779623 | controller | Monday 16 March 2026  10:22:24 +0000 (0:00:00.467)       0:01:28.684 **********
2026-03-16 10:22:24.779640 | controller | changed: [instance]
2026-03-16 10:22:24.779694 | controller |
2026-03-16 10:22:24.779704 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2026-03-16 10:22:24.779713 | controller | Monday 16 March 2026  10:22:24 +0000 (0:00:00.593)       0:01:29.277 **********
2026-03-16 10:22:24.779924 | controller |
2026-03-16 10:22:24.779980 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-16 10:22:25.288415 | controller | Monday 16 March 2026  10:22:24 +0000 (0:00:00.057)       0:01:29.335 **********
2026-03-16 10:22:25.288481 | controller | changed: [instance]
2026-03-16 10:22:26.004452 | controller |
2026-03-16 10:22:26.004498 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-03-16 10:22:26.004507 | controller | Monday 16 March 2026  10:22:25 +0000 (0:00:00.506)       0:01:29.841 **********
2026-03-16 10:22:26.004519 | controller | changed: [instance]
2026-03-16 10:22:26.051884 | controller |
2026-03-16 10:22:26.051908 | controller | TASK [Deploy virtualbmc] *******************************************************
2026-03-16 10:22:26.051920 | controller | Monday 16 March 2026  10:22:26 +0000 (0:00:00.718)       0:01:30.559 **********
2026-03-16 10:22:26.051930 | controller | skipping: [instance]
2026-03-16 10:22:26.093376 | controller |
2026-03-16 10:22:26.093399 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2026-03-16 10:22:26.093407 | controller | Monday 16 March 2026  10:22:26 +0000 (0:00:00.048)       0:01:30.608 **********
2026-03-16 10:22:26.093417 | controller | skipping: [instance]
2026-03-16 10:22:26.093444 | controller |
2026-03-16 10:22:26.093451 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2026-03-16 10:22:26.093458 | controller | Monday 16 March 2026  10:22:26 +0000 (0:00:00.041)       0:01:30.649 **********
2026-03-16 10:22:26.695576 | controller | changed: [instance] => (item=workload)
2026-03-16 10:22:27.142478 | controller | changed: [instance] => (item=reproducer-inventory)
2026-03-16 10:22:27.142558 | controller | ok: [instance] => (item=volumes)
2026-03-16 10:22:27.142567 | controller |
2026-03-16 10:22:27.142573 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2026-03-16 10:22:27.142580 | controller | Monday 16 March 2026  10:22:26 +0000 (0:00:00.600)       0:01:31.249 **********
2026-03-16 10:22:27.142598 | controller | changed: [instance] => (item=workload)
2026-03-16 10:22:27.173001 | controller | changed: [instance] => (item=volumes)
2026-03-16 10:22:27.173054 | controller |
2026-03-16 10:22:27.173063 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2026-03-16 10:22:27.173071 | controller | Monday 16 March 2026  10:22:27 +0000 (0:00:00.448)       0:01:31.698 **********
2026-03-16 10:22:27.173085 | controller | skipping: [instance]
2026-03-16 10:22:28.275992 | controller |
2026-03-16 10:22:28.276023 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2026-03-16 10:22:28.276031 | controller | Monday 16 March 2026  10:22:27 +0000 (0:00:00.031)       0:01:31.729 **********
2026-03-16 10:22:28.276047 | controller | changed: [instance] => (item=compute)
2026-03-16 10:22:28.311103 | controller | changed: [instance] => (item=controller)
2026-03-16 10:22:28.311130 | controller | changed: [instance] => (item=crc)
2026-03-16 10:22:28.311139 | controller |
2026-03-16 10:22:28.311147 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2026-03-16 10:22:28.311154 | controller | Monday 16 March 2026  10:22:28 +0000 (0:00:01.102)       0:01:32.831 **********
2026-03-16 10:22:28.311165 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance
2026-03-16 10:22:28.505964 | controller |
2026-03-16 10:22:28.505990 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] *****************
2026-03-16 10:22:28.505998 | controller | Monday 16 March 2026  10:22:28 +0000 (0:00:00.035)       0:01:32.867 **********
2026-03-16 10:22:28.506008 | controller | ok: [instance]
2026-03-16 10:22:28.528891 | controller |
2026-03-16 10:22:28.528910 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] *************
2026-03-16 10:22:28.528918 | controller | Monday 16 March 2026  10:22:28 +0000 (0:00:00.194)       0:01:33.062 **********
2026-03-16 10:22:28.528927 | controller | skipping: [instance]
2026-03-16 10:22:28.926435 | controller |
2026-03-16 10:22:28.926471 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] ***
2026-03-16 10:22:28.926479 | controller | Monday 16 March 2026  10:22:28 +0000 (0:00:00.023)       0:01:33.085 **********
2026-03-16 10:22:28.926490 | controller | changed: [instance]
2026-03-16 10:22:28.926520 | controller |
2026-03-16 10:22:28.926529 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] *********************
2026-03-16 10:22:28.926646 | controller | Monday 16 March 2026  10:22:28 +0000 (0:00:00.397)       0:01:33.482 **********
2026-03-16 10:22:28.952031 | controller | skipping: [instance]
2026-03-16 10:22:28.974396 | controller |
2026-03-16 10:22:28.974420 | controller | TASK [libvirt_manager : Write merged all-group.yml] ****************************
2026-03-16 10:22:28.974430 | controller | Monday 16 March 2026  10:22:28 +0000 (0:00:00.025)       0:01:33.508 **********
2026-03-16 10:22:28.974440 | controller | skipping: [instance]
2026-03-16 10:22:29.022476 | controller |
2026-03-16 10:22:29.022504 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2026-03-16 10:22:29.022514 | controller | Monday 16 March 2026  10:22:28 +0000 (0:00:00.022)       0:01:33.530 **********
2026-03-16 10:22:29.022526 | controller | skipping: [instance]
2026-03-16 10:22:29.097552 | controller |
2026-03-16 10:22:29.097626 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2026-03-16 10:22:29.097638 | controller | Monday 16 March 2026  10:22:29 +0000 (0:00:00.047)       0:01:33.578 **********
2026-03-16 10:22:29.097654 | controller | skipping: [instance] => (item=crc)
2026-03-16 10:22:29.097706 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2026-03-16 10:22:29.097716 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2026-03-16 10:22:29.097729 | controller |
2026-03-16 10:22:29.097991 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-03-16 10:22:29.324140 | controller | Monday 16 March 2026  10:22:29 +0000 (0:00:00.074)       0:01:33.653 **********
2026-03-16 10:22:29.324178 | controller | changed: [instance]
2026-03-16 10:22:29.520783 | controller |
2026-03-16 10:22:29.520818 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-03-16 10:22:29.520826 | controller | Monday 16 March 2026  10:22:29 +0000 (0:00:00.226)       0:01:33.880 **********
2026-03-16 10:22:29.520843 | controller | ok: [instance]
2026-03-16 10:22:59.521587 | controller |
2026-03-16 10:22:59.521686 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-03-16 10:22:59.521702 | controller | Monday 16 March 2026  10:22:29 +0000 (0:00:00.196)       0:01:34.076 **********
2026-03-16 10:22:59.521725 | controller | changed: [instance]
2026-03-16 10:22:59.752512 | controller |
2026-03-16 10:22:59.752553 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-03-16 10:22:59.752579 | controller | Monday 16 March 2026  10:22:59 +0000 (0:00:30.000)       0:02:04.077 **********
2026-03-16 10:22:59.752593 | controller | ok: [instance]
2026-03-16 10:22:59.853100 | controller |
2026-03-16 10:22:59.853125 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-03-16 10:22:59.853132 | controller | Monday 16 March 2026  10:22:59 +0000 (0:00:00.231)       0:02:04.308 **********
2026-03-16 10:22:59.853141 | controller | ok: [instance] => changed=false
2026-03-16 10:23:00.072789 | controller |   msg: All assertions passed
2026-03-16 10:23:00.072812 | controller |
2026-03-16 10:23:00.072821 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-03-16 10:23:00.072829 | controller | Monday 16 March 2026  10:22:59 +0000 (0:00:00.100)       0:02:04.408 **********
2026-03-16 10:23:00.072839 | controller | changed: [instance]
2026-03-16 10:23:00.290233 | controller |
2026-03-16 10:23:00.290251 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-03-16 10:23:00.290258 | controller | Monday 16 March 2026  10:23:00 +0000 (0:00:00.220)       0:02:04.628 **********
2026-03-16 10:23:00.290266 | controller | ok: [instance]
2026-03-16 10:23:00.491229 | controller |
2026-03-16 10:23:00.491246 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-03-16 10:23:00.491252 | controller | Monday 16 March 2026  10:23:00 +0000 (0:00:00.217)       0:02:04.846 **********
2026-03-16 10:23:00.491261 | controller | ok: [instance]
2026-03-16 10:23:00.517407 | controller |
2026-03-16 10:23:00.517444 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-03-16 10:23:00.517453 | controller | Monday 16 March 2026  10:23:00 +0000 (0:00:00.201)       0:02:05.047 **********
2026-03-16 10:23:00.517464 | controller | skipping: [instance]
2026-03-16 10:23:00.517491 | controller |
2026-03-16 10:23:00.517497 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-03-16 10:23:00.517505 | controller | Monday 16 March 2026  10:23:00 +0000 (0:00:00.025)       0:02:05.073 **********
2026-03-16 10:23:00.724403 | controller | ok: [instance]
2026-03-16 10:23:00.724454 | controller |
2026-03-16 10:23:00.724574 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-03-16 10:23:00.724687 | controller | Monday 16 March 2026  10:23:00 +0000 (0:00:00.207)       0:02:05.280 **********
2026-03-16 10:23:00.770215 | controller | ok: [instance] => changed=false
2026-03-16 10:23:00.988254 | controller |   msg: All assertions passed
2026-03-16 10:23:00.988290 | controller |
2026-03-16 10:23:00.988298 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-03-16 10:23:00.988304 | controller | Monday 16 March 2026  10:23:00 +0000 (0:00:00.045)       0:02:05.326 **********
2026-03-16 10:23:00.988339 | controller | ok: [instance]
2026-03-16 10:23:01.169834 | controller |
2026-03-16 10:23:01.169868 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2026-03-16 10:23:01.169876 | controller | Monday 16 March 2026  10:23:00 +0000 (0:00:00.217)       0:02:05.544 **********
2026-03-16 10:23:01.169886 | controller | ok: [instance]
2026-03-16 10:23:01.571394 | controller |
2026-03-16 10:23:01.571430 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2026-03-16 10:23:01.571439 | controller | Monday 16 March 2026  10:23:01 +0000 (0:00:00.181)       0:02:05.725 **********
2026-03-16 10:23:01.571450 | controller | changed: [instance]
2026-03-16 10:23:01.571753 | controller |
2026-03-16 10:23:01.750995 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2026-03-16 10:23:01.751031 | controller | Monday 16 March 2026  10:23:01 +0000 (0:00:00.401)       0:02:06.127 **********
2026-03-16 10:23:01.751044 | controller | ok: [instance]
2026-03-16 10:23:01.934410 | controller |
2026-03-16 10:23:01.934453 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2026-03-16 10:23:01.934464 | controller | Monday 16 March 2026  10:23:01 +0000 (0:00:00.179)       0:02:06.307 **********
2026-03-16 10:23:01.934477 | controller | ok: [instance]
2026-03-16 10:23:02.336445 | controller |
2026-03-16 10:23:02.336486 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2026-03-16 10:23:02.336501 | controller | Monday 16 March 2026  10:23:01 +0000 (0:00:00.182)       0:02:06.490 **********
2026-03-16 10:23:02.336520 | controller | changed: [instance]
2026-03-16 10:23:02.336544 | controller |
2026-03-16 10:23:02.336571 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2026-03-16 10:23:02.336737 | controller | Monday 16 March 2026  10:23:02 +0000 (0:00:00.402)       0:02:06.892 **********
2026-03-16 10:23:02.359292 | controller | ok: [instance]
2026-03-16 10:23:02.586029 | controller |
2026-03-16 10:23:02.586065 | controller | TASK [libvirt_manager : List existing networks] ********************************
2026-03-16 10:23:02.586073 | controller | Monday 16 March 2026  10:23:02 +0000 (0:00:00.022)       0:02:06.915 **********
2026-03-16 10:23:02.586083 | controller | ok: [instance]
2026-03-16 10:23:03.073890 | controller |
2026-03-16 10:23:03.073930 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2026-03-16 10:23:03.073941 | controller | Monday 16 March 2026  10:23:02 +0000 (0:00:00.226)       0:02:07.142 **********
2026-03-16 10:23:03.073954 | controller | ok: [instance]
2026-03-16 10:23:03.199263 | controller |
2026-03-16 10:23:03.199280 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2026-03-16 10:23:03.199287 | controller | Monday 16 March 2026  10:23:03 +0000 (0:00:00.487)       0:02:07.629 **********
2026-03-16 10:23:03.199295 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-16 10:23:03.448156 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-16 10:23:03.448187 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-16 10:23:03.448195 | controller |
2026-03-16 10:23:03.448201 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2026-03-16 10:23:03.448208 | controller | Monday 16 March 2026  10:23:03 +0000 (0:00:00.125)       0:02:07.755 **********
2026-03-16 10:23:03.448217 | controller | changed: [instance]
2026-03-16 10:23:03.679453 | controller |
2026-03-16 10:23:03.679492 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2026-03-16 10:23:03.679502 | controller | Monday 16 March 2026  10:23:03 +0000 (0:00:00.248)       0:02:08.004 **********
2026-03-16 10:23:03.679515 | controller | changed: [instance]
2026-03-16 10:23:03.980020 | controller |
2026-03-16 10:23:03.980054 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2026-03-16 10:23:03.980062 | controller | Monday 16 March 2026  10:23:03 +0000 (0:00:00.231)       0:02:08.235 **********
2026-03-16 10:23:03.980073 | controller | changed: [instance]
2026-03-16 10:23:04.011170 | controller |
2026-03-16 10:23:04.011193 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2026-03-16 10:23:04.011200 | controller | Monday 16 March 2026  10:23:03 +0000 (0:00:00.300)       0:02:08.536 **********
2026-03-16 10:23:04.011211 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-16 10:23:04.057411 | controller |
2026-03-16 10:23:04.057450 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-16 10:23:04.057460 | controller | Monday 16 March 2026  10:23:04 +0000 (0:00:00.031)       0:02:08.567 **********
2026-03-16 10:23:04.057473 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-16 10:23:04.058027 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-16 10:23:04.292226 | controller |
2026-03-16 10:23:04.292262 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 10:23:04.292272 | controller | Monday 16 March 2026  10:23:04 +0000 (0:00:00.046)       0:02:08.613 **********
2026-03-16 10:23:04.292285 | controller | ok: [instance]
2026-03-16 10:23:04.340439 | controller |
2026-03-16 10:23:04.340485 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 10:23:04.340496 | controller | Monday 16 March 2026  10:23:04 +0000 (0:00:00.234)       0:02:08.848 **********
2026-03-16 10:23:04.340508 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 10:23:04.340562 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:23:04.340587 | controller |
2026-03-16 10:23:04.340596 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 10:23:04.340604 | controller | Monday 16 March 2026  10:23:04 +0000 (0:00:00.048)       0:02:08.896 **********
2026-03-16 10:23:04.577228 | controller | ok: [instance]
2026-03-16 10:23:04.782462 | controller |
2026-03-16 10:23:04.782506 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 10:23:04.782516 | controller | Monday 16 March 2026  10:23:04 +0000 (0:00:00.236)       0:02:09.133 **********
2026-03-16 10:23:04.782529 | controller | ok: [instance]
2026-03-16 10:23:05.085299 | controller |
2026-03-16 10:23:05.085345 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2026-03-16 10:23:05.085354 | controller | Monday 16 March 2026  10:23:04 +0000 (0:00:00.205)       0:02:09.338 **********
2026-03-16 10:23:05.085365 | controller | changed: [instance]
2026-03-16 10:23:05.085467 | controller |
2026-03-16 10:23:05.085525 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 10:23:05.085645 | controller | Monday 16 March 2026  10:23:05 +0000 (0:00:00.303)       0:02:09.641 **********
2026-03-16 10:23:05.326443 | controller | ok: [instance]
2026-03-16 10:23:05.326527 | controller |
2026-03-16 10:23:05.326557 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 10:23:05.326570 | controller | Monday 16 March 2026  10:23:05 +0000 (0:00:00.240)       0:02:09.882 **********
2026-03-16 10:23:05.375103 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 10:23:05.613756 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:23:05.613776 | controller |
2026-03-16 10:23:05.613784 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 10:23:05.613789 | controller | Monday 16 March 2026  10:23:05 +0000 (0:00:00.048)       0:02:09.931 **********
2026-03-16 10:23:05.613798 | controller | ok: [instance]
2026-03-16 10:23:05.823978 | controller |
2026-03-16 10:23:05.824006 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 10:23:05.824016 | controller | Monday 16 March 2026  10:23:05 +0000 (0:00:00.238)       0:02:10.170 **********
2026-03-16 10:23:05.824027 | controller | ok: [instance]
2026-03-16 10:23:06.120198 | controller |
2026-03-16 10:23:06.120219 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2026-03-16 10:23:06.120226 | controller | Monday 16 March 2026  10:23:05 +0000 (0:00:00.209)       0:02:10.380 **********
2026-03-16 10:23:06.120236 | controller | changed: [instance]
2026-03-16 10:23:06.143384 | controller |
2026-03-16 10:23:06.143411 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2026-03-16 10:23:06.143421 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.296)       0:02:10.676 **********
2026-03-16 10:23:06.143432 | controller | skipping: [instance]
2026-03-16 10:23:06.174027 | controller |
2026-03-16 10:23:06.174050 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2026-03-16 10:23:06.174057 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.023)       0:02:10.699 **********
2026-03-16 10:23:06.174066 | controller | skipping: [instance]
2026-03-16 10:23:06.204294 | controller |
2026-03-16 10:23:06.204329 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2026-03-16 10:23:06.204341 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.030)       0:02:10.730 **********
2026-03-16 10:23:06.204350 | controller | skipping: [instance]
2026-03-16 10:23:06.234030 | controller |
2026-03-16 10:23:06.234053 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2026-03-16 10:23:06.234062 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.030)       0:02:10.760 **********
2026-03-16 10:23:06.234074 | controller | skipping: [instance]
2026-03-16 10:23:06.465437 | controller |
2026-03-16 10:23:06.465476 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-16 10:23:06.465492 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.029)       0:02:10.790 **********
2026-03-16 10:23:06.465505 | controller | changed: [instance]
2026-03-16 10:23:06.504407 | controller |
2026-03-16 10:23:06.504429 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-16 10:23:06.504436 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.231)       0:02:11.021 **********
2026-03-16 10:23:06.504446 | controller | ok: [instance]
2026-03-16 10:23:06.561865 | controller |
2026-03-16 10:23:06.561893 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-16 10:23:06.561901 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.039)       0:02:11.060 **********
2026-03-16 10:23:06.561916 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-03-16 10:23:06.766164 | controller |
2026-03-16 10:23:06.766187 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-03-16 10:23:06.766195 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.057)       0:02:11.118 **********
2026-03-16 10:23:06.766205 | controller | ok: [instance]
2026-03-16 10:23:06.831042 | controller |
2026-03-16 10:23:06.831074 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-03-16 10:23:06.831084 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.204)       0:02:11.322 **********
2026-03-16 10:23:06.831096 | controller | ok: [instance]
2026-03-16 10:23:06.880080 | controller |
2026-03-16 10:23:06.880101 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-03-16 10:23:06.880109 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.064)       0:02:11.387 **********
2026-03-16 10:23:06.880119 | controller | ok: [instance]
2026-03-16 10:23:06.925243 | controller |
2026-03-16 10:23:06.925267 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-03-16 10:23:06.925276 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.049)       0:02:11.436 **********
2026-03-16 10:23:06.925287 | controller | skipping: [instance]
2026-03-16 10:23:06.970346 | controller |
2026-03-16 10:23:06.970369 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-03-16 10:23:06.970378 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.045)       0:02:11.481 **********
2026-03-16 10:23:06.970389 | controller | skipping: [instance]
2026-03-16 10:23:07.032213 | controller |
2026-03-16 10:23:07.032246 | controller | TASK [Call the config_drive role] **********************************************
2026-03-16 10:23:07.032261 | controller | Monday 16 March 2026  10:23:06 +0000 (0:00:00.045)       0:02:11.526 **********
2026-03-16 10:23:07.032274 | controller |
2026-03-16 10:23:07.484489 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-03-16 10:23:07.484540 | controller | Monday 16 March 2026  10:23:07 +0000 (0:00:00.061)       0:02:11.588 **********
2026-03-16 10:23:07.484565 | controller | ok: [instance] => (item=artifacts)
2026-03-16 10:23:08.813845 | controller | ok: [instance] => (item=logs)
2026-03-16 10:23:08.813881 | controller |
2026-03-16 10:23:08.813888 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-03-16 10:23:08.813895 | controller | Monday 16 March 2026  10:23:07 +0000 (0:00:00.451)       0:02:12.040 **********
2026-03-16 10:23:08.813905 | controller | ok: [instance]
2026-03-16 10:23:09.037250 | controller |
2026-03-16 10:23:09.037280 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-03-16 10:23:09.037288 | controller | Monday 16 March 2026  10:23:08 +0000 (0:00:01.329)       0:02:13.369 **********
2026-03-16 10:23:09.037299 | controller | changed: [instance]
2026-03-16 10:23:09.416094 | controller |
2026-03-16 10:23:09.416129 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-03-16 10:23:09.416137 | controller | Monday 16 March 2026  10:23:09 +0000 (0:00:00.223)       0:02:13.593 **********
2026-03-16 10:23:09.416147 | controller | changed: [instance]
2026-03-16 10:23:09.794426 | controller |
2026-03-16 10:23:09.794456 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-03-16 10:23:09.794466 | controller | Monday 16 March 2026  10:23:09 +0000 (0:00:00.378)       0:02:13.972 **********
2026-03-16 10:23:09.794484 | controller | changed: [instance]
2026-03-16 10:23:09.794511 | controller |
2026-03-16 10:23:09.794521 | controller | TASK [config_drive : Generate network-data] ************************************
2026-03-16 10:23:09.794553 | controller | Monday 16 March 2026  10:23:09 +0000 (0:00:00.378)       0:02:14.350 **********
2026-03-16 10:23:09.845095 | controller | skipping: [instance]
2026-03-16 10:23:10.044932 | controller |
2026-03-16 10:23:10.044967 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-03-16 10:23:10.044975 | controller | Monday 16 March 2026  10:23:09 +0000 (0:00:00.050)       0:02:14.401 **********
2026-03-16 10:23:10.044985 | controller | ok: [instance]
2026-03-16 10:23:10.091096 | controller |
2026-03-16 10:23:10.091122 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-03-16 10:23:10.091131 | controller | Monday 16 March 2026  10:23:10 +0000 (0:00:00.199)       0:02:14.600 **********
2026-03-16 10:23:10.091143 | controller | skipping: [instance]
2026-03-16 10:23:10.325174 | controller |
2026-03-16 10:23:10.325198 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-03-16 10:23:10.325206 | controller | Monday 16 March 2026  10:23:10 +0000 (0:00:00.046)       0:02:14.647 **********
2026-03-16 10:23:10.325216 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2026-03-16 10:23:10.616272 | controller | changed: [instance]
2026-03-16 10:23:10.616306 | controller |
2026-03-16 10:23:10.616331 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-16 10:23:10.616341 | controller | Monday 16 March 2026  10:23:10 +0000 (0:00:00.234)       0:02:14.881 **********
2026-03-16 10:23:10.616352 | controller | changed: [instance]
2026-03-16 10:23:10.665471 | controller |
2026-03-16 10:23:10.665513 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-16 10:23:10.665523 | controller | Monday 16 March 2026  10:23:10 +0000 (0:00:00.290)       0:02:15.172 **********
2026-03-16 10:23:10.665536 | controller | skipping: [instance]
2026-03-16 10:23:10.665568 | controller |
2026-03-16 10:23:10.665579 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ********************
2026-03-16 10:23:10.665686 | controller | Monday 16 March 2026  10:23:10 +0000 (0:00:00.049)       0:02:15.221 **********
2026-03-16 10:23:10.694413 | controller | skipping: [instance]
2026-03-16 10:23:10.694637 | controller |
2026-03-16 10:23:10.694658 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2026-03-16 10:23:10.935185 | controller | Monday 16 March 2026  10:23:10 +0000 (0:00:00.029)       0:02:15.251 **********
2026-03-16 10:23:10.935218 | controller | changed: [instance]
2026-03-16 10:23:11.159137 | controller |
2026-03-16 10:23:11.159170 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2026-03-16 10:23:11.159178 | controller | Monday 16 March 2026  10:23:10 +0000 (0:00:00.240)       0:02:15.491 **********
2026-03-16 10:23:11.159189 | controller | changed: [instance]
2026-03-16 10:23:11.497690 | controller |
2026-03-16 10:23:11.497725 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2026-03-16 10:23:11.497737 | controller | Monday 16 March 2026  10:23:11 +0000 (0:00:00.223)       0:02:15.715 **********
2026-03-16 10:23:11.497748 | controller | changed: [instance]
2026-03-16 10:23:11.528332 | controller |
2026-03-16 10:23:11.528353 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2026-03-16 10:23:11.528360 | controller | Monday 16 March 2026  10:23:11 +0000 (0:00:00.338)       0:02:16.053 **********
2026-03-16 10:23:11.528369 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-16 10:23:11.573484 | controller |
2026-03-16 10:23:11.573505 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-16 10:23:11.573514 | controller | Monday 16 March 2026  10:23:11 +0000 (0:00:00.030)       0:02:16.084 **********
2026-03-16 10:23:11.573524 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-16 10:23:11.810462 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-16 10:23:11.810511 | controller |
2026-03-16 10:23:11.810521 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 10:23:11.810529 | controller | Monday 16 March 2026  10:23:11 +0000 (0:00:00.044)       0:02:16.129 **********
2026-03-16 10:23:11.810542 | controller | ok: [instance]
2026-03-16 10:23:11.898248 | controller |
2026-03-16 10:23:11.898284 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 10:23:11.898291 | controller | Monday 16 March 2026  10:23:11 +0000 (0:00:00.236)       0:02:16.366 **********
2026-03-16 10:23:11.898302 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 10:23:12.130216 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:23:12.130251 | controller |
2026-03-16 10:23:12.130259 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 10:23:12.130265 | controller | Monday 16 March 2026  10:23:11 +0000 (0:00:00.087)       0:02:16.454 **********
2026-03-16 10:23:12.130276 | controller | ok: [instance]
2026-03-16 10:23:12.332368 | controller |
2026-03-16 10:23:12.332395 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 10:23:12.332403 | controller | Monday 16 March 2026  10:23:12 +0000 (0:00:00.232)       0:02:16.686 **********
2026-03-16 10:23:12.332413 | controller | ok: [instance]
2026-03-16 10:23:12.332437 | controller |
2026-03-16 10:23:12.332689 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2026-03-16 10:23:12.624931 | controller | Monday 16 March 2026  10:23:12 +0000 (0:00:00.202)       0:02:16.888 **********
2026-03-16 10:23:12.624973 | controller | changed: [instance]
2026-03-16 10:23:12.869381 | controller |
2026-03-16 10:23:12.869418 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 10:23:12.869427 | controller | Monday 16 March 2026  10:23:12 +0000 (0:00:00.292)       0:02:17.180 **********
2026-03-16 10:23:12.869437 | controller | ok: [instance]
2026-03-16 10:23:12.869462 | controller |
2026-03-16 10:23:12.869726 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 10:23:12.917007 | controller | Monday 16 March 2026  10:23:12 +0000 (0:00:00.244)       0:02:17.425 **********
2026-03-16 10:23:12.917029 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 10:23:13.161396 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:23:13.161417 | controller |
2026-03-16 10:23:13.161424 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 10:23:13.161430 | controller | Monday 16 March 2026  10:23:12 +0000 (0:00:00.047)       0:02:17.473 **********
2026-03-16 10:23:13.161441 | controller | ok: [instance]
2026-03-16 10:23:13.375150 | controller |
2026-03-16 10:23:13.375170 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 10:23:13.375177 | controller | Monday 16 March 2026  10:23:13 +0000 (0:00:00.244)       0:02:17.717 **********
2026-03-16 10:23:13.375186 | controller | ok: [instance]
2026-03-16 10:23:13.671399 | controller |
2026-03-16 10:23:13.671430 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2026-03-16 10:23:13.671440 | controller | Monday 16 March 2026  10:23:13 +0000 (0:00:00.213)       0:02:17.931 **********
2026-03-16 10:23:13.671453 | controller | changed: [instance]
2026-03-16 10:23:13.671461 | controller |
2026-03-16 10:23:13.671468 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2026-03-16 10:23:13.671477 | controller | Monday 16 March 2026  10:23:13 +0000 (0:00:00.296)       0:02:18.227 **********
2026-03-16 10:23:13.695973 | controller | skipping: [instance]
2026-03-16 10:23:13.726796 | controller |
2026-03-16 10:23:13.726813 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2026-03-16 10:23:13.726820 | controller | Monday 16 March 2026  10:23:13 +0000 (0:00:00.024)       0:02:18.252 **********
2026-03-16 10:23:13.726828 | controller | skipping: [instance]
2026-03-16 10:23:13.758423 | controller |
2026-03-16 10:23:13.758445 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2026-03-16 10:23:13.758453 | controller | Monday 16 March 2026  10:23:13 +0000 (0:00:00.031)       0:02:18.283 **********
2026-03-16 10:23:13.758473 | controller | skipping: [instance]
2026-03-16 10:23:13.758500 | controller |
2026-03-16 10:23:13.758509 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2026-03-16 10:23:13.758581 | controller | Monday 16 March 2026  10:23:13 +0000 (0:00:00.031)       0:02:18.315 **********
2026-03-16 10:23:13.786142 | controller | skipping: [instance]
2026-03-16 10:23:14.010196 | controller |
2026-03-16 10:23:14.010233 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-16 10:23:14.010242 | controller | Monday 16 March 2026  10:23:13 +0000 (0:00:00.027)       0:02:18.342 **********
2026-03-16 10:23:14.010252 | controller | changed: [instance]
2026-03-16 10:23:14.049859 | controller |
2026-03-16 10:23:14.049882 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-16 10:23:14.049889 | controller | Monday 16 March 2026  10:23:14 +0000 (0:00:00.223)       0:02:18.566 **********
2026-03-16 10:23:14.049898 | controller | ok: [instance]
2026-03-16 10:23:14.106875 | controller |
2026-03-16 10:23:14.106899 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-16 10:23:14.106908 | controller | Monday 16 March 2026  10:23:14 +0000 (0:00:00.040)       0:02:18.606 **********
2026-03-16 10:23:14.106919 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-03-16 10:23:14.308076 | controller |
2026-03-16 10:23:14.308110 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-03-16 10:23:14.308119 | controller | Monday 16 March 2026  10:23:14 +0000 (0:00:00.056)       0:02:18.663 **********
2026-03-16 10:23:14.308129 | controller | ok: [instance]
2026-03-16 10:23:14.373520 | controller |
2026-03-16 10:23:14.373561 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-03-16 10:23:14.373573 | controller | Monday 16 March 2026  10:23:14 +0000 (0:00:00.200)       0:02:18.864 **********
2026-03-16 10:23:14.373587 | controller | ok: [instance]
2026-03-16 10:23:14.373643 | controller |
2026-03-16 10:23:14.373658 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-03-16 10:23:14.373751 | controller | Monday 16 March 2026  10:23:14 +0000 (0:00:00.065)       0:02:18.929 **********
2026-03-16 10:23:14.417283 | controller | ok: [instance]
2026-03-16 10:23:14.463099 | controller |
2026-03-16 10:23:14.463124 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-03-16 10:23:14.463131 | controller | Monday 16 March 2026  10:23:14 +0000 (0:00:00.043)       0:02:18.973 **********
2026-03-16 10:23:14.463142 | controller | skipping: [instance]
2026-03-16 10:23:14.507902 | controller |
2026-03-16 10:23:14.507933 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-03-16 10:23:14.507941 | controller | Monday 16 March 2026  10:23:14 +0000 (0:00:00.045)       0:02:19.019 **********
2026-03-16 10:23:14.507952 | controller | skipping: [instance]
2026-03-16 10:23:14.571451 | controller |
2026-03-16 10:23:14.571479 | controller | TASK [Call the config_drive role] **********************************************
2026-03-16 10:23:14.571489 | controller | Monday 16 March 2026  10:23:14 +0000 (0:00:00.044)       0:02:19.064 **********
2026-03-16 10:23:14.571501 | controller |
2026-03-16 10:23:14.571532 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-03-16 10:23:14.571542 | controller | Monday 16 March 2026  10:23:14 +0000 (0:00:00.063)       0:02:19.127 **********
2026-03-16 10:23:14.981416 | controller | ok: [instance] => (item=artifacts)
2026-03-16 10:23:14.981477 | controller | ok: [instance] => (item=logs)
2026-03-16 10:23:14.981796 | controller |
2026-03-16 10:23:16.246227 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-03-16 10:23:16.246269 | controller | Monday 16 March 2026  10:23:14 +0000 (0:00:00.409)       0:02:19.537 **********
2026-03-16 10:23:16.246282 | controller | ok: [instance]
2026-03-16 10:23:16.466416 | controller |
2026-03-16 10:23:16.466465 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-03-16 10:23:16.466477 | controller | Monday 16 March 2026  10:23:16 +0000 (0:00:01.264)       0:02:20.802 **********
2026-03-16 10:23:16.466493 | controller | changed: [instance]
2026-03-16 10:23:16.466501 | controller |
2026-03-16 10:23:16.466508 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-03-16 10:23:16.466531 | controller | Monday 16 March 2026  10:23:16 +0000 (0:00:00.220)       0:02:21.022 **********
2026-03-16 10:23:16.844809 | controller | changed: [instance]
2026-03-16 10:23:17.226941 | controller |
2026-03-16 10:23:17.226980 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-03-16 10:23:17.226989 | controller | Monday 16 March 2026  10:23:16 +0000 (0:00:00.378)       0:02:21.400 **********
2026-03-16 10:23:17.226999 | controller | changed: [instance]
2026-03-16 10:23:17.276478 | controller |
2026-03-16 10:23:17.276513 | controller | TASK [config_drive : Generate network-data] ************************************
2026-03-16 10:23:17.276527 | controller | Monday 16 March 2026  10:23:17 +0000 (0:00:00.382)       0:02:21.782 **********
2026-03-16 10:23:17.276539 | controller | skipping: [instance]
2026-03-16 10:23:17.485071 | controller |
2026-03-16 10:23:17.485110 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-03-16 10:23:17.485118 | controller | Monday 16 March 2026  10:23:17 +0000 (0:00:00.049)       0:02:21.832 **********
2026-03-16 10:23:17.485129 | controller | ok: [instance]
2026-03-16 10:23:17.530268 | controller |
2026-03-16 10:23:17.530301 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-03-16 10:23:17.530332 | controller | Monday 16 March 2026  10:23:17 +0000 (0:00:00.208)       0:02:22.041 **********
2026-03-16 10:23:17.530349 | controller | skipping: [instance]
2026-03-16 10:23:17.769427 | controller |
2026-03-16 10:23:17.769472 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-03-16 10:23:17.769480 | controller | Monday 16 March 2026  10:23:17 +0000 (0:00:00.045)       0:02:22.086 **********
2026-03-16 10:23:17.769492 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2026-03-16 10:23:17.769516 | controller | changed: [instance]
2026-03-16 10:23:17.769525 | controller |
2026-03-16 10:23:17.769673 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-16 10:23:17.769713 | controller | Monday 16 March 2026  10:23:17 +0000 (0:00:00.239)       0:02:22.325 **********
2026-03-16 10:23:18.052697 | controller | changed: [instance]
2026-03-16 10:23:18.103439 | controller |
2026-03-16 10:23:18.103480 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-16 10:23:18.103490 | controller | Monday 16 March 2026  10:23:18 +0000 (0:00:00.282)       0:02:22.608 **********
2026-03-16 10:23:18.103502 | controller | skipping: [instance]
2026-03-16 10:23:18.103533 | controller |
2026-03-16 10:23:18.103560 | controller | TASK [libvirt_manager : Configure boot order for controller-0] *****************
2026-03-16 10:23:18.103733 | controller | Monday 16 March 2026  10:23:18 +0000 (0:00:00.051)       0:02:22.659 **********
2026-03-16 10:23:18.135386 | controller | skipping: [instance]
2026-03-16 10:23:18.135549 | controller |
2026-03-16 10:23:18.135562 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2026-03-16 10:23:18.135573 | controller | Monday 16 March 2026  10:23:18 +0000 (0:00:00.031)       0:02:22.691 **********
2026-03-16 10:23:18.398808 | controller | changed: [instance]
2026-03-16 10:23:18.632785 | controller |
2026-03-16 10:23:18.632809 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2026-03-16 10:23:18.632816 | controller | Monday 16 March 2026  10:23:18 +0000 (0:00:00.262)       0:02:22.954 **********
2026-03-16 10:23:18.632826 | controller | changed: [instance]
2026-03-16 10:23:18.937081 | controller |
2026-03-16 10:23:18.937147 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2026-03-16 10:23:18.937156 | controller | Monday 16 March 2026  10:23:18 +0000 (0:00:00.234)       0:02:23.188 **********
2026-03-16 10:23:18.937166 | controller | changed: [instance]
2026-03-16 10:23:18.971201 | controller |
2026-03-16 10:23:18.971220 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2026-03-16 10:23:18.971228 | controller | Monday 16 March 2026  10:23:18 +0000 (0:00:00.304)       0:02:23.493 **********
2026-03-16 10:23:18.971237 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-16 10:23:19.019994 | controller |
2026-03-16 10:23:19.020016 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-16 10:23:19.020031 | controller | Monday 16 March 2026  10:23:18 +0000 (0:00:00.034)       0:02:23.527 **********
2026-03-16 10:23:19.020042 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-16 10:23:19.274922 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-16 10:23:19.274952 | controller |
2026-03-16 10:23:19.274960 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 10:23:19.274967 | controller | Monday 16 March 2026  10:23:19 +0000 (0:00:00.048)       0:02:23.576 **********
2026-03-16 10:23:19.274977 | controller | ok: [instance]
2026-03-16 10:23:19.323059 | controller |
2026-03-16 10:23:19.323081 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 10:23:19.323089 | controller | Monday 16 March 2026  10:23:19 +0000 (0:00:00.254)       0:02:23.830 **********
2026-03-16 10:23:19.323099 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 10:23:19.554329 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:23:19.554350 | controller |
2026-03-16 10:23:19.554358 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 10:23:19.554364 | controller | Monday 16 March 2026  10:23:19 +0000 (0:00:00.048)       0:02:23.879 **********
2026-03-16 10:23:19.554374 | controller | ok: [instance]
2026-03-16 10:23:19.755423 | controller |
2026-03-16 10:23:19.755472 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 10:23:19.755489 | controller | Monday 16 March 2026  10:23:19 +0000 (0:00:00.231)       0:02:24.110 **********
2026-03-16 10:23:19.755503 | controller | ok: [instance]
2026-03-16 10:23:19.755534 | controller |
2026-03-16 10:23:19.755544 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2026-03-16 10:23:19.755761 | controller | Monday 16 March 2026  10:23:19 +0000 (0:00:00.200)       0:02:24.311 **********
2026-03-16 10:23:20.052410 | controller | changed: [instance]
2026-03-16 10:23:20.052461 | controller |
2026-03-16 10:23:20.052472 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-16 10:23:20.052566 | controller | Monday 16 March 2026  10:23:20 +0000 (0:00:00.296)       0:02:24.608 **********
2026-03-16 10:23:20.288399 | controller | ok: [instance]
2026-03-16 10:23:20.288440 | controller |
2026-03-16 10:23:20.288448 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-16 10:23:20.288457 | controller | Monday 16 March 2026  10:23:20 +0000 (0:00:00.235)       0:02:24.844 **********
2026-03-16 10:23:20.334366 | controller | ok: [instance] => (item=cifmw-public)
2026-03-16 10:23:20.570709 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-16 10:23:20.570734 | controller |
2026-03-16 10:23:20.570742 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-16 10:23:20.570749 | controller | Monday 16 March 2026  10:23:20 +0000 (0:00:00.046)       0:02:24.890 **********
2026-03-16 10:23:20.570758 | controller | ok: [instance]
2026-03-16 10:23:20.773855 | controller |
2026-03-16 10:23:20.773890 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-16 10:23:20.773899 | controller | Monday 16 March 2026  10:23:20 +0000 (0:00:00.236)       0:02:25.127 **********
2026-03-16 10:23:20.773910 | controller | ok: [instance]
2026-03-16 10:23:21.067164 | controller |
2026-03-16 10:23:21.067200 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2026-03-16 10:23:21.067209 | controller | Monday 16 March 2026  10:23:20 +0000 (0:00:00.202)       0:02:25.329 **********
2026-03-16 10:23:21.067219 | controller | changed: [instance]
2026-03-16 10:23:21.091915 | controller |
2026-03-16 10:23:21.091944 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2026-03-16 10:23:21.091955 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.293)       0:02:25.623 **********
2026-03-16 10:23:21.091967 | controller | skipping: [instance]
2026-03-16 10:23:21.175830 | controller |
2026-03-16 10:23:21.175851 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2026-03-16 10:23:21.175866 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.024)       0:02:25.648 **********
2026-03-16 10:23:21.175876 | controller | skipping: [instance]
2026-03-16 10:23:21.204844 | controller |
2026-03-16 10:23:21.204868 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2026-03-16 10:23:21.204878 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.084)       0:02:25.732 **********
2026-03-16 10:23:21.204888 | controller | skipping: [instance]
2026-03-16 10:23:21.233364 | controller |
2026-03-16 10:23:21.233381 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2026-03-16 10:23:21.233389 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.028)       0:02:25.761 **********
2026-03-16 10:23:21.233397 | controller | skipping: [instance]
2026-03-16 10:23:21.233500 | controller |
2026-03-16 10:23:21.233553 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-16 10:23:21.451969 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.028)       0:02:25.789 **********
2026-03-16 10:23:21.452000 | controller | changed: [instance]
2026-03-16 10:23:21.491715 | controller |
2026-03-16 10:23:21.491740 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-16 10:23:21.491748 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.218)       0:02:26.008 **********
2026-03-16 10:23:21.491758 | controller | ok: [instance]
2026-03-16 10:23:21.521268 | controller |
2026-03-16 10:23:21.521287 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-16 10:23:21.521294 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.039)       0:02:26.048 **********
2026-03-16 10:23:21.521303 | controller | skipping: [instance]
2026-03-16 10:23:21.550270 | controller |
2026-03-16 10:23:21.550287 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-16 10:23:21.550294 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.029)       0:02:26.077 **********
2026-03-16 10:23:21.550302 | controller | skipping: [instance]
2026-03-16 10:23:21.599228 | controller |
2026-03-16 10:23:21.599250 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-16 10:23:21.599260 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.029)       0:02:26.106 **********
2026-03-16 10:23:21.599275 | controller | skipping: [instance]
2026-03-16 10:23:21.628526 | controller |
2026-03-16 10:23:21.628579 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************
2026-03-16 10:23:21.628593 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.048)       0:02:26.155 **********
2026-03-16 10:23:21.628628 | controller | skipping: [instance]
2026-03-16 10:23:21.694521 | controller |
2026-03-16 10:23:21.694573 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2026-03-16 10:23:21.694587 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.029)       0:02:26.184 **********
2026-03-16 10:23:21.694619 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2026-03-16 10:23:21.938014 | controller |
2026-03-16 10:23:21.938048 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2026-03-16 10:23:21.938056 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.065)       0:02:26.250 **********
2026-03-16 10:23:21.938067 | controller | ok: [instance] => (item=crc)
2026-03-16 10:23:24.012255 | controller |
2026-03-16 10:23:24.012297 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2026-03-16 10:23:24.012306 | controller | Monday 16 March 2026  10:23:21 +0000 (0:00:00.243)       0:02:26.494 **********
2026-03-16 10:23:24.012334 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-16 10:23:24.573054 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-16 10:23:24.573089 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-16 10:23:24.573103 | controller |
2026-03-16 10:23:24.573109 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-16 10:23:24.573116 | controller | Monday 16 March 2026  10:23:24 +0000 (0:00:02.073)       0:02:28.567 **********
2026-03-16 10:23:24.573127 | controller | changed: [instance]
2026-03-16 10:23:25.048962 | controller |
2026-03-16 10:23:25.048999 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-16 10:23:25.049008 | controller | Monday 16 March 2026  10:23:24 +0000 (0:00:00.561)       0:02:29.128 **********
2026-03-16 10:23:25.049019 | controller | changed: [instance]
2026-03-16 10:23:25.564573 | controller |
2026-03-16 10:23:25.564622 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-16 10:23:25.564632 | controller | Monday 16 March 2026  10:23:25 +0000 (0:00:00.475)       0:02:29.604 **********
2026-03-16 10:23:25.564645 | controller | changed: [instance]
2026-03-16 10:23:26.314929 | controller |
2026-03-16 10:23:26.314964 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2026-03-16 10:23:26.314972 | controller | Monday 16 March 2026  10:23:25 +0000 (0:00:00.515)       0:02:30.120 **********
2026-03-16 10:23:26.314983 | controller | changed: [instance] => (item=compute-0.utility)
2026-03-16 10:23:49.271769 | controller | changed: [instance] => (item=controller-0.utility)
2026-03-16 10:23:49.271808 | controller | changed: [instance] => (item=crc-0.utility)
2026-03-16 10:23:49.271816 | controller |
2026-03-16 10:23:49.271823 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2026-03-16 10:23:49.271829 | controller | Monday 16 March 2026  10:23:26 +0000 (0:00:00.750)       0:02:30.870 **********
2026-03-16 10:23:49.271839 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2026-03-16 10:23:49.272833 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2026-03-16 10:23:49.398728 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2026-03-16 10:23:49.398761 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2026-03-16 10:23:49.398776 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2026-03-16 10:23:49.398782 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left).
2026-03-16 10:23:49.398787 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left).
2026-03-16 10:23:49.398793 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j845339459408.22433', 'results_file': '/home/zuul/.ansible_async/j845339459408.22433', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2026-03-16 10:23:49.398803 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j630136655674.22450', 'results_file': '/home/zuul/.ansible_async/j630136655674.22450', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2026-03-16 10:23:49.398809 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j415933399538.22466', 'results_file': '/home/zuul/.ansible_async/j415933399538.22466', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2026-03-16 10:23:49.398814 | controller |
2026-03-16 10:23:49.398820 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2026-03-16 10:23:49.398826 | controller | Monday 16 March 2026  10:23:49 +0000 (0:00:22.957)       0:02:53.828 **********
2026-03-16 10:23:49.398836 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-16 10:23:49.398991 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-16 10:23:49.399283 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-16 10:23:49.399480 | controller |
2026-03-16 10:23:49.399503 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-16 10:23:49.432466 | controller | Monday 16 March 2026  10:23:49 +0000 (0:00:00.126)       0:02:53.954 **********
2026-03-16 10:23:49.432489 | controller | skipping: [instance]
2026-03-16 10:23:49.482507 | controller |
2026-03-16 10:23:49.482528 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2026-03-16 10:23:49.482535 | controller | Monday 16 March 2026  10:23:49 +0000 (0:00:00.034)       0:02:53.988 **********
2026-03-16 10:23:49.482544 | controller |
2026-03-16 10:23:49.575607 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-16 10:23:49.575641 | controller | Monday 16 March 2026  10:23:49 +0000 (0:00:00.049)       0:02:54.038 **********
2026-03-16 10:23:49.575658 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-03-16 10:23:49.820695 | controller |
2026-03-16 10:23:49.820726 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-16 10:23:49.820734 | controller | Monday 16 March 2026  10:23:49 +0000 (0:00:00.092)       0:02:54.131 **********
2026-03-16 10:23:49.820744 | controller | changed: [instance]
2026-03-16 10:23:50.059746 | controller |
2026-03-16 10:23:50.059777 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-16 10:23:50.059785 | controller | Monday 16 March 2026  10:23:49 +0000 (0:00:00.244)       0:02:54.376 **********
2026-03-16 10:23:50.059803 | controller | changed: [instance]
2026-03-16 10:23:50.059970 | controller |
2026-03-16 10:23:50.060113 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2026-03-16 10:23:50.060126 | controller | Monday 16 March 2026  10:23:50 +0000 (0:00:00.239)       0:02:54.616 **********
2026-03-16 10:23:50.509439 | controller | changed: [instance]
2026-03-16 10:23:50.541659 | controller |
2026-03-16 10:23:50.541685 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2026-03-16 10:23:50.541705 | controller | Monday 16 March 2026  10:23:50 +0000 (0:00:00.449)       0:02:55.065 **********
2026-03-16 10:23:50.541716 | controller | skipping: [instance]
2026-03-16 10:23:50.573940 | controller |
2026-03-16 10:23:50.573961 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-16 10:23:50.573969 | controller | Monday 16 March 2026  10:23:50 +0000 (0:00:00.032)       0:02:55.097 **********
2026-03-16 10:23:50.573978 | controller | skipping: [instance]
2026-03-16 10:23:50.626231 | controller |
2026-03-16 10:23:50.626250 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2026-03-16 10:23:50.626258 | controller | Monday 16 March 2026  10:23:50 +0000 (0:00:00.032)       0:02:55.130 **********
2026-03-16 10:23:50.626267 | controller | skipping: [instance]
2026-03-16 10:23:50.679819 | controller |
2026-03-16 10:23:50.679841 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2026-03-16 10:23:50.679850 | controller | Monday 16 March 2026  10:23:50 +0000 (0:00:00.052)       0:02:55.182 **********
2026-03-16 10:23:50.679859 | controller | skipping: [instance]
2026-03-16 10:23:50.710404 | controller |
2026-03-16 10:23:50.710425 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-16 10:23:50.710432 | controller | Monday 16 March 2026  10:23:50 +0000 (0:00:00.053)       0:02:55.236 **********
2026-03-16 10:23:50.710441 | controller | skipping: [instance]
2026-03-16 10:23:50.751230 | controller |
2026-03-16 10:23:50.751267 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2026-03-16 10:23:50.751276 | controller | Monday 16 March 2026  10:23:50 +0000 (0:00:00.030)       0:02:55.266 **********
2026-03-16 10:23:50.751285 | controller |
2026-03-16 10:23:50.835462 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-16 10:23:50.835487 | controller | Monday 16 March 2026  10:23:50 +0000 (0:00:00.040)       0:02:55.307 **********
2026-03-16 10:23:50.835503 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-03-16 10:23:51.082896 | controller |
2026-03-16 10:23:51.082936 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-16 10:23:51.082945 | controller | Monday 16 March 2026  10:23:50 +0000 (0:00:00.084)       0:02:55.391 **********
2026-03-16 10:23:51.082955 | controller | ok: [instance]
2026-03-16 10:23:51.083109 | controller |
2026-03-16 10:23:51.083277 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-16 10:23:51.083456 | controller | Monday 16 March 2026  10:23:51 +0000 (0:00:00.247)       0:02:55.639 **********
2026-03-16 10:23:51.314425 | controller | ok: [instance]
2026-03-16 10:23:51.730649 | controller |
2026-03-16 10:23:51.730684 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2026-03-16 10:23:51.730692 | controller | Monday 16 March 2026  10:23:51 +0000 (0:00:00.231)       0:02:55.870 **********
2026-03-16 10:23:51.730718 | controller | changed: [instance]
2026-03-16 10:23:51.757064 | controller |
2026-03-16 10:23:51.757087 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2026-03-16 10:23:51.757095 | controller | Monday 16 March 2026  10:23:51 +0000 (0:00:00.416)       0:02:56.286 **********
2026-03-16 10:23:51.757105 | controller | skipping: [instance]
2026-03-16 10:23:51.785925 | controller |
2026-03-16 10:23:51.785947 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-16 10:23:51.785955 | controller | Monday 16 March 2026  10:23:51 +0000 (0:00:00.026)       0:02:56.313 **********
2026-03-16 10:23:51.785964 | controller | skipping: [instance]
2026-03-16 10:23:53.616841 | controller |
2026-03-16 10:23:53.616878 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2026-03-16 10:23:53.616886 | controller | Monday 16 March 2026  10:23:51 +0000 (0:00:00.028)       0:02:56.342 **********
2026-03-16 10:23:53.616897 | controller | changed: [instance -> controller-0.instance]
2026-03-16 10:23:54.880766 | controller |
2026-03-16 10:23:54.880798 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2026-03-16 10:23:54.880806 | controller | Monday 16 March 2026  10:23:53 +0000 (0:00:01.830)       0:02:58.172 **********
2026-03-16 10:23:54.880817 | controller | changed: [instance -> controller-0.instance]
2026-03-16 10:23:54.923595 | controller |
2026-03-16 10:23:54.923628 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-16 10:23:54.923637 | controller | Monday 16 March 2026  10:23:54 +0000 (0:00:01.263)       0:02:59.436 **********
2026-03-16 10:23:54.923651 | controller |
2026-03-16 10:23:55.165639 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-03-16 10:23:55.165671 | controller | Monday 16 March 2026  10:23:54 +0000 (0:00:00.043)       0:02:59.480 **********
2026-03-16 10:23:55.165683 | controller | ok: [instance]
2026-03-16 10:23:55.197892 | controller |
2026-03-16 10:23:55.197924 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-03-16 10:23:55.197932 | controller | Monday 16 March 2026  10:23:55 +0000 (0:00:00.241)       0:02:59.721 **********
2026-03-16 10:23:55.197942 | controller | ok: [instance]
2026-03-16 10:23:55.229004 | controller |
2026-03-16 10:23:55.229035 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-03-16 10:23:55.229043 | controller | Monday 16 March 2026  10:23:55 +0000 (0:00:00.032)       0:02:59.753 **********
2026-03-16 10:23:55.229053 | controller | skipping: [instance]
2026-03-16 10:23:55.277219 | controller |
2026-03-16 10:23:55.277256 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2026-03-16 10:23:55.277264 | controller | Monday 16 March 2026  10:23:55 +0000 (0:00:00.031)       0:02:59.785 **********
2026-03-16 10:23:55.277281 | controller |
2026-03-16 10:23:55.366194 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-16 10:23:55.366226 | controller | Monday 16 March 2026  10:23:55 +0000 (0:00:00.048)       0:02:59.833 **********
2026-03-16 10:23:55.366238 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2026-03-16 10:23:55.607146 | controller |
2026-03-16 10:23:55.607174 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-16 10:23:55.607182 | controller | Monday 16 March 2026  10:23:55 +0000 (0:00:00.088)       0:02:59.921 **********
2026-03-16 10:23:55.607193 | controller | ok: [instance]
2026-03-16 10:23:55.837115 | controller |
2026-03-16 10:23:55.837146 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-16 10:23:55.837154 | controller | Monday 16 March 2026  10:23:55 +0000 (0:00:00.241)       0:03:00.163 **********
2026-03-16 10:23:55.837165 | controller | ok: [instance]
2026-03-16 10:23:56.230037 | controller |
2026-03-16 10:23:56.230068 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2026-03-16 10:23:56.230076 | controller | Monday 16 March 2026  10:23:55 +0000 (0:00:00.230)       0:03:00.393 **********
2026-03-16 10:23:56.230086 | controller | changed: [instance]
2026-03-16 10:23:57.043903 | controller |
2026-03-16 10:23:57.043937 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2026-03-16 10:23:57.043945 | controller | Monday 16 March 2026  10:23:56 +0000 (0:00:00.392)       0:03:00.786 **********
2026-03-16 10:23:57.043955 | controller | changed: [instance]
2026-03-16 10:23:57.071702 | controller |
2026-03-16 10:23:57.071732 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-16 10:23:57.071741 | controller | Monday 16 March 2026  10:23:57 +0000 (0:00:00.813)       0:03:01.600 **********
2026-03-16 10:23:57.071753 | controller | skipping: [instance]
2026-03-16 10:23:57.118511 | controller |
2026-03-16 10:23:57.118535 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2026-03-16 10:23:57.118543 | controller | Monday 16 March 2026  10:23:57 +0000 (0:00:00.027)       0:03:01.627 **********
2026-03-16 10:23:57.118553 | controller | skipping: [instance]
2026-03-16 10:23:57.166000 | controller |
2026-03-16 10:23:57.166024 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2026-03-16 10:23:57.166032 | controller | Monday 16 March 2026  10:23:57 +0000 (0:00:00.046)       0:03:01.674 **********
2026-03-16 10:23:57.166041 | controller | skipping: [instance]
2026-03-16 10:23:57.215159 | controller |
2026-03-16 10:23:57.215182 | controller | TASK [Create VBMC entity] ******************************************************
2026-03-16 10:23:57.215190 | controller | Monday 16 March 2026  10:23:57 +0000 (0:00:00.047)       0:03:01.722 **********
2026-03-16 10:23:57.215199 | controller | skipping: [instance] => (item=compute-0)
2026-03-16 10:23:57.460725 | controller | skipping: [instance] => (item=controller-0)
2026-03-16 10:23:57.460756 | controller | skipping: [instance] => (item=crc-0)
2026-03-16 10:23:57.460763 | controller | skipping: [instance]
2026-03-16 10:23:57.460770 | controller |
2026-03-16 10:23:57.460776 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2026-03-16 10:23:57.460782 | controller | Monday 16 March 2026  10:23:57 +0000 (0:00:00.048)       0:03:01.771 **********
2026-03-16 10:23:57.460791 | controller | ok: [instance]
2026-03-16 10:23:57.832307 | controller |
2026-03-16 10:23:57.832358 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2026-03-16 10:23:57.832366 | controller | Monday 16 March 2026  10:23:57 +0000 (0:00:00.245)       0:03:02.016 **********
2026-03-16 10:23:57.832377 | controller | changed: [instance]
2026-03-16 10:23:57.868670 | controller |
2026-03-16 10:23:57.868720 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2026-03-16 10:23:57.868734 | controller | Monday 16 March 2026  10:23:57 +0000 (0:00:00.371)       0:03:02.388 **********
2026-03-16 10:23:57.868745 | controller | skipping: [instance]
2026-03-16 10:23:57.906497 | controller |
2026-03-16 10:23:57.906525 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2026-03-16 10:23:57.906533 | controller | Monday 16 March 2026  10:23:57 +0000 (0:00:00.036)       0:03:02.424 **********
2026-03-16 10:23:57.906543 | controller | skipping: [instance]
2026-03-16 10:23:57.939239 | controller |
2026-03-16 10:23:57.939262 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2026-03-16 10:23:57.939270 | controller | Monday 16 March 2026  10:23:57 +0000 (0:00:00.037)       0:03:02.462 **********
2026-03-16 10:23:57.939290 | controller | skipping: [instance]
2026-03-16 10:23:58.678369 | controller |
2026-03-16 10:23:58.678419 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2026-03-16 10:23:58.678427 | controller | Monday 16 March 2026  10:23:57 +0000 (0:00:00.033)       0:03:02.495 **********
2026-03-16 10:23:58.678439 | controller | changed: [instance]
2026-03-16 10:23:59.367827 | controller |
2026-03-16 10:23:59.367879 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2026-03-16 10:23:59.367888 | controller | Monday 16 March 2026  10:23:58 +0000 (0:00:00.738)       0:03:03.234 **********
2026-03-16 10:23:59.367900 | controller | changed: [instance]
2026-03-16 10:23:59.406437 | controller |
2026-03-16 10:23:59.406479 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2026-03-16 10:23:59.406488 | controller | Monday 16 March 2026  10:23:59 +0000 (0:00:00.689)       0:03:03.923 **********
2026-03-16 10:23:59.406499 | controller | skipping: [instance]
2026-03-16 10:23:59.406519 | controller |
2026-03-16 10:23:59.406593 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2026-03-16 10:23:59.406679 | controller | Monday 16 March 2026  10:23:59 +0000 (0:00:00.039)       0:03:03.963 **********
2026-03-16 10:23:59.465039 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2026-03-16 10:23:59.465123 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2026-03-16 10:23:59.465225 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2026-03-16 10:23:59.465342 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2026-03-16 10:23:59.465429 | controller |
2026-03-16 10:23:59.465521 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2026-03-16 10:23:59.465609 | controller | Monday 16 March 2026  10:23:59 +0000 (0:00:00.058)       0:03:04.021 **********
2026-03-16 10:23:59.505383 | controller | skipping: [instance]
2026-03-16 10:23:59.505466 | controller |
2026-03-16 10:23:59.505564 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2026-03-16 10:23:59.505657 | controller | Monday 16 March 2026  10:23:59 +0000 (0:00:00.040)       0:03:04.062 **********
2026-03-16 10:23:59.542361 | controller | skipping: [instance]
2026-03-16 10:23:59.542443 | controller |
2026-03-16 10:23:59.542535 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2026-03-16 10:23:59.542622 | controller | Monday 16 March 2026  10:23:59 +0000 (0:00:00.037)       0:03:04.099 **********
2026-03-16 10:23:59.578497 | controller | skipping: [instance]
2026-03-16 10:23:59.578589 | controller |
2026-03-16 10:23:59.578681 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2026-03-16 10:23:59.578782 | controller | Monday 16 March 2026  10:23:59 +0000 (0:00:00.035)       0:03:04.134 **********
2026-03-16 10:23:59.612472 | controller | skipping: [instance]
2026-03-16 10:23:59.612517 | controller |
2026-03-16 10:23:59.612631 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2026-03-16 10:23:59.612721 | controller | Monday 16 March 2026  10:23:59 +0000 (0:00:00.034)       0:03:04.169 **********
2026-03-16 10:24:00.269288 | controller | changed: [instance]
2026-03-16 10:24:00.269361 | controller |
2026-03-16 10:24:00.269466 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2026-03-16 10:24:00.269558 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.652)       0:03:04.821 **********
2026-03-16 10:24:00.302642 | controller | skipping: [instance]
2026-03-16 10:24:00.302716 | controller |
2026-03-16 10:24:00.302819 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2026-03-16 10:24:00.302899 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.037)       0:03:04.859 **********
2026-03-16 10:24:00.335203 | controller | skipping: [instance]
2026-03-16 10:24:00.335293 | controller |
2026-03-16 10:24:00.335419 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2026-03-16 10:24:00.335509 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.032)       0:03:04.891 **********
2026-03-16 10:24:00.367104 | controller | skipping: [instance]
2026-03-16 10:24:00.367187 | controller |
2026-03-16 10:24:00.367293 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-16 10:24:00.367430 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.031)       0:03:04.923 **********
2026-03-16 10:24:00.399966 | controller | skipping: [instance]
2026-03-16 10:24:00.400063 | controller |
2026-03-16 10:24:00.400152 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-16 10:24:00.400240 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.032)       0:03:04.956 **********
2026-03-16 10:24:00.432109 | controller | skipping: [instance]
2026-03-16 10:24:00.432184 | controller |
2026-03-16 10:24:00.432295 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-16 10:24:00.432427 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.032)       0:03:04.988 **********
2026-03-16 10:24:00.463105 | controller | skipping: [instance]
2026-03-16 10:24:00.463172 | controller |
2026-03-16 10:24:00.463282 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-16 10:24:00.463403 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.030)       0:03:05.019 **********
2026-03-16 10:24:00.497387 | controller | skipping: [instance]
2026-03-16 10:24:00.497476 | controller |
2026-03-16 10:24:00.497571 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-16 10:24:00.497655 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.034)       0:03:05.054 **********
2026-03-16 10:24:00.530326 | controller | skipping: [instance]
2026-03-16 10:24:00.530423 | controller |
2026-03-16 10:24:00.530518 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-16 10:24:00.530630 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.032)       0:03:05.087 **********
2026-03-16 10:24:00.562050 | controller | skipping: [instance]
2026-03-16 10:24:00.562131 | controller |
2026-03-16 10:24:00.562227 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-16 10:24:00.562350 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.031)       0:03:05.118 **********
2026-03-16 10:24:00.605207 | controller | skipping: [instance]
2026-03-16 10:24:00.605286 | controller |
2026-03-16 10:24:00.605439 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2026-03-16 10:24:00.605524 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.043)       0:03:05.161 **********
2026-03-16 10:24:00.637757 | controller | skipping: [instance]
2026-03-16 10:24:00.637839 | controller |
2026-03-16 10:24:00.637938 | controller | TASK [reproducer : Configure Controller node] **********************************
2026-03-16 10:24:00.638025 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.032)       0:03:05.194 **********
2026-03-16 10:24:00.793143 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2026-03-16 10:24:00.793200 | controller |
2026-03-16 10:24:00.793299 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-03-16 10:24:00.793410 | controller | Monday 16 March 2026  10:24:00 +0000 (0:00:00.154)       0:03:05.349 **********
2026-03-16 10:24:02.273497 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-03-16 10:24:02.273549 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-03-16 10:24:02.273608 | controller |
2026-03-16 10:24:02.273759 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-03-16 10:24:02.294955 | controller | Monday 16 March 2026  10:24:02 +0000 (0:00:01.480)       0:03:06.829 **********
2026-03-16 10:24:02.294996 | controller | skipping: [instance]
2026-03-16 10:24:02.901048 | controller |
2026-03-16 10:24:02.901113 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-16 10:24:02.901128 | controller | Monday 16 March 2026  10:24:02 +0000 (0:00:00.021)       0:03:06.851 **********
2026-03-16 10:24:02.901149 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:02.937388 | controller |
2026-03-16 10:24:02.937440 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-16 10:24:02.937449 | controller | Monday 16 March 2026  10:24:02 +0000 (0:00:00.605)       0:03:07.457 **********
2026-03-16 10:24:02.937462 | controller | skipping: [instance]
2026-03-16 10:24:02.972352 | controller |
2026-03-16 10:24:02.972395 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-16 10:24:02.972404 | controller | Monday 16 March 2026  10:24:02 +0000 (0:00:00.036)       0:03:07.493 **********
2026-03-16 10:24:02.972416 | controller | skipping: [instance]
2026-03-16 10:24:03.007558 | controller |
2026-03-16 10:24:03.007621 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-16 10:24:03.007630 | controller | Monday 16 March 2026  10:24:02 +0000 (0:00:00.034)       0:03:07.528 **********
2026-03-16 10:24:03.007646 | controller | skipping: [instance]
2026-03-16 10:24:03.050756 | controller |
2026-03-16 10:24:03.050809 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-16 10:24:03.050819 | controller | Monday 16 March 2026  10:24:03 +0000 (0:00:00.035)       0:03:07.563 **********
2026-03-16 10:24:03.050841 | controller | skipping: [instance]
2026-03-16 10:24:03.050933 | controller |
2026-03-16 10:24:03.050948 | controller | TASK [reproducer : Get rhos-release] *******************************************
2026-03-16 10:24:03.051050 | controller | Monday 16 March 2026  10:24:03 +0000 (0:00:00.043)       0:03:07.607 **********
2026-03-16 10:24:03.085090 | controller | skipping: [instance]
2026-03-16 10:24:03.085162 | controller |
2026-03-16 10:24:03.085294 | controller | TASK [reproducer : Install repos] **********************************************
2026-03-16 10:24:03.085400 | controller | Monday 16 March 2026  10:24:03 +0000 (0:00:00.034)       0:03:07.641 **********
2026-03-16 10:24:03.121578 | controller | skipping: [instance]
2026-03-16 10:24:03.121659 | controller |
2026-03-16 10:24:03.121758 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2026-03-16 10:24:03.121850 | controller | Monday 16 March 2026  10:24:03 +0000 (0:00:00.036)       0:03:07.678 **********
2026-03-16 10:24:03.156777 | controller | skipping: [instance]
2026-03-16 10:24:03.156871 | controller |
2026-03-16 10:24:03.156986 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2026-03-16 10:24:03.157096 | controller | Monday 16 March 2026  10:24:03 +0000 (0:00:00.035)       0:03:07.713 **********
2026-03-16 10:24:03.194096 | controller | skipping: [instance]
2026-03-16 10:24:03.194159 | controller |
2026-03-16 10:24:03.194242 | controller | TASK [reproducer : Install some tools] *****************************************
2026-03-16 10:24:03.194374 | controller | Monday 16 March 2026  10:24:03 +0000 (0:00:00.037)       0:03:07.750 **********
2026-03-16 10:24:04.305379 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:04.305424 | controller |
2026-03-16 10:24:04.305501 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2026-03-16 10:24:04.305599 | controller | Monday 16 March 2026  10:24:04 +0000 (0:00:01.111)       0:03:08.861 **********
2026-03-16 10:24:05.433453 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:05.433574 | controller |
2026-03-16 10:24:05.433642 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2026-03-16 10:24:05.433676 | controller | Monday 16 March 2026  10:24:05 +0000 (0:00:01.127)       0:03:09.989 **********
2026-03-16 10:24:06.126639 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:07.116464 | controller |
2026-03-16 10:24:07.116500 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2026-03-16 10:24:07.116508 | controller | Monday 16 March 2026  10:24:06 +0000 (0:00:00.693)       0:03:10.682 **********
2026-03-16 10:24:07.116520 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:08.346568 | controller |
2026-03-16 10:24:08.346604 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2026-03-16 10:24:08.346613 | controller | Monday 16 March 2026  10:24:07 +0000 (0:00:00.990)       0:03:11.672 **********
2026-03-16 10:24:08.346627 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-03-16 10:24:09.013050 | controller | skipping: [instance] => (item=compute-0)
2026-03-16 10:24:09.013084 | controller | skipping: [instance] => (item=controller-0)
2026-03-16 10:24:09.013092 | controller | skipping: [instance] => (item=crc-0)
2026-03-16 10:24:09.013098 | controller |
2026-03-16 10:24:09.013104 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2026-03-16 10:24:09.013110 | controller | Monday 16 March 2026  10:24:08 +0000 (0:00:01.229)       0:03:12.901 **********
2026-03-16 10:24:09.013121 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-03-16 10:24:10.752900 | controller | skipping: [instance] => (item=compute-0)
2026-03-16 10:24:10.752942 | controller | skipping: [instance] => (item=controller-0)
2026-03-16 10:24:10.752950 | controller | skipping: [instance] => (item=crc-0)
2026-03-16 10:24:10.752956 | controller |
2026-03-16 10:24:10.752962 | controller | TASK [reproducer : Inject SSH configuration] ***********************************
2026-03-16 10:24:10.752968 | controller | Monday 16 March 2026  10:24:09 +0000 (0:00:00.667)       0:03:13.568 **********
2026-03-16 10:24:10.752981 | controller | skipping: [instance] => (item=instance)
2026-03-16 10:24:11.316712 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
2026-03-16 10:24:11.316746 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-03-16 10:24:11.316754 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
2026-03-16 10:24:11.316760 | controller |
2026-03-16 10:24:11.316766 | controller | TASK [reproducer : Create kube directory] **************************************
2026-03-16 10:24:11.316771 | controller | Monday 16 March 2026  10:24:10 +0000 (0:00:01.739)       0:03:15.308 **********
2026-03-16 10:24:11.316782 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:12.295261 | controller |
2026-03-16 10:24:12.295293 | controller | TASK [reproducer : Inject kubeconfig content] **********************************
2026-03-16 10:24:12.295301 | controller | Monday 16 March 2026  10:24:11 +0000 (0:00:00.564)       0:03:15.873 **********
2026-03-16 10:24:12.295330 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:13.273655 | controller |
2026-03-16 10:24:13.273688 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************
2026-03-16 10:24:13.273696 | controller | Monday 16 March 2026  10:24:12 +0000 (0:00:00.978)       0:03:16.851 **********
2026-03-16 10:24:13.273706 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:13.306566 | controller |
2026-03-16 10:24:13.306592 | controller | TASK [reproducer : Inject devscripts private key if set] ***********************
2026-03-16 10:24:13.306600 | controller | Monday 16 March 2026  10:24:13 +0000 (0:00:00.978)       0:03:17.829 **********
2026-03-16 10:24:13.306614 | controller | skipping: [instance]
2026-03-16 10:24:13.880352 | controller |
2026-03-16 10:24:13.880386 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ******************************
2026-03-16 10:24:13.880395 | controller | Monday 16 March 2026  10:24:13 +0000 (0:00:00.033)       0:03:17.862 **********
2026-03-16 10:24:13.880405 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:14.415415 | controller |
2026-03-16 10:24:14.415449 | controller | TASK [manage_secrets : Ensure directory tree exist] ****************************
2026-03-16 10:24:14.415458 | controller | Monday 16 March 2026  10:24:13 +0000 (0:00:00.572)       0:03:18.435 **********
2026-03-16 10:24:14.415469 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:14.415635 | controller |
2026-03-16 10:24:14.415646 | controller | TASK [manage_secrets : Assert we get needed data] ******************************
2026-03-16 10:24:14.415654 | controller | Monday 16 March 2026  10:24:14 +0000 (0:00:00.535)       0:03:18.970 **********
2026-03-16 10:24:14.456391 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:14.522911 | controller |
2026-03-16 10:24:14.522933 | controller | TASK [manage_secrets : Push reproducer secrets] ********************************
2026-03-16 10:24:14.522941 | controller | Monday 16 March 2026  10:24:14 +0000 (0:00:00.042)       0:03:19.012 **********
2026-03-16 10:24:14.522950 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
2026-03-16 10:24:14.576430 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
2026-03-16 10:24:14.576459 | controller |
2026-03-16 10:24:14.576466 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-03-16 10:24:14.576472 | controller | Monday 16 March 2026  10:24:14 +0000 (0:00:00.066)       0:03:19.079 **********
2026-03-16 10:24:14.576481 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 10:24:14.626022 | controller |   _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
2026-03-16 10:24:14.626045 | controller |
2026-03-16 10:24:14.626052 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-03-16 10:24:14.626058 | controller | Monday 16 March 2026  10:24:14 +0000 (0:00:00.053)       0:03:19.132 **********
2026-03-16 10:24:14.626068 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 10:24:14.686234 | controller |   _secret_file: ''
2026-03-16 10:24:14.686253 | controller |
2026-03-16 10:24:14.686260 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-03-16 10:24:14.686265 | controller | Monday 16 March 2026  10:24:14 +0000 (0:00:00.049)       0:03:19.182 **********
2026-03-16 10:24:14.686275 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 10:24:14.738608 | controller |   _secret_content: my-default-location-place
2026-03-16 10:24:14.738628 | controller |
2026-03-16 10:24:14.738635 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-03-16 10:24:14.738641 | controller | Monday 16 March 2026  10:24:14 +0000 (0:00:00.060)       0:03:19.242 **********
2026-03-16 10:24:14.738650 | controller | skipping: [instance]
2026-03-16 10:24:14.791118 | controller |
2026-03-16 10:24:14.791141 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-03-16 10:24:14.791150 | controller | Monday 16 March 2026  10:24:14 +0000 (0:00:00.052)       0:03:19.295 **********
2026-03-16 10:24:14.791161 | controller | skipping: [instance]
2026-03-16 10:24:14.842039 | controller |
2026-03-16 10:24:14.842061 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-03-16 10:24:14.842070 | controller | Monday 16 March 2026  10:24:14 +0000 (0:00:00.052)       0:03:19.347 **********
2026-03-16 10:24:14.842080 | controller | skipping: [instance]
2026-03-16 10:24:15.840144 | controller |
2026-03-16 10:24:15.840179 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-03-16 10:24:15.840188 | controller | Monday 16 March 2026  10:24:14 +0000 (0:00:00.051)       0:03:19.398 **********
2026-03-16 10:24:15.840198 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:15.840393 | controller |
2026-03-16 10:24:15.840544 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-03-16 10:24:15.840687 | controller | Monday 16 March 2026  10:24:15 +0000 (0:00:00.998)       0:03:20.396 **********
2026-03-16 10:24:15.905026 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 10:24:15.905193 | controller |   _secret_dest: /home/zuul/ipmi-things
2026-03-16 10:24:15.905341 | controller |
2026-03-16 10:24:15.905506 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-03-16 10:24:15.905637 | controller | Monday 16 March 2026  10:24:15 +0000 (0:00:00.064)       0:03:20.461 **********
2026-03-16 10:24:15.957374 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 10:24:15.957531 | controller |   _secret_file: /tmp/ipmi-things
2026-03-16 10:24:15.957658 | controller |
2026-03-16 10:24:15.957786 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-03-16 10:24:15.957914 | controller | Monday 16 March 2026  10:24:15 +0000 (0:00:00.052)       0:03:20.514 **********
2026-03-16 10:24:16.004844 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-16 10:24:16.004991 | controller |   _secret_content: ''
2026-03-16 10:24:16.005130 | controller |
2026-03-16 10:24:16.005272 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-03-16 10:24:16.005428 | controller | Monday 16 March 2026  10:24:16 +0000 (0:00:00.047)       0:03:20.561 **********
2026-03-16 10:24:16.059842 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false
2026-03-16 10:24:16.060034 | controller |   msg: All assertions passed
2026-03-16 10:24:16.060200 | controller |
2026-03-16 10:24:16.060400 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-03-16 10:24:16.060571 | controller | Monday 16 March 2026  10:24:16 +0000 (0:00:00.054)       0:03:20.616 **********
2026-03-16 10:24:16.657139 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:16.657421 | controller |
2026-03-16 10:24:16.657575 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-03-16 10:24:16.657709 | controller | Monday 16 March 2026  10:24:16 +0000 (0:00:00.596)       0:03:21.213 **********
2026-03-16 10:24:17.836344 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:17.889694 | controller |
2026-03-16 10:24:17.889719 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-03-16 10:24:17.889728 | controller | Monday 16 March 2026  10:24:17 +0000 (0:00:01.178)       0:03:22.392 **********
2026-03-16 10:24:17.889739 | controller | skipping: [instance]
2026-03-16 10:24:18.508100 | controller |
2026-03-16 10:24:18.508131 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
2026-03-16 10:24:18.508139 | controller | Monday 16 March 2026  10:24:17 +0000 (0:00:00.053)       0:03:22.446 **********
2026-03-16 10:24:18.508149 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:19.118347 | controller |
2026-03-16 10:24:19.118378 | controller | TASK [reproducer : Check if async file is still available] *********************
2026-03-16 10:24:19.118386 | controller | Monday 16 March 2026  10:24:18 +0000 (0:00:00.618)       0:03:23.064 **********
2026-03-16 10:24:19.118396 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:58.518448 | controller |
2026-03-16 10:24:58.518492 | controller | TASK [reproducer : Check package install status] *******************************
2026-03-16 10:24:58.518501 | controller | Monday 16 March 2026  10:24:19 +0000 (0:00:00.610)       0:03:23.674 **********
2026-03-16 10:24:58.518512 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
2026-03-16 10:24:59.288946 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
2026-03-16 10:24:59.289006 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
2026-03-16 10:24:59.289015 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
2026-03-16 10:24:59.289020 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
2026-03-16 10:24:59.289025 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
2026-03-16 10:24:59.289031 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
2026-03-16 10:24:59.289036 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:24:59.289042 | controller |
2026-03-16 10:24:59.289048 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
2026-03-16 10:24:59.289054 | controller | Monday 16 March 2026  10:24:58 +0000 (0:00:39.398)       0:04:03.072 **********
2026-03-16 10:24:59.289074 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:02.460076 | controller |
2026-03-16 10:25:02.460135 | controller | TASK [sushy_emulator : Install required packages] ******************************
2026-03-16 10:25:02.460145 | controller | Monday 16 March 2026  10:24:59 +0000 (0:00:00.771)       0:04:03.844 **********
2026-03-16 10:25:02.460159 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:02.520231 | controller |
2026-03-16 10:25:02.520255 | controller | TASK [sushy_emulator : Get ingresses domain] ***********************************
2026-03-16 10:25:02.520262 | controller | Monday 16 March 2026  10:25:02 +0000 (0:00:03.171)       0:04:07.015 **********
2026-03-16 10:25:02.520273 | controller | skipping: [instance]
2026-03-16 10:25:02.567471 | controller |
2026-03-16 10:25:02.567488 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] *********************
2026-03-16 10:25:02.567495 | controller | Monday 16 March 2026  10:25:02 +0000 (0:00:00.052)       0:04:07.068 **********
2026-03-16 10:25:02.567503 | controller | skipping: [instance]
2026-03-16 10:25:03.314066 | controller |
2026-03-16 10:25:03.314139 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
2026-03-16 10:25:03.314148 | controller | Monday 16 March 2026  10:25:02 +0000 (0:00:00.055)       0:04:07.123 **********
2026-03-16 10:25:03.314162 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:04.000451 | controller |
2026-03-16 10:25:04.000529 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ********************
2026-03-16 10:25:04.000539 | controller | Monday 16 March 2026  10:25:03 +0000 (0:00:00.745)       0:04:07.869 **********
2026-03-16 10:25:04.000554 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:04.333236 | controller |
2026-03-16 10:25:04.333274 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
2026-03-16 10:25:04.333282 | controller | Monday 16 March 2026  10:25:03 +0000 (0:00:00.686)       0:04:08.555 **********
2026-03-16 10:25:04.333297 | controller | changed: [instance]
2026-03-16 10:25:05.015992 | controller |
2026-03-16 10:25:05.016024 | controller | TASK [sushy_emulator : Run ssh-keyscan] ****************************************
2026-03-16 10:25:05.016032 | controller | Monday 16 March 2026  10:25:04 +0000 (0:00:00.333)       0:04:08.889 **********
2026-03-16 10:25:05.016042 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:06.008127 | controller |
2026-03-16 10:25:06.008159 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************
2026-03-16 10:25:06.008167 | controller | Monday 16 March 2026  10:25:05 +0000 (0:00:00.682)       0:04:09.572 **********
2026-03-16 10:25:06.008177 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:06.055801 | controller |
2026-03-16 10:25:06.055819 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-16 10:25:06.055839 | controller | Monday 16 March 2026  10:25:06 +0000 (0:00:00.991)       0:04:10.563 **********
2026-03-16 10:25:06.055848 | controller | skipping: [instance]
2026-03-16 10:25:06.105507 | controller |
2026-03-16 10:25:06.105526 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-16 10:25:06.105534 | controller | Monday 16 March 2026  10:25:06 +0000 (0:00:00.048)       0:04:10.611 **********
2026-03-16 10:25:06.105543 | controller | skipping: [instance]
2026-03-16 10:25:06.143204 | controller |
2026-03-16 10:25:06.143223 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-16 10:25:06.143231 | controller | Monday 16 March 2026  10:25:06 +0000 (0:00:00.049)       0:04:10.661 **********
2026-03-16 10:25:06.143240 | controller | skipping: [instance]
2026-03-16 10:25:06.197695 | controller |
2026-03-16 10:25:06.197714 | controller | TASK [sushy_emulator : Generate list of filtered VMs] **************************
2026-03-16 10:25:06.197721 | controller | Monday 16 March 2026  10:25:06 +0000 (0:00:00.037)       0:04:10.699 **********
2026-03-16 10:25:06.197730 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:06.235090 | controller |
2026-03-16 10:25:06.235115 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
2026-03-16 10:25:06.235132 | controller | Monday 16 March 2026  10:25:06 +0000 (0:00:00.054)       0:04:10.753 **********
2026-03-16 10:25:06.235144 | controller | skipping: [instance]
2026-03-16 10:25:06.272992 | controller |
2026-03-16 10:25:06.273016 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
2026-03-16 10:25:06.273026 | controller | Monday 16 March 2026  10:25:06 +0000 (0:00:00.037)       0:04:10.791 **********
2026-03-16 10:25:06.273037 | controller | skipping: [instance]
2026-03-16 10:25:06.309938 | controller |
2026-03-16 10:25:06.309956 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
2026-03-16 10:25:06.309963 | controller | Monday 16 March 2026  10:25:06 +0000 (0:00:00.037)       0:04:10.829 **********
2026-03-16 10:25:06.309971 | controller | skipping: [instance]
2026-03-16 10:25:06.908479 | controller |
2026-03-16 10:25:06.908514 | controller | TASK [sushy_emulator : Generate htpasswd string] *******************************
2026-03-16 10:25:06.908522 | controller | Monday 16 March 2026  10:25:06 +0000 (0:00:00.036)       0:04:10.866 **********
2026-03-16 10:25:06.908534 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:07.009674 | controller |
2026-03-16 10:25:07.009707 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] *********************
2026-03-16 10:25:07.009716 | controller | Monday 16 March 2026  10:25:06 +0000 (0:00:00.598)       0:04:11.464 **********
2026-03-16 10:25:07.009727 | controller | skipping: [instance] => (item=secret)
2026-03-16 10:25:08.010436 | controller | skipping: [instance] => (item=configmap)
2026-03-16 10:25:08.010478 | controller | skipping: [instance] => (item=pod)
2026-03-16 10:25:08.010486 | controller | skipping: [instance] => (item=service)
2026-03-16 10:25:08.010492 | controller | skipping: [instance] => (item=route)
2026-03-16 10:25:08.010497 | controller | skipping: [instance]
2026-03-16 10:25:08.010504 | controller |
2026-03-16 10:25:08.010510 | controller | TASK [sushy_emulator : Write sushy emulator config] ****************************
2026-03-16 10:25:08.010516 | controller | Monday 16 March 2026  10:25:07 +0000 (0:00:00.100)       0:04:11.565 **********
2026-03-16 10:25:08.010526 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:08.010543 | controller |
2026-03-16 10:25:08.010549 | controller | TASK [sushy_emulator : Write htpasswd string to file] **************************
2026-03-16 10:25:08.010556 | controller | Monday 16 March 2026  10:25:08 +0000 (0:00:01.001)       0:04:12.566 **********
2026-03-16 10:25:08.959503 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:08.959560 | controller |
2026-03-16 10:25:08.959671 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
2026-03-16 10:25:08.959765 | controller | Monday 16 March 2026  10:25:08 +0000 (0:00:00.949)       0:04:13.515 **********
2026-03-16 10:25:08.996205 | controller | skipping: [instance]
2026-03-16 10:25:08.996298 | controller |
2026-03-16 10:25:08.996452 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
2026-03-16 10:25:08.996566 | controller | Monday 16 March 2026  10:25:08 +0000 (0:00:00.037)       0:04:13.552 **********
2026-03-16 10:25:09.032784 | controller | skipping: [instance]
2026-03-16 10:25:09.032867 | controller |
2026-03-16 10:25:09.032965 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
2026-03-16 10:25:09.033057 | controller | Monday 16 March 2026  10:25:09 +0000 (0:00:00.036)       0:04:13.589 **********
2026-03-16 10:25:09.107667 | controller | skipping: [instance] => (item=secret)
2026-03-16 10:25:09.146522 | controller | skipping: [instance] => (item=configmap)
2026-03-16 10:25:09.146546 | controller | skipping: [instance] => (item=service)
2026-03-16 10:25:09.146555 | controller | skipping: [instance] => (item=route)
2026-03-16 10:25:09.146563 | controller | skipping: [instance]
2026-03-16 10:25:09.146570 | controller |
2026-03-16 10:25:09.146577 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
2026-03-16 10:25:09.146585 | controller | Monday 16 March 2026  10:25:09 +0000 (0:00:00.074)       0:04:13.663 **********
2026-03-16 10:25:09.146600 | controller | skipping: [instance]
2026-03-16 10:25:10.663756 | controller |
2026-03-16 10:25:10.663789 | controller | TASK [podman : Ensure podman is installed] *************************************
2026-03-16 10:25:10.663797 | controller | Monday 16 March 2026  10:25:09 +0000 (0:00:00.039)       0:04:13.702 **********
2026-03-16 10:25:10.663812 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:11.439963 | controller |
2026-03-16 10:25:11.439995 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] *********************
2026-03-16 10:25:11.440004 | controller | Monday 16 March 2026  10:25:10 +0000 (0:00:01.516)       0:04:15.219 **********
2026-03-16 10:25:11.440014 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:11.484073 | controller |
2026-03-16 10:25:11.484111 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
2026-03-16 10:25:11.484120 | controller | Monday 16 March 2026  10:25:11 +0000 (0:00:00.776)       0:04:15.996 **********
2026-03-16 10:25:11.484133 | controller | skipping: [instance]
2026-03-16 10:25:11.529790 | controller |
2026-03-16 10:25:11.529832 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
2026-03-16 10:25:11.529841 | controller | Monday 16 March 2026  10:25:11 +0000 (0:00:00.044)       0:04:16.040 **********
2026-03-16 10:25:11.529851 | controller | skipping: [instance]
2026-03-16 10:25:11.578373 | controller |
2026-03-16 10:25:11.578400 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
2026-03-16 10:25:11.578408 | controller | Monday 16 March 2026  10:25:11 +0000 (0:00:00.045)       0:04:16.085 **********
2026-03-16 10:25:11.578420 | controller | skipping: [instance]
2026-03-16 10:25:22.389828 | controller |
2026-03-16 10:25:22.389868 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
2026-03-16 10:25:22.389877 | controller | Monday 16 March 2026  10:25:11 +0000 (0:00:00.048)       0:04:16.134 **********
2026-03-16 10:25:22.389891 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:23.810170 | controller |
2026-03-16 10:25:23.810202 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] **************
2026-03-16 10:25:23.810210 | controller | Monday 16 March 2026  10:25:22 +0000 (0:00:10.810)       0:04:26.945 **********
2026-03-16 10:25:23.810220 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:24.983972 | controller |
2026-03-16 10:25:24.984006 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-03-16 10:25:24.984016 | controller | Monday 16 March 2026  10:25:23 +0000 (0:00:01.420)       0:04:28.366 **********
2026-03-16 10:25:24.984029 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-03-16 10:25:25.021358 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-03-16 10:25:25.021387 | controller |
2026-03-16 10:25:25.021394 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] *************
2026-03-16 10:25:25.021401 | controller | Monday 16 March 2026  10:25:24 +0000 (0:00:01.171)       0:04:29.537 **********
2026-03-16 10:25:25.021410 | controller | skipping: [instance]
2026-03-16 10:25:25.575154 | controller |
2026-03-16 10:25:25.575204 | controller | TASK [reproducer : Check if baremetal-info.yml exists] *************************
2026-03-16 10:25:25.575212 | controller | Monday 16 March 2026  10:25:25 +0000 (0:00:00.039)       0:04:29.577 **********
2026-03-16 10:25:25.575223 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:25.611728 | controller |
2026-03-16 10:25:25.611757 | controller | TASK [reproducer : Get content of baremetal-info file] *************************
2026-03-16 10:25:25.611767 | controller | Monday 16 March 2026  10:25:25 +0000 (0:00:00.550)       0:04:30.128 **********
2026-03-16 10:25:25.611779 | controller | skipping: [instance]
2026-03-16 10:25:25.655298 | controller |
2026-03-16 10:25:25.655338 | controller | TASK [reproducer : Interpret remote file content as yaml] **********************
2026-03-16 10:25:25.655350 | controller | Monday 16 March 2026  10:25:25 +0000 (0:00:00.039)       0:04:30.167 **********
2026-03-16 10:25:25.655360 | controller | skipping: [instance]
2026-03-16 10:25:25.696874 | controller |
2026-03-16 10:25:25.696896 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-03-16 10:25:25.696906 | controller | Monday 16 March 2026  10:25:25 +0000 (0:00:00.043)       0:04:30.211 **********
2026-03-16 10:25:25.696917 | controller | skipping: [instance]
2026-03-16 10:25:25.732384 | controller |
2026-03-16 10:25:25.732408 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-03-16 10:25:25.732417 | controller | Monday 16 March 2026  10:25:25 +0000 (0:00:00.041)       0:04:30.253 **********
2026-03-16 10:25:25.732428 | controller | skipping: [instance]
2026-03-16 10:25:25.868448 | controller |
2026-03-16 10:25:25.868473 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
2026-03-16 10:25:25.868481 | controller | Monday 16 March 2026  10:25:25 +0000 (0:00:00.035)       0:04:30.288 **********
2026-03-16 10:25:25.868491 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'})
2026-03-16 10:25:26.914556 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'})
2026-03-16 10:25:26.914589 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'})
2026-03-16 10:25:26.914596 | controller |
2026-03-16 10:25:26.914603 | controller | TASK [reproducer : Output baremetal info file] *********************************
2026-03-16 10:25:26.914608 | controller | Monday 16 March 2026  10:25:25 +0000 (0:00:00.135)       0:04:30.424 **********
2026-03-16 10:25:26.914618 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:26.952499 | controller |
2026-03-16 10:25:26.952525 | controller | TASK [reproducer : Output ironic_nodes to file] ********************************
2026-03-16 10:25:26.952537 | controller | Monday 16 March 2026  10:25:26 +0000 (0:00:01.046)       0:04:31.470 **********
2026-03-16 10:25:26.952547 | controller | skipping: [instance]
2026-03-16 10:25:27.092473 | controller |
2026-03-16 10:25:27.092503 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
2026-03-16 10:25:27.092513 | controller | Monday 16 March 2026  10:25:26 +0000 (0:00:00.038)       0:04:31.508 **********
2026-03-16 10:25:27.092525 | controller |
2026-03-16 10:25:27.138264 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
2026-03-16 10:25:27.138288 | controller | Monday 16 March 2026  10:25:27 +0000 (0:00:00.139)       0:04:31.648 **********
2026-03-16 10:25:27.138300 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:27.182300 | controller |
2026-03-16 10:25:27.182336 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-03-16 10:25:27.182345 | controller | Monday 16 March 2026  10:25:27 +0000 (0:00:00.046)       0:04:31.694 **********
2026-03-16 10:25:27.182354 | controller | skipping: [instance]
2026-03-16 10:25:27.217541 | controller |
2026-03-16 10:25:27.217558 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-03-16 10:25:27.217566 | controller | Monday 16 March 2026  10:25:27 +0000 (0:00:00.044)       0:04:31.738 **********
2026-03-16 10:25:27.217575 | controller | skipping: [instance]
2026-03-16 10:25:28.568855 | controller |
2026-03-16 10:25:28.568888 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
2026-03-16 10:25:28.568896 | controller | Monday 16 March 2026  10:25:27 +0000 (0:00:00.035)       0:04:31.773 **********
2026-03-16 10:25:28.568906 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:35.360826 | controller |
2026-03-16 10:25:35.360856 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
2026-03-16 10:25:35.360865 | controller | Monday 16 March 2026  10:25:28 +0000 (0:00:01.351)       0:04:33.124 **********
2026-03-16 10:25:35.360875 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1)
2026-03-16 10:25:35.464010 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b)
2026-03-16 10:25:35.464042 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282)
2026-03-16 10:25:35.464049 | controller |
2026-03-16 10:25:35.464056 | controller | TASK [sushy_emulator : Verify baremetal VM power status] ***********************
2026-03-16 10:25:35.464067 | controller | Monday 16 March 2026  10:25:35 +0000 (0:00:06.791)       0:04:39.916 **********
2026-03-16 10:25:35.464077 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
2026-03-16 10:25:35.678985 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
2026-03-16 10:25:35.679013 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
2026-03-16 10:25:35.679022 | controller |
2026-03-16 10:25:35.679028 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
2026-03-16 10:25:35.679033 | controller | Monday 16 March 2026  10:25:35 +0000 (0:00:00.103)       0:04:40.020 **********
2026-03-16 10:25:35.679043 | controller | ok: [instance -> localhost]
2026-03-16 10:25:37.508896 | controller |
2026-03-16 10:25:37.508926 | controller | TASK [reproducer : Sync local repositories to other hosts if present] **********
2026-03-16 10:25:37.508934 | controller | Monday 16 March 2026  10:25:35 +0000 (0:00:00.215)       0:04:40.235 **********
2026-03-16 10:25:37.508944 | controller | changed: [instance -> localhost] => (item=controller-0)
2026-03-16 10:25:38.151808 | controller |
2026-03-16 10:25:38.151841 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
2026-03-16 10:25:38.151849 | controller | Monday 16 March 2026  10:25:37 +0000 (0:00:01.829)       0:04:42.064 **********
2026-03-16 10:25:38.151860 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:38.874592 | controller |
2026-03-16 10:25:38.874630 | controller | TASK [reproducer : Install ansible dependencies] *******************************
2026-03-16 10:25:38.874638 | controller | Monday 16 March 2026  10:25:38 +0000 (0:00:00.642)       0:04:42.707 **********
2026-03-16 10:25:38.874649 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:39.919157 | controller |
2026-03-16 10:25:39.919215 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
2026-03-16 10:25:39.919223 | controller | Monday 16 March 2026  10:25:38 +0000 (0:00:00.722)       0:04:43.430 **********
2026-03-16 10:25:39.919239 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:40.536326 | controller |
2026-03-16 10:25:40.536364 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
2026-03-16 10:25:40.536373 | controller | Monday 16 March 2026  10:25:39 +0000 (0:00:01.044)       0:04:44.475 **********
2026-03-16 10:25:40.536383 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:40.536518 | controller |
2026-03-16 10:25:40.536687 | controller | TASK [reproducer : Inject local environment parameters] ************************
2026-03-16 10:25:40.536843 | controller | Monday 16 March 2026  10:25:40 +0000 (0:00:00.617)       0:04:45.092 **********
2026-03-16 10:25:41.535423 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:41.535476 | controller |
2026-03-16 10:25:41.535488 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
2026-03-16 10:25:41.535583 | controller | Monday 16 March 2026  10:25:41 +0000 (0:00:00.996)       0:04:46.088 **********
2026-03-16 10:25:42.130180 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:42.741086 | controller |
2026-03-16 10:25:42.741128 | controller | TASK [reproducer : Get interfaces-info content] ********************************
2026-03-16 10:25:42.741137 | controller | Monday 16 March 2026  10:25:42 +0000 (0:00:00.597)       0:04:46.686 **********
2026-03-16 10:25:42.741160 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:44.081692 | controller |
2026-03-16 10:25:44.081730 | controller | TASK [reproducer : Wait for OCP nodes to be ready] *****************************
2026-03-16 10:25:44.081738 | controller | Monday 16 March 2026  10:25:42 +0000 (0:00:00.610)       0:04:47.296 **********
2026-03-16 10:25:44.081749 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-03-16 10:25:44.116916 | controller |
2026-03-16 10:25:44.116941 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-16 10:25:44.116949 | controller | Monday 16 March 2026  10:25:44 +0000 (0:00:01.340)       0:04:48.637 **********
2026-03-16 10:25:44.116959 | controller | skipping: [instance]
2026-03-16 10:25:44.151092 | controller |
2026-03-16 10:25:44.151118 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-16 10:25:44.151126 | controller | Monday 16 March 2026  10:25:44 +0000 (0:00:00.035)       0:04:48.673 **********
2026-03-16 10:25:44.151136 | controller | skipping: [instance]
2026-03-16 10:25:44.188890 | controller |
2026-03-16 10:25:44.188912 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-16 10:25:44.188919 | controller | Monday 16 March 2026  10:25:44 +0000 (0:00:00.034)       0:04:48.707 **********
2026-03-16 10:25:44.188929 | controller | skipping: [instance]
2026-03-16 10:25:44.225526 | controller |
2026-03-16 10:25:44.225547 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-16 10:25:44.225554 | controller | Monday 16 March 2026  10:25:44 +0000 (0:00:00.037)       0:04:48.745 **********
2026-03-16 10:25:44.225563 | controller | skipping: [instance]
2026-03-16 10:25:44.265040 | controller |
2026-03-16 10:25:44.265060 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-16 10:25:44.265067 | controller | Monday 16 March 2026  10:25:44 +0000 (0:00:00.036)       0:04:48.781 **********
2026-03-16 10:25:44.265076 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:44.375029 | controller |
2026-03-16 10:25:44.375050 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-16 10:25:44.375058 | controller | Monday 16 March 2026  10:25:44 +0000 (0:00:00.039)       0:04:48.821 **********
2026-03-16 10:25:44.375074 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
2026-03-16 10:25:44.423455 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={})
2026-03-16 10:25:44.423474 | controller |
2026-03-16 10:25:44.423481 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-16 10:25:44.423487 | controller | Monday 16 March 2026  10:25:44 +0000 (0:00:00.109)       0:04:48.931 **********
2026-03-16 10:25:44.423501 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
2026-03-16 10:25:47.911139 | controller |
2026-03-16 10:25:47.911175 | controller | TASK [networking_mapper : Gather the facts] ************************************
2026-03-16 10:25:47.911183 | controller | Monday 16 March 2026  10:25:44 +0000 (0:00:00.048)       0:04:48.979 **********
2026-03-16 10:25:47.911193 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-03-16 10:25:48.896891 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
2026-03-16 10:25:48.896923 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-03-16 10:25:48.896931 | controller |
2026-03-16 10:25:48.896937 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
2026-03-16 10:25:48.896943 | controller | Monday 16 March 2026  10:25:47 +0000 (0:00:03.487)       0:04:52.467 **********
2026-03-16 10:25:48.896954 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:49.360491 | controller |
2026-03-16 10:25:49.360523 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-16 10:25:49.360530 | controller | Monday 16 March 2026  10:25:48 +0000 (0:00:00.985)       0:04:53.453 **********
2026-03-16 10:25:49.360541 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:50.251231 | controller |
2026-03-16 10:25:50.251262 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-16 10:25:50.251270 | controller | Monday 16 March 2026  10:25:49 +0000 (0:00:00.463)       0:04:53.916 **********
2026-03-16 10:25:50.251280 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:50.326918 | controller |
2026-03-16 10:25:50.326945 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-16 10:25:50.326954 | controller | Monday 16 March 2026  10:25:50 +0000 (0:00:00.890)       0:04:54.807 **********
2026-03-16 10:25:50.326964 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:50.375543 | controller |
2026-03-16 10:25:50.375569 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-16 10:25:50.375577 | controller | Monday 16 March 2026  10:25:50 +0000 (0:00:00.075)       0:04:54.883 **********
2026-03-16 10:25:50.375587 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:51.341783 | controller |
2026-03-16 10:25:51.341814 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-16 10:25:51.341827 | controller | Monday 16 March 2026  10:25:50 +0000 (0:00:00.048)       0:04:54.931 **********
2026-03-16 10:25:51.341838 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:52.218219 | controller |
2026-03-16 10:25:52.218250 | controller | TASK [reproducer : Inject CRC ssh key] *****************************************
2026-03-16 10:25:52.218258 | controller | Monday 16 March 2026  10:25:51 +0000 (0:00:00.966)       0:04:55.897 **********
2026-03-16 10:25:52.218268 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:58.124917 | controller |
2026-03-16 10:25:58.124948 | controller | TASK [reproducer : Ensure we have all dependencies installed] ******************
2026-03-16 10:25:58.124957 | controller | Monday 16 March 2026  10:25:52 +0000 (0:00:00.876)       0:04:56.774 **********
2026-03-16 10:25:58.124968 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
2026-03-16 10:25:58.322287 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:25:58.322330 | controller |
2026-03-16 10:25:58.322341 | controller | TASK [Configure ntp service] ***************************************************
2026-03-16 10:25:58.322352 | controller | Monday 16 March 2026  10:25:58 +0000 (0:00:05.906)       0:05:02.680 **********
2026-03-16 10:25:58.322362 | controller |
2026-03-16 10:25:59.338341 | controller | TASK [cifmw_ntp : Install chrony] **********************************************
2026-03-16 10:25:59.338374 | controller | Monday 16 March 2026  10:25:58 +0000 (0:00:00.197)       0:05:02.878 **********
2026-03-16 10:25:59.338395 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:00.229250 | controller |
2026-03-16 10:26:00.229284 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] *************************
2026-03-16 10:26:00.229292 | controller | Monday 16 March 2026  10:25:59 +0000 (0:00:01.012)       0:05:03.890 **********
2026-03-16 10:26:00.229303 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
2026-03-16 10:26:01.123971 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
2026-03-16 10:26:01.124005 | controller |
2026-03-16 10:26:01.124016 | controller | TASK [cifmw_ntp : Render chrony extra config file] *****************************
2026-03-16 10:26:01.124023 | controller | Monday 16 March 2026  10:26:00 +0000 (0:00:00.894)       0:05:04.785 **********
2026-03-16 10:26:01.124035 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:01.745621 | controller |
2026-03-16 10:26:01.745651 | controller | TASK [cifmw_ntp : Enable chrony service] ***************************************
2026-03-16 10:26:01.745659 | controller | Monday 16 March 2026  10:26:01 +0000 (0:00:00.894)       0:05:05.680 **********
2026-03-16 10:26:01.745670 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:01.885091 | controller |
2026-03-16 10:26:01.885112 | controller | TASK [reproducer : Configure CRC node if available] ****************************
2026-03-16 10:26:01.885119 | controller | Monday 16 March 2026  10:26:01 +0000 (0:00:00.620)       0:05:06.300 **********
2026-03-16 10:26:01.885128 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
2026-03-16 10:26:02.333983 | controller |
2026-03-16 10:26:02.334013 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] ***
2026-03-16 10:26:02.334021 | controller | Monday 16 March 2026  10:26:01 +0000 (0:00:00.140)       0:05:06.441 **********
2026-03-16 10:26:02.334032 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:02.773130 | controller |
2026-03-16 10:26:02.773163 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ********************
2026-03-16 10:26:02.773172 | controller | Monday 16 March 2026  10:26:02 +0000 (0:00:00.448)       0:05:06.889 **********
2026-03-16 10:26:02.773182 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-03-16 10:26:03.417808 | controller |
2026-03-16 10:26:03.417841 | controller | TASK [reproducer : Configure local DNS for CRC pod] ****************************
2026-03-16 10:26:03.417850 | controller | Monday 16 March 2026  10:26:02 +0000 (0:00:00.439)       0:05:07.329 **********
2026-03-16 10:26:03.417860 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-16 10:26:03.981188 | controller |
2026-03-16 10:26:03.981248 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
2026-03-16 10:26:03.981258 | controller | Monday 16 March 2026  10:26:03 +0000 (0:00:00.644)       0:05:07.974 **********
2026-03-16 10:26:03.981271 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-16 10:26:04.044234 | controller |
2026-03-16 10:26:04.044279 | controller | TASK [Restart DNS in CRC VM] ***************************************************
2026-03-16 10:26:04.044289 | controller | Monday 16 March 2026  10:26:03 +0000 (0:00:00.562)       0:05:08.536 **********
2026-03-16 10:26:04.044301 | controller |
2026-03-16 10:26:04.547048 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
2026-03-16 10:26:04.547117 | controller | Monday 16 March 2026  10:26:04 +0000 (0:00:00.063)       0:05:08.600 **********
2026-03-16 10:26:04.547133 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-03-16 10:26:05.294228 | controller |
2026-03-16 10:26:05.294272 | controller | TASK [openshift_setup : Restart dnsmasq service if used] ***********************
2026-03-16 10:26:05.294281 | controller | Monday 16 March 2026  10:26:04 +0000 (0:00:00.502)       0:05:09.102 **********
2026-03-16 10:26:05.294299 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-16 10:26:05.325273 | controller |
2026-03-16 10:26:05.325298 | controller | TASK [openshift_setup : Stop dnsmasq] ******************************************
2026-03-16 10:26:05.325306 | controller | Monday 16 March 2026  10:26:05 +0000 (0:00:00.747)       0:05:09.850 **********
2026-03-16 10:26:05.325342 | controller | skipping: [instance]
2026-03-16 10:26:05.364778 | controller |
2026-03-16 10:26:05.364808 | controller | TASK [openshift_setup : Start dnsmasq] *****************************************
2026-03-16 10:26:05.364816 | controller | Monday 16 March 2026  10:26:05 +0000 (0:00:00.030)       0:05:09.881 **********
2026-03-16 10:26:05.364827 | controller | skipping: [instance]
2026-03-16 10:26:05.625618 | controller |
2026-03-16 10:26:05.625671 | controller | TASK [reproducer : Remove entry from /etc/hosts] *******************************
2026-03-16 10:26:05.625681 | controller | Monday 16 March 2026  10:26:05 +0000 (0:00:00.039)       0:05:09.920 **********
2026-03-16 10:26:05.625694 | controller | changed: [instance]
2026-03-16 10:26:05.705682 | controller |
2026-03-16 10:26:05.705711 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
2026-03-16 10:26:05.705720 | controller | Monday 16 March 2026  10:26:05 +0000 (0:00:00.260)       0:05:10.181 **********
2026-03-16 10:26:05.705761 | controller | skipping: [instance] => (item=)
2026-03-16 10:26:05.749454 | controller |
2026-03-16 10:26:05.749482 | controller | TASK [dnsmasq : Assert we have needed address data] ****************************
2026-03-16 10:26:05.749490 | controller | Monday 16 March 2026  10:26:05 +0000 (0:00:00.080)       0:05:10.261 **********
2026-03-16 10:26:05.749500 | controller | ok: [instance]
2026-03-16 10:26:05.829023 | controller |
2026-03-16 10:26:05.829042 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-16 10:26:05.829049 | controller | Monday 16 March 2026  10:26:05 +0000 (0:00:00.043)       0:05:10.305 **********
2026-03-16 10:26:05.829059 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-03-16 10:26:06.110307 | controller |
2026-03-16 10:26:06.110358 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-16 10:26:06.110366 | controller | Monday 16 March 2026  10:26:05 +0000 (0:00:00.079)       0:05:10.385 **********
2026-03-16 10:26:06.110377 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-03-16 10:26:06.166713 | controller |
2026-03-16 10:26:06.166753 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
2026-03-16 10:26:06.166762 | controller | Monday 16 March 2026  10:26:06 +0000 (0:00:00.281)       0:05:10.666 **********
2026-03-16 10:26:06.166772 | controller |
2026-03-16 10:26:06.228999 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-16 10:26:06.229023 | controller | Monday 16 March 2026  10:26:06 +0000 (0:00:00.056)       0:05:10.723 **********
2026-03-16 10:26:06.229035 | controller | ok: [instance]
2026-03-16 10:26:06.286823 | controller |
2026-03-16 10:26:06.286850 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-16 10:26:06.286860 | controller | Monday 16 March 2026  10:26:06 +0000 (0:00:00.062)       0:05:10.785 **********
2026-03-16 10:26:06.286872 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-16 10:26:06.548307 | controller |
2026-03-16 10:26:06.548362 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-16 10:26:06.548370 | controller | Monday 16 March 2026  10:26:06 +0000 (0:00:00.057)       0:05:10.843 **********
2026-03-16 10:26:06.548381 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-16 10:26:06.601760 | controller |
2026-03-16 10:26:06.601786 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-16 10:26:06.601795 | controller | Monday 16 March 2026  10:26:06 +0000 (0:00:00.260)       0:05:11.103 **********
2026-03-16 10:26:06.601817 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-16 10:26:06.632362 | controller | skipping: [instance]
2026-03-16 10:26:06.632384 | controller |
2026-03-16 10:26:06.632391 | controller | TASK [dnsmasq : Remove crc.testing from host_records] **************************
2026-03-16 10:26:06.632402 | controller | Monday 16 March 2026  10:26:06 +0000 (0:00:00.053)       0:05:11.157 **********
2026-03-16 10:26:06.632411 | controller | skipping: [instance]
2026-03-16 10:26:06.632574 | controller |
2026-03-16 10:26:06.632587 | controller | TASK [reproducer : Ensure "testing" domain is "local"] *************************
2026-03-16 10:26:07.029387 | controller | Monday 16 March 2026  10:26:06 +0000 (0:00:00.031)       0:05:11.188 **********
2026-03-16 10:26:07.029424 | controller | changed: [instance]
2026-03-16 10:26:07.029800 | controller |
2026-03-16 10:26:07.029813 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-03-16 10:26:07.029822 | controller | Monday 16 March 2026  10:26:07 +0000 (0:00:00.379)       0:05:11.568 **********
2026-03-16 10:26:07.712755 | controller |
2026-03-16 10:26:07.712785 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
2026-03-16 10:26:07.712794 | controller | Monday 16 March 2026  10:26:07 +0000 (0:00:00.017)       0:05:11.585 **********
2026-03-16 10:26:07.712804 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:08.092477 | controller |
2026-03-16 10:26:08.092519 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-16 10:26:08.092537 | controller | Monday 16 March 2026  10:26:07 +0000 (0:00:00.683)       0:05:12.268 **********
2026-03-16 10:26:08.092552 | controller | changed: [instance]
2026-03-16 10:26:08.271497 | controller |
2026-03-16 10:26:08.271526 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
2026-03-16 10:26:08.271533 | controller | Monday 16 March 2026  10:26:08 +0000 (0:00:00.379)       0:05:12.648 **********
2026-03-16 10:26:08.271543 | controller | skipping: [instance] => (item=controller-0)
2026-03-16 10:26:09.715864 | controller | skipping: [instance] => (item=crc-0)
2026-03-16 10:26:09.715897 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
2026-03-16 10:26:09.715905 | controller |
2026-03-16 10:26:09.715912 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
2026-03-16 10:26:09.715917 | controller | Monday 16 March 2026  10:26:08 +0000 (0:00:00.178)       0:05:12.826 **********
2026-03-16 10:26:09.715942 | controller | changed: [instance -> compute-0(compute-0.instance)]
2026-03-16 10:26:09.735016 | controller |
2026-03-16 10:26:09.735040 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-03-16 10:26:09.735048 | controller | Monday 16 March 2026  10:26:09 +0000 (0:00:01.444)       0:05:14.271 **********
2026-03-16 10:26:09.735057 | controller | skipping: [instance]
2026-03-16 10:26:09.735080 | controller |
2026-03-16 10:26:09.735087 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-16 10:26:09.735103 | controller | Monday 16 March 2026  10:26:09 +0000 (0:00:00.019)       0:05:14.291 **********
2026-03-16 10:26:10.246505 | controller | ok: [instance -> compute-0(compute-0.instance)]
2026-03-16 10:26:10.246596 | controller |
2026-03-16 10:26:10.246613 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-16 10:26:10.246624 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.511)       0:05:14.802 **********
2026-03-16 10:26:10.280881 | controller | skipping: [instance]
2026-03-16 10:26:10.316416 | controller |
2026-03-16 10:26:10.316440 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-16 10:26:10.316458 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.034)       0:05:14.837 **********
2026-03-16 10:26:10.316470 | controller | skipping: [instance]
2026-03-16 10:26:10.316491 | controller |
2026-03-16 10:26:10.316746 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-16 10:26:10.350412 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.035)       0:05:14.873 **********
2026-03-16 10:26:10.350437 | controller | skipping: [instance]
2026-03-16 10:26:10.350596 | controller |
2026-03-16 10:26:10.350615 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-16 10:26:10.392461 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.034)       0:05:14.907 **********
2026-03-16 10:26:10.392510 | controller | skipping: [instance]
2026-03-16 10:26:10.428430 | controller |
2026-03-16 10:26:10.428461 | controller | TASK [reproducer : Get rhos-release and setup repos] ***************************
2026-03-16 10:26:10.428471 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.041)       0:05:14.948 **********
2026-03-16 10:26:10.428482 | controller | skipping: [instance]
2026-03-16 10:26:10.428560 | controller |
2026-03-16 10:26:10.428579 | controller | TASK [reproducer : Create repositories on computes] ****************************
2026-03-16 10:26:10.428592 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.035)       0:05:14.984 **********
2026-03-16 10:26:10.447029 | controller | skipping: [instance]
2026-03-16 10:26:10.447295 | controller |
2026-03-16 10:26:10.475130 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
2026-03-16 10:26:10.475152 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.018)       0:05:15.003 **********
2026-03-16 10:26:10.475165 | controller | skipping: [instance]
2026-03-16 10:26:10.530631 | controller |
2026-03-16 10:26:10.530665 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2026-03-16 10:26:10.530673 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.027)       0:05:15.031 **********
2026-03-16 10:26:10.530684 | controller | ok: [instance]
2026-03-16 10:26:10.530711 | controller |
2026-03-16 10:26:10.530909 | controller | TASK [reproducer : Push local code] ********************************************
2026-03-16 10:26:10.626056 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.055)       0:05:15.087 **********
2026-03-16 10:26:10.626082 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
2026-03-16 10:26:10.666202 | controller |
2026-03-16 10:26:10.666229 | controller | TASK [reproducer : Check if repository directories already exist] **************
2026-03-16 10:26:10.666237 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.095)       0:05:15.182 **********
2026-03-16 10:26:10.666246 | controller | skipping: [instance]
2026-03-16 10:26:10.705238 | controller |
2026-03-16 10:26:10.705266 | controller | TASK [reproducer : Ensure we are not in the job_id branch] *********************
2026-03-16 10:26:10.705274 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.040)       0:05:15.222 **********
2026-03-16 10:26:10.705290 | controller | skipping: [instance]
2026-03-16 10:26:10.744423 | controller |
2026-03-16 10:26:10.744450 | controller | TASK [reproducer : Fetch zuul.items repositories] ******************************
2026-03-16 10:26:10.744460 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.039)       0:05:15.261 **********
2026-03-16 10:26:10.744471 | controller | skipping: [instance]
2026-03-16 10:26:10.744509 | controller |
2026-03-16 10:26:10.744518 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
2026-03-16 10:26:10.744528 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.039)       0:05:15.300 **********
2026-03-16 10:26:10.783389 | controller | skipping: [instance]
2026-03-16 10:26:10.816495 | controller |
2026-03-16 10:26:10.816543 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
2026-03-16 10:26:10.816557 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.038)       0:05:15.339 **********
2026-03-16 10:26:10.816575 | controller | skipping: [instance]
2026-03-16 10:26:11.276432 | controller |
2026-03-16 10:26:11.276469 | controller | TASK [reproducer : Create target directories beforehand] ***********************
2026-03-16 10:26:11.276480 | controller | Monday 16 March 2026  10:26:10 +0000 (0:00:00.033)       0:05:15.372 **********
2026-03-16 10:26:11.276493 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
2026-03-16 10:26:11.276558 | controller |
2026-03-16 10:26:11.276591 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2026-03-16 10:26:11.276604 | controller | Monday 16 March 2026  10:26:11 +0000 (0:00:00.459)       0:05:15.832 **********
2026-03-16 10:26:11.829289 | controller | ok: [instance -> localhost] => (item=ci-framework)
2026-03-16 10:26:11.829788 | controller |
2026-03-16 10:26:11.870279 | controller | TASK [reproducer : Sync remote repositories] ***********************************
2026-03-16 10:26:11.870302 | controller | Monday 16 March 2026  10:26:11 +0000 (0:00:00.552)       0:05:16.385 **********
2026-03-16 10:26:11.870341 | controller | skipping: [instance] => (item=ci-framework)
2026-03-16 10:26:11.948405 | controller | skipping: [instance]
2026-03-16 10:26:11.948450 | controller |
2026-03-16 10:26:11.948459 | controller | TASK [reproducer : Ensure default repositories are present] ********************
2026-03-16 10:26:11.948466 | controller | Monday 16 March 2026  10:26:11 +0000 (0:00:00.040)       0:05:16.426 **********
2026-03-16 10:26:11.948499 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework)
2026-03-16 10:26:11.948603 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls)
2026-03-16 10:26:11.948625 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture)
2026-03-16 10:26:11.948643 | controller |
2026-03-16 10:26:11.948896 | controller | TASK [reproducer : Check repository availability: ci-framework] ****************
2026-03-16 10:26:12.404052 | controller | Monday 16 March 2026  10:26:11 +0000 (0:00:00.078)       0:05:16.504 **********
2026-03-16 10:26:12.404090 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:12.440798 | controller |
2026-03-16 10:26:12.440826 | controller | TASK [reproducer : Clone repository if needed: ci-framework] *******************
2026-03-16 10:26:12.440834 | controller | Monday 16 March 2026  10:26:12 +0000 (0:00:00.455)       0:05:16.960 **********
2026-03-16 10:26:12.440844 | controller | skipping: [instance]
2026-03-16 10:26:12.905302 | controller |
2026-03-16 10:26:12.905356 | controller | TASK [reproducer : Check repository availability: install_yamls] ***************
2026-03-16 10:26:12.905365 | controller | Monday 16 March 2026  10:26:12 +0000 (0:00:00.036)       0:05:16.997 **********
2026-03-16 10:26:12.905375 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:12.943091 | controller |
2026-03-16 10:26:12.943121 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ******************
2026-03-16 10:26:12.943129 | controller | Monday 16 March 2026  10:26:12 +0000 (0:00:00.464)       0:05:17.461 **********
2026-03-16 10:26:12.943139 | controller | skipping: [instance]
2026-03-16 10:26:13.427841 | controller |
2026-03-16 10:26:13.427871 | controller | TASK [reproducer : Check repository availability: architecture] ****************
2026-03-16 10:26:13.427879 | controller | Monday 16 March 2026  10:26:12 +0000 (0:00:00.037)       0:05:17.499 **********
2026-03-16 10:26:13.427889 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:15.712124 | controller |
2026-03-16 10:26:15.712157 | controller | TASK [reproducer : Clone repository if needed: architecture] *******************
2026-03-16 10:26:15.712165 | controller | Monday 16 March 2026  10:26:13 +0000 (0:00:00.484)       0:05:17.983 **********
2026-03-16 10:26:15.712176 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:35.888785 | controller |
2026-03-16 10:26:35.888827 | controller | TASK [reproducer : Install collections on controller-0] ************************
2026-03-16 10:26:35.888836 | controller | Monday 16 March 2026  10:26:15 +0000 (0:00:02.284)       0:05:20.268 **********
2026-03-16 10:26:35.888847 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:36.921050 | controller |
2026-03-16 10:26:36.921081 | controller | TASK [reproducer : Inject CI Framework motd] ***********************************
2026-03-16 10:26:36.921089 | controller | Monday 16 March 2026  10:26:35 +0000 (0:00:20.176)       0:05:40.444 **********
2026-03-16 10:26:36.921099 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:37.030175 | controller |
2026-03-16 10:26:37.030210 | controller | TASK [reproducer : Rotate some logs] *******************************************
2026-03-16 10:26:37.030218 | controller | Monday 16 March 2026  10:26:36 +0000 (0:00:01.032)       0:05:41.476 **********
2026-03-16 10:26:37.030240 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log)
2026-03-16 10:26:37.521051 | controller |
2026-03-16 10:26:37.521146 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] *********************
2026-03-16 10:26:37.521157 | controller | Monday 16 March 2026  10:26:37 +0000 (0:00:00.109)       0:05:41.586 **********
2026-03-16 10:26:37.521198 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:37.521220 | controller |
2026-03-16 10:26:37.521226 | controller | TASK [reproducer : Rotate log if present] **************************************
2026-03-16 10:26:37.521234 | controller | Monday 16 March 2026  10:26:37 +0000 (0:00:00.490)       0:05:42.077 **********
2026-03-16 10:26:37.573154 | controller | skipping: [instance]
2026-03-16 10:26:37.573228 | controller |
2026-03-16 10:26:37.573367 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] ***********************
2026-03-16 10:26:37.573459 | controller | Monday 16 March 2026  10:26:37 +0000 (0:00:00.052)       0:05:42.129 **********
2026-03-16 10:26:37.637084 | controller | skipping: [instance]
2026-03-16 10:26:37.637191 | controller |
2026-03-16 10:26:37.637205 | controller | TASK [cifmw_setup : Get customized parameters] *********************************
2026-03-16 10:26:37.761944 | controller | Monday 16 March 2026  10:26:37 +0000 (0:00:00.063)       0:05:42.193 **********
2026-03-16 10:26:37.762048 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:37.762074 | controller |
2026-03-16 10:26:37.762083 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-16 10:26:38.276386 | controller | Monday 16 March 2026  10:26:37 +0000 (0:00:00.124)       0:05:42.317 **********
2026-03-16 10:26:38.276480 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:38.276523 | controller |
2026-03-16 10:26:38.276555 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-16 10:26:38.276565 | controller | Monday 16 March 2026  10:26:38 +0000 (0:00:00.514)       0:05:42.832 **********
2026-03-16 10:26:38.317228 | controller | skipping: [instance]
2026-03-16 10:26:38.317301 | controller |
2026-03-16 10:26:38.317340 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-16 10:26:38.317448 | controller | Monday 16 March 2026  10:26:38 +0000 (0:00:00.040)       0:05:42.873 **********
2026-03-16 10:26:38.359454 | controller | skipping: [instance]
2026-03-16 10:26:38.359548 | controller |
2026-03-16 10:26:38.359560 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-16 10:26:38.398815 | controller | Monday 16 March 2026  10:26:38 +0000 (0:00:00.042)       0:05:42.915 **********
2026-03-16 10:26:38.398857 | controller | skipping: [instance]
2026-03-16 10:26:38.398881 | controller |
2026-03-16 10:26:38.398966 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-16 10:26:38.399060 | controller | Monday 16 March 2026  10:26:38 +0000 (0:00:00.039)       0:05:42.955 **********
2026-03-16 10:26:38.451733 | controller | skipping: [instance]
2026-03-16 10:26:38.451827 | controller |
2026-03-16 10:26:38.451930 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-03-16 10:26:38.452024 | controller | Monday 16 March 2026  10:26:38 +0000 (0:00:00.052)       0:05:43.008 **********
2026-03-16 10:26:39.922327 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:26:39.922883 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:26:40.935830 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:26:40.935874 | controller | changed: [instance -> controller-0]
2026-03-16 10:26:40.935882 | controller |
2026-03-16 10:26:40.935889 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-03-16 10:26:40.935895 | controller | Monday 16 March 2026  10:26:39 +0000 (0:00:01.470)       0:05:44.478 **********
2026-03-16 10:26:40.935906 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:40.935941 | controller |
2026-03-16 10:26:40.935951 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-03-16 10:26:42.207471 | controller | Monday 16 March 2026  10:26:40 +0000 (0:00:01.013)       0:05:45.491 **********
2026-03-16 10:26:42.207515 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:49.884026 | controller |
2026-03-16 10:26:49.884061 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-03-16 10:26:49.884070 | controller | Monday 16 March 2026  10:26:42 +0000 (0:00:01.271)       0:05:46.763 **********
2026-03-16 10:26:49.884088 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:50.768346 | controller |
2026-03-16 10:26:50.768385 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-03-16 10:26:50.768395 | controller | Monday 16 March 2026  10:26:49 +0000 (0:00:07.676)       0:05:54.440 **********
2026-03-16 10:26:50.768407 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:50.805651 | controller |
2026-03-16 10:26:50.805686 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-03-16 10:26:50.805695 | controller | Monday 16 March 2026  10:26:50 +0000 (0:00:00.884)       0:05:55.324 **********
2026-03-16 10:26:50.805707 | controller | skipping: [instance]
2026-03-16 10:26:50.805727 | controller |
2026-03-16 10:26:50.805749 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-03-16 10:26:50.805864 | controller | Monday 16 March 2026  10:26:50 +0000 (0:00:00.037)       0:05:55.362 **********
2026-03-16 10:26:51.886109 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:51.886166 | controller |
2026-03-16 10:26:51.886261 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-03-16 10:26:51.886384 | controller | Monday 16 March 2026  10:26:51 +0000 (0:00:01.080)       0:05:56.442 **********
2026-03-16 10:26:51.940367 | controller | skipping: [instance]
2026-03-16 10:26:51.940447 | controller |
2026-03-16 10:26:51.940553 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-03-16 10:26:51.940664 | controller | Monday 16 March 2026  10:26:51 +0000 (0:00:00.053)       0:05:56.496 **********
2026-03-16 10:26:51.993154 | controller | skipping: [instance]
2026-03-16 10:26:51.993231 | controller |
2026-03-16 10:26:51.993378 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-03-16 10:26:51.993508 | controller | Monday 16 March 2026  10:26:51 +0000 (0:00:00.053)       0:05:56.549 **********
2026-03-16 10:26:52.058471 | controller | skipping: [instance]
2026-03-16 10:26:52.058562 | controller |
2026-03-16 10:26:52.058670 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-03-16 10:26:52.058758 | controller | Monday 16 March 2026  10:26:52 +0000 (0:00:00.065)       0:05:56.614 **********
2026-03-16 10:26:53.022553 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:53.022639 | controller |
2026-03-16 10:26:53.022869 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-03-16 10:26:53.910397 | controller | Monday 16 March 2026  10:26:53 +0000 (0:00:00.963)       0:05:57.578 **********
2026-03-16 10:26:53.910435 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:53.951051 | controller |
2026-03-16 10:26:53.951081 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-03-16 10:26:53.951090 | controller | Monday 16 March 2026  10:26:53 +0000 (0:00:00.887)       0:05:58.466 **********
2026-03-16 10:26:53.951100 | controller | skipping: [instance]
2026-03-16 10:26:53.991278 | controller |
2026-03-16 10:26:53.991305 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-03-16 10:26:53.991336 | controller | Monday 16 March 2026  10:26:53 +0000 (0:00:00.040)       0:05:58.507 **********
2026-03-16 10:26:53.991347 | controller | skipping: [instance]
2026-03-16 10:26:54.030384 | controller |
2026-03-16 10:26:54.030424 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-03-16 10:26:54.030433 | controller | Monday 16 March 2026  10:26:53 +0000 (0:00:00.040)       0:05:58.547 **********
2026-03-16 10:26:54.030446 | controller | skipping: [instance]
2026-03-16 10:26:54.030484 | controller |
2026-03-16 10:26:54.030664 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-03-16 10:26:54.082772 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.039)       0:05:58.586 **********
2026-03-16 10:26:54.082803 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:54.126454 | controller |
2026-03-16 10:26:54.126477 | controller | TASK [repo_setup : Create download directory] **********************************
2026-03-16 10:26:54.126484 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.052)       0:05:58.639 **********
2026-03-16 10:26:54.126499 | controller | skipping: [instance]
2026-03-16 10:26:54.166062 | controller |
2026-03-16 10:26:54.166087 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-03-16 10:26:54.166095 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.043)       0:05:58.682 **********
2026-03-16 10:26:54.166106 | controller | skipping: [instance]
2026-03-16 10:26:54.205477 | controller |
2026-03-16 10:26:54.205500 | controller | TASK [Download the RPM] ********************************************************
2026-03-16 10:26:54.205508 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.039)       0:05:58.722 **********
2026-03-16 10:26:54.205519 | controller | skipping: [instance]
2026-03-16 10:26:54.205544 | controller |
2026-03-16 10:26:54.205765 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-03-16 10:26:54.243815 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.039)       0:05:58.762 **********
2026-03-16 10:26:54.243861 | controller | skipping: [instance]
2026-03-16 10:26:54.284372 | controller |
2026-03-16 10:26:54.284398 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-03-16 10:26:54.284407 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.037)       0:05:58.800 **********
2026-03-16 10:26:54.284427 | controller | skipping: [instance]
2026-03-16 10:26:54.284720 | controller |
2026-03-16 10:26:54.322424 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-03-16 10:26:54.322448 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.040)       0:05:58.840 **********
2026-03-16 10:26:54.322468 | controller | skipping: [instance]
2026-03-16 10:26:54.322607 | controller |
2026-03-16 10:26:54.322634 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-03-16 10:26:54.362172 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.038)       0:05:58.879 **********
2026-03-16 10:26:54.362217 | controller | skipping: [instance]
2026-03-16 10:26:54.362228 | controller |
2026-03-16 10:26:54.362364 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-03-16 10:26:54.362482 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.039)       0:05:58.918 **********
2026-03-16 10:26:54.803687 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:54.803773 | controller |
2026-03-16 10:26:54.803902 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-03-16 10:26:54.804017 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.441)       0:05:59.360 **********
2026-03-16 10:26:54.855812 | controller | skipping: [instance]
2026-03-16 10:26:54.856201 | controller |
2026-03-16 10:26:54.906429 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-03-16 10:26:54.906461 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.051)       0:05:59.411 **********
2026-03-16 10:26:54.906474 | controller | skipping: [instance]
2026-03-16 10:26:54.906498 | controller |
2026-03-16 10:26:54.906617 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-03-16 10:26:54.906730 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.051)       0:05:59.462 **********
2026-03-16 10:26:54.945282 | controller | skipping: [instance]
2026-03-16 10:26:54.945346 | controller |
2026-03-16 10:26:54.945478 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-03-16 10:26:54.945570 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.038)       0:05:59.501 **********
2026-03-16 10:26:54.999074 | controller | skipping: [instance]
2026-03-16 10:26:54.999147 | controller |
2026-03-16 10:26:54.999247 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-03-16 10:26:54.999376 | controller | Monday 16 March 2026  10:26:54 +0000 (0:00:00.053)       0:05:59.555 **********
2026-03-16 10:26:55.049283 | controller | skipping: [instance]
2026-03-16 10:26:55.049399 | controller |
2026-03-16 10:26:55.049498 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-03-16 10:26:55.049594 | controller | Monday 16 March 2026  10:26:55 +0000 (0:00:00.050)       0:05:59.605 **********
2026-03-16 10:26:55.101355 | controller | skipping: [instance]
2026-03-16 10:26:55.101428 | controller |
2026-03-16 10:26:55.101543 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-03-16 10:26:55.101632 | controller | Monday 16 March 2026  10:26:55 +0000 (0:00:00.052)       0:05:59.658 **********
2026-03-16 10:26:55.150576 | controller | skipping: [instance]
2026-03-16 10:26:55.150667 | controller |
2026-03-16 10:26:55.150771 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-03-16 10:26:55.150867 | controller | Monday 16 March 2026  10:26:55 +0000 (0:00:00.049)       0:05:59.707 **********
2026-03-16 10:26:55.200642 | controller | skipping: [instance]
2026-03-16 10:26:55.200721 | controller |
2026-03-16 10:26:55.200903 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-03-16 10:26:55.201014 | controller | Monday 16 March 2026  10:26:55 +0000 (0:00:00.049)       0:05:59.757 **********
2026-03-16 10:26:55.797358 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:55.797423 | controller |
2026-03-16 10:26:55.797535 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-03-16 10:26:55.797635 | controller | Monday 16 March 2026  10:26:55 +0000 (0:00:00.596)       0:06:00.353 **********
2026-03-16 10:26:56.830518 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:26:56.830603 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:26:56.830712 | controller | changed: [instance -> controller-0]
2026-03-16 10:26:56.830793 | controller |
2026-03-16 10:26:56.830885 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-03-16 10:26:56.830988 | controller | Monday 16 March 2026  10:26:56 +0000 (0:00:01.033)       0:06:01.386 **********
2026-03-16 10:26:57.511560 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:57.511608 | controller |
2026-03-16 10:26:57.511729 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-03-16 10:26:57.511819 | controller | Monday 16 March 2026  10:26:57 +0000 (0:00:00.680)       0:06:02.067 **********
2026-03-16 10:26:58.023916 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:58.024009 | controller |
2026-03-16 10:26:58.024110 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-03-16 10:26:58.024198 | controller | Monday 16 March 2026  10:26:58 +0000 (0:00:00.512)       0:06:02.580 **********
2026-03-16 10:26:58.081786 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:26:58.081873 | controller | ok: [instance -> controller-0]
2026-03-16 10:26:58.081960 | controller |
2026-03-16 10:26:58.082054 | controller | TASK [ci_setup : List packages to install] *************************************
2026-03-16 10:26:58.082129 | controller | Monday 16 March 2026  10:26:58 +0000 (0:00:00.057)       0:06:02.638 **********
2026-03-16 10:26:58.124892 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:26:58.124967 | controller |
2026-03-16 10:26:58.125071 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-03-16 10:26:58.125165 | controller | Monday 16 March 2026  10:26:58 +0000 (0:00:00.043)       0:06:02.681 **********
2026-03-16 10:27:37.861069 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:37.861133 | controller |
2026-03-16 10:27:37.861184 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-03-16 10:27:37.861291 | controller | Monday 16 March 2026  10:27:37 +0000 (0:00:39.735)       0:06:42.417 **********
2026-03-16 10:27:38.328379 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:38.328447 | controller |
2026-03-16 10:27:38.328549 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-03-16 10:27:38.328675 | controller | Monday 16 March 2026  10:27:38 +0000 (0:00:00.467)       0:06:42.884 **********
2026-03-16 10:27:38.804193 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:45.005536 | controller |
2026-03-16 10:27:45.005588 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-03-16 10:27:45.005598 | controller | Monday 16 March 2026  10:27:38 +0000 (0:00:00.475)       0:06:43.360 **********
2026-03-16 10:27:45.005619 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:45.058277 | controller |
2026-03-16 10:27:45.058338 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-03-16 10:27:45.058351 | controller | Monday 16 March 2026  10:27:45 +0000 (0:00:06.201)       0:06:49.561 **********
2026-03-16 10:27:45.058363 | controller | skipping: [instance]
2026-03-16 10:27:45.058401 | controller |
2026-03-16 10:27:45.058420 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-03-16 10:27:45.682205 | controller | Monday 16 March 2026  10:27:45 +0000 (0:00:00.053)       0:06:49.614 **********
2026-03-16 10:27:45.682268 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:45.682410 | controller |
2026-03-16 10:27:45.682434 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-03-16 10:27:45.682508 | controller | Monday 16 March 2026  10:27:45 +0000 (0:00:00.623)       0:06:50.238 **********
2026-03-16 10:27:46.161232 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:46.161293 | controller |
2026-03-16 10:27:46.161483 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-03-16 10:27:46.161550 | controller | Monday 16 March 2026  10:27:46 +0000 (0:00:00.474)       0:06:50.713 **********
2026-03-16 10:27:46.202363 | controller | skipping: [instance]
2026-03-16 10:27:46.202462 | controller |
2026-03-16 10:27:46.202552 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-03-16 10:27:46.202653 | controller | Monday 16 March 2026  10:27:46 +0000 (0:00:00.045)       0:06:50.758 **********
2026-03-16 10:27:46.244155 | controller | skipping: [instance]
2026-03-16 10:27:46.244243 | controller |
2026-03-16 10:27:46.244363 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-03-16 10:27:46.244462 | controller | Monday 16 March 2026  10:27:46 +0000 (0:00:00.041)       0:06:50.800 **********
2026-03-16 10:27:46.289457 | controller | skipping: [instance]
2026-03-16 10:27:46.289513 | controller |
2026-03-16 10:27:46.289632 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-03-16 10:27:46.289743 | controller | Monday 16 March 2026  10:27:46 +0000 (0:00:00.042)       0:06:50.843 **********
2026-03-16 10:27:46.330090 | controller | skipping: [instance]
2026-03-16 10:27:46.330178 | controller |
2026-03-16 10:27:46.330285 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-03-16 10:27:46.330407 | controller | Monday 16 March 2026  10:27:46 +0000 (0:00:00.043)       0:06:50.886 **********
2026-03-16 10:27:46.375250 | controller | skipping: [instance]
2026-03-16 10:27:46.375348 | controller |
2026-03-16 10:27:46.375482 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-03-16 10:27:46.375615 | controller | Monday 16 March 2026  10:27:46 +0000 (0:00:00.042)       0:06:50.928 **********
2026-03-16 10:27:46.421492 | controller | skipping: [instance]
2026-03-16 10:27:46.421598 | controller |
2026-03-16 10:27:46.421713 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-03-16 10:27:46.421805 | controller | Monday 16 March 2026  10:27:46 +0000 (0:00:00.049)       0:06:50.978 **********
2026-03-16 10:27:49.027516 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:27:49.027603 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:27:49.027710 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:27:49.027801 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:27:49.027895 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:27:49.027986 | controller | changed: [instance -> controller-0]
2026-03-16 10:27:49.028072 | controller |
2026-03-16 10:27:49.028173 | controller | TASK [Prepare install_yamls make targets] **************************************
2026-03-16 10:27:49.028267 | controller | Monday 16 March 2026  10:27:49 +0000 (0:00:02.605)       0:06:53.583 **********
2026-03-16 10:27:49.191073 | controller |
2026-03-16 10:27:49.191185 | controller | TASK [install_yamls : Ensure directories exist] ********************************
2026-03-16 10:27:49.191305 | controller | Monday 16 March 2026  10:27:49 +0000 (0:00:00.163)       0:06:53.747 **********
2026-03-16 10:27:50.937515 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:27:50.937617 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:27:50.938093 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:27:50.938132 | controller | changed: [instance -> controller-0]
2026-03-16 10:27:51.005017 | controller |
2026-03-16 10:27:51.005051 | controller | TASK [Create variables with local repos based on Zuul items] *******************
2026-03-16 10:27:51.005085 | controller | Monday 16 March 2026  10:27:50 +0000 (0:00:01.745)       0:06:55.493 **********
2026-03-16 10:27:51.005098 | controller |
2026-03-16 10:27:51.055141 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] ***********
2026-03-16 10:27:51.055163 | controller | Monday 16 March 2026  10:27:51 +0000 (0:00:00.067)       0:06:55.561 **********
2026-03-16 10:27:51.055174 | controller | skipping: [instance]
2026-03-16 10:27:51.108082 | controller |
2026-03-16 10:27:51.108103 | controller | TASK [install_yamls : Print helpful data for debugging] ************************
2026-03-16 10:27:51.108110 | controller | Monday 16 March 2026  10:27:51 +0000 (0:00:00.047)       0:06:55.608 **********
2026-03-16 10:27:51.108120 | controller | skipping: [instance]
2026-03-16 10:27:51.189903 | controller |
2026-03-16 10:27:51.189933 | controller | TASK [Customize install_yamls devsetup vars if needed] *************************
2026-03-16 10:27:51.189942 | controller | Monday 16 March 2026  10:27:51 +0000 (0:00:00.055)       0:06:55.664 **********
2026-03-16 10:27:51.189952 | controller |
2026-03-16 10:27:51.239125 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] ***
2026-03-16 10:27:51.239147 | controller | Monday 16 March 2026  10:27:51 +0000 (0:00:00.081)       0:06:55.746 **********
2026-03-16 10:27:51.239159 | controller | skipping: [instance]
2026-03-16 10:27:51.289251 | controller |
2026-03-16 10:27:51.289282 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] ***
2026-03-16 10:27:51.289299 | controller | Monday 16 March 2026  10:27:51 +0000 (0:00:00.046)       0:06:55.792 **********
2026-03-16 10:27:51.289326 | controller | skipping: [instance]
2026-03-16 10:27:51.339493 | controller |
2026-03-16 10:27:51.339515 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] ***
2026-03-16 10:27:51.339522 | controller | Monday 16 March 2026  10:27:51 +0000 (0:00:00.050)       0:06:55.843 **********
2026-03-16 10:27:51.339537 | controller | skipping: [instance]
2026-03-16 10:27:51.398594 | controller |
2026-03-16 10:27:51.398628 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] ***
2026-03-16 10:27:51.398638 | controller | Monday 16 March 2026  10:27:51 +0000 (0:00:00.050)       0:06:55.893 **********
2026-03-16 10:27:51.398647 | controller | skipping: [instance]
2026-03-16 10:27:51.536219 | controller |
2026-03-16 10:27:51.536250 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ********
2026-03-16 10:27:51.536263 | controller | Monday 16 March 2026  10:27:51 +0000 (0:00:00.061)       0:06:55.954 **********
2026-03-16 10:27:51.536273 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-16 10:27:51.610730 | controller | ok: [instance -> controller-0]
2026-03-16 10:27:51.610757 | controller |
2026-03-16 10:27:51.610766 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] ***
2026-03-16 10:27:51.610772 | controller | Monday 16 March 2026  10:27:51 +0000 (0:00:00.137)       0:06:56.092 **********
2026-03-16 10:27:51.610781 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:51.610923 | controller |
2026-03-16 10:27:51.611061 | controller | TASK [install_yamls : Get environment structure] *******************************
2026-03-16 10:27:51.611213 | controller | Monday 16 March 2026  10:27:51 +0000 (0:00:00.075)       0:06:56.167 **********
2026-03-16 10:27:52.895931 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:52.896173 | controller |
2026-03-16 10:27:52.896373 | controller | TASK [install_yamls : Ensure Output directory exists] **************************
2026-03-16 10:27:52.896610 | controller | Monday 16 March 2026  10:27:52 +0000 (0:00:01.284)       0:06:57.452 **********
2026-03-16 10:27:52.950040 | controller | skipping: [instance]
2026-03-16 10:27:52.950244 | controller |
2026-03-16 10:27:52.950458 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] ***
2026-03-16 10:27:52.950665 | controller | Monday 16 March 2026  10:27:52 +0000 (0:00:00.051)       0:06:57.503 **********
2026-03-16 10:27:53.010464 | controller | skipping: [instance]
2026-03-16 10:27:53.010649 | controller |
2026-03-16 10:27:53.010845 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] ***
2026-03-16 10:27:53.011023 | controller | Monday 16 March 2026  10:27:53 +0000 (0:00:00.063)       0:06:57.566 **********
2026-03-16 10:27:53.059945 | controller | skipping: [instance]
2026-03-16 10:27:53.144831 | controller |
2026-03-16 10:27:53.144861 | controller | TASK [install_yamls : Set install_yamls default values] ************************
2026-03-16 10:27:53.144875 | controller | Monday 16 March 2026  10:27:53 +0000 (0:00:00.046)       0:06:57.613 **********
2026-03-16 10:27:53.144888 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:53.208797 | controller |
2026-03-16 10:27:53.208821 | controller | TASK [install_yamls : Show the env structure] **********************************
2026-03-16 10:27:53.208829 | controller | Monday 16 March 2026  10:27:53 +0000 (0:00:00.086)       0:06:57.699 **********
2026-03-16 10:27:53.208839 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:53.277922 | controller |
2026-03-16 10:27:53.277950 | controller | TASK [install_yamls : Show the env structure defaults] *************************
2026-03-16 10:27:53.277959 | controller | Monday 16 March 2026  10:27:53 +0000 (0:00:00.061)       0:06:57.760 **********
2026-03-16 10:27:53.277976 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:54.230210 | controller |
2026-03-16 10:27:54.230248 | controller | TASK [install_yamls : Generate make targets] ***********************************
2026-03-16 10:27:54.230263 | controller | Monday 16 March 2026  10:27:53 +0000 (0:00:00.073)       0:06:57.833 **********
2026-03-16 10:27:54.230276 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:54.314835 | controller |
2026-03-16 10:27:54.314867 | controller | TASK [install_yamls : Debug generate_make module] ******************************
2026-03-16 10:27:54.314880 | controller | Monday 16 March 2026  10:27:54 +0000 (0:00:00.951)       0:06:58.785 **********
2026-03-16 10:27:54.314892 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:55.575609 | controller |
2026-03-16 10:27:55.575657 | controller | TASK [install_yamls : Create the install_yamls parameters file] ****************
2026-03-16 10:27:55.575675 | controller | Monday 16 March 2026  10:27:54 +0000 (0:00:00.084)       0:06:58.869 **********
2026-03-16 10:27:55.575687 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:55.638450 | controller |
2026-03-16 10:27:55.638485 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] ***
2026-03-16 10:27:55.638494 | controller | Monday 16 March 2026  10:27:55 +0000 (0:00:01.260)       0:07:00.130 **********
2026-03-16 10:27:55.638510 | controller | skipping: [instance]
2026-03-16 10:27:55.697419 | controller |
2026-03-16 10:27:55.697459 | controller | TASK [discover_latest_image : Set the discovered image vars to empty/null] *****
2026-03-16 10:27:55.697468 | controller | Monday 16 March 2026  10:27:55 +0000 (0:00:00.064)       0:07:00.194 **********
2026-03-16 10:27:55.697479 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:55.772941 | controller |
2026-03-16 10:27:55.772975 | controller | TASK [discover_latest_image : Discover images] *********************************
2026-03-16 10:27:55.772984 | controller | Monday 16 March 2026  10:27:55 +0000 (0:00:00.052)       0:07:00.247 **********
2026-03-16 10:27:55.772994 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/discover_latest_image/tasks/per-image.yml for instance => (item=(censored due to no_log))
2026-03-16 10:27:55.773204 | controller |
2026-03-16 10:27:55.773430 | controller | TASK [discover_latest_image : Ensure the current image dict entry has the expected data] ***
2026-03-16 10:27:55.773645 | controller | Monday 16 March 2026  10:27:55 +0000 (0:00:00.082)       0:07:00.329 **********
2026-03-16 10:27:55.845630 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:55.845832 | controller |
2026-03-16 10:27:55.846015 | controller | TASK [discover_latest_image : Get latest image for the current entry] **********
2026-03-16 10:27:55.846201 | controller | Monday 16 March 2026  10:27:55 +0000 (0:00:00.067)       0:07:00.396 **********
2026-03-16 10:27:56.737401 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:56.737672 | controller |
2026-03-16 10:27:56.737869 | controller | TASK [discover_latest_image : Append the current return value to the discovered images dict] ***
2026-03-16 10:27:56.738050 | controller | Monday 16 March 2026  10:27:56 +0000 (0:00:00.891)       0:07:01.288 **********
2026-03-16 10:27:56.814021 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:56.814221 | controller |
2026-03-16 10:27:56.814429 | controller | TASK [discover_latest_image : Export single-image facts if an image with name 'default' was discovered] ***
2026-03-16 10:27:56.814623 | controller | Monday 16 March 2026  10:27:56 +0000 (0:00:00.081)       0:07:01.370 **********
2026-03-16 10:27:56.975756 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:56.975978 | controller |
2026-03-16 10:27:56.976177 | controller | TASK [cifmw_setup : Create artifacts with custom params] ***********************
2026-03-16 10:27:56.976379 | controller | Monday 16 March 2026  10:27:56 +0000 (0:00:00.161)       0:07:01.531 **********
2026-03-16 10:27:58.250475 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:58.250692 | controller |
2026-03-16 10:27:58.250876 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] *******
2026-03-16 10:27:58.251054 | controller | Monday 16 March 2026  10:27:58 +0000 (0:00:01.269)       0:07:02.801 **********
2026-03-16 10:27:58.946020 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:27:59.212217 | controller |
2026-03-16 10:27:59.212259 | controller | TASK [Configure CRC network if needed] *****************************************
2026-03-16 10:27:59.212267 | controller | Monday 16 March 2026  10:27:58 +0000 (0:00:00.692)       0:07:03.493 **********
2026-03-16 10:27:59.212288 | controller |
2026-03-16 10:28:00.999153 | controller | TASK [openshift_setup : Gather network.operator info] **************************
2026-03-16 10:28:00.999202 | controller | Monday 16 March 2026  10:27:59 +0000 (0:00:00.273)       0:07:03.767 **********
2026-03-16 10:28:00.999216 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:02.750382 | controller |
2026-03-16 10:28:02.750424 | controller | TASK [openshift_setup : Patch network operator] ********************************
2026-03-16 10:28:02.750438 | controller | Monday 16 March 2026  10:28:00 +0000 (0:00:01.786)       0:07:05.554 **********
2026-03-16 10:28:02.750454 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:02.788716 | controller |
2026-03-16 10:28:02.788740 | controller | TASK [Ensure OCP cluster is stable] ********************************************
2026-03-16 10:28:02.788753 | controller | Monday 16 March 2026  10:28:02 +0000 (0:00:01.751)       0:07:07.305 **********
2026-03-16 10:28:02.788765 | controller | skipping: [instance]
2026-03-16 10:28:02.835569 | controller |
2026-03-16 10:28:02.835596 | controller | TASK [reproducer : Emulate CI job] *********************************************
2026-03-16 10:28:02.835611 | controller | Monday 16 March 2026  10:28:02 +0000 (0:00:00.038)       0:07:07.344 **********
2026-03-16 10:28:02.835628 | controller | skipping: [instance]
2026-03-16 10:28:02.887946 | controller |
2026-03-16 10:28:02.887969 | controller | TASK [reproducer : Prepare architecture-based deployment] **********************
2026-03-16 10:28:02.887977 | controller | Monday 16 March 2026  10:28:02 +0000 (0:00:00.046)       0:07:07.391 **********
2026-03-16 10:28:02.887986 | controller | skipping: [instance]
2026-03-16 10:28:02.959029 | controller |
2026-03-16 10:28:02.959053 | controller | TASK [reproducer : Prepare architecture-based post deployment] *****************
2026-03-16 10:28:02.959060 | controller | Monday 16 March 2026  10:28:02 +0000 (0:00:00.052)       0:07:07.443 **********
2026-03-16 10:28:02.959070 | controller | skipping: [instance]
2026-03-16 10:28:04.117740 | controller |
2026-03-16 10:28:04.117784 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ********************************
2026-03-16 10:28:04.117793 | controller | Monday 16 March 2026  10:28:02 +0000 (0:00:00.071)       0:07:07.515 **********
2026-03-16 10:28:04.117835 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:04.758763 | controller |
2026-03-16 10:28:04.758806 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] ***********
2026-03-16 10:28:04.758815 | controller | Monday 16 March 2026  10:28:04 +0000 (0:00:01.158)       0:07:08.673 **********
2026-03-16 10:28:04.758826 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:05.462287 | controller |
2026-03-16 10:28:05.462367 | controller | TASK [Ensure we have needed inventory files] ***********************************
2026-03-16 10:28:05.462378 | controller | Monday 16 March 2026  10:28:04 +0000 (0:00:00.641)       0:07:09.314 **********
2026-03-16 10:28:05.462390 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:06.230928 | controller |
2026-03-16 10:28:06.230977 | controller | TASK [Ensure we have CRC ssh key] **********************************************
2026-03-16 10:28:06.230991 | controller | Monday 16 March 2026  10:28:05 +0000 (0:00:00.702)       0:07:10.017 **********
2026-03-16 10:28:06.231004 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:06.934055 | controller |
2026-03-16 10:28:06.934099 | controller | TASK [Ensure we have the MAC mapping file] *************************************
2026-03-16 10:28:06.934108 | controller | Monday 16 March 2026  10:28:06 +0000 (0:00:00.769)       0:07:10.786 **********
2026-03-16 10:28:06.934119 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:07.637661 | controller |
2026-03-16 10:28:07.637709 | controller | TASK [Load crc inventory] ******************************************************
2026-03-16 10:28:07.637720 | controller | Monday 16 March 2026  10:28:06 +0000 (0:00:00.702)       0:07:11.489 **********
2026-03-16 10:28:07.637731 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:08.232844 | controller |
2026-03-16 10:28:08.232921 | controller | TASK [Load compute inventory] **************************************************
2026-03-16 10:28:08.232932 | controller | Monday 16 March 2026  10:28:07 +0000 (0:00:00.703)       0:07:12.193 **********
2026-03-16 10:28:08.232952 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:08.846747 | controller |
2026-03-16 10:28:08.846819 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] ***************************
2026-03-16 10:28:08.846830 | controller | Monday 16 March 2026  10:28:08 +0000 (0:00:00.594)       0:07:12.787 **********
2026-03-16 10:28:08.846844 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:09.480433 | controller |
2026-03-16 10:28:09.480487 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] *******************************
2026-03-16 10:28:09.480497 | controller | Monday 16 March 2026  10:28:08 +0000 (0:00:00.613)       0:07:13.401 **********
2026-03-16 10:28:09.480514 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:10.248065 | controller |
2026-03-16 10:28:10.248125 | controller | TASK [Check default location secret file] **************************************
2026-03-16 10:28:10.248145 | controller | Monday 16 March 2026  10:28:09 +0000 (0:00:00.634)       0:07:14.035 **********
2026-03-16 10:28:10.248159 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:10.902261 | controller |
2026-03-16 10:28:10.902339 | controller | TASK [Check non-default location secret] ***************************************
2026-03-16 10:28:10.902354 | controller | Monday 16 March 2026  10:28:10 +0000 (0:00:00.766)       0:07:14.802 **********
2026-03-16 10:28:10.902369 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-16 10:28:10.950490 | controller |
2026-03-16 10:28:10.950525 | controller | TASK [Assert all of the tests] *************************************************
2026-03-16 10:28:10.950535 | controller | Monday 16 March 2026  10:28:10 +0000 (0:00:00.653)       0:07:15.456 **********
2026-03-16 10:28:10.950551 | controller | ok: [instance]
2026-03-16 10:28:11.226638 | controller |
2026-03-16 10:28:11.226709 | controller | TASK [Create dnsmasq dir] ******************************************************
2026-03-16 10:28:11.226718 | controller | Monday 16 March 2026  10:28:10 +0000 (0:00:00.050)       0:07:15.506 **********
2026-03-16 10:28:11.226746 | controller | changed: [instance]
2026-03-16 10:28:11.226899 | controller |
2026-03-16 10:28:11.227050 | controller | TASK [Get journalctl in a file] ************************************************
2026-03-16 10:28:11.227202 | controller | Monday 16 March 2026  10:28:11 +0000 (0:00:00.275)       0:07:15.782 **********
2026-03-16 10:28:11.497068 | controller | changed: [instance]
2026-03-16 10:28:11.497288 | controller |
2026-03-16 10:28:11.497472 | controller | TASK [Dump journalctl output] **************************************************
2026-03-16 10:28:11.497633 | controller | Monday 16 March 2026  10:28:11 +0000 (0:00:00.270)       0:07:16.052 **********
2026-03-16 10:28:12.013991 | controller | changed: [instance]
2026-03-16 10:28:12.014181 | controller |
2026-03-16 10:28:12.014327 | controller | TASK [Copy all dnsmasq config] *************************************************
2026-03-16 10:28:12.014468 | controller | Monday 16 March 2026  10:28:12 +0000 (0:00:00.517)       0:07:16.570 **********
2026-03-16 10:28:12.671405 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-03-16 10:28:12.984064 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2026-03-16 10:28:12.984144 | controller |
2026-03-16 10:28:12.984152 | controller | TASK [Create log directory] ****************************************************
2026-03-16 10:28:12.984166 | controller | Monday 16 March 2026  10:28:12 +0000 (0:00:00.655)       0:07:17.225 **********
2026-03-16 10:28:12.984180 | controller | changed: [instance]
2026-03-16 10:28:14.043932 | controller |
2026-03-16 10:28:14.044002 | controller | TASK [Sync logs from controller-0] *********************************************
2026-03-16 10:28:14.044012 | controller | Monday 16 March 2026  10:28:12 +0000 (0:00:00.310)       0:07:17.536 **********
2026-03-16 10:28:14.044026 | controller | changed: [instance]
2026-03-16 10:28:14.233938 | controller |
2026-03-16 10:28:14.233990 | controller | PLAY RECAP *********************************************************************
2026-03-16 10:28:14.233999 | controller | instance                   : ok=565  changed=214  unreachable=0    failed=0    skipped=237  rescued=0    ignored=0
2026-03-16 10:28:14.234005 | controller |
2026-03-16 10:28:14.234010 | controller | Monday 16 March 2026  10:28:14 +0000 (0:00:01.057)       0:07:18.594 **********
2026-03-16 10:28:14.234015 | controller | ===============================================================================
2026-03-16 10:28:14.234020 | controller | ci_setup : Install needed packages ------------------------------------- 39.74s
2026-03-16 10:28:14.234025 | controller | reproducer : Check package install status ------------------------------ 39.40s
2026-03-16 10:28:14.234030 | controller | libvirt_manager : Download base image ---------------------------------- 30.00s
2026-03-16 10:28:14.234036 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 22.96s
2026-03-16 10:28:14.234041 | controller | reproducer : Install collections on controller-0 ----------------------- 20.18s
2026-03-16 10:28:14.234046 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.81s
2026-03-16 10:28:14.234051 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.65s
2026-03-16 10:28:14.234056 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.68s
2026-03-16 10:28:14.234061 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 6.79s
2026-03-16 10:28:14.234066 | controller | ci_setup : Install openshift client ------------------------------------- 6.20s
2026-03-16 10:28:14.234071 | controller | reproducer : Ensure we have all dependencies installed ------------------ 5.91s
2026-03-16 10:28:14.234076 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.07s
2026-03-16 10:28:14.234081 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.98s
2026-03-16 10:28:14.234086 | controller | networking_mapper : Gather the facts ------------------------------------ 3.49s
2026-03-16 10:28:14.234091 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.48s
2026-03-16 10:28:14.234096 | controller | sushy_emulator : Install required packages ------------------------------ 3.17s
2026-03-16 10:28:14.234101 | controller | ci_setup : Manage directories ------------------------------------------- 2.61s
2026-03-16 10:28:14.234106 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.28s
2026-03-16 10:28:14.234118 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.23s
2026-03-16 10:28:14.234127 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s
2026-03-16 10:28:14.234139 | controller | INFO     Running crc_layout > cleanup
2026-03-16 10:28:14.234711 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-16 10:28:14.242848 | controller | INFO     Running job_uri > prepare
2026-03-16 10:28:14.243278 | controller | WARNING  Skipping, prepare playbook not configured.
2026-03-16 10:28:14.253607 | controller | INFO     Running job_uri > converge
2026-03-16 10:28:14.847218 | controller |
2026-03-16 10:28:14.960838 | controller | PLAY [Prepare] *****************************************************************
2026-03-16 10:28:14.960882 | controller |
2026-03-16 10:28:14.960890 | controller | TASK [Call task file in loop] **************************************************
2026-03-16 10:28:14.960897 | controller | Monday 16 March 2026  10:28:14 +0000 (0:00:00.038)       0:00:00.038 **********
2026-03-16 10:28:14.960915 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'})
2026-03-16 10:28:15.015768 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'})
2026-03-16 10:28:15.015814 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'})
2026-03-16 10:28:15.015822 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'})
2026-03-16 10:28:15.015829 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'})
2026-03-16 10:28:15.015835 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'})
2026-03-16 10:28:15.015841 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'})
2026-03-16 10:28:15.015847 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'})
2026-03-16 10:28:15.015853 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'})
2026-03-16 10:28:15.015859 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'})
2026-03-16 10:28:15.015870 | controller |
2026-03-16 10:28:15.015881 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] ***
2026-03-16 10:28:15.015888 | controller | Monday 16 March 2026  10:28:14 +0000 (0:00:00.112)       0:00:00.151 **********
2026-03-16 10:28:15.015899 | controller |
2026-03-16 10:28:15.074217 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-16 10:28:15.074242 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.056)       0:00:00.208 **********
2026-03-16 10:28:15.074253 | controller | ok: [instance]
2026-03-16 10:28:15.131473 | controller |
2026-03-16 10:28:15.131496 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-16 10:28:15.131504 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.058)       0:00:00.266 **********
2026-03-16 10:28:15.131513 | controller | ok: [instance]
2026-03-16 10:28:15.196070 | controller |
2026-03-16 10:28:15.196091 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-16 10:28:15.196099 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.057)       0:00:00.324 **********
2026-03-16 10:28:15.196108 | controller | ok: [instance]
2026-03-16 10:28:15.232846 | controller |
2026-03-16 10:28:15.232866 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-16 10:28:15.232874 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.064)       0:00:00.388 **********
2026-03-16 10:28:15.232884 | controller | skipping: [instance]
2026-03-16 10:28:15.308400 | controller |
2026-03-16 10:28:15.308433 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-16 10:28:15.308442 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.036)       0:00:00.425 **********
2026-03-16 10:28:15.308452 | controller | ok: [instance] => changed=false
2026-03-16 10:28:15.355598 | controller |   msg: All assertions passed
2026-03-16 10:28:15.355635 | controller |
2026-03-16 10:28:15.355643 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] ***
2026-03-16 10:28:15.355651 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.075)       0:00:00.500 **********
2026-03-16 10:28:15.355668 | controller |
2026-03-16 10:28:15.413949 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-16 10:28:15.413979 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.047)       0:00:00.548 **********
2026-03-16 10:28:15.413997 | controller | ok: [instance]
2026-03-16 10:28:15.469940 | controller |
2026-03-16 10:28:15.469971 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-16 10:28:15.469981 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.055)       0:00:00.603 **********
2026-03-16 10:28:15.469993 | controller | ok: [instance]
2026-03-16 10:28:15.527396 | controller |
2026-03-16 10:28:15.527427 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-16 10:28:15.527435 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.058)       0:00:00.662 **********
2026-03-16 10:28:15.527445 | controller | ok: [instance]
2026-03-16 10:28:15.575705 | controller |
2026-03-16 10:28:15.575730 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-16 10:28:15.575738 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.057)       0:00:00.719 **********
2026-03-16 10:28:15.575749 | controller | skipping: [instance]
2026-03-16 10:28:15.627305 | controller |
2026-03-16 10:28:15.627364 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-16 10:28:15.627375 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.048)       0:00:00.768 **********
2026-03-16 10:28:15.627386 | controller | ok: [instance] => changed=false
2026-03-16 10:28:15.681784 | controller |   msg: All assertions passed
2026-03-16 10:28:15.681819 | controller |
2026-03-16 10:28:15.681840 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] ***
2026-03-16 10:28:15.681854 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.051)       0:00:00.819 **********
2026-03-16 10:28:15.681865 | controller |
2026-03-16 10:28:15.732493 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-16 10:28:15.732523 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.054)       0:00:00.874 **********
2026-03-16 10:28:15.732536 | controller | ok: [instance]
2026-03-16 10:28:15.801122 | controller |
2026-03-16 10:28:15.801144 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-16 10:28:15.801160 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.050)       0:00:00.924 **********
2026-03-16 10:28:15.801170 | controller | ok: [instance]
2026-03-16 10:28:15.857467 | controller |
2026-03-16 10:28:15.857551 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-16 10:28:15.857561 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.065)       0:00:00.990 **********
2026-03-16 10:28:15.857600 | controller | ok: [instance]
2026-03-16 10:28:15.857645 | controller |
2026-03-16 10:28:15.857665 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-16 10:28:15.898233 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.059)       0:00:01.050 **********
2026-03-16 10:28:15.898274 | controller | skipping: [instance]
2026-03-16 10:28:15.949084 | controller |
2026-03-16 10:28:15.949114 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-16 10:28:15.949122 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.040)       0:00:01.090 **********
2026-03-16 10:28:15.949134 | controller | ok: [instance] => changed=false
2026-03-16 10:28:16.006890 | controller |   msg: All assertions passed
2026-03-16 10:28:16.006929 | controller |
2026-03-16 10:28:16.006941 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] ***
2026-03-16 10:28:16.006949 | controller | Monday 16 March 2026  10:28:15 +0000 (0:00:00.050)       0:00:01.141 **********
2026-03-16 10:28:16.006972 | controller |
2026-03-16 10:28:16.059850 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-16 10:28:16.059878 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.057)       0:00:01.199 **********
2026-03-16 10:28:16.059893 | controller | ok: [instance]
2026-03-16 10:28:16.125929 | controller |
2026-03-16 10:28:16.125960 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-16 10:28:16.125968 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.052)       0:00:01.252 **********
2026-03-16 10:28:16.125985 | controller | ok: [instance]
2026-03-16 10:28:16.183929 | controller |
2026-03-16 10:28:16.183966 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-16 10:28:16.183975 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.066)       0:00:01.318 **********
2026-03-16 10:28:16.183998 | controller | ok: [instance]
2026-03-16 10:28:16.231293 | controller |
2026-03-16 10:28:16.231342 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-16 10:28:16.231353 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.057)       0:00:01.376 **********
2026-03-16 10:28:16.231374 | controller | skipping: [instance]
2026-03-16 10:28:16.318439 | controller |
2026-03-16 10:28:16.318528 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-16 10:28:16.318540 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.042)       0:00:01.418 **********
2026-03-16 10:28:16.318570 | controller | ok: [instance] => changed=false
2026-03-16 10:28:16.368445 | controller |   msg: All assertions passed
2026-03-16 10:28:16.368525 | controller |
2026-03-16 10:28:16.368537 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] ***
2026-03-16 10:28:16.368551 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.092)       0:00:01.510 **********
2026-03-16 10:28:16.368584 | controller |
2026-03-16 10:28:16.442501 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-16 10:28:16.442549 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.050)       0:00:01.561 **********
2026-03-16 10:28:16.442583 | controller | ok: [instance]
2026-03-16 10:28:16.528532 | controller |
2026-03-16 10:28:16.528620 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-16 10:28:16.528630 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.073)       0:00:01.634 **********
2026-03-16 10:28:16.528651 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:16.587932 | controller |   assertion: _matched_url | default('') | length > 0
2026-03-16 10:28:16.587982 | controller |   evaluated_to: false
2026-03-16 10:28:16.588026 | controller |   msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job'
2026-03-16 10:28:16.588056 | controller |
2026-03-16 10:28:16.641358 | controller | TASK [Clear errors to manually handle them] ************************************
2026-03-16 10:28:16.641422 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.123)       0:00:01.758 **********
2026-03-16 10:28:16.641431 | controller |
2026-03-16 10:28:16.641437 | controller | TASK [Really fail if string passed but should have failed] *********************
2026-03-16 10:28:16.641443 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.021)       0:00:01.780 **********
2026-03-16 10:28:16.641456 | controller | skipping: [instance]
2026-03-16 10:28:16.696191 | controller |
2026-03-16 10:28:16.696227 | controller | TASK [Really fail if string failed but should have passed] *********************
2026-03-16 10:28:16.696235 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.053)       0:00:01.833 **********
2026-03-16 10:28:16.696247 | controller | skipping: [instance]
2026-03-16 10:28:16.744594 | controller |
2026-03-16 10:28:16.744640 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] ***
2026-03-16 10:28:16.744684 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.055)       0:00:01.888 **********
2026-03-16 10:28:16.744700 | controller |
2026-03-16 10:28:16.791592 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-16 10:28:16.791634 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.047)       0:00:01.936 **********
2026-03-16 10:28:16.791661 | controller | ok: [instance]
2026-03-16 10:28:16.843641 | controller |
2026-03-16 10:28:16.843670 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-16 10:28:16.843678 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.047)       0:00:01.984 **********
2026-03-16 10:28:16.843696 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:16.874697 | controller |   assertion: _matched_url | default('') | length > 0
2026-03-16 10:28:16.874720 | controller |   evaluated_to: false
2026-03-16 10:28:16.874728 | controller |   msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job'
2026-03-16 10:28:16.874740 | controller |
2026-03-16 10:28:16.875382 | controller | TASK [Clear errors to manually handle them] ************************************
2026-03-16 10:28:16.875403 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.064)       0:00:02.048 **********
2026-03-16 10:28:16.914420 | controller |
2026-03-16 10:28:16.914444 | controller | TASK [Really fail if string passed but should have failed] *********************
2026-03-16 10:28:16.914453 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.017)       0:00:02.065 **********
2026-03-16 10:28:16.914462 | controller | skipping: [instance]
2026-03-16 10:28:16.958539 | controller |
2026-03-16 10:28:16.958560 | controller | TASK [Really fail if string failed but should have passed] *********************
2026-03-16 10:28:16.958579 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.040)       0:00:02.106 **********
2026-03-16 10:28:16.958594 | controller | skipping: [instance]
2026-03-16 10:28:17.002691 | controller |
2026-03-16 10:28:17.002712 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] ***
2026-03-16 10:28:17.002720 | controller | Monday 16 March 2026  10:28:16 +0000 (0:00:00.042)       0:00:02.149 **********
2026-03-16 10:28:17.002730 | controller |
2026-03-16 10:28:17.046534 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-16 10:28:17.046555 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.046)       0:00:02.195 **********
2026-03-16 10:28:17.046578 | controller | ok: [instance]
2026-03-16 10:28:17.046851 | controller |
2026-03-16 10:28:17.097117 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-16 10:28:17.097151 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.043)       0:00:02.239 **********
2026-03-16 10:28:17.097163 | controller | ok: [instance]
2026-03-16 10:28:17.135743 | controller |
2026-03-16 10:28:17.135771 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-16 10:28:17.135780 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.047)       0:00:02.286 **********
2026-03-16 10:28:17.135790 | controller | ok: [instance]
2026-03-16 10:28:17.169581 | controller |
2026-03-16 10:28:17.169608 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-16 10:28:17.169618 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.041)       0:00:02.328 **********
2026-03-16 10:28:17.169627 | controller | skipping: [instance]
2026-03-16 10:28:17.239623 | controller |
2026-03-16 10:28:17.239643 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-16 10:28:17.239651 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.034)       0:00:02.362 **********
2026-03-16 10:28:17.239661 | controller | ok: [instance] => changed=false
2026-03-16 10:28:17.311509 | controller |   msg: All assertions passed
2026-03-16 10:28:17.311531 | controller |
2026-03-16 10:28:17.311538 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] ***
2026-03-16 10:28:17.311546 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.069)       0:00:02.432 **********
2026-03-16 10:28:17.311555 | controller |
2026-03-16 10:28:17.376551 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-16 10:28:17.376663 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.071)       0:00:02.503 **********
2026-03-16 10:28:17.376682 | controller | ok: [instance]
2026-03-16 10:28:17.441684 | controller |
2026-03-16 10:28:17.441708 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-16 10:28:17.441716 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.064)       0:00:02.568 **********
2026-03-16 10:28:17.441725 | controller | ok: [instance]
2026-03-16 10:28:17.515589 | controller |
2026-03-16 10:28:17.515618 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-16 10:28:17.515628 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.065)       0:00:02.633 **********
2026-03-16 10:28:17.515643 | controller | ok: [instance]
2026-03-16 10:28:17.567284 | controller |
2026-03-16 10:28:17.567308 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-16 10:28:17.567335 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.074)       0:00:02.707 **********
2026-03-16 10:28:17.567345 | controller | skipping: [instance]
2026-03-16 10:28:17.615206 | controller |
2026-03-16 10:28:17.615226 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-16 10:28:17.615234 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.051)       0:00:02.759 **********
2026-03-16 10:28:17.615257 | controller | ok: [instance] => changed=false
2026-03-16 10:28:17.671660 | controller |   msg: All assertions passed
2026-03-16 10:28:17.671686 | controller |
2026-03-16 10:28:17.671693 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] ***
2026-03-16 10:28:17.671701 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.047)       0:00:02.807 **********
2026-03-16 10:28:17.671732 | controller |
2026-03-16 10:28:17.743357 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-16 10:28:17.743393 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.056)       0:00:02.864 **********
2026-03-16 10:28:17.743406 | controller | ok: [instance]
2026-03-16 10:28:17.790551 | controller |
2026-03-16 10:28:17.790585 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-16 10:28:17.790600 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.066)       0:00:02.931 **********
2026-03-16 10:28:17.790611 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:17.830595 | controller |   assertion: _matched_url | default('') | length > 0
2026-03-16 10:28:17.830616 | controller |   evaluated_to: false
2026-03-16 10:28:17.830626 | controller |   msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job'
2026-03-16 10:28:17.830637 | controller |
2026-03-16 10:28:17.882655 | controller | TASK [Clear errors to manually handle them] ************************************
2026-03-16 10:28:17.882689 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.066)       0:00:02.997 **********
2026-03-16 10:28:17.882698 | controller |
2026-03-16 10:28:17.882704 | controller | TASK [Really fail if string passed but should have failed] *********************
2026-03-16 10:28:17.882709 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.024)       0:00:03.021 **********
2026-03-16 10:28:17.882719 | controller | skipping: [instance]
2026-03-16 10:28:17.944212 | controller |
2026-03-16 10:28:17.944242 | controller | TASK [Really fail if string failed but should have passed] *********************
2026-03-16 10:28:17.944250 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.053)       0:00:03.074 **********
2026-03-16 10:28:17.944265 | controller | skipping: [instance]
2026-03-16 10:28:17.999188 | controller |
2026-03-16 10:28:17.999228 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] ***
2026-03-16 10:28:17.999238 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.061)       0:00:03.136 **********
2026-03-16 10:28:17.999249 | controller |
2026-03-16 10:28:18.051177 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-16 10:28:18.051198 | controller | Monday 16 March 2026  10:28:17 +0000 (0:00:00.055)       0:00:03.191 **********
2026-03-16 10:28:18.051215 | controller | ok: [instance]
2026-03-16 10:28:18.107193 | controller |
2026-03-16 10:28:18.107213 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-16 10:28:18.107220 | controller | Monday 16 March 2026  10:28:18 +0000 (0:00:00.052)       0:00:03.243 **********
2026-03-16 10:28:18.107230 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:18.139339 | controller |   assertion: _matched_url | default('') | length > 0
2026-03-16 10:28:18.139361 | controller |   evaluated_to: false
2026-03-16 10:28:18.139370 | controller |   msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job'
2026-03-16 10:28:18.139386 | controller |
2026-03-16 10:28:18.187720 | controller | TASK [Clear errors to manually handle them] ************************************
2026-03-16 10:28:18.187750 | controller | Monday 16 March 2026  10:28:18 +0000 (0:00:00.068)       0:00:03.312 **********
2026-03-16 10:28:18.187758 | controller |
2026-03-16 10:28:18.187765 | controller | TASK [Really fail if string passed but should have failed] *********************
2026-03-16 10:28:18.187771 | controller | Monday 16 March 2026  10:28:18 +0000 (0:00:00.019)       0:00:03.331 **********
2026-03-16 10:28:18.187780 | controller | skipping: [instance]
2026-03-16 10:28:18.237430 | controller |
2026-03-16 10:28:18.237458 | controller | TASK [Really fail if string failed but should have passed] *********************
2026-03-16 10:28:18.237467 | controller | Monday 16 March 2026  10:28:18 +0000 (0:00:00.048)       0:00:03.380 **********
2026-03-16 10:28:18.237496 | controller | skipping: [instance]
2026-03-16 10:28:18.237696 | controller |
2026-03-16 10:28:18.237884 | controller | TASK [Print success message] ***************************************************
2026-03-16 10:28:18.238061 | controller | Monday 16 March 2026  10:28:18 +0000 (0:00:00.049)       0:00:03.430 **********
2026-03-16 10:28:18.333913 | controller | ok: [instance] =>
2026-03-16 10:28:18.409731 | controller |   msg: All strings passed!
2026-03-16 10:28:18.409811 | controller |
2026-03-16 10:28:18.409822 | controller | PLAY RECAP *********************************************************************
2026-03-16 10:28:18.409830 | controller | instance                   : ok=39   changed=0    unreachable=0    failed=0    skipped=14   rescued=4    ignored=0
2026-03-16 10:28:18.409836 | controller |
2026-03-16 10:28:18.409841 | controller | Monday 16 March 2026  10:28:18 +0000 (0:00:00.093)       0:00:03.523 **********
2026-03-16 10:28:18.409848 | controller | ===============================================================================
2026-03-16 10:28:18.409853 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.12s
2026-03-16 10:28:18.409859 | controller | Call task file in loop -------------------------------------------------- 0.11s
2026-03-16 10:28:18.409869 | controller | Print success message --------------------------------------------------- 0.09s
2026-03-16 10:28:18.409880 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.09s
2026-03-16 10:28:18.409900 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.08s
2026-03-16 10:28:18.409909 | controller | reproducer : Extract job id for later reference ------------------------- 0.07s
2026-03-16 10:28:18.409914 | controller | reproducer : Apply regex match filter ----------------------------------- 0.07s
2026-03-16 10:28:18.409920 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.07s
2026-03-16 10:28:18.409927 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.07s
2026-03-16 10:28:18.409932 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.07s
2026-03-16 10:28:18.409938 | controller | reproducer : Apply regex match filter ----------------------------------- 0.07s
2026-03-16 10:28:18.409949 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.07s
2026-03-16 10:28:18.409954 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.07s
2026-03-16 10:28:18.409990 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.07s
2026-03-16 10:28:18.410003 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.07s
2026-03-16 10:28:18.410010 | controller | reproducer : Apply regex match filter ----------------------------------- 0.06s
2026-03-16 10:28:18.410015 | controller | reproducer : Extract job id for later reference ------------------------- 0.06s
2026-03-16 10:28:18.410026 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.06s
2026-03-16 10:28:18.410037 | controller | Really fail if string failed but should have passed --------------------- 0.06s
2026-03-16 10:28:18.410043 | controller | reproducer : Extract job id for later reference ------------------------- 0.06s
2026-03-16 10:28:18.410053 | controller | INFO     Running job_uri > cleanup
2026-03-16 10:28:18.410780 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-16 10:28:18.420918 | controller | INFO     Running network_validations > prepare
2026-03-16 10:28:18.421628 | controller | WARNING  Skipping, prepare playbook not configured.
2026-03-16 10:28:18.430975 | controller | INFO     Running network_validations > converge
2026-03-16 10:28:18.993077 | controller |
2026-03-16 10:28:19.033965 | controller | PLAY [Prepare] *****************************************************************
2026-03-16 10:28:19.034012 | controller |
2026-03-16 10:28:19.034020 | controller | TASK [Set failed fact] *********************************************************
2026-03-16 10:28:19.034027 | controller | Monday 16 March 2026  10:28:18 +0000 (0:00:00.061)       0:00:00.061 **********
2026-03-16 10:28:19.034040 | controller | ok: [instance]
2026-03-16 10:28:19.166091 | controller |
2026-03-16 10:28:19.166129 | controller | TASK [Load scenarios] **********************************************************
2026-03-16 10:28:19.166147 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.044)       0:00:00.105 **********
2026-03-16 10:28:19.166161 | controller | ok: [instance]
2026-03-16 10:28:19.268136 | controller |
2026-03-16 10:28:19.268198 | controller | TASK [Test network validations] ************************************************
2026-03-16 10:28:19.268209 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.132)       0:00:00.237 **********
2026-03-16 10:28:19.268227 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only)
2026-03-16 10:28:19.307379 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf)
2026-03-16 10:28:19.307478 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net)
2026-03-16 10:28:19.307493 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition)
2026-03-16 10:28:19.307499 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition)
2026-03-16 10:28:19.307505 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM)
2026-03-16 10:28:19.307512 | controller |
2026-03-16 10:28:19.307523 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:19.307532 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.101)       0:00:00.338 **********
2026-03-16 10:28:19.307554 | controller | ok: [instance]
2026-03-16 10:28:19.358108 | controller |
2026-03-16 10:28:19.358160 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:19.358170 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.039)       0:00:00.378 **********
2026-03-16 10:28:19.358184 | controller | ok: [instance]
2026-03-16 10:28:19.358207 | controller |
2026-03-16 10:28:19.358348 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:19.358365 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.051)       0:00:00.430 **********
2026-03-16 10:28:19.397769 | controller | ok: [instance] =>
2026-03-16 10:28:19.397913 | controller |   msg: 'Running: Default nets only'
2026-03-16 10:28:19.397959 | controller |
2026-03-16 10:28:19.398089 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:19.398161 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.039)       0:00:00.469 **********
2026-03-16 10:28:19.454997 | controller |
2026-03-16 10:28:19.455150 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-16 10:28:19.455264 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.058)       0:00:00.527 **********
2026-03-16 10:28:19.589412 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-16 10:28:19.610884 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-16 10:28:19.610907 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-16 10:28:19.610915 | controller | collisions and unexpected behavior.
2026-03-16 10:28:19.610926 | controller | ok: [instance] => (item=controller)
2026-03-16 10:28:19.610982 | controller |
2026-03-16 10:28:19.611120 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-16 10:28:19.611246 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.155)       0:00:00.682 **********
2026-03-16 10:28:19.689233 | controller | ok: [instance]
2026-03-16 10:28:19.689279 | controller |
2026-03-16 10:28:19.689420 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-16 10:28:19.689440 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.078)       0:00:00.760 **********
2026-03-16 10:28:19.775615 | controller | ok: [instance] => changed=false
2026-03-16 10:28:19.775712 | controller |   msg: All assertions passed
2026-03-16 10:28:19.775858 | controller |
2026-03-16 10:28:19.775987 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:19.776197 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.085)       0:00:00.846 **********
2026-03-16 10:28:19.839651 | controller | skipping: [instance]
2026-03-16 10:28:19.839772 | controller |
2026-03-16 10:28:19.839898 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:19.840257 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.064)       0:00:00.911 **********
2026-03-16 10:28:19.890651 | controller | skipping: [instance]
2026-03-16 10:28:19.890775 | controller |
2026-03-16 10:28:19.890789 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:19.891180 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.050)       0:00:00.962 **********
2026-03-16 10:28:19.939582 | controller | skipping: [instance]
2026-03-16 10:28:19.939737 | controller |
2026-03-16 10:28:19.939908 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:19.939989 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.049)       0:00:01.011 **********
2026-03-16 10:28:19.971537 | controller | ok: [instance]
2026-03-16 10:28:19.971693 | controller |
2026-03-16 10:28:19.971801 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:19.971927 | controller | Monday 16 March 2026  10:28:19 +0000 (0:00:00.031)       0:00:01.043 **********
2026-03-16 10:28:20.025925 | controller | ok: [instance]
2026-03-16 10:28:20.026025 | controller |
2026-03-16 10:28:20.026159 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:20.026273 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.054)       0:00:01.097 **********
2026-03-16 10:28:20.068108 | controller | ok: [instance] =>
2026-03-16 10:28:20.068246 | controller |   msg: 'Running: Default nets and spine/leaf'
2026-03-16 10:28:20.068382 | controller |
2026-03-16 10:28:20.068503 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:20.068657 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.042)       0:00:01.140 **********
2026-03-16 10:28:20.140178 | controller |
2026-03-16 10:28:20.180233 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-16 10:28:20.180367 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.071)       0:00:01.211 **********
2026-03-16 10:28:20.180414 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-16 10:28:20.241675 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-16 10:28:20.241757 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-16 10:28:20.241767 | controller | collisions and unexpected behavior.
2026-03-16 10:28:20.241782 | controller | ok: [instance] => (item=controller)
2026-03-16 10:28:20.322435 | controller |
2026-03-16 10:28:20.322491 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-16 10:28:20.322503 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.100)       0:00:01.312 **********
2026-03-16 10:28:20.322514 | controller | ok: [instance]
2026-03-16 10:28:20.435073 | controller |
2026-03-16 10:28:20.435144 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-16 10:28:20.435155 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.081)       0:00:01.394 **********
2026-03-16 10:28:20.435168 | controller | ok: [instance] => changed=false
2026-03-16 10:28:20.501010 | controller |   msg: All assertions passed
2026-03-16 10:28:20.501058 | controller |
2026-03-16 10:28:20.501067 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:20.501073 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.110)       0:00:01.505 **********
2026-03-16 10:28:20.501085 | controller | skipping: [instance]
2026-03-16 10:28:20.551701 | controller |
2026-03-16 10:28:20.551762 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:20.551784 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.067)       0:00:01.572 **********
2026-03-16 10:28:20.551832 | controller | skipping: [instance]
2026-03-16 10:28:20.604950 | controller |
2026-03-16 10:28:20.604978 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:20.604987 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.050)       0:00:01.623 **********
2026-03-16 10:28:20.604998 | controller | skipping: [instance]
2026-03-16 10:28:20.605220 | controller |
2026-03-16 10:28:20.605550 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:20.605824 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.053)       0:00:01.676 **********
2026-03-16 10:28:20.635180 | controller | ok: [instance]
2026-03-16 10:28:20.635614 | controller |
2026-03-16 10:28:20.635810 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:20.636049 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.029)       0:00:01.706 **********
2026-03-16 10:28:20.697392 | controller | ok: [instance]
2026-03-16 10:28:20.697671 | controller |
2026-03-16 10:28:20.698447 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:20.698645 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.033)       0:00:01.740 **********
2026-03-16 10:28:20.760954 | controller | ok: [instance] =>
2026-03-16 10:28:20.761399 | controller |   msg: 'Running: Default nets with extra defined net'
2026-03-16 10:28:20.761755 | controller |
2026-03-16 10:28:20.776385 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:20.776419 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.091)       0:00:01.831 **********
2026-03-16 10:28:20.869867 | controller |
2026-03-16 10:28:20.870120 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-16 10:28:20.870331 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.109)       0:00:01.941 **********
2026-03-16 10:28:20.908452 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-16 10:28:20.908778 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-16 10:28:20.909172 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-16 10:28:20.909400 | controller | collisions and unexpected behavior.
2026-03-16 10:28:20.939721 | controller | ok: [instance] => (item=controller)
2026-03-16 10:28:20.939925 | controller |
2026-03-16 10:28:20.940113 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-16 10:28:20.940289 | controller | Monday 16 March 2026  10:28:20 +0000 (0:00:00.069)       0:00:02.010 **********
2026-03-16 10:28:21.033739 | controller | ok: [instance]
2026-03-16 10:28:21.114735 | controller |
2026-03-16 10:28:21.114782 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-16 10:28:21.114820 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.094)       0:00:02.105 **********
2026-03-16 10:28:21.114831 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:21.125279 | controller |   assertion: _defined | difference(_all_nets) | length == 0
2026-03-16 10:28:21.125301 | controller |   evaluated_to: false
2026-03-16 10:28:21.125331 | controller |   msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']'
2026-03-16 10:28:21.125349 | controller |
2026-03-16 10:28:21.180398 | controller | TASK [reproducer : Dump initial layout] ****************************************
2026-03-16 10:28:21.180445 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.091)       0:00:02.196 **********
2026-03-16 10:28:21.180477 | controller | ok: [instance] =>
2026-03-16 10:28:21.222635 | controller |   cifmw_libvirt_manager_configuration:
2026-03-16 10:28:21.222659 | controller |     networks:
2026-03-16 10:28:21.222667 | controller |       public: defined
2026-03-16 10:28:21.222680 | controller |     vms:
2026-03-16 10:28:21.222706 | controller |       controller:
2026-03-16 10:28:21.222719 | controller |         nets:
2026-03-16 10:28:21.222741 | controller |         - public
2026-03-16 10:28:21.222764 | controller |
2026-03-16 10:28:21.222772 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************
2026-03-16 10:28:21.222792 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.053)       0:00:02.250 **********
2026-03-16 10:28:21.222803 | controller | skipping: [instance]
2026-03-16 10:28:21.312921 | controller |
2026-03-16 10:28:21.312942 | controller | TASK [reproducer : Dump layout patches] ****************************************
2026-03-16 10:28:21.312950 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.041)       0:00:02.291 **********
2026-03-16 10:28:21.312959 | controller | skipping: [instance]
2026-03-16 10:28:21.376800 | controller |
2026-03-16 10:28:21.376852 | controller | TASK [reproducer : Dump built layout] ******************************************
2026-03-16 10:28:21.376861 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.092)       0:00:02.384 **********
2026-03-16 10:28:21.376877 | controller | ok: [instance] =>
2026-03-16 10:28:21.402926 | controller |   _cifmw_libvirt_manager_layout:
2026-03-16 10:28:21.402976 | controller |     networks:
2026-03-16 10:28:21.402986 | controller |       extra_net_1: defined
2026-03-16 10:28:21.402992 | controller |       public: defined
2026-03-16 10:28:21.402998 | controller |     vms:
2026-03-16 10:28:21.403004 | controller |       controller:
2026-03-16 10:28:21.403009 | controller |         nets:
2026-03-16 10:28:21.403014 | controller |         - public
2026-03-16 10:28:21.403020 | controller |
2026-03-16 10:28:21.403025 | controller | TASK [reproducer : Fail for good] **********************************************
2026-03-16 10:28:21.403031 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.062)       0:00:02.447 **********
2026-03-16 10:28:21.403040 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:21.467237 | controller |   msg: Error detected, please check assertions and debugging output above.
2026-03-16 10:28:21.467350 | controller |
2026-03-16 10:28:21.501216 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:21.501248 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.032)       0:00:02.479 **********
2026-03-16 10:28:21.501257 | controller |
2026-03-16 10:28:21.501270 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:21.501276 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.058)       0:00:02.538 **********
2026-03-16 10:28:21.501298 | controller | ok: [instance]
2026-03-16 10:28:21.501343 | controller |
2026-03-16 10:28:21.501463 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:21.501675 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.034)       0:00:02.573 **********
2026-03-16 10:28:21.553179 | controller | skipping: [instance]
2026-03-16 10:28:21.553294 | controller |
2026-03-16 10:28:21.553676 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:21.553897 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.052)       0:00:02.625 **********
2026-03-16 10:28:21.599276 | controller | skipping: [instance]
2026-03-16 10:28:21.599534 | controller |
2026-03-16 10:28:21.599768 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:21.599955 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.046)       0:00:02.671 **********
2026-03-16 10:28:21.650125 | controller | skipping: [instance]
2026-03-16 10:28:21.650417 | controller |
2026-03-16 10:28:21.650600 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:21.650837 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.050)       0:00:02.722 **********
2026-03-16 10:28:21.685536 | controller | ok: [instance]
2026-03-16 10:28:21.685663 | controller |
2026-03-16 10:28:21.685800 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:21.686016 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.034)       0:00:02.756 **********
2026-03-16 10:28:21.724280 | controller | ok: [instance]
2026-03-16 10:28:21.724480 | controller |
2026-03-16 10:28:21.724651 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:21.724978 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.039)       0:00:02.796 **********
2026-03-16 10:28:21.759692 | controller | ok: [instance] =>
2026-03-16 10:28:21.759862 | controller |   msg: 'Running: Missing default net definition'
2026-03-16 10:28:21.759969 | controller |
2026-03-16 10:28:21.760210 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:21.760393 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.035)       0:00:02.831 **********
2026-03-16 10:28:21.847729 | controller |
2026-03-16 10:28:21.848022 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-16 10:28:21.848238 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.087)       0:00:02.918 **********
2026-03-16 10:28:21.888539 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-16 10:28:21.913708 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-16 10:28:21.913735 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-16 10:28:21.913744 | controller | collisions and unexpected behavior.
2026-03-16 10:28:21.913754 | controller | ok: [instance] => (item=controller)
2026-03-16 10:28:21.913936 | controller |
2026-03-16 10:28:21.914075 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-16 10:28:21.914262 | controller | Monday 16 March 2026  10:28:21 +0000 (0:00:00.066)       0:00:02.985 **********
2026-03-16 10:28:21.992153 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:21.992516 | controller |   assertion: _all_nets | difference(_defined) | length == 0
2026-03-16 10:28:21.992599 | controller |   evaluated_to: false
2026-03-16 10:28:21.992840 | controller |   msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']'
2026-03-16 10:28:22.009620 | controller |
2026-03-16 10:28:22.009893 | controller | TASK [reproducer : Dump initial layout] ****************************************
2026-03-16 10:28:22.010065 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.095)       0:00:03.081 **********
2026-03-16 10:28:22.062096 | controller | ok: [instance] =>
2026-03-16 10:28:22.062465 | controller |   cifmw_libvirt_manager_configuration:
2026-03-16 10:28:22.062733 | controller |     networks:
2026-03-16 10:28:22.062975 | controller |       public: defined
2026-03-16 10:28:22.063222 | controller |     vms:
2026-03-16 10:28:22.063592 | controller |       controller:
2026-03-16 10:28:22.063770 | controller |         nets:
2026-03-16 10:28:22.063914 | controller |         - public
2026-03-16 10:28:22.064197 | controller |
2026-03-16 10:28:22.064487 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************
2026-03-16 10:28:22.064722 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.048)       0:00:03.130 **********
2026-03-16 10:28:22.191753 | controller | skipping: [instance]
2026-03-16 10:28:22.191914 | controller |
2026-03-16 10:28:22.192093 | controller | TASK [reproducer : Dump layout patches] ****************************************
2026-03-16 10:28:22.192248 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.133)       0:00:03.263 **********
2026-03-16 10:28:22.321241 | controller | skipping: [instance]
2026-03-16 10:28:22.321479 | controller |
2026-03-16 10:28:22.321642 | controller | TASK [reproducer : Dump built layout] ******************************************
2026-03-16 10:28:22.321911 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.129)       0:00:03.392 **********
2026-03-16 10:28:22.378479 | controller | ok: [instance] =>
2026-03-16 10:28:22.378667 | controller |   _cifmw_libvirt_manager_layout:
2026-03-16 10:28:22.378860 | controller |     networks:
2026-03-16 10:28:22.379073 | controller |       public: defined
2026-03-16 10:28:22.379266 | controller |     vms:
2026-03-16 10:28:22.379513 | controller |       controller:
2026-03-16 10:28:22.379553 | controller |         nets:
2026-03-16 10:28:22.379733 | controller |         - public
2026-03-16 10:28:22.379846 | controller |         - foo
2026-03-16 10:28:22.379946 | controller |
2026-03-16 10:28:22.380071 | controller | TASK [reproducer : Fail for good] **********************************************
2026-03-16 10:28:22.380269 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.057)       0:00:03.450 **********
2026-03-16 10:28:22.400695 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:22.435776 | controller |   msg: Error detected, please check assertions and debugging output above.
2026-03-16 10:28:22.435807 | controller |
2026-03-16 10:28:22.435959 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:22.436102 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.039)       0:00:03.490 **********
2026-03-16 10:28:22.436262 | controller |
2026-03-16 10:28:22.436385 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:22.436621 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.017)       0:00:03.507 **********
2026-03-16 10:28:22.477898 | controller | ok: [instance]
2026-03-16 10:28:22.478113 | controller |
2026-03-16 10:28:22.478263 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:22.478441 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.038)       0:00:03.546 **********
2026-03-16 10:28:22.542587 | controller | skipping: [instance]
2026-03-16 10:28:22.542817 | controller |
2026-03-16 10:28:22.543030 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:22.543206 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.062)       0:00:03.609 **********
2026-03-16 10:28:22.594840 | controller | skipping: [instance]
2026-03-16 10:28:22.594993 | controller |
2026-03-16 10:28:22.595152 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:22.595289 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.056)       0:00:03.666 **********
2026-03-16 10:28:22.637973 | controller | skipping: [instance]
2026-03-16 10:28:22.668009 | controller |
2026-03-16 10:28:22.668042 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:22.668050 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.042)       0:00:03.709 **********
2026-03-16 10:28:22.668061 | controller | ok: [instance]
2026-03-16 10:28:22.698535 | controller |
2026-03-16 10:28:22.698560 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:22.698585 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.030)       0:00:03.739 **********
2026-03-16 10:28:22.698600 | controller | ok: [instance]
2026-03-16 10:28:22.733177 | controller |
2026-03-16 10:28:22.733210 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:22.733219 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.030)       0:00:03.770 **********
2026-03-16 10:28:22.733240 | controller | ok: [instance] =>
2026-03-16 10:28:22.787694 | controller |   msg: 'Running: Missing spine/leaf net definition'
2026-03-16 10:28:22.787724 | controller |
2026-03-16 10:28:22.787738 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:22.787745 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.034)       0:00:03.804 **********
2026-03-16 10:28:22.787755 | controller |
2026-03-16 10:28:22.824393 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-16 10:28:22.824425 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.054)       0:00:03.859 **********
2026-03-16 10:28:22.824439 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-16 10:28:22.846492 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-16 10:28:22.846517 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-16 10:28:22.846525 | controller | collisions and unexpected behavior.
2026-03-16 10:28:22.846536 | controller | ok: [instance] => (item=controller)
2026-03-16 10:28:22.907628 | controller |
2026-03-16 10:28:22.907650 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-16 10:28:22.907658 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.058)       0:00:03.917 **********
2026-03-16 10:28:22.907668 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:22.926728 | controller |   assertion: _all_nets | difference(_defined) | length == 0
2026-03-16 10:28:22.926753 | controller |   evaluated_to: false
2026-03-16 10:28:22.926762 | controller |   msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']'
2026-03-16 10:28:22.926772 | controller |
2026-03-16 10:28:22.967704 | controller | TASK [reproducer : Dump initial layout] ****************************************
2026-03-16 10:28:22.967735 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.079)       0:00:03.997 **********
2026-03-16 10:28:22.967748 | controller | ok: [instance] =>
2026-03-16 10:28:23.065195 | controller |   cifmw_libvirt_manager_configuration:
2026-03-16 10:28:23.065241 | controller |     networks:
2026-03-16 10:28:23.065252 | controller |       l00-s0: defined
2026-03-16 10:28:23.065263 | controller |       public: defined
2026-03-16 10:28:23.065269 | controller |     vms:
2026-03-16 10:28:23.065274 | controller |       controller:
2026-03-16 10:28:23.065280 | controller |         nets:
2026-03-16 10:28:23.065285 | controller |         - public
2026-03-16 10:28:23.065295 | controller |         spineleafnets:
2026-03-16 10:28:23.065302 | controller |         - l00-s0
2026-03-16 10:28:23.065323 | controller |
2026-03-16 10:28:23.065331 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************
2026-03-16 10:28:23.065337 | controller | Monday 16 March 2026  10:28:22 +0000 (0:00:00.040)       0:00:04.038 **********
2026-03-16 10:28:23.065347 | controller | skipping: [instance]
2026-03-16 10:28:23.205189 | controller |
2026-03-16 10:28:23.205223 | controller | TASK [reproducer : Dump layout patches] ****************************************
2026-03-16 10:28:23.205233 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.097)       0:00:04.136 **********
2026-03-16 10:28:23.205245 | controller | skipping: [instance]
2026-03-16 10:28:23.205460 | controller |
2026-03-16 10:28:23.205483 | controller | TASK [reproducer : Dump built layout] ******************************************
2026-03-16 10:28:23.205781 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.140)       0:00:04.276 **********
2026-03-16 10:28:23.314222 | controller | ok: [instance] =>
2026-03-16 10:28:23.314360 | controller |   _cifmw_libvirt_manager_layout:
2026-03-16 10:28:23.314642 | controller |     networks:
2026-03-16 10:28:23.314804 | controller |       l00-s0: defined
2026-03-16 10:28:23.314946 | controller |       public: defined
2026-03-16 10:28:23.315105 | controller |     vms:
2026-03-16 10:28:23.315241 | controller |       controller:
2026-03-16 10:28:23.315451 | controller |         nets:
2026-03-16 10:28:23.315597 | controller |         - public
2026-03-16 10:28:23.315785 | controller |         spineleafnets:
2026-03-16 10:28:23.315907 | controller |         - l00-s0
2026-03-16 10:28:23.316061 | controller |         - l00-s1
2026-03-16 10:28:23.316187 | controller |
2026-03-16 10:28:23.316478 | controller | TASK [reproducer : Fail for good] **********************************************
2026-03-16 10:28:23.316701 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.108)       0:00:04.385 **********
2026-03-16 10:28:23.336419 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:23.336618 | controller |   msg: Error detected, please check assertions and debugging output above.
2026-03-16 10:28:23.404050 | controller |
2026-03-16 10:28:23.404237 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:23.404513 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.031)       0:00:04.417 **********
2026-03-16 10:28:23.404675 | controller |
2026-03-16 10:28:23.404825 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:23.404946 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.058)       0:00:04.475 **********
2026-03-16 10:28:23.440902 | controller | ok: [instance]
2026-03-16 10:28:23.491202 | controller |
2026-03-16 10:28:23.491226 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:23.491234 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.036)       0:00:04.512 **********
2026-03-16 10:28:23.491245 | controller | skipping: [instance]
2026-03-16 10:28:23.544270 | controller |
2026-03-16 10:28:23.544300 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:23.544325 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.050)       0:00:04.562 **********
2026-03-16 10:28:23.544341 | controller | skipping: [instance]
2026-03-16 10:28:23.544672 | controller |
2026-03-16 10:28:23.594420 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:23.594445 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.046)       0:00:04.609 **********
2026-03-16 10:28:23.594458 | controller | skipping: [instance]
2026-03-16 10:28:23.622582 | controller |
2026-03-16 10:28:23.622609 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:23.622617 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.056)       0:00:04.666 **********
2026-03-16 10:28:23.622628 | controller | ok: [instance]
2026-03-16 10:28:23.658044 | controller |
2026-03-16 10:28:23.658071 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:23.658079 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.028)       0:00:04.694 **********
2026-03-16 10:28:23.658106 | controller | ok: [instance]
2026-03-16 10:28:23.689505 | controller |
2026-03-16 10:28:23.689534 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:23.689542 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.033)       0:00:04.727 **********
2026-03-16 10:28:23.689552 | controller | ok: [instance] =>
2026-03-16 10:28:23.689807 | controller |   msg: 'Running: No network for a VM'
2026-03-16 10:28:23.689998 | controller |
2026-03-16 10:28:23.690260 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:23.690491 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.034)       0:00:04.761 **********
2026-03-16 10:28:23.740202 | controller |
2026-03-16 10:28:23.740252 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-16 10:28:23.740482 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.050)       0:00:04.812 **********
2026-03-16 10:28:23.782391 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-16 10:28:23.797143 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-16 10:28:23.797168 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-16 10:28:23.797177 | controller | collisions and unexpected behavior.
2026-03-16 10:28:23.797187 | controller | failed: [instance] (item=foo) => changed=false
2026-03-16 10:28:23.797342 | controller |   ansible_loop_var: item
2026-03-16 10:28:23.797536 | controller |   assertion: item.value.nets is defined
2026-03-16 10:28:23.797728 | controller |   evaluated_to: false
2026-03-16 10:28:23.797868 | controller |   item:
2026-03-16 10:28:23.798123 | controller |     key: foo
2026-03-16 10:28:23.798220 | controller |     value:
2026-03-16 10:28:23.798355 | controller |       disksize: 10
2026-03-16 10:28:23.798636 | controller |   msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.'
2026-03-16 10:28:23.814622 | controller | ok: [instance] => (item=controller)
2026-03-16 10:28:23.814779 | controller |
2026-03-16 10:28:23.814953 | controller | TASK [reproducer : Dump initial layout] ****************************************
2026-03-16 10:28:23.815225 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.074)       0:00:04.886 **********
2026-03-16 10:28:23.884665 | controller | ok: [instance] =>
2026-03-16 10:28:23.925126 | controller |   cifmw_libvirt_manager_configuration:
2026-03-16 10:28:23.925152 | controller |     networks:
2026-03-16 10:28:23.925161 | controller |       public: defined
2026-03-16 10:28:23.925167 | controller |     vms:
2026-03-16 10:28:23.925173 | controller |       controller:
2026-03-16 10:28:23.925179 | controller |         nets:
2026-03-16 10:28:23.925184 | controller |         - public
2026-03-16 10:28:23.925190 | controller |
2026-03-16 10:28:23.925195 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************
2026-03-16 10:28:23.925201 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.066)       0:00:04.952 **********
2026-03-16 10:28:23.925211 | controller | skipping: [instance]
2026-03-16 10:28:24.017056 | controller |
2026-03-16 10:28:24.017090 | controller | TASK [reproducer : Dump layout patches] ****************************************
2026-03-16 10:28:24.017099 | controller | Monday 16 March 2026  10:28:23 +0000 (0:00:00.043)       0:00:04.996 **********
2026-03-16 10:28:24.017111 | controller | skipping: [instance]
2026-03-16 10:28:24.084089 | controller |
2026-03-16 10:28:24.084134 | controller | TASK [reproducer : Dump built layout] ******************************************
2026-03-16 10:28:24.084144 | controller | Monday 16 March 2026  10:28:24 +0000 (0:00:00.092)       0:00:05.088 **********
2026-03-16 10:28:24.084156 | controller | ok: [instance] =>
2026-03-16 10:28:24.084333 | controller |   _cifmw_libvirt_manager_layout:
2026-03-16 10:28:24.084547 | controller |     networks:
2026-03-16 10:28:24.084837 | controller |       public: defined
2026-03-16 10:28:24.085035 | controller |     vms:
2026-03-16 10:28:24.085141 | controller |       controller:
2026-03-16 10:28:24.085278 | controller |         nets:
2026-03-16 10:28:24.085516 | controller |         - public
2026-03-16 10:28:24.085760 | controller |       foo:
2026-03-16 10:28:24.085937 | controller |         disksize: 10
2026-03-16 10:28:24.086085 | controller |
2026-03-16 10:28:24.086325 | controller | TASK [reproducer : Fail for good] **********************************************
2026-03-16 10:28:24.086555 | controller | Monday 16 March 2026  10:28:24 +0000 (0:00:00.067)       0:00:05.156 **********
2026-03-16 10:28:24.102958 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:24.103265 | controller |   msg: Error detected, please check assertions and debugging output above.
2026-03-16 10:28:24.156495 | controller |
2026-03-16 10:28:24.156652 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:24.156777 | controller | Monday 16 March 2026  10:28:24 +0000 (0:00:00.033)       0:00:05.189 **********
2026-03-16 10:28:24.156949 | controller |
2026-03-16 10:28:24.157338 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:24.157475 | controller | Monday 16 March 2026  10:28:24 +0000 (0:00:00.019)       0:00:05.209 **********
2026-03-16 10:28:24.189486 | controller | ok: [instance]
2026-03-16 10:28:24.189770 | controller |
2026-03-16 10:28:24.190047 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:24.190408 | controller | Monday 16 March 2026  10:28:24 +0000 (0:00:00.051)       0:00:05.261 **********
2026-03-16 10:28:24.236188 | controller | skipping: [instance]
2026-03-16 10:28:24.236519 | controller |
2026-03-16 10:28:24.236805 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:24.236996 | controller | Monday 16 March 2026  10:28:24 +0000 (0:00:00.046)       0:00:05.308 **********
2026-03-16 10:28:24.287997 | controller | skipping: [instance]
2026-03-16 10:28:24.288297 | controller |
2026-03-16 10:28:24.288466 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:24.288694 | controller | Monday 16 March 2026  10:28:24 +0000 (0:00:00.051)       0:00:05.359 **********
2026-03-16 10:28:24.336992 | controller | skipping: [instance]
2026-03-16 10:28:24.337358 | controller |
2026-03-16 10:28:24.337536 | controller | TASK [Fail if needed] **********************************************************
2026-03-16 10:28:24.337776 | controller | Monday 16 March 2026  10:28:24 +0000 (0:00:00.049)       0:00:05.409 **********
2026-03-16 10:28:24.459360 | controller | skipping: [instance]
2026-03-16 10:28:24.459406 | controller |
2026-03-16 10:28:24.459416 | controller | PLAY RECAP *********************************************************************
2026-03-16 10:28:24.459423 | controller | instance                   : ok=48   changed=0    unreachable=0    failed=0    skipped=27   rescued=8    ignored=0
2026-03-16 10:28:24.459432 | controller |
2026-03-16 10:28:24.460772 | controller | Monday 16 March 2026  10:28:24 +0000 (0:00:00.120)       0:00:05.530 **********
2026-03-16 10:28:24.460801 | controller | ===============================================================================
2026-03-16 10:28:24.460809 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.16s
2026-03-16 10:28:24.460815 | controller | reproducer : Dump layout patches ---------------------------------------- 0.14s
2026-03-16 10:28:24.460821 | controller | reproducer : Dump CI reproducer generated layout ------------------------ 0.13s
2026-03-16 10:28:24.460826 | controller | Load scenarios ---------------------------------------------------------- 0.13s
2026-03-16 10:28:24.460832 | controller | reproducer : Dump layout patches ---------------------------------------- 0.13s
2026-03-16 10:28:24.460840 | controller | Fail if needed ---------------------------------------------------------- 0.12s
2026-03-16 10:28:24.461393 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.11s
2026-03-16 10:28:24.461693 | controller | Validate data ----------------------------------------------------------- 0.11s
2026-03-16 10:28:24.461713 | controller | reproducer : Dump built layout ------------------------------------------ 0.11s
2026-03-16 10:28:24.461855 | controller | Test network validations ------------------------------------------------ 0.10s
2026-03-16 10:28:24.461869 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.10s
2026-03-16 10:28:24.461878 | controller | reproducer : Dump CI reproducer generated layout ------------------------ 0.10s
2026-03-16 10:28:24.462107 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.10s
2026-03-16 10:28:24.462560 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.09s
2026-03-16 10:28:24.462816 | controller | reproducer : Dump layout patches ---------------------------------------- 0.09s
2026-03-16 10:28:24.462861 | controller | reproducer : Dump layout patches ---------------------------------------- 0.09s
2026-03-16 10:28:24.462872 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.09s
2026-03-16 10:28:24.463034 | controller | Output scenario name ---------------------------------------------------- 0.09s
2026-03-16 10:28:24.463066 | controller | Validate data ----------------------------------------------------------- 0.09s
2026-03-16 10:28:24.463224 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.09s
2026-03-16 10:28:24.541195 | controller | INFO     Running network_validations > cleanup
2026-03-16 10:28:24.541948 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-16 10:28:24.552335 | controller | INFO     Running ocp_validations > prepare
2026-03-16 10:28:24.552940 | controller | WARNING  Skipping, prepare playbook not configured.
2026-03-16 10:28:24.564179 | controller | INFO     Running ocp_validations > converge
2026-03-16 10:28:25.456144 | controller |
2026-03-16 10:28:25.476741 | controller | PLAY [Prepare] *****************************************************************
2026-03-16 10:28:25.476786 | controller |
2026-03-16 10:28:25.476795 | controller | TASK [Set failed fact] *********************************************************
2026-03-16 10:28:25.476801 | controller | Monday 16 March 2026  10:28:25 +0000 (0:00:00.053)       0:00:00.053 **********
2026-03-16 10:28:25.476819 | controller | ok: [instance]
2026-03-16 10:28:25.518880 | controller |
2026-03-16 10:28:25.518922 | controller | TASK [Load scenarios] **********************************************************
2026-03-16 10:28:25.518931 | controller | Monday 16 March 2026  10:28:25 +0000 (0:00:00.031)       0:00:00.085 **********
2026-03-16 10:28:25.518944 | controller | ok: [instance]
2026-03-16 10:28:25.674948 | controller |
2026-03-16 10:28:25.674984 | controller | TASK [Test no volumes] *********************************************************
2026-03-16 10:28:25.674998 | controller | Monday 16 March 2026  10:28:25 +0000 (0:00:00.042)       0:00:00.127 **********
2026-03-16 10:28:25.675014 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker)
2026-03-16 10:28:25.710705 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker)
2026-03-16 10:28:25.710730 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker)
2026-03-16 10:28:25.710739 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker)
2026-03-16 10:28:25.710745 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes)
2026-03-16 10:28:25.710751 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount)
2026-03-16 10:28:25.710763 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume)
2026-03-16 10:28:25.710769 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume)
2026-03-16 10:28:25.710775 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice)
2026-03-16 10:28:25.710780 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS)
2026-03-16 10:28:25.710786 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm)
2026-03-16 10:28:25.710797 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts)
2026-03-16 10:28:25.710803 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker)
2026-03-16 10:28:25.710808 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker)
2026-03-16 10:28:25.710814 | controller |
2026-03-16 10:28:25.710820 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:25.710826 | controller | Monday 16 March 2026  10:28:25 +0000 (0:00:00.152)       0:00:00.280 **********
2026-03-16 10:28:25.710837 | controller | ok: [instance]
2026-03-16 10:28:25.710959 | controller |
2026-03-16 10:28:25.710969 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:25.711091 | controller | Monday 16 March 2026  10:28:25 +0000 (0:00:00.039)       0:00:00.319 **********
2026-03-16 10:28:25.754511 | controller | ok: [instance]
2026-03-16 10:28:25.754696 | controller |
2026-03-16 10:28:25.754891 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:25.755038 | controller | Monday 16 March 2026  10:28:25 +0000 (0:00:00.043)       0:00:00.363 **********
2026-03-16 10:28:25.794348 | controller | ok: [instance] =>
2026-03-16 10:28:25.794590 | controller |   msg: 'Running: No volume, no worker'
2026-03-16 10:28:25.794804 | controller |
2026-03-16 10:28:25.795012 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:25.795195 | controller | Monday 16 March 2026  10:28:25 +0000 (0:00:00.039)       0:00:00.403 **********
2026-03-16 10:28:25.881680 | controller |
2026-03-16 10:28:25.881872 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:25.882031 | controller | Monday 16 March 2026  10:28:25 +0000 (0:00:00.087)       0:00:00.490 **********
2026-03-16 10:28:25.962197 | controller | ok: [instance]
2026-03-16 10:28:25.962395 | controller |
2026-03-16 10:28:25.962559 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:25.962775 | controller | Monday 16 March 2026  10:28:25 +0000 (0:00:00.080)       0:00:00.571 **********
2026-03-16 10:28:26.026497 | controller | ok: [instance]
2026-03-16 10:28:26.143372 | controller |
2026-03-16 10:28:26.143403 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:26.143412 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.063)       0:00:00.634 **********
2026-03-16 10:28:26.143428 | controller | ok: [instance]
2026-03-16 10:28:26.209114 | controller |
2026-03-16 10:28:26.209138 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:26.209147 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.116)       0:00:00.751 **********
2026-03-16 10:28:26.209158 | controller | skipping: [instance]
2026-03-16 10:28:26.277718 | controller |
2026-03-16 10:28:26.277754 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:26.277764 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.063)       0:00:00.814 **********
2026-03-16 10:28:26.277775 | controller | ok: [instance]
2026-03-16 10:28:26.330658 | controller |
2026-03-16 10:28:26.330697 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-16 10:28:26.330720 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.071)       0:00:00.886 **********
2026-03-16 10:28:26.330734 | controller | skipping: [instance]
2026-03-16 10:28:26.384046 | controller |
2026-03-16 10:28:26.384075 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-16 10:28:26.384084 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.051)       0:00:00.937 **********
2026-03-16 10:28:26.384096 | controller | skipping: [instance]
2026-03-16 10:28:26.433819 | controller |
2026-03-16 10:28:26.433861 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-16 10:28:26.433870 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.054)       0:00:00.992 **********
2026-03-16 10:28:26.433881 | controller | skipping: [instance]
2026-03-16 10:28:26.487981 | controller |
2026-03-16 10:28:26.488017 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-16 10:28:26.488026 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.049)       0:00:01.042 **********
2026-03-16 10:28:26.488037 | controller | skipping: [instance]
2026-03-16 10:28:26.543205 | controller |
2026-03-16 10:28:26.543232 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-16 10:28:26.543245 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.053)       0:00:01.096 **********
2026-03-16 10:28:26.543258 | controller | skipping: [instance]
2026-03-16 10:28:26.610161 | controller |
2026-03-16 10:28:26.610191 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-16 10:28:26.610203 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.055)       0:00:01.151 **********
2026-03-16 10:28:26.610216 | controller | skipping: [instance]
2026-03-16 10:28:26.660000 | controller |
2026-03-16 10:28:26.660039 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:26.660049 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.067)       0:00:01.218 **********
2026-03-16 10:28:26.660061 | controller | skipping: [instance]
2026-03-16 10:28:26.709380 | controller |
2026-03-16 10:28:26.709413 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:26.709421 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.049)       0:00:01.268 **********
2026-03-16 10:28:26.709431 | controller | skipping: [instance]
2026-03-16 10:28:26.754605 | controller |
2026-03-16 10:28:26.754633 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:26.754641 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.049)       0:00:01.317 **********
2026-03-16 10:28:26.754651 | controller | skipping: [instance]
2026-03-16 10:28:26.786110 | controller |
2026-03-16 10:28:26.786133 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:26.786140 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.045)       0:00:01.362 **********
2026-03-16 10:28:26.786150 | controller | ok: [instance]
2026-03-16 10:28:26.818984 | controller |
2026-03-16 10:28:26.819013 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:26.819021 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.031)       0:00:01.394 **********
2026-03-16 10:28:26.819041 | controller | ok: [instance]
2026-03-16 10:28:26.851346 | controller |
2026-03-16 10:28:26.851369 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:26.851381 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.032)       0:00:01.426 **********
2026-03-16 10:28:26.851394 | controller | ok: [instance] =>
2026-03-16 10:28:26.897803 | controller |   msg: 'Running: No volume, with worker'
2026-03-16 10:28:26.897826 | controller |
2026-03-16 10:28:26.897834 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:26.897840 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.031)       0:00:01.458 **********
2026-03-16 10:28:26.897851 | controller |
2026-03-16 10:28:26.979698 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:26.979725 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.048)       0:00:01.506 **********
2026-03-16 10:28:26.979738 | controller | ok: [instance]
2026-03-16 10:28:26.979876 | controller |
2026-03-16 10:28:26.980294 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:26.980354 | controller | Monday 16 March 2026  10:28:26 +0000 (0:00:00.082)       0:00:01.588 **********
2026-03-16 10:28:27.130854 | controller | ok: [instance]
2026-03-16 10:28:27.241659 | controller |
2026-03-16 10:28:27.241701 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:27.241710 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.150)       0:00:01.739 **********
2026-03-16 10:28:27.241736 | controller | ok: [instance]
2026-03-16 10:28:27.372325 | controller |
2026-03-16 10:28:27.372359 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:27.372368 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.110)       0:00:01.849 **********
2026-03-16 10:28:27.372380 | controller | ok: [instance]
2026-03-16 10:28:27.452289 | controller |
2026-03-16 10:28:27.452336 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:27.452348 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.128)       0:00:01.978 **********
2026-03-16 10:28:27.452359 | controller | ok: [instance]
2026-03-16 10:28:27.511505 | controller |
2026-03-16 10:28:27.511537 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-16 10:28:27.511547 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.081)       0:00:02.060 **********
2026-03-16 10:28:27.511563 | controller | skipping: [instance]
2026-03-16 10:28:27.511819 | controller |
2026-03-16 10:28:27.511835 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-16 10:28:27.511846 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.056)       0:00:02.117 **********
2026-03-16 10:28:27.568463 | controller | skipping: [instance]
2026-03-16 10:28:27.568648 | controller |
2026-03-16 10:28:27.568798 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-16 10:28:27.568967 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.056)       0:00:02.174 **********
2026-03-16 10:28:27.621498 | controller | skipping: [instance]
2026-03-16 10:28:27.621617 | controller |
2026-03-16 10:28:27.621774 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-16 10:28:27.621902 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.053)       0:00:02.228 **********
2026-03-16 10:28:27.679175 | controller | skipping: [instance]
2026-03-16 10:28:27.679278 | controller |
2026-03-16 10:28:27.679453 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-16 10:28:27.679614 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.057)       0:00:02.285 **********
2026-03-16 10:28:27.733785 | controller | skipping: [instance]
2026-03-16 10:28:27.733896 | controller |
2026-03-16 10:28:27.734047 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-16 10:28:27.734233 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.054)       0:00:02.340 **********
2026-03-16 10:28:27.806007 | controller | skipping: [instance]
2026-03-16 10:28:27.806396 | controller |
2026-03-16 10:28:27.806416 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:27.864086 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.073)       0:00:02.414 **********
2026-03-16 10:28:27.864118 | controller | skipping: [instance]
2026-03-16 10:28:27.864335 | controller |
2026-03-16 10:28:27.864364 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:27.864627 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.058)       0:00:02.472 **********
2026-03-16 10:28:27.921955 | controller | skipping: [instance]
2026-03-16 10:28:27.922058 | controller |
2026-03-16 10:28:27.922190 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:27.922436 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.055)       0:00:02.528 **********
2026-03-16 10:28:27.967820 | controller | skipping: [instance]
2026-03-16 10:28:27.968690 | controller |
2026-03-16 10:28:27.969100 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:27.969116 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.048)       0:00:02.576 **********
2026-03-16 10:28:27.997822 | controller | ok: [instance]
2026-03-16 10:28:27.997857 | controller |
2026-03-16 10:28:27.998069 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:27.998332 | controller | Monday 16 March 2026  10:28:27 +0000 (0:00:00.029)       0:00:02.606 **********
2026-03-16 10:28:28.033294 | controller | ok: [instance]
2026-03-16 10:28:28.033626 | controller |
2026-03-16 10:28:28.033791 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:28.033941 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.035)       0:00:02.641 **********
2026-03-16 10:28:28.066735 | controller | ok: [instance] =>
2026-03-16 10:28:28.066946 | controller |   msg: 'Running: Volume, no worker'
2026-03-16 10:28:28.067092 | controller |
2026-03-16 10:28:28.067110 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:28.067229 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.032)       0:00:02.674 **********
2026-03-16 10:28:28.122111 | controller |
2026-03-16 10:28:28.122381 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:28.122468 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.056)       0:00:02.730 **********
2026-03-16 10:28:28.212636 | controller | ok: [instance]
2026-03-16 10:28:28.212745 | controller |
2026-03-16 10:28:28.212925 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:28.213091 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.090)       0:00:02.821 **********
2026-03-16 10:28:28.317879 | controller | ok: [instance]
2026-03-16 10:28:28.325771 | controller |
2026-03-16 10:28:28.500328 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:28.500360 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.105)       0:00:02.926 **********
2026-03-16 10:28:28.500374 | controller | ok: [instance]
2026-03-16 10:28:28.500519 | controller |
2026-03-16 10:28:28.500542 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:28.500616 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.182)       0:00:03.108 **********
2026-03-16 10:28:28.556583 | controller | skipping: [instance]
2026-03-16 10:28:28.556775 | controller |
2026-03-16 10:28:28.556955 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:28.557146 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.056)       0:00:03.165 **********
2026-03-16 10:28:28.606293 | controller | skipping: [instance]
2026-03-16 10:28:28.606485 | controller |
2026-03-16 10:28:28.606652 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-16 10:28:28.606835 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.049)       0:00:03.215 **********
2026-03-16 10:28:28.669539 | controller | ok: [instance]
2026-03-16 10:28:28.669660 | controller |
2026-03-16 10:28:28.669798 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-16 10:28:28.669976 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.063)       0:00:03.278 **********
2026-03-16 10:28:28.721374 | controller | skipping: [instance]
2026-03-16 10:28:28.721658 | controller |
2026-03-16 10:28:28.721882 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-16 10:28:28.722129 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.051)       0:00:03.330 **********
2026-03-16 10:28:28.793135 | controller | ok: [instance]
2026-03-16 10:28:28.793319 | controller |
2026-03-16 10:28:28.793731 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-16 10:28:28.793908 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.071)       0:00:03.401 **********
2026-03-16 10:28:28.876178 | controller | ok: [instance]
2026-03-16 10:28:28.876349 | controller |
2026-03-16 10:28:28.876574 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-16 10:28:28.876775 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.083)       0:00:03.485 **********
2026-03-16 10:28:28.965298 | controller | ok: [instance] => changed=false
2026-03-16 10:28:28.965450 | controller |   msg: All assertions passed
2026-03-16 10:28:28.965476 | controller |
2026-03-16 10:28:28.965583 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-16 10:28:28.965847 | controller | Monday 16 March 2026  10:28:28 +0000 (0:00:00.088)       0:00:03.573 **********
2026-03-16 10:28:29.127175 | controller | ok: [instance] => changed=false
2026-03-16 10:28:29.127284 | controller |   msg: All assertions passed
2026-03-16 10:28:29.127442 | controller |
2026-03-16 10:28:29.127562 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:29.127737 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.161)       0:00:03.735 **********
2026-03-16 10:28:29.187197 | controller | skipping: [instance]
2026-03-16 10:28:29.187353 | controller |
2026-03-16 10:28:29.187534 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:29.187686 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.060)       0:00:03.795 **********
2026-03-16 10:28:29.259343 | controller | skipping: [instance]
2026-03-16 10:28:29.259734 | controller |
2026-03-16 10:28:29.259750 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:29.259761 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.071)       0:00:03.867 **********
2026-03-16 10:28:29.313410 | controller | skipping: [instance]
2026-03-16 10:28:29.313641 | controller |
2026-03-16 10:28:29.313825 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:29.314203 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.053)       0:00:03.921 **********
2026-03-16 10:28:29.360468 | controller | ok: [instance]
2026-03-16 10:28:29.360702 | controller |
2026-03-16 10:28:29.360904 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:29.361050 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.047)       0:00:03.968 **********
2026-03-16 10:28:29.408864 | controller | ok: [instance]
2026-03-16 10:28:29.408962 | controller |
2026-03-16 10:28:29.408979 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:29.409070 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.048)       0:00:04.017 **********
2026-03-16 10:28:29.449178 | controller | ok: [instance] =>
2026-03-16 10:28:29.449334 | controller |   msg: 'Running: Volume, with worker'
2026-03-16 10:28:29.449446 | controller |
2026-03-16 10:28:29.449717 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:29.449881 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.040)       0:00:04.058 **********
2026-03-16 10:28:29.505941 | controller |
2026-03-16 10:28:29.506119 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:29.506383 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.056)       0:00:04.114 **********
2026-03-16 10:28:29.593250 | controller | ok: [instance]
2026-03-16 10:28:29.593277 | controller |
2026-03-16 10:28:29.593557 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:29.593738 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.087)       0:00:04.201 **********
2026-03-16 10:28:29.664175 | controller | ok: [instance]
2026-03-16 10:28:29.664513 | controller |
2026-03-16 10:28:29.664549 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:29.763243 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.070)       0:00:04.272 **********
2026-03-16 10:28:29.763279 | controller | ok: [instance]
2026-03-16 10:28:29.763396 | controller |
2026-03-16 10:28:29.763591 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:29.763748 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.099)       0:00:04.372 **********
2026-03-16 10:28:29.857397 | controller | ok: [instance]
2026-03-16 10:28:29.857488 | controller |
2026-03-16 10:28:29.857797 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:29.972386 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.093)       0:00:04.466 **********
2026-03-16 10:28:29.972421 | controller | skipping: [instance]
2026-03-16 10:28:29.972461 | controller |
2026-03-16 10:28:29.972481 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-16 10:28:29.972703 | controller | Monday 16 March 2026  10:28:29 +0000 (0:00:00.114)       0:00:04.580 **********
2026-03-16 10:28:30.029681 | controller | ok: [instance]
2026-03-16 10:28:30.029769 | controller |
2026-03-16 10:28:30.029978 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-16 10:28:30.030121 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.057)       0:00:04.638 **********
2026-03-16 10:28:30.109013 | controller | ok: [instance]
2026-03-16 10:28:30.203951 | controller |
2026-03-16 10:28:30.203998 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-16 10:28:30.204013 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.076)       0:00:04.714 **********
2026-03-16 10:28:30.204045 | controller | ok: [instance]
2026-03-16 10:28:30.204136 | controller |
2026-03-16 10:28:30.204160 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-16 10:28:30.204248 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.097)       0:00:04.812 **********
2026-03-16 10:28:30.312511 | controller | ok: [instance]
2026-03-16 10:28:30.503381 | controller |
2026-03-16 10:28:30.503414 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-16 10:28:30.503426 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.105)       0:00:04.917 **********
2026-03-16 10:28:30.503440 | controller | ok: [instance] => changed=false
2026-03-16 10:28:30.666111 | controller |   msg: All assertions passed
2026-03-16 10:28:30.666146 | controller |
2026-03-16 10:28:30.666161 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-16 10:28:30.666169 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.181)       0:00:05.098 **********
2026-03-16 10:28:30.666182 | controller | ok: [instance] => changed=false
2026-03-16 10:28:30.666539 | controller |   msg: All assertions passed
2026-03-16 10:28:30.666651 | controller |
2026-03-16 10:28:30.666683 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:30.726387 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.175)       0:00:05.274 **********
2026-03-16 10:28:30.726464 | controller | skipping: [instance]
2026-03-16 10:28:30.779061 | controller |
2026-03-16 10:28:30.779091 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:30.779100 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.060)       0:00:05.334 **********
2026-03-16 10:28:30.779118 | controller | skipping: [instance]
2026-03-16 10:28:30.834778 | controller |
2026-03-16 10:28:30.834799 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:30.834821 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.052)       0:00:05.387 **********
2026-03-16 10:28:30.834832 | controller | skipping: [instance]
2026-03-16 10:28:30.886532 | controller |
2026-03-16 10:28:30.886558 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:30.886575 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.053)       0:00:05.440 **********
2026-03-16 10:28:30.886586 | controller | ok: [instance]
2026-03-16 10:28:30.886770 | controller |
2026-03-16 10:28:30.886982 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:30.887252 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.054)       0:00:05.495 **********
2026-03-16 10:28:30.928745 | controller | ok: [instance]
2026-03-16 10:28:30.928956 | controller |
2026-03-16 10:28:30.929268 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:30.929539 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.039)       0:00:05.535 **********
2026-03-16 10:28:30.985306 | controller | ok: [instance] =>
2026-03-16 10:28:31.118993 | controller |   msg: 'Running: Too many allocated volumes'
2026-03-16 10:28:31.119022 | controller |
2026-03-16 10:28:31.119031 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:31.119038 | controller | Monday 16 March 2026  10:28:30 +0000 (0:00:00.058)       0:00:05.593 **********
2026-03-16 10:28:31.119089 | controller |
2026-03-16 10:28:31.215835 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:31.215872 | controller | Monday 16 March 2026  10:28:31 +0000 (0:00:00.133)       0:00:05.727 **********
2026-03-16 10:28:31.215884 | controller | ok: [instance]
2026-03-16 10:28:31.267894 | controller |
2026-03-16 10:28:31.267917 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:31.267962 | controller | Monday 16 March 2026  10:28:31 +0000 (0:00:00.096)       0:00:05.824 **********
2026-03-16 10:28:31.267973 | controller | ok: [instance]
2026-03-16 10:28:31.267993 | controller |
2026-03-16 10:28:31.268117 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:31.268231 | controller | Monday 16 March 2026  10:28:31 +0000 (0:00:00.051)       0:00:05.876 **********
2026-03-16 10:28:31.363848 | controller | ok: [instance]
2026-03-16 10:28:31.363938 | controller |
2026-03-16 10:28:31.364068 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:31.364158 | controller | Monday 16 March 2026  10:28:31 +0000 (0:00:00.093)       0:00:05.969 **********
2026-03-16 10:28:31.454530 | controller | skipping: [instance]
2026-03-16 10:28:31.454579 | controller |
2026-03-16 10:28:31.454699 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:31.454762 | controller | Monday 16 March 2026  10:28:31 +0000 (0:00:00.093)       0:00:06.063 **********
2026-03-16 10:28:31.502340 | controller | skipping: [instance]
2026-03-16 10:28:31.502447 | controller |
2026-03-16 10:28:31.502588 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-16 10:28:31.502676 | controller | Monday 16 March 2026  10:28:31 +0000 (0:00:00.047)       0:00:06.111 **********
2026-03-16 10:28:31.855329 | controller | ok: [instance]
2026-03-16 10:28:31.855393 | controller |
2026-03-16 10:28:31.855425 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-16 10:28:31.855538 | controller | Monday 16 March 2026  10:28:31 +0000 (0:00:00.352)       0:00:06.463 **********
2026-03-16 10:28:31.953912 | controller | skipping: [instance]
2026-03-16 10:28:32.047897 | controller |
2026-03-16 10:28:32.047928 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-16 10:28:32.047937 | controller | Monday 16 March 2026  10:28:31 +0000 (0:00:00.090)       0:00:06.554 **********
2026-03-16 10:28:32.047957 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:32.047986 | controller |   assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int
2026-03-16 10:28:32.048105 | controller |   evaluated_to: false
2026-03-16 10:28:32.048243 | controller |   msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3'
2026-03-16 10:28:32.096363 | controller |
2026-03-16 10:28:32.096456 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:32.096560 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.123)       0:00:06.678 **********
2026-03-16 10:28:32.096697 | controller |
2026-03-16 10:28:32.096832 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:32.096954 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.025)       0:00:06.704 **********
2026-03-16 10:28:32.140617 | controller | ok: [instance]
2026-03-16 10:28:32.140736 | controller |
2026-03-16 10:28:32.140892 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:32.140991 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.044)       0:00:06.749 **********
2026-03-16 10:28:32.197992 | controller | skipping: [instance]
2026-03-16 10:28:32.198100 | controller |
2026-03-16 10:28:32.198234 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:32.198379 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.057)       0:00:06.806 **********
2026-03-16 10:28:32.249741 | controller | skipping: [instance]
2026-03-16 10:28:32.249831 | controller |
2026-03-16 10:28:32.249968 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:32.250107 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.051)       0:00:06.858 **********
2026-03-16 10:28:32.298670 | controller | skipping: [instance]
2026-03-16 10:28:32.298788 | controller |
2026-03-16 10:28:32.298947 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:32.299013 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.048)       0:00:06.907 **********
2026-03-16 10:28:32.338614 | controller | ok: [instance]
2026-03-16 10:28:32.338693 | controller |
2026-03-16 10:28:32.338845 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:32.338955 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.040)       0:00:06.947 **********
2026-03-16 10:28:32.385331 | controller | ok: [instance]
2026-03-16 10:28:32.385462 | controller |
2026-03-16 10:28:32.385552 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:32.385678 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.046)       0:00:06.994 **********
2026-03-16 10:28:32.429366 | controller | ok: [instance] =>
2026-03-16 10:28:32.429475 | controller |   msg: 'Running: Different volume amount'
2026-03-16 10:28:32.429605 | controller |
2026-03-16 10:28:32.429737 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:32.429853 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.043)       0:00:07.037 **********
2026-03-16 10:28:32.501171 | controller |
2026-03-16 10:28:32.501344 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:32.501492 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.071)       0:00:07.109 **********
2026-03-16 10:28:32.605206 | controller | ok: [instance]
2026-03-16 10:28:32.605285 | controller |
2026-03-16 10:28:32.605452 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:32.605530 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.103)       0:00:07.213 **********
2026-03-16 10:28:32.678591 | controller | ok: [instance]
2026-03-16 10:28:32.678702 | controller |
2026-03-16 10:28:32.678793 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:32.678907 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.073)       0:00:07.287 **********
2026-03-16 10:28:32.836064 | controller | ok: [instance]
2026-03-16 10:28:32.836147 | controller |
2026-03-16 10:28:32.836234 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:32.836356 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.157)       0:00:07.444 **********
2026-03-16 10:28:32.968204 | controller | ok: [instance]
2026-03-16 10:28:32.968276 | controller |
2026-03-16 10:28:32.968391 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:32.968510 | controller | Monday 16 March 2026  10:28:32 +0000 (0:00:00.131)       0:00:07.576 **********
2026-03-16 10:28:33.045981 | controller | skipping: [instance]
2026-03-16 10:28:33.046101 | controller |
2026-03-16 10:28:33.046223 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-16 10:28:33.046367 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.078)       0:00:07.654 **********
2026-03-16 10:28:33.124795 | controller | ok: [instance]
2026-03-16 10:28:33.124906 | controller |
2026-03-16 10:28:33.125020 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-16 10:28:33.125132 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.078)       0:00:07.733 **********
2026-03-16 10:28:33.192721 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:33.192798 | controller |   assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0
2026-03-16 10:28:33.192925 | controller |   evaluated_to: false
2026-03-16 10:28:33.193073 | controller |   msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.'
2026-03-16 10:28:33.283204 | controller |
2026-03-16 10:28:33.283268 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:33.283341 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.082)       0:00:07.816 **********
2026-03-16 10:28:33.283467 | controller |
2026-03-16 10:28:33.283599 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:33.283710 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.075)       0:00:07.891 **********
2026-03-16 10:28:33.318015 | controller | ok: [instance]
2026-03-16 10:28:33.318136 | controller |
2026-03-16 10:28:33.318247 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:33.318402 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.035)       0:00:07.926 **********
2026-03-16 10:28:33.374489 | controller | skipping: [instance]
2026-03-16 10:28:33.374597 | controller |
2026-03-16 10:28:33.374709 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:33.374846 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.056)       0:00:07.983 **********
2026-03-16 10:28:33.419540 | controller | skipping: [instance]
2026-03-16 10:28:33.419658 | controller |
2026-03-16 10:28:33.419780 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:33.419905 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.045)       0:00:08.028 **********
2026-03-16 10:28:33.465173 | controller | skipping: [instance]
2026-03-16 10:28:33.465283 | controller |
2026-03-16 10:28:33.465434 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:33.465575 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.045)       0:00:08.073 **********
2026-03-16 10:28:33.496098 | controller | ok: [instance]
2026-03-16 10:28:33.496159 | controller |
2026-03-16 10:28:33.496265 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:33.496387 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.030)       0:00:08.104 **********
2026-03-16 10:28:33.532561 | controller | ok: [instance]
2026-03-16 10:28:33.532671 | controller |
2026-03-16 10:28:33.532782 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:33.532904 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.036)       0:00:08.141 **********
2026-03-16 10:28:33.578180 | controller | ok: [instance] =>
2026-03-16 10:28:33.578356 | controller |   msg: 'Running: Create LVM without volume'
2026-03-16 10:28:33.578533 | controller |
2026-03-16 10:28:33.578652 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:33.578788 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.045)       0:00:08.186 **********
2026-03-16 10:28:33.654905 | controller |
2026-03-16 10:28:33.655019 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:33.655128 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.076)       0:00:08.263 **********
2026-03-16 10:28:33.837888 | controller | ok: [instance]
2026-03-16 10:28:33.837972 | controller |
2026-03-16 10:28:33.838108 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:33.838211 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.182)       0:00:08.446 **********
2026-03-16 10:28:33.938292 | controller | ok: [instance]
2026-03-16 10:28:33.938396 | controller |
2026-03-16 10:28:33.938467 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:33.938589 | controller | Monday 16 March 2026  10:28:33 +0000 (0:00:00.099)       0:00:08.546 **********
2026-03-16 10:28:34.055125 | controller | ok: [instance]
2026-03-16 10:28:34.055219 | controller |
2026-03-16 10:28:34.055341 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:34.055448 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.116)       0:00:08.662 **********
2026-03-16 10:28:34.118390 | controller | skipping: [instance]
2026-03-16 10:28:34.118456 | controller |
2026-03-16 10:28:34.118577 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:34.118702 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.064)       0:00:08.727 **********
2026-03-16 10:28:34.197398 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:34.242869 | controller |   assertion: not cifmw_devscripts_create_logical_volume | bool
2026-03-16 10:28:34.242890 | controller |   evaluated_to: false
2026-03-16 10:28:34.242916 | controller |   msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members'
2026-03-16 10:28:34.242926 | controller |
2026-03-16 10:28:34.242963 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:34.243076 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.091)       0:00:08.818 **********
2026-03-16 10:28:34.243143 | controller |
2026-03-16 10:28:34.243232 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:34.243350 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.033)       0:00:08.851 **********
2026-03-16 10:28:34.273156 | controller | ok: [instance]
2026-03-16 10:28:34.273217 | controller |
2026-03-16 10:28:34.273330 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:34.273430 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.029)       0:00:08.881 **********
2026-03-16 10:28:34.345384 | controller | skipping: [instance]
2026-03-16 10:28:34.345632 | controller |
2026-03-16 10:28:34.345735 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:34.345855 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.059)       0:00:08.941 **********
2026-03-16 10:28:34.390505 | controller | skipping: [instance]
2026-03-16 10:28:34.390545 | controller |
2026-03-16 10:28:34.390675 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:34.390745 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.057)       0:00:08.999 **********
2026-03-16 10:28:34.463723 | controller | skipping: [instance]
2026-03-16 10:28:34.463811 | controller |
2026-03-16 10:28:34.464180 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:34.525462 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.073)       0:00:09.072 **********
2026-03-16 10:28:34.525515 | controller | ok: [instance]
2026-03-16 10:28:34.525577 | controller |
2026-03-16 10:28:34.525687 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:34.525769 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.056)       0:00:09.128 **********
2026-03-16 10:28:34.571385 | controller | ok: [instance]
2026-03-16 10:28:34.571470 | controller |
2026-03-16 10:28:34.571626 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:34.571700 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.049)       0:00:09.178 **********
2026-03-16 10:28:34.757328 | controller | ok: [instance] =>
2026-03-16 10:28:34.757408 | controller |   msg: 'Running: Create LVMS without volume'
2026-03-16 10:28:34.757485 | controller |
2026-03-16 10:28:34.757583 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:34.757708 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.187)       0:00:09.366 **********
2026-03-16 10:28:34.831332 | controller |
2026-03-16 10:28:34.831521 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:34.831662 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.074)       0:00:09.440 **********
2026-03-16 10:28:34.953898 | controller | ok: [instance]
2026-03-16 10:28:34.953981 | controller |
2026-03-16 10:28:34.954108 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:34.954254 | controller | Monday 16 March 2026  10:28:34 +0000 (0:00:00.116)       0:00:09.556 **********
2026-03-16 10:28:35.112337 | controller | ok: [instance]
2026-03-16 10:28:35.112387 | controller |
2026-03-16 10:28:35.112491 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:35.112633 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.163)       0:00:09.720 **********
2026-03-16 10:28:35.246709 | controller | ok: [instance]
2026-03-16 10:28:35.246946 | controller |
2026-03-16 10:28:35.247090 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:35.247107 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.135)       0:00:09.855 **********
2026-03-16 10:28:35.315941 | controller | skipping: [instance]
2026-03-16 10:28:35.316040 | controller |
2026-03-16 10:28:35.316122 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:35.316224 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.069)       0:00:09.924 **********
2026-03-16 10:28:35.382217 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:35.416432 | controller |   assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0
2026-03-16 10:28:35.416460 | controller |   evaluated_to: false
2026-03-16 10:28:35.416469 | controller |   msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members'
2026-03-16 10:28:35.416480 | controller |
2026-03-16 10:28:35.416501 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:35.416565 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.079)       0:00:10.004 **********
2026-03-16 10:28:35.416792 | controller |
2026-03-16 10:28:35.416963 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:35.416977 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.020)       0:00:10.025 **********
2026-03-16 10:28:35.451663 | controller | ok: [instance]
2026-03-16 10:28:35.451775 | controller |
2026-03-16 10:28:35.451996 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:35.452043 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.035)       0:00:10.060 **********
2026-03-16 10:28:35.507131 | controller | skipping: [instance]
2026-03-16 10:28:35.507183 | controller |
2026-03-16 10:28:35.507421 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:35.507464 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.055)       0:00:10.116 **********
2026-03-16 10:28:35.562378 | controller | skipping: [instance]
2026-03-16 10:28:35.599992 | controller |
2026-03-16 10:28:35.600027 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:35.600048 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.047)       0:00:10.163 **********
2026-03-16 10:28:35.600074 | controller | skipping: [instance]
2026-03-16 10:28:35.600097 | controller |
2026-03-16 10:28:35.600226 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:35.600371 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.045)       0:00:10.209 **********
2026-03-16 10:28:35.636482 | controller | ok: [instance]
2026-03-16 10:28:35.636603 | controller |
2026-03-16 10:28:35.636729 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:35.636868 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.036)       0:00:10.245 **********
2026-03-16 10:28:35.671303 | controller | ok: [instance]
2026-03-16 10:28:35.671435 | controller |
2026-03-16 10:28:35.671586 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:35.671651 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.034)       0:00:10.279 **********
2026-03-16 10:28:35.714150 | controller | ok: [instance] =>
2026-03-16 10:28:35.714404 | controller |   msg: 'Running: Allocate same volume twice'
2026-03-16 10:28:35.714524 | controller |
2026-03-16 10:28:35.714546 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:35.714661 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.043)       0:00:10.323 **********
2026-03-16 10:28:35.768437 | controller |
2026-03-16 10:28:35.768550 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:35.768770 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.054)       0:00:10.377 **********
2026-03-16 10:28:35.857820 | controller | ok: [instance]
2026-03-16 10:28:35.857924 | controller |
2026-03-16 10:28:35.858070 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:35.858196 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.089)       0:00:10.466 **********
2026-03-16 10:28:35.928910 | controller | ok: [instance]
2026-03-16 10:28:35.928979 | controller |
2026-03-16 10:28:35.929143 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:35.929272 | controller | Monday 16 March 2026  10:28:35 +0000 (0:00:00.071)       0:00:10.537 **********
2026-03-16 10:28:36.025883 | controller | ok: [instance]
2026-03-16 10:28:36.025923 | controller |
2026-03-16 10:28:36.026061 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:36.026168 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.097)       0:00:10.634 **********
2026-03-16 10:28:36.145045 | controller | skipping: [instance]
2026-03-16 10:28:36.145163 | controller |
2026-03-16 10:28:36.145286 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:36.145500 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.118)       0:00:10.753 **********
2026-03-16 10:28:36.210690 | controller | skipping: [instance]
2026-03-16 10:28:36.283937 | controller |
2026-03-16 10:28:36.283985 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-16 10:28:36.283995 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.065)       0:00:10.818 **********
2026-03-16 10:28:36.284042 | controller | ok: [instance]
2026-03-16 10:28:36.284077 | controller |
2026-03-16 10:28:36.284124 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-16 10:28:36.284263 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.070)       0:00:10.889 **********
2026-03-16 10:28:36.362231 | controller | skipping: [instance]
2026-03-16 10:28:36.362353 | controller |
2026-03-16 10:28:36.362428 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-16 10:28:36.362518 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.081)       0:00:10.970 **********
2026-03-16 10:28:36.455173 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:36.455345 | controller |   assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int
2026-03-16 10:28:36.455374 | controller |   evaluated_to: false
2026-03-16 10:28:36.455475 | controller |   msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4'
2026-03-16 10:28:36.496550 | controller |
2026-03-16 10:28:36.496660 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:36.496751 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.111)       0:00:11.082 **********
2026-03-16 10:28:36.496889 | controller |
2026-03-16 10:28:36.496975 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:36.497139 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.022)       0:00:11.104 **********
2026-03-16 10:28:36.532641 | controller | ok: [instance]
2026-03-16 10:28:36.532706 | controller |
2026-03-16 10:28:36.532965 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:36.533014 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.036)       0:00:11.141 **********
2026-03-16 10:28:36.596763 | controller | skipping: [instance]
2026-03-16 10:28:36.596868 | controller |
2026-03-16 10:28:36.596895 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:36.596965 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.058)       0:00:11.200 **********
2026-03-16 10:28:36.645669 | controller | skipping: [instance]
2026-03-16 10:28:36.645785 | controller |
2026-03-16 10:28:36.645900 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:36.645981 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.054)       0:00:11.254 **********
2026-03-16 10:28:36.703913 | controller | skipping: [instance]
2026-03-16 10:28:36.703974 | controller |
2026-03-16 10:28:36.704102 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:36.704218 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.057)       0:00:11.312 **********
2026-03-16 10:28:36.747470 | controller | ok: [instance]
2026-03-16 10:28:36.747643 | controller |
2026-03-16 10:28:36.747746 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:36.747879 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.040)       0:00:11.353 **********
2026-03-16 10:28:36.787875 | controller | ok: [instance]
2026-03-16 10:28:36.788049 | controller |
2026-03-16 10:28:36.788177 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:36.788288 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.043)       0:00:11.396 **********
2026-03-16 10:28:36.839735 | controller | ok: [instance] =>
2026-03-16 10:28:36.839802 | controller |   msg: 'Running: Allocate same volume twice - no LVMS'
2026-03-16 10:28:36.840100 | controller |
2026-03-16 10:28:36.900552 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:36.900582 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.051)       0:00:11.448 **********
2026-03-16 10:28:36.900594 | controller |
2026-03-16 10:28:36.900746 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:36.900963 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.060)       0:00:11.509 **********
2026-03-16 10:28:36.980893 | controller | ok: [instance]
2026-03-16 10:28:36.980930 | controller |
2026-03-16 10:28:36.981048 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:36.981282 | controller | Monday 16 March 2026  10:28:36 +0000 (0:00:00.080)       0:00:11.589 **********
2026-03-16 10:28:37.067227 | controller | ok: [instance]
2026-03-16 10:28:37.067334 | controller |
2026-03-16 10:28:37.067477 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:37.067532 | controller | Monday 16 March 2026  10:28:37 +0000 (0:00:00.086)       0:00:11.676 **********
2026-03-16 10:28:37.210785 | controller | ok: [instance]
2026-03-16 10:28:37.210832 | controller |
2026-03-16 10:28:37.211111 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:37.292031 | controller | Monday 16 March 2026  10:28:37 +0000 (0:00:00.142)       0:00:11.819 **********
2026-03-16 10:28:37.292073 | controller | skipping: [instance]
2026-03-16 10:28:37.351783 | controller |
2026-03-16 10:28:37.351806 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:37.351818 | controller | Monday 16 March 2026  10:28:37 +0000 (0:00:00.080)       0:00:11.899 **********
2026-03-16 10:28:37.351833 | controller | skipping: [instance]
2026-03-16 10:28:37.351852 | controller |
2026-03-16 10:28:37.351860 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-16 10:28:37.352023 | controller | Monday 16 March 2026  10:28:37 +0000 (0:00:00.061)       0:00:11.960 **********
2026-03-16 10:28:37.424193 | controller | ok: [instance]
2026-03-16 10:28:37.424348 | controller |
2026-03-16 10:28:37.424491 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-16 10:28:37.424534 | controller | Monday 16 March 2026  10:28:37 +0000 (0:00:00.072)       0:00:12.033 **********
2026-03-16 10:28:37.563709 | controller | skipping: [instance]
2026-03-16 10:28:37.563816 | controller |
2026-03-16 10:28:37.563940 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-16 10:28:37.564099 | controller | Monday 16 March 2026  10:28:37 +0000 (0:00:00.139)       0:00:12.172 **********
2026-03-16 10:28:37.661780 | controller | ok: [instance]
2026-03-16 10:28:37.661862 | controller |
2026-03-16 10:28:37.661975 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-16 10:28:37.662096 | controller | Monday 16 March 2026  10:28:37 +0000 (0:00:00.097)       0:00:12.270 **********
2026-03-16 10:28:37.737018 | controller | skipping: [instance]
2026-03-16 10:28:37.737091 | controller |
2026-03-16 10:28:37.737234 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-16 10:28:37.737347 | controller | Monday 16 March 2026  10:28:37 +0000 (0:00:00.074)       0:00:12.345 **********
2026-03-16 10:28:37.851786 | controller | ok: [instance] => changed=false
2026-03-16 10:28:37.851842 | controller |   msg: All assertions passed
2026-03-16 10:28:37.851965 | controller |
2026-03-16 10:28:37.852056 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-16 10:28:37.852163 | controller | Monday 16 March 2026  10:28:37 +0000 (0:00:00.115)       0:00:12.460 **********
2026-03-16 10:28:37.972231 | controller | ok: [instance] => changed=false
2026-03-16 10:28:37.972348 | controller |   msg: All assertions passed
2026-03-16 10:28:37.972366 | controller |
2026-03-16 10:28:37.972385 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:37.972472 | controller | Monday 16 March 2026  10:28:37 +0000 (0:00:00.119)       0:00:12.580 **********
2026-03-16 10:28:38.032476 | controller | skipping: [instance]
2026-03-16 10:28:38.032713 | controller |
2026-03-16 10:28:38.032740 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:38.032753 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.060)       0:00:12.641 **********
2026-03-16 10:28:38.083665 | controller | skipping: [instance]
2026-03-16 10:28:38.083897 | controller |
2026-03-16 10:28:38.083912 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:38.083956 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.051)       0:00:12.692 **********
2026-03-16 10:28:38.132496 | controller | skipping: [instance]
2026-03-16 10:28:38.132624 | controller |
2026-03-16 10:28:38.132746 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:38.132867 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.046)       0:00:12.738 **********
2026-03-16 10:28:38.163736 | controller | ok: [instance]
2026-03-16 10:28:38.163858 | controller |
2026-03-16 10:28:38.163925 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:38.164033 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.032)       0:00:12.771 **********
2026-03-16 10:28:38.199789 | controller | ok: [instance]
2026-03-16 10:28:38.199825 | controller |
2026-03-16 10:28:38.199931 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:38.200106 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.037)       0:00:12.808 **********
2026-03-16 10:28:38.242496 | controller | ok: [instance] =>
2026-03-16 10:28:38.242684 | controller |   msg: 'Running: Allocate same volume twice - no cinder_lvm'
2026-03-16 10:28:38.242712 | controller |
2026-03-16 10:28:38.242815 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:38.242930 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.042)       0:00:12.851 **********
2026-03-16 10:28:38.307556 | controller |
2026-03-16 10:28:38.307666 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:38.307795 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.064)       0:00:12.916 **********
2026-03-16 10:28:38.400143 | controller | ok: [instance]
2026-03-16 10:28:38.400224 | controller |
2026-03-16 10:28:38.400440 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:38.400602 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.089)       0:00:13.005 **********
2026-03-16 10:28:38.456564 | controller | ok: [instance]
2026-03-16 10:28:38.456649 | controller |
2026-03-16 10:28:38.456662 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:38.456807 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.060)       0:00:13.065 **********
2026-03-16 10:28:38.560630 | controller | ok: [instance]
2026-03-16 10:28:38.560675 | controller |
2026-03-16 10:28:38.560803 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:38.560938 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.104)       0:00:13.169 **********
2026-03-16 10:28:38.629584 | controller | skipping: [instance]
2026-03-16 10:28:38.629669 | controller |
2026-03-16 10:28:38.629776 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:38.629914 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.068)       0:00:13.237 **********
2026-03-16 10:28:38.697282 | controller | skipping: [instance]
2026-03-16 10:28:38.697351 | controller |
2026-03-16 10:28:38.697603 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-16 10:28:38.763676 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.068)       0:00:13.306 **********
2026-03-16 10:28:38.763698 | controller | ok: [instance]
2026-03-16 10:28:38.763767 | controller |
2026-03-16 10:28:38.763941 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-16 10:28:38.764067 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.064)       0:00:13.370 **********
2026-03-16 10:28:38.815926 | controller | skipping: [instance]
2026-03-16 10:28:38.815985 | controller |
2026-03-16 10:28:38.816115 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-16 10:28:38.816229 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.054)       0:00:13.424 **********
2026-03-16 10:28:38.969749 | controller | ok: [instance]
2026-03-16 10:28:38.969889 | controller |
2026-03-16 10:28:38.970066 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-16 10:28:38.970156 | controller | Monday 16 March 2026  10:28:38 +0000 (0:00:00.153)       0:00:13.578 **********
2026-03-16 10:28:39.033561 | controller | skipping: [instance]
2026-03-16 10:28:39.033673 | controller |
2026-03-16 10:28:39.033741 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-16 10:28:39.033864 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.064)       0:00:13.642 **********
2026-03-16 10:28:39.140676 | controller | ok: [instance] => changed=false
2026-03-16 10:28:39.140719 | controller |   msg: All assertions passed
2026-03-16 10:28:39.140729 | controller |
2026-03-16 10:28:39.140871 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-16 10:28:39.140936 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.106)       0:00:13.749 **********
2026-03-16 10:28:39.224048 | controller | skipping: [instance]
2026-03-16 10:28:39.224183 | controller |
2026-03-16 10:28:39.224475 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:39.282840 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.082)       0:00:13.832 **********
2026-03-16 10:28:39.282875 | controller | skipping: [instance]
2026-03-16 10:28:39.282899 | controller |
2026-03-16 10:28:39.283046 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:39.283146 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.059)       0:00:13.891 **********
2026-03-16 10:28:39.337108 | controller | skipping: [instance]
2026-03-16 10:28:39.337191 | controller |
2026-03-16 10:28:39.337334 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:39.337476 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.051)       0:00:13.943 **********
2026-03-16 10:28:39.383693 | controller | skipping: [instance]
2026-03-16 10:28:39.383793 | controller |
2026-03-16 10:28:39.383899 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:39.384044 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.047)       0:00:13.990 **********
2026-03-16 10:28:39.419076 | controller | ok: [instance]
2026-03-16 10:28:39.419120 | controller |
2026-03-16 10:28:39.419268 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:39.419415 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.035)       0:00:14.026 **********
2026-03-16 10:28:39.534324 | controller | ok: [instance]
2026-03-16 10:28:39.534432 | controller |
2026-03-16 10:28:39.534501 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:39.534653 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.081)       0:00:14.107 **********
2026-03-16 10:28:39.606404 | controller | ok: [instance] =>
2026-03-16 10:28:39.606531 | controller |   msg: 'Running: Config overrides via devscripts'
2026-03-16 10:28:39.606638 | controller |
2026-03-16 10:28:39.606761 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:39.606846 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.107)       0:00:14.215 **********
2026-03-16 10:28:39.676992 | controller |
2026-03-16 10:28:39.677261 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:39.677280 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.070)       0:00:14.285 **********
2026-03-16 10:28:39.796392 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:39.796645 | controller |   assertion: cifmw_devscripts_config.master_memory is undefined
2026-03-16 10:28:39.796796 | controller |   evaluated_to: false
2026-03-16 10:28:39.796937 | controller |   msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.'
2026-03-16 10:28:39.832143 | controller |
2026-03-16 10:28:39.832273 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:39.832450 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.131)       0:00:14.417 **********
2026-03-16 10:28:39.832612 | controller |
2026-03-16 10:28:39.832638 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:39.832795 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.023)       0:00:14.440 **********
2026-03-16 10:28:39.862992 | controller | ok: [instance]
2026-03-16 10:28:39.863087 | controller |
2026-03-16 10:28:39.863206 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:39.863282 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.031)       0:00:14.471 **********
2026-03-16 10:28:39.915869 | controller | skipping: [instance]
2026-03-16 10:28:39.915920 | controller |
2026-03-16 10:28:39.916114 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:39.916278 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.049)       0:00:14.521 **********
2026-03-16 10:28:39.960855 | controller | skipping: [instance]
2026-03-16 10:28:39.960929 | controller |
2026-03-16 10:28:39.960993 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:39.961144 | controller | Monday 16 March 2026  10:28:39 +0000 (0:00:00.045)       0:00:14.567 **********
2026-03-16 10:28:40.007808 | controller | skipping: [instance]
2026-03-16 10:28:40.007876 | controller |
2026-03-16 10:28:40.007915 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:40.008049 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.049)       0:00:14.616 **********
2026-03-16 10:28:40.036213 | controller | ok: [instance]
2026-03-16 10:28:40.036476 | controller |
2026-03-16 10:28:40.036586 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:40.036602 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.028)       0:00:14.645 **********
2026-03-16 10:28:40.077402 | controller | ok: [instance]
2026-03-16 10:28:40.077592 | controller |
2026-03-16 10:28:40.077752 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:40.077897 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.041)       0:00:14.686 **********
2026-03-16 10:28:40.114948 | controller | ok: [instance] =>
2026-03-16 10:28:40.115045 | controller |   msg: 'Running: Inject 10 dev-scripts extra_worker'
2026-03-16 10:28:40.115159 | controller |
2026-03-16 10:28:40.115348 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:40.115485 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.037)       0:00:14.723 **********
2026-03-16 10:28:40.210936 | controller |
2026-03-16 10:28:40.211036 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:40.211129 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.095)       0:00:14.819 **********
2026-03-16 10:28:40.293134 | controller | ok: [instance]
2026-03-16 10:28:40.293214 | controller |
2026-03-16 10:28:40.293228 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:40.293333 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.082)       0:00:14.901 **********
2026-03-16 10:28:40.338048 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-16 10:28:40.338146 | controller |   assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0
2026-03-16 10:28:40.338331 | controller |   evaluated_to: false
2026-03-16 10:28:40.338465 | controller |   msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.'
2026-03-16 10:28:40.368260 | controller |
2026-03-16 10:28:40.368387 | controller | TASK [Clear host errors] *******************************************************
2026-03-16 10:28:40.368581 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.056)       0:00:14.958 **********
2026-03-16 10:28:40.368701 | controller |
2026-03-16 10:28:40.368731 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:40.368793 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.018)       0:00:14.976 **********
2026-03-16 10:28:40.395223 | controller | ok: [instance]
2026-03-16 10:28:40.395303 | controller |
2026-03-16 10:28:40.395454 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:40.395532 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.027)       0:00:15.004 **********
2026-03-16 10:28:40.439786 | controller | skipping: [instance]
2026-03-16 10:28:40.439825 | controller |
2026-03-16 10:28:40.439964 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:40.440049 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.044)       0:00:15.048 **********
2026-03-16 10:28:40.478725 | controller | skipping: [instance]
2026-03-16 10:28:40.478844 | controller |
2026-03-16 10:28:40.478930 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:40.479016 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.038)       0:00:15.087 **********
2026-03-16 10:28:40.522974 | controller | skipping: [instance]
2026-03-16 10:28:40.523045 | controller |
2026-03-16 10:28:40.523196 | controller | TASK [Mark run as failed] ******************************************************
2026-03-16 10:28:40.523298 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.044)       0:00:15.132 **********
2026-03-16 10:28:40.553945 | controller | ok: [instance]
2026-03-16 10:28:40.554004 | controller |
2026-03-16 10:28:40.554092 | controller | TASK [Load environment file] ***************************************************
2026-03-16 10:28:40.554204 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.030)       0:00:15.162 **********
2026-03-16 10:28:40.582728 | controller | ok: [instance]
2026-03-16 10:28:40.582810 | controller |
2026-03-16 10:28:40.582942 | controller | TASK [Output scenario name] ****************************************************
2026-03-16 10:28:40.583047 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.029)       0:00:15.191 **********
2026-03-16 10:28:40.617931 | controller | ok: [instance] =>
2026-03-16 10:28:40.618042 | controller |   msg: 'Running: Inject 0 dev-scripts extra_worker'
2026-03-16 10:28:40.618110 | controller |
2026-03-16 10:28:40.618230 | controller | TASK [Validate data] ***********************************************************
2026-03-16 10:28:40.618339 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.033)       0:00:15.225 **********
2026-03-16 10:28:40.686624 | controller |
2026-03-16 10:28:40.686695 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-16 10:28:40.686787 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.069)       0:00:15.295 **********
2026-03-16 10:28:40.758276 | controller | ok: [instance]
2026-03-16 10:28:40.758446 | controller |
2026-03-16 10:28:40.758463 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-16 10:28:40.758588 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.071)       0:00:15.366 **********
2026-03-16 10:28:40.824469 | controller | ok: [instance]
2026-03-16 10:28:40.824544 | controller |
2026-03-16 10:28:40.824659 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-16 10:28:40.824781 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.066)       0:00:15.433 **********
2026-03-16 10:28:40.929916 | controller | ok: [instance]
2026-03-16 10:28:40.930002 | controller |
2026-03-16 10:28:40.930126 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-16 10:28:40.930146 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.098)       0:00:15.531 **********
2026-03-16 10:28:40.985406 | controller | skipping: [instance]
2026-03-16 10:28:40.985495 | controller |
2026-03-16 10:28:40.985603 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-16 10:28:40.985702 | controller | Monday 16 March 2026  10:28:40 +0000 (0:00:00.062)       0:00:15.594 **********
2026-03-16 10:28:41.052615 | controller | ok: [instance]
2026-03-16 10:28:41.052698 | controller |
2026-03-16 10:28:41.052802 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-16 10:28:41.052917 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.067)       0:00:15.661 **********
2026-03-16 10:28:41.107375 | controller | skipping: [instance]
2026-03-16 10:28:41.107458 | controller |
2026-03-16 10:28:41.107561 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-16 10:28:41.107685 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.051)       0:00:15.712 **********
2026-03-16 10:28:41.154135 | controller | skipping: [instance]
2026-03-16 10:28:41.154206 | controller |
2026-03-16 10:28:41.154362 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-16 10:28:41.154458 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.050)       0:00:15.763 **********
2026-03-16 10:28:41.209881 | controller | skipping: [instance]
2026-03-16 10:28:41.209935 | controller |
2026-03-16 10:28:41.210042 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-16 10:28:41.210152 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.052)       0:00:15.816 **********
2026-03-16 10:28:41.264692 | controller | skipping: [instance]
2026-03-16 10:28:41.264803 | controller |
2026-03-16 10:28:41.264901 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-16 10:28:41.265025 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.049)       0:00:15.865 **********
2026-03-16 10:28:41.478024 | controller | skipping: [instance]
2026-03-16 10:28:41.478083 | controller |
2026-03-16 10:28:41.478197 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-16 10:28:41.478305 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.214)       0:00:16.079 **********
2026-03-16 10:28:41.562484 | controller | skipping: [instance]
2026-03-16 10:28:41.613985 | controller |
2026-03-16 10:28:41.614031 | controller | TASK [Mark failure] ************************************************************
2026-03-16 10:28:41.614040 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.090)       0:00:16.169 **********
2026-03-16 10:28:41.614052 | controller | skipping: [instance]
2026-03-16 10:28:41.707687 | controller |
2026-03-16 10:28:41.707719 | controller | TASK [Display error message] ***************************************************
2026-03-16 10:28:41.707727 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.052)       0:00:16.222 **********
2026-03-16 10:28:41.707738 | controller | skipping: [instance]
2026-03-16 10:28:41.751437 | controller |
2026-03-16 10:28:41.751475 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-16 10:28:41.751485 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.089)       0:00:16.311 **********
2026-03-16 10:28:41.751503 | controller | skipping: [instance]
2026-03-16 10:28:41.892429 | controller |
2026-03-16 10:28:41.892460 | controller | TASK [Fail if needed] **********************************************************
2026-03-16 10:28:41.892469 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.044)       0:00:16.356 **********
2026-03-16 10:28:41.892479 | controller | skipping: [instance]
2026-03-16 10:28:41.893414 | controller |
2026-03-16 10:28:41.894967 | controller | PLAY RECAP *********************************************************************
2026-03-16 10:28:41.894983 | controller | instance                   : ok=129  changed=0    unreachable=0    failed=0    skipped=85   rescued=7    ignored=0
2026-03-16 10:28:41.894990 | controller |
2026-03-16 10:28:41.894996 | controller | Monday 16 March 2026  10:28:41 +0000 (0:00:00.144)       0:00:16.500 **********
2026-03-16 10:28:41.895002 | controller | ===============================================================================
2026-03-16 10:28:41.895007 | controller | reproducer : Ensure we get disk_size ------------------------------------ 0.35s
2026-03-16 10:28:41.895013 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.21s
2026-03-16 10:28:41.895018 | controller | Output scenario name ---------------------------------------------------- 0.19s
2026-03-16 10:28:41.895026 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.18s
2026-03-16 10:28:42.075474 | controller | reproducer : Ensure we get required data in the layout description ------ 0.18s
2026-03-16 10:28:42.075524 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.18s
2026-03-16 10:28:42.075531 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.18s
2026-03-16 10:28:42.075537 | controller | reproducer : Ensure we don't try to create extra_workers ---------------- 0.16s
2026-03-16 10:28:42.075543 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.16s
2026-03-16 10:28:42.075549 | controller | reproducer : Ensure we get required data in the layout description ------ 0.16s
2026-03-16 10:28:42.075554 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.15s
2026-03-16 10:28:42.075559 | controller | Test no volumes --------------------------------------------------------- 0.15s
2026-03-16 10:28:42.075565 | controller | reproducer : Ensure we don't try to create extra_workers ---------------- 0.15s
2026-03-16 10:28:42.075584 | controller | Fail if needed ---------------------------------------------------------- 0.14s
2026-03-16 10:28:42.075590 | controller | reproducer : Ensure we get required data in the layout description ------ 0.14s
2026-03-16 10:28:42.075595 | controller | reproducer : Ensure same amount of disks are created -------------------- 0.14s
2026-03-16 10:28:42.075600 | controller | reproducer : Ensure we get required data in the layout description ------ 0.14s
2026-03-16 10:28:42.075606 | controller | Validate data ----------------------------------------------------------- 0.13s
2026-03-16 10:28:42.075618 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.13s
2026-03-16 10:28:42.075623 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.13s
2026-03-16 10:28:42.075640 | controller | INFO     Running ocp_validations > cleanup
2026-03-16 10:28:42.076158 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-16 10:28:42.076911 | controller | INFO     Writing /tmp/report.html report.
2026-03-16 10:28:42.520372 | [controller] Waiting on logger
2026-03-16 10:28:47.675936 | [controller] Waiting on logger
2026-03-16 10:28:58.107897 | [controller] Waiting on logger
2026-03-16 10:29:08.540020 | [controller] Waiting on logger
2026-03-16 10:29:12.434657 | [Zuul] Log Stream did not terminate
2026-03-16 10:29:12.434934 | controller | changed
2026-03-16 10:29:12.483721 | 
2026-03-16 10:29:12.483793 | PLAY RECAP
2026-03-16 10:29:12.483834 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-16 10:29:12.483855 | 
2026-03-16 10:29:12.558557 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-03-16 10:29:12.559408 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-03-16 10:29:13.091446 | 
2026-03-16 10:29:13.091624 | PLAY [Run ci/playbooks/collect-logs.yml]
2026-03-16 10:29:13.112138 | 
2026-03-16 10:29:13.112211 | TASK [Filter out host if needed]
2026-03-16 10:29:13.121054 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2026-03-16 10:29:13.125531 | 
2026-03-16 10:29:13.125600 | TASK [Ensure file is present]
2026-03-16 10:29:13.792072 | controller | ok
2026-03-16 10:29:13.797986 | 
2026-03-16 10:29:13.798071 | TASK [Manage molecule report file]
2026-03-16 10:29:13.818691 | [controller] Waiting on logger
2026-03-16 10:29:23.196203 | [controller] Waiting on logger
2026-03-16 10:29:32.576512 | [controller] Waiting on logger
2026-03-16 10:29:42.972277 | [controller] Waiting on logger
2026-03-16 10:29:44.303714 | [Zuul] Log Stream did not terminate
2026-03-16 10:29:44.303978 | controller | changed
2026-03-16 10:29:44.309634 | 
2026-03-16 10:29:44.309706 | TASK [Check if we get ci-framework-data basedir]
2026-03-16 10:29:44.715259 | controller | ok
2026-03-16 10:29:44.720642 | 
2026-03-16 10:29:44.720738 | TASK [Create ci-framework-data log directory for zuul]
2026-03-16 10:29:45.175886 | controller | changed
2026-03-16 10:29:45.181125 | 
2026-03-16 10:29:45.181208 | TASK [Copy ci-framework interesting files]
2026-03-16 10:29:45.202245 | [controller] Waiting on logger
2026-03-16 10:30:01.787966 | [controller] Waiting on logger
2026-03-16 10:30:12.219967 | [controller] Waiting on logger
2026-03-16 10:30:15.566252 | [Zuul] Log Stream did not terminate
2026-03-16 10:30:15.566475 | controller | changed
2026-03-16 10:30:15.571571 | 
2026-03-16 10:30:15.571635 | TASK [Get SELinux listing]
2026-03-16 10:30:15.591291 | [controller] Waiting on logger
2026-03-16 10:30:28.795845 | [controller] Waiting on logger
2026-03-16 10:30:35.259837 | [controller] Waiting on logger
2026-03-16 10:30:40.369251 | controller | changed
2026-03-16 10:30:40.376600 | 
2026-03-16 10:30:40.376679 | TASK [Generate log index]
2026-03-16 10:30:41.695355 | controller | changed
2026-03-16 10:30:41.701024 | 
2026-03-16 10:30:41.701100 | TASK [Get some env related data]
2026-03-16 10:30:41.726280 | [controller] Waiting on logger
2026-03-16 10:30:52.155980 | [controller] Waiting on logger
2026-03-16 10:31:01.536741 | [controller] Waiting on logger
2026-03-16 10:31:11.932016 | [controller] Waiting on logger
2026-03-16 10:31:13.473116 | [Zuul] Log Stream did not terminate
2026-03-16 10:31:13.473542 | controller | changed
2026-03-16 10:31:13.478929 | 
2026-03-16 10:31:13.478994 | TASK [Generate list of logs to collect in home directory]
2026-03-16 10:31:13.812546 | controller | ok: All paths examined
2026-03-16 10:31:13.817878 | 
2026-03-16 10:31:13.817964 | LOOP [Copy logs from home directory]
2026-03-16 10:31:14.422430 | controller | changed:
2026-03-16 10:31:14.422715 | controller | {
2026-03-16 10:31:14.422743 | controller |   "atime": 1772005405.932821,
2026-03-16 10:31:14.422764 | controller |   "ctime": 1772006396.9238591,
2026-03-16 10:31:14.422782 | controller |   "dev": 64513,
2026-03-16 10:31:14.422800 | controller |   "gid": 1000,
2026-03-16 10:31:14.422821 | controller |   "gr_name": "zuul",
2026-03-16 10:31:14.422837 | controller |   "inode": 2773,
2026-03-16 10:31:14.422853 | controller |   "isblk": false,
2026-03-16 10:31:14.422870 | controller |   "ischr": false,
2026-03-16 10:31:14.422909 | controller |   "isdir": false,
2026-03-16 10:31:14.422928 | controller |   "isfifo": false,
2026-03-16 10:31:14.422943 | controller |   "isgid": false,
2026-03-16 10:31:14.422958 | controller |   "islnk": false,
2026-03-16 10:31:14.422976 | controller |   "isreg": true,
2026-03-16 10:31:14.422990 | controller |   "issock": false,
2026-03-16 10:31:14.423005 | controller |   "isuid": false,
2026-03-16 10:31:14.423019 | controller |   "mode": "0644",
2026-03-16 10:31:14.423032 | controller |   "mtime": 1772006396.9238591,
2026-03-16 10:31:14.423046 | controller |   "nlink": 1,
2026-03-16 10:31:14.423060 | controller |   "path": "/home/zuul/crc-setup.log",
2026-03-16 10:31:14.423075 | controller |   "pw_name": "zuul",
2026-03-16 10:31:14.423089 | controller |   "rgrp": true,
2026-03-16 10:31:14.423104 | controller |   "roth": true,
2026-03-16 10:31:14.423117 | controller |   "rusr": true,
2026-03-16 10:31:14.423132 | controller |   "size": 4108,
2026-03-16 10:31:14.423145 | controller |   "uid": 1000,
2026-03-16 10:31:14.423158 | controller |   "wgrp": false,
2026-03-16 10:31:14.423172 | controller |   "woth": false,
2026-03-16 10:31:14.423185 | controller |   "wusr": true,
2026-03-16 10:31:14.423198 | controller |   "xgrp": false,
2026-03-16 10:31:14.423211 | controller |   "xoth": false,
2026-03-16 10:31:14.423224 | controller |   "xusr": false
2026-03-16 10:31:14.423238 | controller | }
2026-03-16 10:31:14.931990 | controller | changed:
2026-03-16 10:31:14.932108 | controller | {
2026-03-16 10:31:14.932135 | controller |   "atime": 1772006398.6759083,
2026-03-16 10:31:14.932155 | controller |   "ctime": 1772007098.5537844,
2026-03-16 10:31:14.932174 | controller |   "dev": 64513,
2026-03-16 10:31:14.932192 | controller |   "gid": 1000,
2026-03-16 10:31:14.932209 | controller |   "gr_name": "zuul",
2026-03-16 10:31:14.932225 | controller |   "inode": 359205,
2026-03-16 10:31:14.932241 | controller |   "isblk": false,
2026-03-16 10:31:14.932257 | controller |   "ischr": false,
2026-03-16 10:31:14.932272 | controller |   "isdir": false,
2026-03-16 10:31:14.932286 | controller |   "isfifo": false,
2026-03-16 10:31:14.932322 | controller |   "isgid": false,
2026-03-16 10:31:14.932342 | controller |   "islnk": false,
2026-03-16 10:31:14.932358 | controller |   "isreg": true,
2026-03-16 10:31:14.932372 | controller |   "issock": false,
2026-03-16 10:31:14.932386 | controller |   "isuid": false,
2026-03-16 10:31:14.932401 | controller |   "mode": "0644",
2026-03-16 10:31:14.932414 | controller |   "mtime": 1772007098.5537844,
2026-03-16 10:31:14.932428 | controller |   "nlink": 1,
2026-03-16 10:31:14.932442 | controller |   "path": "/home/zuul/crc-start.log",
2026-03-16 10:31:14.932456 | controller |   "pw_name": "zuul",
2026-03-16 10:31:14.932469 | controller |   "rgrp": true,
2026-03-16 10:31:14.932484 | controller |   "roth": true,
2026-03-16 10:31:14.932498 | controller |   "rusr": true,
2026-03-16 10:31:14.932512 | controller |   "size": 4654,
2026-03-16 10:31:14.932526 | controller |   "uid": 1000,
2026-03-16 10:31:14.932539 | controller |   "wgrp": false,
2026-03-16 10:31:14.932553 | controller |   "woth": false,
2026-03-16 10:31:14.932566 | controller |   "wusr": true,
2026-03-16 10:31:14.932580 | controller |   "xgrp": false,
2026-03-16 10:31:14.932593 | controller |   "xoth": false,
2026-03-16 10:31:14.932607 | controller |   "xusr": false
2026-03-16 10:31:14.932620 | controller | }
2026-03-16 10:31:15.505114 | controller | changed:
2026-03-16 10:31:15.505580 | controller | {
2026-03-16 10:31:15.505610 | controller |   "atime": 1773656344.4987764,
2026-03-16 10:31:15.505630 | controller |   "ctime": 1773656360.2789605,
2026-03-16 10:31:15.505648 | controller |   "dev": 64513,
2026-03-16 10:31:15.505665 | controller |   "gid": 1000,
2026-03-16 10:31:15.505683 | controller |   "gr_name": "zuul",
2026-03-16 10:31:15.505700 | controller |   "inode": 359215,
2026-03-16 10:31:15.505717 | controller |   "isblk": false,
2026-03-16 10:31:15.505735 | controller |   "ischr": false,
2026-03-16 10:31:15.505754 | controller |   "isdir": false,
2026-03-16 10:31:15.505777 | controller |   "isfifo": false,
2026-03-16 10:31:15.505793 | controller |   "isgid": false,
2026-03-16 10:31:15.505808 | controller |   "islnk": false,
2026-03-16 10:31:15.505824 | controller |   "isreg": true,
2026-03-16 10:31:15.505839 | controller |   "issock": false,
2026-03-16 10:31:15.505852 | controller |   "isuid": false,
2026-03-16 10:31:15.505865 | controller |   "mode": "0644",
2026-03-16 10:31:15.505880 | controller |   "mtime": 1773656360.2789605,
2026-03-16 10:31:15.505911 | controller |   "nlink": 1,
2026-03-16 10:31:15.505925 | controller |   "path": "/home/zuul/ansible.log",
2026-03-16 10:31:15.505939 | controller |   "pw_name": "zuul",
2026-03-16 10:31:15.505952 | controller |   "rgrp": true,
2026-03-16 10:31:15.505966 | controller |   "roth": true,
2026-03-16 10:31:15.505979 | controller |   "rusr": true,
2026-03-16 10:31:15.505993 | controller |   "size": 6749,
2026-03-16 10:31:15.506006 | controller |   "uid": 1000,
2026-03-16 10:31:15.506019 | controller |   "wgrp": false,
2026-03-16 10:31:15.506032 | controller |   "woth": false,
2026-03-16 10:31:15.506045 | controller |   "wusr": true,
2026-03-16 10:31:15.506057 | controller |   "xgrp": false,
2026-03-16 10:31:15.506070 | controller |   "xoth": false,
2026-03-16 10:31:15.506082 | controller |   "xusr": false
2026-03-16 10:31:15.506095 | controller | }
2026-03-16 10:31:15.515505 | 
2026-03-16 10:31:15.515582 | TASK [Copy crio stats log file]
2026-03-16 10:31:15.531446 | controller | skipping: Conditional result was False
2026-03-16 10:31:15.537569 | 
2026-03-16 10:31:15.537637 | TASK [Get SELinux related data]
2026-03-16 10:31:15.560699 | [controller] Waiting on logger
2026-03-16 10:31:29.595891 | [controller] Waiting on logger
2026-03-16 10:31:36.188098 | [controller] Waiting on logger
2026-03-16 10:31:45.860543 | [Zuul] Log Stream did not terminate
2026-03-16 10:31:45.860804 | controller | ERROR
2026-03-16 10:31:45.860923 | controller | {
2026-03-16 10:31:45.861213 | controller |   "delta": "0:00:00.013230",
2026-03-16 10:31:45.861239 | controller |   "end": "2026-03-16 10:31:15.837743",
2026-03-16 10:31:45.861256 | controller |   "msg": "non-zero return code",
2026-03-16 10:31:45.861271 | controller |   "rc": 1,
2026-03-16 10:31:45.861286 | controller |   "start": "2026-03-16 10:31:15.824513"
2026-03-16 10:31:45.861331 | controller | }
2026-03-16 10:31:45.861366 | controller | ERROR: Ignoring Errors
2026-03-16 10:31:45.869513 | 
2026-03-16 10:31:45.869588 | TASK [Create system configuration directory]
2026-03-16 10:31:46.143231 | controller | changed
2026-03-16 10:31:46.148415 | 
2026-03-16 10:31:46.148484 | TASK [Get some of the system configurations]
2026-03-16 10:31:48.220059 | [controller] Waiting on logger
2026-03-16 10:31:51.175427 | controller | changed
2026-03-16 10:31:51.181251 | 
2026-03-16 10:31:51.181331 | TASK [Copy generated documentation if available]
2026-03-16 10:31:51.207422 | controller | skipping: Conditional result was False
2026-03-16 10:31:51.212612 | 
2026-03-16 10:31:51.212671 | TASK [Copy generated AsciiDoc documentation if available]
2026-03-16 10:31:51.228210 | controller | skipping: Conditional result was False
2026-03-16 10:31:51.233985 | 
2026-03-16 10:31:51.234043 | TASK [Compress logs bigger than 2MB]
2026-03-16 10:31:51.257257 | [controller] Waiting on logger
2026-03-16 10:31:53.851848 | [controller] Waiting on logger
2026-03-16 10:31:56.364431 | controller | changed
2026-03-16 10:31:56.369857 | 
2026-03-16 10:31:56.369926 | TASK [Copy files from workspace on node]
2026-03-16 10:31:56.389260 | controller | ok
2026-03-16 10:31:56.410564 | 
2026-03-16 10:31:56.410632 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-16 10:31:56.435476 | controller | skipping: Conditional result was False
2026-03-16 10:31:56.440861 | 
2026-03-16 10:31:56.440943 | TASK [fetch-output : Set log path for single node]
2026-03-16 10:31:56.470312 | controller | ok
2026-03-16 10:31:56.475000 | 
2026-03-16 10:31:56.475064 | LOOP [fetch-output : Ensure local output dirs]
2026-03-16 10:31:56.679544 | controller -> localhost | ok: "/var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/logs"
2026-03-16 10:31:56.679895 | controller -> localhost | changed: All items complete
2026-03-16 10:31:56.679928 | 
2026-03-16 10:31:56.861921 | controller -> localhost | changed: "/var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/artifacts"
2026-03-16 10:31:57.036116 | controller -> localhost | changed: "/var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/docs"
2026-03-16 10:31:57.047257 | 
2026-03-16 10:31:57.047402 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-16 10:31:57.723524 | controller | changed:
2026-03-16 10:31:57.723820 | controller | .d..t...... ./
2026-03-16 10:31:57.723851 | controller | >f+++++++++ README.html
2026-03-16 10:31:57.723886 | controller | >f+++++++++ ansible-execution.log
2026-03-16 10:31:57.723907 | controller | >f+++++++++ ansible.log
2026-03-16 10:31:57.723925 | controller | >f+++++++++ crc-setup.log
2026-03-16 10:31:57.723943 | controller | >f+++++++++ crc-start.log
2026-03-16 10:31:57.723958 | controller | >f+++++++++ dmesg.log
2026-03-16 10:31:57.723975 | controller | >f+++++++++ installed-pkgs.log
2026-03-16 10:31:57.723990 | controller | >f+++++++++ python.log
2026-03-16 10:31:57.724005 | controller | >f+++++++++ registries.conf
2026-03-16 10:31:57.724021 | controller | >f+++++++++ report.html
2026-03-16 10:31:57.724035 | controller | >f+++++++++ selinux-denials.log
2026-03-16 10:31:57.724050 | controller | >f+++++++++ selinux-listing.log
2026-03-16 10:31:57.724064 | controller | cd+++++++++ ci-framework-data/
2026-03-16 10:31:57.724079 | controller | cd+++++++++ ci-framework-data/artifacts/
2026-03-16 10:31:57.724095 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2026-03-16 10:31:57.724110 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2026-03-16 10:31:57.724124 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf
2026-03-16 10:31:57.724139 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2026-03-16 10:31:57.724153 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf
2026-03-16 10:31:57.724168 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2026-03-16 10:31:57.724183 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2026-03-16 10:31:57.724197 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2026-03-16 10:31:57.724212 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2026-03-16 10:31:57.724226 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2026-03-16 10:31:57.724241 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2026-03-16 10:31:57.724255 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2026-03-16 10:31:57.724269 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2026-03-16 10:31:57.724283 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:bd:8b:c6
2026-03-16 10:31:57.724323 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:62:83:c6
2026-03-16 10:31:57.724342 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:a8:6e:20
2026-03-16 10:31:57.724358 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:11:16:a1
2026-03-16 10:31:57.724372 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:f8:4c:2e
2026-03-16 10:31:57.724388 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:27:03:be
2026-03-16 10:31:57.724404 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2026-03-16 10:31:57.724419 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2026-03-16 10:31:57.724444 | controller | cd+++++++++ ci-framework-data/logs/
2026-03-16 10:31:57.724461 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2026-03-16 10:31:57.724476 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2026-03-16 10:31:57.724491 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log
2026-03-16 10:31:57.724506 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2026-03-16 10:31:57.724521 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2026-03-16 10:31:57.724535 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml
2026-03-16 10:31:57.724551 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2026-03-16 10:31:57.724566 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/
2026-03-16 10:31:57.724581 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/
2026-03-16 10:31:57.724595 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/
2026-03-16 10:31:57.724612 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/
2026-03-16 10:31:57.724627 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml
2026-03-16 10:31:57.724642 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml
2026-03-16 10:31:57.724656 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/
2026-03-16 10:31:57.724671 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo
2026-03-16 10:31:57.724686 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo
2026-03-16 10:31:57.724701 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5
2026-03-16 10:31:57.724715 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo
2026-03-16 10:31:57.724730 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo
2026-03-16 10:31:57.724745 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo
2026-03-16 10:31:57.724760 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo
2026-03-16 10:31:57.724774 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/
2026-03-16 10:31:57.724788 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/
2026-03-16 10:31:57.724803 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd
2026-03-16 10:31:57.724817 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf
2026-03-16 10:31:57.724831 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts
2026-03-16 10:31:57.724845 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/
2026-03-16 10:31:57.724859 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2026-03-16 10:31:57.724885 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml
2026-03-16 10:31:57.724901 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2026-03-16 10:31:57.724921 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml
2026-03-16 10:31:57.724940 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml
2026-03-16 10:31:57.724956 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/
2026-03-16 10:31:57.724970 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt
2026-03-16 10:31:57.724985 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/
2026-03-16 10:31:57.725000 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2026-03-16 10:31:57.725014 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd
2026-03-16 10:31:57.725028 | controller | cd+++++++++ registries.conf.d/
2026-03-16 10:31:57.725043 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2026-03-16 10:31:57.725056 | controller | cd+++++++++ system-config/
2026-03-16 10:31:57.725070 | controller | cd+++++++++ system-config/libvirt/
2026-03-16 10:31:57.725084 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2026-03-16 10:31:57.725098 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2026-03-16 10:31:57.725112 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2026-03-16 10:31:57.725126 | controller | >f+++++++++ system-config/libvirt/network.conf
2026-03-16 10:31:57.725140 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2026-03-16 10:31:57.725154 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2026-03-16 10:31:57.725168 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2026-03-16 10:31:57.725182 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2026-03-16 10:31:57.725196 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2026-03-16 10:31:57.725210 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2026-03-16 10:31:57.725224 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2026-03-16 10:31:57.725238 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2026-03-16 10:31:57.725251 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2026-03-16 10:31:57.725265 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2026-03-16 10:31:57.725279 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2026-03-16 10:31:57.725307 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2026-03-16 10:31:58.187685 | controller | changed: .d..t...... ./
2026-03-16 10:31:58.621487 | controller | changed: .d..t...... ./
2026-03-16 10:31:58.637729 | 
2026-03-16 10:31:58.637905 | TASK [Return artifact to Zuul]
2026-03-16 10:31:58.669657 | controller | ok
2026-03-16 10:31:58.690215 | 
2026-03-16 10:31:58.690278 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2026-03-16 10:31:58.690415 | 
2026-03-16 10:31:58.690445 | PLAY RECAP
2026-03-16 10:31:58.690490 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2026-03-16 10:31:58.690511 | 
2026-03-16 10:31:58.799852 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-03-16 10:31:58.801943 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-16 10:31:59.309775 | 
2026-03-16 10:31:59.309918 | PLAY [all]
2026-03-16 10:31:59.327723 | 
2026-03-16 10:31:59.327798 | TASK [include_role : fetch-output]
2026-03-16 10:31:59.358562 | controller | ok
2026-03-16 10:31:59.374530 | 
2026-03-16 10:31:59.374609 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-16 10:31:59.421333 | controller | skipping: Conditional result was False
2026-03-16 10:31:59.427364 | 
2026-03-16 10:31:59.427442 | TASK [fetch-output : Set log path for single node]
2026-03-16 10:31:59.467819 | controller | ok
2026-03-16 10:31:59.472502 | 
2026-03-16 10:31:59.472573 | LOOP [fetch-output : Ensure local output dirs]
2026-03-16 10:31:59.816950 | controller -> localhost | ok: "/var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/logs"
2026-03-16 10:32:00.003791 | controller -> localhost | ok: "/var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/artifacts"
2026-03-16 10:32:00.189225 | controller -> localhost | ok: "/var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/docs"
2026-03-16 10:32:00.206145 | 
2026-03-16 10:32:00.206326 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-16 10:32:00.804631 | controller | ok
2026-03-16 10:32:00.805001 | controller | ok: All items complete
2026-03-16 10:32:00.805032 | 
2026-03-16 10:32:01.258112 | controller | ok
2026-03-16 10:32:01.713447 | controller | ok
2026-03-16 10:32:01.728500 | 
2026-03-16 10:32:01.728692 | TASK [include_role : fetch-output-openshift]
2026-03-16 10:32:01.745377 | controller | skipping: Conditional result was False
2026-03-16 10:32:01.752791 | 
2026-03-16 10:32:01.752892 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-16 10:32:02.128717 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.008776
2026-03-16 10:32:02.327977 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.009039
2026-03-16 10:32:02.366811 | 
2026-03-16 10:32:02.366946 | PLAY [all]
2026-03-16 10:32:02.381094 | 
2026-03-16 10:32:02.381167 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-16 10:32:02.890384 | controller | changed
2026-03-16 10:32:02.912122 | 
2026-03-16 10:32:02.912182 | PLAY RECAP
2026-03-16 10:32:02.912229 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2026-03-16 10:32:02.912252 | 
2026-03-16 10:32:03.014070 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-16 10:32:03.015048 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2026-03-16 10:32:03.579376 | 
2026-03-16 10:32:03.579518 | PLAY [localhost]
2026-03-16 10:32:03.595855 | 
2026-03-16 10:32:03.595945 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-16 10:32:03.920127 | localhost | changed
2026-03-16 10:32:03.924663 | 
2026-03-16 10:32:03.924739 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-16 10:32:03.953898 | localhost | ok
2026-03-16 10:32:03.961177 | 
2026-03-16 10:32:03.961244 | TASK [add-fileserver : Create SSH private key tempfile]
2026-03-16 10:32:04.264073 | localhost | changed
2026-03-16 10:32:04.270417 | 
2026-03-16 10:32:04.270516 | TASK [add-fileserver : Create SSH private key from secret]
2026-03-16 10:32:04.826692 | localhost | changed
2026-03-16 10:32:04.833052 | 
2026-03-16 10:32:04.833164 | TASK [add-fileserver : Add fileserver ssh key]
2026-03-16 10:32:05.198872 | localhost | Identity added: /var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/tmp/ansible.o_36s3wf (/var/lib/zuul/builds/bab9642638d64476bf84f5e40b69cd8e/work/tmp/ansible.o_36s3wf)
2026-03-16 10:32:05.199060 | localhost | ok: Runtime: 0:00:00.007180
2026-03-16 10:32:05.203193 | 
2026-03-16 10:32:05.203264 | TASK [add-fileserver : Remove SSH private key from disk]
2026-03-16 10:32:05.434334 | localhost | ok: Runtime: 0:00:00.005200
2026-03-16 10:32:05.438990 | 
2026-03-16 10:32:05.439055 | TASK [add-fileserver : Add fileserver to inventory]
2026-03-16 10:32:05.490379 | localhost | changed
2026-03-16 10:32:05.494243 | 
2026-03-16 10:32:05.494326 | TASK [add-fileserver : Add fileserver server to known hosts]
2026-03-16 10:32:05.827399 | localhost | changed
2026-03-16 10:32:05.845432 | 
2026-03-16 10:32:05.845496 | PLAY [localhost]
2026-03-16 10:32:05.855822 | 
2026-03-16 10:32:05.855893 | TASK [Generate bulk log download script]
2026-03-16 10:32:05.875786 | localhost | ok
2026-03-16 10:32:05.886515 | 
2026-03-16 10:32:05.886578 | TASK [local-log-download : Check API endpoint is defined]
2026-03-16 10:32:05.915205 | localhost | ok: All assertions passed
2026-03-16 10:32:05.919367 | 
2026-03-16 10:32:05.919426 | TASK [local-log-download : Create download script]
2026-03-16 10:32:06.271351 | localhost -> localhost | changed
2026-03-16 10:32:06.281064 | 
2026-03-16 10:32:06.281132 | TASK [Register quick-download link]
2026-03-16 10:32:06.310231 | localhost | ok
2026-03-16 10:32:06.350818 | 
2026-03-16 10:32:06.350899 | PLAY [logserver.rdoproject.org]
2026-03-16 10:32:06.360279 | 
2026-03-16 10:32:06.360358 | TASK [Set zuul-log-path fact]
2026-03-16 10:32:06.377207 | logserver.rdoproject.org | ok
2026-03-16 10:32:06.385622 | 
2026-03-16 10:32:06.385686 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-16 10:32:06.413329 | logserver.rdoproject.org | ok
2026-03-16 10:32:06.418190 | 
2026-03-16 10:32:06.418251 | TASK [upload-logs : Create log directories]
2026-03-16 10:32:07.985604 | logserver.rdoproject.org | changed
2026-03-16 10:32:07.988590 | 
2026-03-16 10:32:07.988652 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-16 10:32:08.227078 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.007458
2026-03-16 10:32:08.231570 | 
2026-03-16 10:32:08.231634 | TASK [upload-logs : Upload logs to log server]
2026-03-16 10:32:09.822939 | logserver.rdoproject.org | Output suppressed because no_log was given
2026-03-16 10:32:09.825782 | 
2026-03-16 10:32:09.825871 | LOOP [upload-logs : Compress console log and json output]
2026-03-16 10:32:09.866906 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-16 10:32:09.877507 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-16 10:32:09.884314 | 
2026-03-16 10:32:09.884412 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-16 10:32:09.924801 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-16 10:32:09.925067 | 
2026-03-16 10:32:09.928088 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-16 10:32:09.933795 | 
2026-03-16 10:32:09.933897 | LOOP [upload-logs : Upload console log and json output]