2026-03-19 12:03:38.973460 | Job console starting...
2026-03-19 12:03:39.179487 | Updating repositories
2026-03-19 12:03:39.857786 | Preparing job workspace
2026-03-19 12:03:47.985977 | Running Ansible setup...
2026-03-19 12:03:51.333591 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-19 12:03:51.803201 | 
2026-03-19 12:03:51.803308 | PLAY [localhost]
2026-03-19 12:03:51.810985 | 
2026-03-19 12:03:51.811050 | TASK [Gathering Facts]
2026-03-19 12:03:52.563903 | localhost | ok
2026-03-19 12:03:52.576994 | 
2026-03-19 12:03:52.577074 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-19 12:03:52.865554 | localhost -> localhost | changed
2026-03-19 12:03:52.870359 | 
2026-03-19 12:03:52.870427 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-19 12:03:53.512640 | localhost -> localhost | changed
2026-03-19 12:03:53.520808 | 
2026-03-19 12:03:53.520880 | TASK [Setup log path fact]
2026-03-19 12:03:53.537579 | localhost | ok
2026-03-19 12:03:53.548317 | 
2026-03-19 12:03:53.548385 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-19 12:03:53.566001 | localhost | ok
2026-03-19 12:03:53.573228 | 
2026-03-19 12:03:53.573314 | TASK [emit-job-header : Print job information]
2026-03-19 12:03:53.600033 | # Job Information
2026-03-19 12:03:53.600144 | Ansible Version: 2.15.12
2026-03-19 12:03:53.600173 | Job: cifmw-molecule-reproducer
2026-03-19 12:03:53.600196 | Pipeline: github-check
2026-03-19 12:03:53.600217 | Executor: ibm-bm3-ze.softwarefactory-project.io
2026-03-19 12:03:53.600237 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3783
2026-03-19 12:03:53.600256 | Log URL (when completed): https://logserver.rdoproject.org/9c4/rdoproject.org/9c441b7272884649bdfe4c82f4bf76ab/
2026-03-19 12:03:53.600299 | Event ID: 83853ed0-238b-11f1-852b-84029284633c
2026-03-19 12:03:53.603921 | 
2026-03-19 12:03:53.603987 | LOOP [emit-job-header : Print node information]
2026-03-19 12:03:53.687119 | localhost | ok:
2026-03-19 12:03:53.687286 | localhost | # Node Information
2026-03-19 12:03:53.687321 | localhost | Inventory Hostname: controller
2026-03-19 12:03:53.687347 | localhost | Hostname: np0005651847
2026-03-19 12:03:53.687368 | localhost | Username: zuul
2026-03-19 12:03:53.687388 | localhost | Distro: CentOS 9
2026-03-19 12:03:53.687405 | localhost | Provider: ibm-bm3-nodepool
2026-03-19 12:03:53.687422 | localhost | Region: regionOne
2026-03-19 12:03:53.687438 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2026-03-19 12:03:53.687454 | localhost | Product Name: OpenStack Compute
2026-03-19 12:03:53.687470 | localhost | Interface IP: 192.168.25.48
2026-03-19 12:03:53.706353 | 
2026-03-19 12:03:53.706420 | PLAY [all]
2026-03-19 12:03:53.712836 | 
2026-03-19 12:03:53.712911 | TASK [Gather network facts]
2026-03-19 12:03:54.107829 | controller | ok
2026-03-19 12:03:54.121102 | 
2026-03-19 12:03:54.121163 | TASK [include_role : start-zuul-console]
2026-03-19 12:03:54.138180 | controller | ok
2026-03-19 12:03:54.150766 | 
2026-03-19 12:03:54.150860 | TASK [start-zuul-console : Start zuul_console daemon.]
2026-03-19 12:03:54.526432 | controller | ok
2026-03-19 12:03:54.535321 | 
2026-03-19 12:03:54.535394 | TASK [include_role : add-build-sshkey]
2026-03-19 12:03:54.557772 | controller | ok
2026-03-19 12:03:54.571595 | 
2026-03-19 12:03:54.571668 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-19 12:03:54.758482 | controller -> localhost | ok
2026-03-19 12:03:54.765427 | 
2026-03-19 12:03:54.765505 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-19 12:03:54.795465 | controller | ok
2026-03-19 12:03:54.810777 | controller | included: /var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-19 12:03:54.816585 | 
2026-03-19 12:03:54.816657 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-19 12:03:55.318710 | controller -> localhost | Generating public/private rsa key pair.
2026-03-19 12:03:55.318964 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/9c441b7272884649bdfe4c82f4bf76ab_id_rsa.
2026-03-19 12:03:55.319002 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/9c441b7272884649bdfe4c82f4bf76ab_id_rsa.pub.
2026-03-19 12:03:55.319027 | controller -> localhost | The key fingerprint is:
2026-03-19 12:03:55.319048 | controller -> localhost | SHA256:wqI2Yi+/OgJWFXAXJatUNCp6JppVbISw4m6wgeZSQ4g zuul-build-sshkey
2026-03-19 12:03:55.319067 | controller -> localhost | The key's randomart image is:
2026-03-19 12:03:55.319084 | controller -> localhost | +---[RSA 3072]----+
2026-03-19 12:03:55.319102 | controller -> localhost | |.. ooooBo.       |
2026-03-19 12:03:55.319120 | controller -> localhost | |.o.o..+ +        |
2026-03-19 12:03:55.319137 | controller -> localhost | |E ..=o .         |
2026-03-19 12:03:55.319155 | controller -> localhost | |+..+o..          |
2026-03-19 12:03:55.319173 | controller -> localhost | |+==o..o S        |
2026-03-19 12:03:55.319191 | controller -> localhost | |BB+o . .         |
2026-03-19 12:03:55.319208 | controller -> localhost | |O=+              |
2026-03-19 12:03:55.319225 | controller -> localhost | |==..             |
2026-03-19 12:03:55.319242 | controller -> localhost | |..=+.            |
2026-03-19 12:03:55.319259 | controller -> localhost | +----[SHA256]-----+
2026-03-19 12:03:55.319354 | controller -> localhost | ok: Runtime: 0:00:00.153590
2026-03-19 12:03:55.324953 | 
2026-03-19 12:03:55.325020 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-19 12:03:55.342596 | controller | ok
2026-03-19 12:03:55.351806 | controller | included: /var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-19 12:03:55.359499 | 
2026-03-19 12:03:55.359567 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-19 12:03:55.372818 | controller | skipping: Conditional result was False
2026-03-19 12:03:55.378304 | 
2026-03-19 12:03:55.378373 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-19 12:03:55.832487 | controller | changed
2026-03-19 12:03:55.837105 | 
2026-03-19 12:03:55.837173 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-19 12:03:56.087640 | controller | ok
2026-03-19 12:03:56.092446 | 
2026-03-19 12:03:56.092512 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-19 12:03:57.166039 | controller | changed
2026-03-19 12:03:57.170794 | 
2026-03-19 12:03:57.170860 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-19 12:03:58.192800 | controller | changed
2026-03-19 12:03:58.197478 | 
2026-03-19 12:03:58.197542 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-19 12:03:58.210868 | controller | skipping: Conditional result was False
2026-03-19 12:03:58.216223 | 
2026-03-19 12:03:58.216304 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-19 12:03:58.512745 | controller -> localhost | changed
2026-03-19 12:03:58.522446 | 
2026-03-19 12:03:58.522514 | TASK [add-build-sshkey : Add back temp key]
2026-03-19 12:03:58.738114 | controller -> localhost | Identity added: /var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/9c441b7272884649bdfe4c82f4bf76ab_id_rsa (zuul-build-sshkey)
2026-03-19 12:03:58.738285 | controller -> localhost | ok: Runtime: 0:00:00.006892
2026-03-19 12:03:58.743397 | 
2026-03-19 12:03:58.743459 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-19 12:03:59.075959 | controller | ok
2026-03-19 12:03:59.080310 | 
2026-03-19 12:03:59.080374 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-19 12:03:59.105515 | controller | skipping: Conditional result was False
2026-03-19 12:03:59.113802 | 
2026-03-19 12:03:59.113868 | TASK [include_role : validate-host]
2026-03-19 12:03:59.131337 | controller | ok
2026-03-19 12:03:59.149141 | 
2026-03-19 12:03:59.149206 | TASK [validate-host : Define zuul_info_dir fact]
2026-03-19 12:03:59.176563 | controller | ok
2026-03-19 12:03:59.180850 | 
2026-03-19 12:03:59.180927 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2026-03-19 12:03:59.376063 | controller -> localhost | ok
2026-03-19 12:03:59.381772 | 
2026-03-19 12:03:59.381837 | TASK [validate-host : Collect information about the host]
2026-03-19 12:04:00.047581 | controller | ok
2026-03-19 12:04:00.056176 | 
2026-03-19 12:04:00.056304 | TASK [validate-host : Sanitize hostname]
2026-03-19 12:04:00.095001 | controller | ok
2026-03-19 12:04:00.099572 | 
2026-03-19 12:04:00.099638 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2026-03-19 12:04:00.457490 | controller -> localhost | changed
2026-03-19 12:04:00.462936 | 
2026-03-19 12:04:00.463011 | TASK [validate-host : Collect information about zuul worker]
2026-03-19 12:04:00.824874 | controller | ok
2026-03-19 12:04:00.829291 | 
2026-03-19 12:04:00.829369 | TASK [validate-host : Write out all zuul information for each host]
2026-03-19 12:04:01.176644 | controller -> localhost | changed
2026-03-19 12:04:01.186426 | 
2026-03-19 12:04:01.186510 | TASK [include_role : prepare-workspace-openshift]
2026-03-19 12:04:01.199686 | controller | skipping: Conditional result was False
2026-03-19 12:04:01.204690 | 
2026-03-19 12:04:01.204754 | TASK [include_role : remove-zuul-sshkey]
2026-03-19 12:04:01.217791 | controller | skipping: Conditional result was False
2026-03-19 12:04:01.222552 | 
2026-03-19 12:04:01.222619 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-19 12:04:01.466854 | controller | ok: "logs"
2026-03-19 12:04:01.467093 | controller | ok: All items complete
2026-03-19 12:04:01.467123 | 
2026-03-19 12:04:01.680410 | controller | ok: "artifacts"
2026-03-19 12:04:01.900733 | controller | ok: "docs"
2026-03-19 12:04:01.909718 | 
2026-03-19 12:04:01.909785 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-19 12:04:02.154696 | controller | changed: "logs"
2026-03-19 12:04:02.376249 | controller | changed: "artifacts"
2026-03-19 12:04:02.594984 | controller | changed: "docs"
2026-03-19 12:04:02.620783 | 
2026-03-19 12:04:02.620839 | PLAY RECAP
2026-03-19 12:04:02.620880 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-19 12:04:02.620923 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-19 12:04:02.620941 | 
2026-03-19 12:04:02.689656 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-19 12:04:02.690384 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-03-19 12:04:03.220389 | 
2026-03-19 12:04:03.220488 | PLAY [all]
2026-03-19 12:04:03.239494 | 
2026-03-19 12:04:03.239570 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-03-19 12:04:03.288075 | controller | ok
2026-03-19 12:04:03.292853 | 
2026-03-19 12:04:03.292947 | TASK [mirror-info-fork : Create /etc/ci]
2026-03-19 12:04:03.685895 | controller | changed
2026-03-19 12:04:03.691075 | 
2026-03-19 12:04:03.691147 | TASK [mirror-info-fork : Install ci_mirror script]
2026-03-19 12:04:04.966503 | controller | changed
2026-03-19 12:04:04.976107 | 
2026-03-19 12:04:04.976179 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2026-03-19 12:04:05.414242 | controller | changed:
2026-03-19 12:04:05.414417 | controller | {
2026-03-19 12:04:05.414450 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2026-03-19 12:04:05.414480 | controller | }
2026-03-19 12:04:05.688512 | controller | changed:
2026-03-19 12:04:05.688600 | controller | {
2026-03-19 12:04:05.688629 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2026-03-19 12:04:05.688651 | controller | }
2026-03-19 12:04:05.962688 | controller | changed:
2026-03-19 12:04:05.962774 | controller | {
2026-03-19 12:04:05.962800 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2026-03-19 12:04:05.962821 | controller | }
2026-03-19 12:04:06.240713 | controller | changed:
2026-03-19 12:04:06.240801 | controller | {
2026-03-19 12:04:06.240828 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2026-03-19 12:04:06.240848 | controller | }
2026-03-19 12:04:06.508782 | controller | changed:
2026-03-19 12:04:06.508867 | controller | {
2026-03-19 12:04:06.508905 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2026-03-19 12:04:06.508926 | controller | }
2026-03-19 12:04:06.783035 | controller | changed:
2026-03-19 12:04:06.783122 | controller | {
2026-03-19 12:04:06.783152 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2026-03-19 12:04:06.783174 | controller | }
2026-03-19 12:04:07.053431 | controller | changed:
2026-03-19 12:04:07.053514 | controller | {
2026-03-19 12:04:07.053542 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2026-03-19 12:04:07.053563 | controller | }
2026-03-19 12:04:07.328662 | controller | changed:
2026-03-19 12:04:07.328747 | controller | {
2026-03-19 12:04:07.328774 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2026-03-19 12:04:07.328795 | controller | }
2026-03-19 12:04:07.603316 | controller | changed:
2026-03-19 12:04:07.603410 | controller | {
2026-03-19 12:04:07.603436 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2026-03-19 12:04:07.603455 | controller | }
2026-03-19 12:04:07.891014 | controller | changed:
2026-03-19 12:04:07.891085 | controller | {
2026-03-19 12:04:07.891111 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2026-03-19 12:04:07.891131 | controller | }
2026-03-19 12:04:08.148242 | controller | changed:
2026-03-19 12:04:08.148347 | controller | {
2026-03-19 12:04:08.148374 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2026-03-19 12:04:08.148393 | controller | }
2026-03-19 12:04:08.424989 | controller | changed:
2026-03-19 12:04:08.425070 | controller | {
2026-03-19 12:04:08.425097 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2026-03-19 12:04:08.425117 | controller | }
2026-03-19 12:04:08.698285 | controller | changed:
2026-03-19 12:04:08.698360 | controller | {
2026-03-19 12:04:08.698386 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com"
2026-03-19 12:04:08.698406 | controller | }
2026-03-19 12:04:08.973459 | controller | changed:
2026-03-19 12:04:08.973509 | controller | {
2026-03-19 12:04:08.973535 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2026-03-19 12:04:08.973553 | controller | }
2026-03-19 12:04:09.245124 | controller | changed:
2026-03-19 12:04:09.245202 | controller | {
2026-03-19 12:04:09.245227 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2026-03-19 12:04:09.245246 | controller | }
2026-03-19 12:04:09.524871 | controller | changed:
2026-03-19 12:04:09.524961 | controller | {
2026-03-19 12:04:09.524987 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2026-03-19 12:04:09.525007 | controller | }
2026-03-19 12:04:09.798767 | controller | changed:
2026-03-19 12:04:09.798846 | controller | {
2026-03-19 12:04:09.798873 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2026-03-19 12:04:09.798907 | controller | }
2026-03-19 12:04:10.073333 | controller | changed:
2026-03-19 12:04:10.073415 | controller | {
2026-03-19 12:04:10.073441 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2026-03-19 12:04:10.073467 | controller | }
2026-03-19 12:04:10.348970 | controller | changed:
2026-03-19 12:04:10.349055 | controller | {
2026-03-19 12:04:10.349080 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2026-03-19 12:04:10.349100 | controller | }
2026-03-19 12:04:10.621955 | controller | changed:
2026-03-19 12:04:10.622038 | controller | {
2026-03-19 12:04:10.622063 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2026-03-19 12:04:10.622082 | controller | }
2026-03-19 12:04:10.902293 | controller | changed:
2026-03-19 12:04:10.902376 | controller | {
2026-03-19 12:04:10.902401 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2026-03-19 12:04:10.902421 | controller | }
2026-03-19 12:04:11.176198 | controller | changed:
2026-03-19 12:04:11.176295 | controller | {
2026-03-19 12:04:11.176326 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2026-03-19 12:04:11.176347 | controller | }
2026-03-19 12:04:11.454666 | controller | changed:
2026-03-19 12:04:11.454747 | controller | {
2026-03-19 12:04:11.454773 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2026-03-19 12:04:11.454793 | controller | }
2026-03-19 12:04:11.725875 | controller | changed:
2026-03-19 12:04:11.725961 | controller | {
2026-03-19 12:04:11.725987 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2026-03-19 12:04:11.726005 | controller | }
2026-03-19 12:04:11.997640 | controller | changed:
2026-03-19 12:04:11.997726 | controller | {
2026-03-19 12:04:11.997753 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2026-03-19 12:04:11.997772 | controller | }
2026-03-19 12:04:12.269163 | controller | changed:
2026-03-19 12:04:12.269253 | controller | {
2026-03-19 12:04:12.269297 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2026-03-19 12:04:12.269326 | controller | }
2026-03-19 12:04:12.285308 | 
2026-03-19 12:04:12.285410 | TASK [Set timezone to UTC]
2026-03-19 12:04:12.741499 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2026-03-19 12:04:12.746301 | 
2026-03-19 12:04:12.746369 | TASK [Create nodepool directory]
2026-03-19 12:04:12.996835 | controller | changed
2026-03-19 12:04:13.002614 | 
2026-03-19 12:04:13.002678 | TASK [Create nodepool sub_nodes file]
2026-03-19 12:04:13.893704 | controller | changed
2026-03-19 12:04:13.898430 | 
2026-03-19 12:04:13.898496 | TASK [Create nodepool sub_nodes_private file]
2026-03-19 12:04:14.788113 | controller | changed
2026-03-19 12:04:14.793480 | 
2026-03-19 12:04:14.793542 | LOOP [Populate nodepool sub_nodes file]
2026-03-19 12:04:14.821236 | 
2026-03-19 12:04:14.821404 | LOOP [Populate nodepool sub_nodes_private file]
2026-03-19 12:04:14.848866 | 
2026-03-19 12:04:14.848994 | TASK [Create nodepool primary file]
2026-03-19 12:04:14.872061 | controller | skipping: Conditional result was False
2026-03-19 12:04:14.877075 | 
2026-03-19 12:04:14.877146 | TASK [Create nodepool node_private for this node]
2026-03-19 12:04:15.806091 | controller | changed
2026-03-19 12:04:15.812520 | 
2026-03-19 12:04:15.812583 | LOOP [Copy ssh keys to nodepool directory]
2026-03-19 12:04:16.178653 | controller | ok: Item: id_rsa Runtime: 0:00:00.004422
2026-03-19 12:04:16.178812 | 
2026-03-19 12:04:16.396798 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004448
2026-03-19 12:04:16.410735 | 
2026-03-19 12:04:16.410804 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2026-03-19 12:04:17.319613 | controller | changed
2026-03-19 12:04:17.324462 | 
2026-03-19 12:04:17.324526 | TASK [Validate sudoers config after edits]
2026-03-19 12:04:17.582566 | controller | /etc/sudoers: parsed OK
2026-03-19 12:04:17.582611 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2026-03-19 12:04:17.582620 | controller | /etc/sudoers.d/zuul: parsed OK
2026-03-19 12:04:17.582626 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2026-03-19 12:04:17.849014 | controller | ok: Runtime: 0:00:00.005266
2026-03-19 12:04:17.854243 | 
2026-03-19 12:04:17.854334 | TASK [Show the environment passed in to job shell scripts]
2026-03-19 12:04:18.105441 | controller | SHELL=/bin/bash
2026-03-19 12:04:18.105486 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2026-03-19 12:04:18.105495 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2026-03-19 12:04:18.105502 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/83/3783/a60f702ca51a6a187dcad687b7af8e7a44347b29
2026-03-19 12:04:18.105507 | controller | PWD=/home/zuul
2026-03-19 12:04:18.105513 | controller | ZUUL_PIPELINE=github-check
2026-03-19 12:04:18.105556 | controller | LOGNAME=zuul
2026-03-19 12:04:18.105565 | controller | XDG_SESSION_TYPE=tty
2026-03-19 12:04:18.105571 | controller | _=/usr/bin/env
2026-03-19 12:04:18.105576 | controller | MOTD_SHOWN=pam
2026-03-19 12:04:18.105582 | controller | HOME=/home/zuul
2026-03-19 12:04:18.105587 | controller | LANG=en_US.UTF-8
2026-03-19 12:04:18.105592 | controller | SSH_CONNECTION=192.168.25.12 40158 192.168.25.48 22
2026-03-19 12:04:18.105598 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2026-03-19 12:04:18.105607 | controller | ZUUL_CHANGE_IDS=3783,a60f702ca51a6a187dcad687b7af8e7a44347b29
2026-03-19 12:04:18.105612 | controller | WORKSPACE=/home/zuul/workspace
2026-03-19 12:04:18.105618 | controller | XDG_SESSION_CLASS=user
2026-03-19 12:04:18.105623 | controller | SELINUX_ROLE_REQUESTED=
2026-03-19 12:04:18.105628 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2026-03-19 12:04:18.105633 | controller | USER=zuul
2026-03-19 12:04:18.105639 | controller | ZUUL_VOTING=True
2026-03-19 12:04:18.105644 | controller | BUILD_TIMEOUT=5400000
2026-03-19 12:04:18.105649 | controller | SELINUX_USE_CURRENT_RANGE=
2026-03-19 12:04:18.105655 | controller | SHLVL=1
2026-03-19 12:04:18.105660 | controller | ZUUL_PATCHSET=a60f702ca51a6a187dcad687b7af8e7a44347b29
2026-03-19 12:04:18.105665 | controller | XDG_SESSION_ID=1
2026-03-19 12:04:18.105671 | controller | ZUUL_BRANCH=main
2026-03-19 12:04:18.105676 | controller | XDG_RUNTIME_DIR=/run/user/1000
2026-03-19 12:04:18.105681 | controller | SSH_CLIENT=192.168.25.12 40158 22
2026-03-19 12:04:18.105688 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2026-03-19 12:04:18.105693 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2026-03-19 12:04:18.105699 | controller | which_declare=declare -f
2026-03-19 12:04:18.105705 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2026-03-19 12:04:18.105710 | controller | SELINUX_LEVEL_REQUESTED=
2026-03-19 12:04:18.105715 | controller | ZUUL_CHANGE=3783
2026-03-19 12:04:18.105721 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2026-03-19 12:04:18.105726 | controller | ZUUL_UUID=9c441b7272884649bdfe4c82f4bf76ab
2026-03-19 12:04:18.105732 | controller | BASH_FUNC_which%%=() {  ( alias;
2026-03-19 12:04:18.105737 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2026-03-19 12:04:18.105742 | controller | }
2026-03-19 12:04:18.378224 | controller | ok: Runtime: 0:00:00.005589
2026-03-19 12:04:18.383486 | 
2026-03-19 12:04:18.383554 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2026-03-19 12:04:18.396736 | controller | skipping: Conditional result was False
2026-03-19 12:04:18.401865 | 
2026-03-19 12:04:18.401942 | TASK [Symlink /home/zuul-worker/workspace]
2026-03-19 12:04:18.945207 | controller | skipping: Conditional result was False
2026-03-19 12:04:18.950863 | 
2026-03-19 12:04:18.950944 | TASK [Ensure legacy workspace directory]
2026-03-19 12:04:19.182956 | controller | changed
2026-03-19 12:04:19.200193 | 
2026-03-19 12:04:19.200258 | PLAY RECAP
2026-03-19 12:04:19.200332 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-19 12:04:19.200363 | 
2026-03-19 12:04:19.266840 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-03-19 12:04:19.267538 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-03-19 12:04:19.781621 | 
2026-03-19 12:04:19.781725 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2026-03-19 12:04:19.802421 | 
2026-03-19 12:04:19.802502 | TASK [Create zuul-output directory]
2026-03-19 12:04:20.166193 | controller | changed
2026-03-19 12:04:20.171108 | 
2026-03-19 12:04:20.171189 | TASK [Slurp Zuul inventory test]
2026-03-19 12:04:20.437033 | controller -> localhost | ok
2026-03-19 12:04:20.443063 | 
2026-03-19 12:04:20.443137 | TASK [Save zuul inventory]
2026-03-19 12:04:21.544846 | controller | changed
2026-03-19 12:04:21.549583 | 
2026-03-19 12:04:21.549647 | TASK [Save zuul vars without the change_message]
2026-03-19 12:04:22.498385 | controller | changed
2026-03-19 12:04:22.515645 | 
2026-03-19 12:04:22.515703 | PLAY RECAP
2026-03-19 12:04:22.515749 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-19 12:04:22.515778 | 
2026-03-19 12:04:22.588478 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-03-19 12:04:22.589163 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-03-19 12:04:23.142012 | 
2026-03-19 12:04:23.142131 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2026-03-19 12:04:23.162194 | 
2026-03-19 12:04:23.162293 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2026-03-19 12:04:23.180624 | controller | ok
2026-03-19 12:04:23.197023 | 
2026-03-19 12:04:23.197107 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-03-19 12:04:23.221474 | controller | skipping: Conditional result was False
2026-03-19 12:04:23.227157 | 
2026-03-19 12:04:23.227241 | TASK [mirror-info-fork : Create /etc/ci]
2026-03-19 12:04:23.589939 | controller | ok
2026-03-19 12:04:23.595561 | 
2026-03-19 12:04:23.595633 | TASK [mirror-info-fork : Install ci_mirror script]
2026-03-19 12:04:24.496963 | controller | ok
2026-03-19 12:04:24.506135 | 
2026-03-19 12:04:24.506351 | TASK [Prepare workspace]
2026-03-19 12:04:24.524757 | controller | ok
2026-03-19 12:04:24.541164 | 
2026-03-19 12:04:24.541234 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-19 12:04:24.874656 | controller | ok
2026-03-19 12:04:24.880966 | 
2026-03-19 12:04:24.881031 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-19 12:04:27.372591 | controller | Output suppressed because no_log was given
2026-03-19 12:04:27.381534 | 
2026-03-19 12:04:27.381598 | LOOP [Create zuul-output directory]
2026-03-19 12:04:27.638426 | controller | changed: "/home/zuul/ci-framework-data/logs"
2026-03-19 12:04:27.856313 | controller | ok: "/home/zuul/zuul-output/logs"
2026-03-19 12:04:27.866597 | 
2026-03-19 12:04:27.866668 | TASK [Install required packages]
2026-03-19 12:04:46.531552 | controller | ok: Nothing to do
2026-03-19 12:04:46.536574 | 
2026-03-19 12:04:46.536634 | TASK [Install venv]
2026-03-19 12:05:43.574843 | controller | changed
2026-03-19 12:05:43.599584 | 
2026-03-19 12:05:43.599704 | PLAY RECAP
2026-03-19 12:05:43.599793 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-19 12:05:43.599822 | 
2026-03-19 12:05:43.670371 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-03-19 12:05:43.671188 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-03-19 12:05:44.184432 | 
2026-03-19 12:05:44.184532 | PLAY [Run ci/playbooks/molecule-test.yml]
2026-03-19 12:05:44.205027 | 
2026-03-19 12:05:44.205107 | TASK [Gather required facts]
2026-03-19 12:05:44.711242 | controller | ok
2026-03-19 12:05:44.716635 | 
2026-03-19 12:05:44.716720 | TASK [Load environment var if instructed to]
2026-03-19 12:05:44.741238 | controller | skipping: Conditional result was False
2026-03-19 12:05:44.746592 | 
2026-03-19 12:05:44.746665 | TASK [Ensure group_vars dir exists]
2026-03-19 12:05:45.099294 | controller | ok
2026-03-19 12:05:45.105566 | 
2026-03-19 12:05:45.105654 | TASK [Print related variables]
2026-03-19 12:05:45.135245 | controller | ok:
2026-03-19 12:05:45.135414 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml
2026-03-19 12:05:45.135468 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer
2026-03-19 12:05:45.140965 | 
2026-03-19 12:05:45.141034 | TASK [Run molecule]
2026-03-19 12:05:46.150854 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2026-03-19 12:05:46.432288 | controller | INFO     Performing prerun with role_name_check=0...
2026-03-19 12:06:03.148769 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.149224 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.149679 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.150112 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.150574 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+c5bc902a was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+c5bc902a (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.150989 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.151427 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.151847 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.152283 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.152679 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.153106 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.153553 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.153960 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.154425 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.154842 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 12:06:03.164149 | controller | INFO     Running crc_layout > prepare
2026-03-19 12:06:03.828873 | controller |
2026-03-19 12:06:03.828984 | controller | PLAY [Prepare] *****************************************************************
2026-03-19 12:06:03.829069 | controller |
2026-03-19 12:06:03.829211 | controller | TASK [Gathering Facts] *********************************************************
2026-03-19 12:06:03.829295 | controller | Thursday 19 March 2026  12:06:03 +0000 (0:00:00.018)       0:00:00.018 ********
2026-03-19 12:06:04.639780 | controller | ok: [instance]
2026-03-19 12:06:04.639872 | controller |
2026-03-19 12:06:04.639989 | controller | TASK [Create custom basedir] ***************************************************
2026-03-19 12:06:04.640130 | controller | Thursday 19 March 2026  12:06:04 +0000 (0:00:00.811)       0:00:00.829 ********
2026-03-19 12:06:04.939492 | controller | changed: [instance]
2026-03-19 12:06:04.939538 | controller |
2026-03-19 12:06:04.939636 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2026-03-19 12:06:04.939728 | controller | Thursday 19 March 2026  12:06:04 +0000 (0:00:00.299)       0:00:01.129 ********
2026-03-19 12:06:04.955762 | controller | skipping: [instance]
2026-03-19 12:06:04.955840 | controller |
2026-03-19 12:06:04.955931 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2026-03-19 12:06:04.956040 | controller | Thursday 19 March 2026  12:06:04 +0000 (0:00:00.016)       0:00:01.146 ********
2026-03-19 12:06:04.995799 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2026-03-19 12:06:04.995905 | controller |
2026-03-19 12:06:04.996021 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2026-03-19 12:06:04.996157 | controller | Thursday 19 March 2026  12:06:04 +0000 (0:00:00.039)       0:00:01.186 ********
2026-03-19 12:06:05.266388 | controller | ok: [instance]
2026-03-19 12:06:05.266478 | controller |
2026-03-19 12:06:05.266589 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2026-03-19 12:06:05.266681 | controller | Thursday 19 March 2026  12:06:05 +0000 (0:00:00.270)       0:00:01.456 ********
2026-03-19 12:06:05.469050 | controller | ok: [instance]
2026-03-19 12:06:05.469166 | controller |
2026-03-19 12:06:05.469312 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2026-03-19 12:06:05.469432 | controller | Thursday 19 March 2026  12:06:05 +0000 (0:00:00.202)       0:00:01.659 ********
2026-03-19 12:06:06.136902 | controller | ok: [instance] => (item=ubi-9-appstream)
2026-03-19 12:06:06.136980 | controller | ok: [instance] => (item=ubi-9-baseos)
2026-03-19 12:06:06.137102 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2026-03-19 12:06:06.137199 | controller |
2026-03-19 12:06:06.137290 | controller | TASK [Deploy repo-setup] *******************************************************
2026-03-19 12:06:06.137385 | controller | Thursday 19 March 2026  12:06:06 +0000 (0:00:00.667)       0:00:02.326 ********
2026-03-19 12:06:06.194519 | controller |
2026-03-19 12:06:06.194635 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-03-19 12:06:06.194796 | controller | Thursday 19 March 2026  12:06:06 +0000 (0:00:00.057)       0:00:02.384 ********
2026-03-19 12:06:06.702647 | controller | changed: [instance] => (item=tmp)
2026-03-19 12:06:06.702722 | controller | changed: [instance] => (item=artifacts/repositories)
2026-03-19 12:06:06.702817 | controller | changed: [instance] => (item=venv/repo_setup)
2026-03-19 12:06:06.702906 | controller |
2026-03-19 12:06:06.703002 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-03-19 12:06:06.703107 | controller | Thursday 19 March 2026  12:06:06 +0000 (0:00:00.507)       0:00:02.892 ********
2026-03-19 12:06:07.532910 | controller | ok: [instance]
2026-03-19 12:06:07.533085 | controller |
2026-03-19 12:06:07.533135 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-03-19 12:06:07.533221 | controller | Thursday 19 March 2026  12:06:07 +0000 (0:00:00.830)       0:00:03.722 ********
2026-03-19 12:06:08.531646 | controller | changed: [instance]
2026-03-19 12:06:16.019452 | controller |
2026-03-19 12:06:16.019495 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-03-19 12:06:16.019504 | controller | Thursday 19 March 2026  12:06:08 +0000 (0:00:00.998)       0:00:04.721 ********
2026-03-19 12:06:16.019514 | controller | changed: [instance]
2026-03-19 12:06:16.698843 | controller |
2026-03-19 12:06:16.698879 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-03-19 12:06:16.698889 | controller | Thursday 19 March 2026  12:06:16 +0000 (0:00:07.486)       0:00:12.207 ********
2026-03-19 12:06:16.698901 | controller | changed: [instance]
2026-03-19 12:06:16.721091 | controller |
2026-03-19 12:06:16.721132 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-03-19 12:06:16.721142 | controller | Thursday 19 March 2026  12:06:16 +0000 (0:00:00.680)       0:00:12.888 ********
2026-03-19 12:06:16.721154 | controller | skipping: [instance]
2026-03-19 12:06:16.721318 | controller |
2026-03-19 12:06:16.721340 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-03-19 12:06:17.818995 | controller | Thursday 19 March 2026  12:06:16 +0000 (0:00:00.022)       0:00:12.910 ********
2026-03-19 12:06:17.819058 | controller | changed: [instance]
2026-03-19 12:06:17.855833 | controller |
2026-03-19 12:06:17.855854 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-03-19 12:06:17.855862 | controller | Thursday 19 March 2026  12:06:17 +0000 (0:00:01.097)       0:00:14.008 ********
2026-03-19 12:06:17.855873 | controller | skipping: [instance]
2026-03-19 12:06:17.892073 | controller |
2026-03-19 12:06:17.892097 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-03-19 12:06:17.892107 | controller | Thursday 19 March 2026  12:06:17 +0000 (0:00:00.036)       0:00:14.045 ********
2026-03-19 12:06:17.892117 | controller | skipping: [instance]
2026-03-19 12:06:17.892650 | controller |
2026-03-19 12:06:17.929125 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-03-19 12:06:17.929179 | controller | Thursday 19 March 2026  12:06:17 +0000 (0:00:00.036)       0:00:14.081 ********
2026-03-19 12:06:17.929195 | controller | skipping: [instance]
2026-03-19 12:06:17.929243 | controller |
2026-03-19 12:06:17.929526 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-03-19 12:06:18.461137 | controller | Thursday 19 March 2026  12:06:17 +0000 (0:00:00.037)       0:00:14.119 ********
2026-03-19 12:06:18.461199 | controller | changed: [instance]
2026-03-19 12:06:18.461236 | controller |
2026-03-19 12:06:18.461427 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-03-19 12:06:18.894824 | controller | Thursday 19 March 2026  12:06:18 +0000 (0:00:00.531)       0:00:14.650 ********
2026-03-19 12:06:18.894864 | controller | changed: [instance]
2026-03-19 12:06:18.895066 | controller |
2026-03-19 12:06:18.895260 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-03-19 12:06:18.895413 | controller | Thursday 19 March 2026  12:06:18 +0000 (0:00:00.433)       0:00:15.084 ********
2026-03-19 12:06:18.922664 | controller | skipping: [instance]
2026-03-19 12:06:18.922815 | controller |
2026-03-19 12:06:18.922955 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-03-19 12:06:18.923113 | controller | Thursday 19 March 2026  12:06:18 +0000 (0:00:00.028)       0:00:15.112 ********
2026-03-19 12:06:18.951039 | controller | skipping: [instance]
2026-03-19 12:06:18.951210 | controller |
2026-03-19 12:06:18.951349 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-03-19 12:06:18.951479 | controller | Thursday 19 March 2026  12:06:18 +0000 (0:00:00.028)       0:00:15.141 ********
2026-03-19 12:06:18.980112 | controller | skipping: [instance]
2026-03-19 12:06:18.980309 | controller |
2026-03-19 12:06:18.980481 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-03-19 12:06:18.980615 | controller | Thursday 19 March 2026  12:06:18 +0000 (0:00:00.029)       0:00:15.170 ********
2026-03-19 12:06:19.016724 | controller | ok: [instance]
2026-03-19 12:06:19.016908 | controller |
2026-03-19 12:06:19.017104 | controller | TASK [repo_setup : Create download directory] **********************************
2026-03-19 12:06:19.017287 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.036)       0:00:15.207 ********
2026-03-19 12:06:19.043596 | controller | skipping: [instance]
2026-03-19 12:06:19.043778 | controller |
2026-03-19 12:06:19.043949 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-03-19 12:06:19.044139 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.026)       0:00:15.233 ********
2026-03-19 12:06:19.070178 | controller | skipping: [instance]
2026-03-19 12:06:19.070327 | controller |
2026-03-19 12:06:19.070463 | controller | TASK [Download the RPM] ********************************************************
2026-03-19 12:06:19.070596 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.026)       0:00:15.260 ********
2026-03-19 12:06:19.097615 | controller | skipping: [instance]
2026-03-19 12:06:19.097782 | controller |
2026-03-19 12:06:19.097954 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-03-19 12:06:19.098142 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.027)       0:00:15.287 ********
2026-03-19 12:06:19.125719 | controller | skipping: [instance]
2026-03-19 12:06:19.125901 | controller |
2026-03-19 12:06:19.126078 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-03-19 12:06:19.126239 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.028)       0:00:15.315 ********
2026-03-19 12:06:19.153499 | controller | skipping: [instance]
2026-03-19 12:06:19.153680 | controller |
2026-03-19 12:06:19.153840 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-03-19 12:06:19.153972 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.027)       0:00:15.343 ********
2026-03-19 12:06:19.181766 | controller | skipping: [instance]
2026-03-19 12:06:19.181933 | controller |
2026-03-19 12:06:19.182099 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-03-19 12:06:19.182253 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.028)       0:00:15.372 ********
2026-03-19 12:06:19.207838 | controller | skipping: [instance]
2026-03-19 12:06:19.208031 | controller |
2026-03-19 12:06:19.208233 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-03-19 12:06:19.208400 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.026)       0:00:15.398 ********
2026-03-19 12:06:19.390843 | controller | ok: [instance]
2026-03-19 12:06:19.391003 | controller |
2026-03-19 12:06:19.391194 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-03-19 12:06:19.391332 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.182)       0:00:15.580 ********
2026-03-19 12:06:19.615570 | controller | changed: [instance]
2026-03-19 12:06:19.834716 | controller |
2026-03-19 12:06:19.834744 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-03-19 12:06:19.834752 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.224)       0:00:15.805 ********
2026-03-19 12:06:19.834762 | controller | changed: [instance]
2026-03-19 12:06:19.854040 | controller |
2026-03-19 12:06:19.854062 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-03-19 12:06:19.854069 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.219)       0:00:16.024 ********
2026-03-19 12:06:19.854078 | controller | skipping: [instance]
2026-03-19 12:06:19.876662 | controller |
2026-03-19 12:06:19.876687 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-03-19 12:06:19.876696 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.019)       0:00:16.044 ********
2026-03-19 12:06:19.876707 | controller | skipping: [instance]
2026-03-19 12:06:19.897615 | controller |
2026-03-19 12:06:19.897638 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-03-19 12:06:19.897647 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.022)       0:00:16.066 ********
2026-03-19 12:06:19.897657 | controller | skipping: [instance]
2026-03-19 12:06:19.918579 | controller |
2026-03-19 12:06:19.918598 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-03-19 12:06:19.918606 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.021)       0:00:16.087 ********
2026-03-19 12:06:19.918614 | controller | skipping: [instance]
2026-03-19 12:06:19.939674 | controller |
2026-03-19 12:06:19.939696 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-03-19 12:06:19.939713 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.020)       0:00:16.108 ********
2026-03-19 12:06:19.939724 | controller | skipping: [instance]
2026-03-19 12:06:19.960526 | controller |
2026-03-19 12:06:19.960545 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-03-19 12:06:19.960552 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.020)       0:00:16.129 ********
2026-03-19 12:06:19.960561 | controller | skipping: [instance]
2026-03-19 12:06:19.976658 | controller |
2026-03-19 12:06:19.976681 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-03-19 12:06:19.976690 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.020)       0:00:16.150 ********
2026-03-19 12:06:19.976701 | controller | skipping: [instance]
2026-03-19 12:06:19.976871 | controller |
2026-03-19 12:06:19.977073 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-03-19 12:06:19.977269 | controller | Thursday 19 March 2026  12:06:19 +0000 (0:00:00.016)       0:00:16.166 ********
2026-03-19 12:06:20.005197 | controller | skipping: [instance]
2026-03-19 12:06:20.005380 | controller |
2026-03-19 12:06:20.005519 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-03-19 12:06:20.005657 | controller | Thursday 19 March 2026  12:06:20 +0000 (0:00:00.028)       0:00:16.195 ********
2026-03-19 12:06:20.022809 | controller | skipping: [instance]
2026-03-19 12:06:20.022957 | controller |
2026-03-19 12:06:20.023118 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-03-19 12:06:20.023277 | controller | Thursday 19 March 2026  12:06:20 +0000 (0:00:00.017)       0:00:16.213 ********
2026-03-19 12:06:20.042584 | controller | skipping: [instance]
2026-03-19 12:06:20.042763 | controller |
2026-03-19 12:06:20.042931 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2026-03-19 12:06:20.043119 | controller | Thursday 19 March 2026  12:06:20 +0000 (0:00:00.019)       0:00:16.232 ********
2026-03-19 12:06:20.071084 | controller | skipping: [instance]
2026-03-19 12:06:20.071281 | controller |
2026-03-19 12:06:20.071447 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2026-03-19 12:06:20.071590 | controller | Thursday 19 March 2026  12:06:20 +0000 (0:00:00.028)       0:00:16.261 ********
2026-03-19 12:06:20.099666 | controller | skipping: [instance]
2026-03-19 12:06:20.099816 | controller |
2026-03-19 12:06:20.099956 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2026-03-19 12:06:20.100111 | controller | Thursday 19 March 2026  12:06:20 +0000 (0:00:00.028)       0:00:16.289 ********
2026-03-19 12:06:20.127950 | controller | skipping: [instance]
2026-03-19 12:06:20.128171 | controller |
2026-03-19 12:06:20.128349 | controller | TASK [test_deps : Install additional packages] *********************************
2026-03-19 12:06:20.128511 | controller | Thursday 19 March 2026  12:06:20 +0000 (0:00:00.028)       0:00:16.318 ********
2026-03-19 12:06:20.154998 | controller | skipping: [instance]
2026-03-19 12:06:20.155216 | controller |
2026-03-19 12:06:20.155361 | controller | TASK [test_deps : Install selinux python libs] *********************************
2026-03-19 12:06:20.155504 | controller | Thursday 19 March 2026  12:06:20 +0000 (0:00:00.027)       0:00:16.345 ********
2026-03-19 12:07:15.418576 | controller | ok: [instance]
2026-03-19 12:07:16.648671 | controller |
2026-03-19 12:07:16.648702 | controller | TASK [test_deps : Install python yaml libs] ************************************
2026-03-19 12:07:16.648710 | controller | Thursday 19 March 2026  12:07:15 +0000 (0:00:55.262)       0:01:11.608 ********
2026-03-19 12:07:16.648720 | controller | ok: [instance]
2026-03-19 12:07:16.679619 | controller |
2026-03-19 12:07:16.679642 | controller | TASK [test_deps : Install extra packages] **************************************
2026-03-19 12:07:16.679651 | controller | Thursday 19 March 2026  12:07:16 +0000 (0:00:01.230)       0:01:12.838 ********
2026-03-19 12:07:16.679662 | controller | skipping: [instance]
2026-03-19 12:07:16.722182 | controller |
2026-03-19 12:07:16.722220 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-03-19 12:07:16.722230 | controller | Thursday 19 March 2026  12:07:16 +0000 (0:00:00.031)       0:01:12.869 ********
2026-03-19 12:07:16.722242 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2026-03-19 12:07:16.722260 | controller |
2026-03-19 12:07:16.722268 | controller | TASK [ci_setup : List packages to install] *************************************
2026-03-19 12:07:16.722278 | controller | Thursday 19 March 2026  12:07:16 +0000 (0:00:00.042)       0:01:12.912 ********
2026-03-19 12:07:16.741187 | controller | ok: [instance] =>
2026-03-19 12:07:16.741634 | controller |   cifmw_ci_setup_packages:
2026-03-19 12:07:16.741651 | controller |   - bash-completion
2026-03-19 12:07:16.741657 | controller |   - ca-certificates
2026-03-19 12:07:16.741663 | controller |   - git-core
2026-03-19 12:07:16.741669 | controller |   - make
2026-03-19 12:07:16.741674 | controller |   - tar
2026-03-19 12:07:16.741683 | controller |   - tmux
2026-03-19 12:07:20.667683 | controller |   - python3-pip
2026-03-19 12:07:20.667726 | controller |
2026-03-19 12:07:20.667735 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-03-19 12:07:20.667741 | controller | Thursday 19 March 2026  12:07:16 +0000 (0:00:00.018)       0:01:12.930 ********
2026-03-19 12:07:20.667751 | controller | changed: [instance]
2026-03-19 12:07:21.217026 | controller |
2026-03-19 12:07:21.217057 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-03-19 12:07:21.217064 | controller | Thursday 19 March 2026  12:07:20 +0000 (0:00:03.926)       0:01:16.857 ********
2026-03-19 12:07:21.217074 | controller | ok: [instance]
2026-03-19 12:07:21.411087 | controller |
2026-03-19 12:07:21.411119 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-03-19 12:07:21.411127 | controller | Thursday 19 March 2026  12:07:21 +0000 (0:00:00.549)       0:01:17.406 ********
2026-03-19 12:07:21.411138 | controller | changed: [instance]
2026-03-19 12:07:21.411161 | controller |
2026-03-19 12:07:21.411170 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-03-19 12:07:21.411256 | controller | Thursday 19 March 2026  12:07:21 +0000 (0:00:00.194)       0:01:17.601 ********
2026-03-19 12:07:26.274818 | controller | changed: [instance]
2026-03-19 12:07:26.310112 | controller |
2026-03-19 12:07:26.310151 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-03-19 12:07:26.310162 | controller | Thursday 19 March 2026  12:07:26 +0000 (0:00:04.863)       0:01:22.464 ********
2026-03-19 12:07:26.310176 | controller | ok: [instance]
2026-03-19 12:07:26.574117 | controller |
2026-03-19 12:07:26.574152 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-03-19 12:07:26.574162 | controller | Thursday 19 March 2026  12:07:26 +0000 (0:00:00.035)       0:01:22.500 ********
2026-03-19 12:07:26.574174 | controller | changed: [instance]
2026-03-19 12:07:26.574206 | controller |
2026-03-19 12:07:26.574387 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-03-19 12:07:26.843556 | controller | Thursday 19 March 2026  12:07:26 +0000 (0:00:00.263)       0:01:22.764 ********
2026-03-19 12:07:26.843590 | controller | changed: [instance]
2026-03-19 12:07:26.861084 | controller |
2026-03-19 12:07:26.861117 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-03-19 12:07:26.861125 | controller | Thursday 19 March 2026  12:07:26 +0000 (0:00:00.269)       0:01:23.033 ********
2026-03-19 12:07:26.861135 | controller | skipping: [instance]
2026-03-19 12:07:26.861160 | controller |
2026-03-19 12:07:26.861168 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-03-19 12:07:26.861247 | controller | Thursday 19 March 2026  12:07:26 +0000 (0:00:00.017)       0:01:23.051 ********
2026-03-19 12:07:26.877069 | controller | skipping: [instance]
2026-03-19 12:07:26.877112 | controller |
2026-03-19 12:07:26.877354 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-03-19 12:07:26.894061 | controller | Thursday 19 March 2026  12:07:26 +0000 (0:00:00.015)       0:01:23.067 ********
2026-03-19 12:07:26.894087 | controller | skipping: [instance]
2026-03-19 12:07:26.910137 | controller |
2026-03-19 12:07:26.910179 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-03-19 12:07:26.910189 | controller | Thursday 19 March 2026  12:07:26 +0000 (0:00:00.016)       0:01:23.083 ********
2026-03-19 12:07:26.910202 | controller | skipping: [instance]
2026-03-19 12:07:26.926115 | controller |
2026-03-19 12:07:26.926158 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-03-19 12:07:26.926184 | controller | Thursday 19 March 2026  12:07:26 +0000 (0:00:00.016)       0:01:23.099 ********
2026-03-19 12:07:26.926199 | controller | skipping: [instance]
2026-03-19 12:07:26.947130 | controller |
2026-03-19 12:07:26.947152 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-03-19 12:07:26.947161 | controller | Thursday 19 March 2026  12:07:26 +0000 (0:00:00.016)       0:01:23.116 ********
2026-03-19 12:07:26.947172 | controller | skipping: [instance]
2026-03-19 12:07:26.947387 | controller |
2026-03-19 12:07:26.947414 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-03-19 12:07:27.887162 | controller | Thursday 19 March 2026  12:07:26 +0000 (0:00:00.021)       0:01:23.137 ********
2026-03-19 12:07:27.887199 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2026-03-19 12:07:27.887727 | controller | changed: [instance] => (item=/opt/basedir/logs)
2026-03-19 12:07:27.887759 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2026-03-19 12:07:28.210106 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2026-03-19 12:07:28.210139 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2026-03-19 12:07:28.210148 | controller |
2026-03-19 12:07:28.210156 | controller | TASK [Create secret file] ******************************************************
2026-03-19 12:07:28.210163 | controller | Thursday 19 March 2026  12:07:27 +0000 (0:00:00.939)       0:01:24.077 ********
2026-03-19 12:07:28.210174 | controller | changed: [instance]
2026-03-19 12:07:28.210195 | controller |
2026-03-19 12:07:28.210202 | controller | PLAY RECAP *********************************************************************
2026-03-19 12:07:28.210217 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2026-03-19 12:07:28.212128 | controller |
2026-03-19 12:07:28.212167 | controller | Thursday 19 March 2026  12:07:28 +0000 (0:00:00.322)       0:01:24.399 ********
2026-03-19 12:07:28.254894 | controller | ===============================================================================
2026-03-19 12:07:28.254921 | controller | test_deps : Install selinux python libs -------------------------------- 55.26s
2026-03-19 12:07:28.254928 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.49s
2026-03-19 12:07:28.254934 | controller | ci_setup : Install openshift client ------------------------------------- 4.86s
2026-03-19 12:07:28.254939 | controller | ci_setup : Install needed packages -------------------------------------- 3.93s
2026-03-19 12:07:28.254945 | controller | test_deps : Install python yaml libs ------------------------------------ 1.23s
2026-03-19 12:07:28.254950 | controller | repo_setup : Run repo-setup --------------------------------------------- 1.10s
2026-03-19 12:07:28.254955 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.00s
2026-03-19 12:07:28.254960 | controller | ci_setup : Manage directories ------------------------------------------- 0.94s
2026-03-19 12:07:28.254965 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.83s
2026-03-19 12:07:28.254971 | controller | Gathering Facts --------------------------------------------------------- 0.81s
2026-03-19 12:07:28.254976 | controller | repo_setup : Install repo-setup package --------------------------------- 0.68s
2026-03-19 12:07:28.254981 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.67s
2026-03-19 12:07:28.254986 | controller | ci_setup : Gather version of openshift client --------------------------- 0.55s
2026-03-19 12:07:28.254991 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s
2026-03-19 12:07:28.254997 | controller | repo_setup : Ensure directories are present ----------------------------- 0.51s
2026-03-19 12:07:28.255002 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s
2026-03-19 12:07:28.255078 | controller | Create secret file ------------------------------------------------------ 0.32s
2026-03-19 12:07:28.255085 | controller | Create custom basedir --------------------------------------------------- 0.30s
2026-03-19 12:07:28.255091 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.27s
2026-03-19 12:07:28.255102 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.27s
2026-03-19 12:07:28.255111 | controller | INFO     Running crc_layout > converge
2026-03-19 12:07:28.840263 | controller |
2026-03-19 12:07:28.840453 | controller | PLAY [Converge] ****************************************************************
2026-03-19 12:07:28.840614 | controller |
2026-03-19 12:07:28.840755 | controller | TASK [Gathering Facts] *********************************************************
2026-03-19 12:07:28.840884 | controller | Thursday 19 March 2026  12:07:28 +0000 (0:00:00.026)       0:00:00.026 ********
2026-03-19 12:07:29.645972 | controller | ok: [instance]
2026-03-19 12:07:29.666213 | controller |
2026-03-19 12:07:29.666252 | controller | TASK [Load networking definition from scenario file] ***************************
2026-03-19 12:07:29.666262 | controller | Thursday 19 March 2026  12:07:29 +0000 (0:00:00.805)       0:00:00.832 ********
2026-03-19 12:07:29.666274 | controller | ok: [instance]
2026-03-19 12:07:29.682915 | controller |
2026-03-19 12:07:29.682941 | controller | TASK [discover_latest_image : Set the discovered images dict to empty] *********
2026-03-19 12:07:29.682950 | controller | Thursday 19 March 2026  12:07:29 +0000 (0:00:00.020)       0:00:00.852 ********
2026-03-19 12:07:29.682961 | controller | ok: [instance]
2026-03-19 12:07:29.720826 | controller |
2026-03-19 12:07:29.720845 | controller | TASK [discover_latest_image : Discover images] *********************************
2026-03-19 12:07:29.720852 | controller | Thursday 19 March 2026  12:07:29 +0000 (0:00:00.016)       0:00:00.869 ********
2026-03-19 12:07:29.720867 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/discover_latest_image/tasks/per-image.yml for instance => (item={'key': 'default', 'value': {'base_url': 'https://cloud.centos.org/centos/9-stream/x86_64/images/', 'qcow_prefix': 'CentOS-Stream-GenericCloud-', 'images_file': 'CHECKSUM'}})
2026-03-19 12:07:29.760776 | controller |
2026-03-19 12:07:29.760794 | controller | TASK [discover_latest_image : Ensure the current image dict entry has the expected data] ***
2026-03-19 12:07:29.760802 | controller | Thursday 19 March 2026  12:07:29 +0000 (0:00:00.037)       0:00:00.907 ********
2026-03-19 12:07:29.760811 | controller | ok: [instance] => changed=false
2026-03-19 12:07:31.244470 | controller |   msg: All assertions passed
2026-03-19 12:07:31.244503 | controller |
2026-03-19 12:07:31.244515 | controller | TASK [discover_latest_image : Get latest image for the current entry] **********
2026-03-19 12:07:31.244521 | controller | Thursday 19 March 2026  12:07:29 +0000 (0:00:00.039)       0:00:00.947 ********
2026-03-19 12:07:31.244531 | controller | changed: [instance]
2026-03-19 12:07:31.275123 | controller |
2026-03-19 12:07:31.275164 | controller | TASK [discover_latest_image : Append the current return value to the discovered images dict] ***
2026-03-19 12:07:31.275172 | controller | Thursday 19 March 2026  12:07:31 +0000 (0:00:01.483)       0:00:02.431 ********
2026-03-19 12:07:31.275183 | controller | ok: [instance]
2026-03-19 12:07:31.275206 | controller |
2026-03-19 12:07:31.275214 | controller | TASK [discover_latest_image : Export single-image facts if an image with name 'default' was discovered] ***
2026-03-19 12:07:31.275561 | controller | Thursday 19 March 2026  12:07:31 +0000 (0:00:00.030)       0:00:02.462 ********
2026-03-19 12:07:31.305780 | controller | ok: [instance]
2026-03-19 12:07:31.326607 | controller |
2026-03-19 12:07:31.326626 | controller | TASK [reproducer : Load CI job environment] ************************************
2026-03-19 12:07:31.326634 | controller | Thursday 19 March 2026  12:07:31 +0000 (0:00:00.030)       0:00:02.492 ********
2026-03-19 12:07:31.326643 | controller | skipping: [instance]
2026-03-19 12:07:31.376166 | controller |
2026-03-19 12:07:31.376209 | controller | TASK [Build final libvirt layout] **********************************************
2026-03-19 12:07:31.376220 | controller | Thursday 19 March 2026  12:07:31 +0000 (0:00:00.020)       0:00:02.513 ********
2026-03-19 12:07:31.376233 | controller |
2026-03-19 12:07:31.376240 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2026-03-19 12:07:31.376249 | controller | Thursday 19 March 2026  12:07:31 +0000 (0:00:00.049)       0:00:02.563 ********
2026-03-19 12:07:31.458593 | controller | ok: [instance]
2026-03-19 12:07:31.523755 | controller |
2026-03-19 12:07:31.523775 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2026-03-19 12:07:31.523783 | controller | Thursday 19 March 2026  12:07:31 +0000 (0:00:00.082)       0:00:02.645 ********
2026-03-19 12:07:31.523799 | controller | skipping: [instance]
2026-03-19 12:07:31.549083 | controller |
2026-03-19 12:07:31.549100 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2026-03-19 12:07:31.549107 | controller | Thursday 19 March 2026  12:07:31 +0000 (0:00:00.065)       0:00:02.710 ********
2026-03-19 12:07:31.549115 | controller | ok: [instance]
2026-03-19 12:07:31.549251 | controller |
2026-03-19 12:07:31.549387 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2026-03-19 12:07:31.549518 | controller | Thursday 19 March 2026  12:07:31 +0000 (0:00:00.025)       0:00:02.736 ********
2026-03-19 12:07:31.572779 | controller | ok: [instance] => changed=false
2026-03-19 12:07:31.572928 | controller |   msg: All assertions passed
2026-03-19 12:07:31.573081 | controller |
2026-03-19 12:07:31.573223 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2026-03-19 12:07:31.573359 | controller | Thursday 19 March 2026  12:07:31 +0000 (0:00:00.023)       0:00:02.760 ********
2026-03-19 12:07:31.613841 | controller | ok: [instance]
2026-03-19 12:07:31.613977 | controller |
2026-03-19 12:07:31.614134 | controller | TASK [reproducer : Ensure directories are present] *****************************
2026-03-19 12:07:31.614267 | controller | Thursday 19 March 2026  12:07:31 +0000 (0:00:00.040)       0:00:02.801 ********
2026-03-19 12:07:32.057902 | controller | ok: [instance] => (item=artifacts)
2026-03-19 12:07:32.132551 | controller | ok: [instance] => (item=logs)
2026-03-19 12:07:32.132586 | controller |
2026-03-19 12:07:32.132596 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2026-03-19 12:07:32.132603 | controller | Thursday 19 March 2026  12:07:32 +0000 (0:00:00.443)       0:00:03.244 ********
2026-03-19 12:07:32.132614 | controller |
2026-03-19 12:07:32.317193 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2026-03-19 12:07:32.317242 | controller | Thursday 19 March 2026  12:07:32 +0000 (0:00:00.074)       0:00:03.319 ********
2026-03-19 12:07:32.317263 | controller | ok: [instance]
2026-03-19 12:07:32.595880 | controller |
2026-03-19 12:07:32.595905 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2026-03-19 12:07:32.595913 | controller | Thursday 19 March 2026  12:07:32 +0000 (0:00:00.184)       0:00:03.503 ********
2026-03-19 12:07:32.595923 | controller | changed: [instance]
2026-03-19 12:07:32.868066 | controller |
2026-03-19 12:07:32.868089 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2026-03-19 12:07:32.868097 | controller | Thursday 19 March 2026  12:07:32 +0000 (0:00:00.278)       0:00:03.782 ********
2026-03-19 12:07:32.868106 | controller | ok: [instance]
2026-03-19 12:07:32.868131 | controller |
2026-03-19 12:07:32.868347 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2026-03-19 12:07:32.897154 | controller | Thursday 19 March 2026  12:07:32 +0000 (0:00:00.272)       0:00:04.054 ********
2026-03-19 12:07:32.897210 | controller | skipping: [instance]
2026-03-19 12:07:32.897243 | controller |
2026-03-19 12:07:32.897253 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2026-03-19 12:07:32.897378 | controller | Thursday 19 March 2026  12:07:32 +0000 (0:00:00.029)       0:00:04.084 ********
2026-03-19 12:07:32.915585 | controller | skipping: [instance]
2026-03-19 12:07:32.936444 | controller |
2026-03-19 12:07:32.936467 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2026-03-19 12:07:32.936477 | controller | Thursday 19 March 2026  12:07:32 +0000 (0:00:00.018)       0:00:04.102 ********
2026-03-19 12:07:32.936488 | controller | ok: [instance]
2026-03-19 12:07:32.964945 | controller |
2026-03-19 12:07:32.964966 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2026-03-19 12:07:32.964975 | controller | Thursday 19 March 2026  12:07:32 +0000 (0:00:00.020)       0:00:04.123 ********
2026-03-19 12:07:32.964986 | controller | skipping: [instance]
2026-03-19 12:07:42.666902 | controller |
2026-03-19 12:07:42.666933 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2026-03-19 12:07:42.666941 | controller | Thursday 19 March 2026  12:07:32 +0000 (0:00:00.028)       0:00:04.151 ********
2026-03-19 12:07:42.666952 | controller | changed: [instance]
2026-03-19 12:07:42.869518 | controller |
2026-03-19 12:07:42.869550 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2026-03-19 12:07:42.869565 | controller | Thursday 19 March 2026  12:07:42 +0000 (0:00:09.701)       0:00:13.853 ********
2026-03-19 12:07:42.869576 | controller | changed: [instance]
2026-03-19 12:07:42.869696 | controller |
2026-03-19 12:07:42.869708 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2026-03-19 12:07:43.345770 | controller | Thursday 19 March 2026  12:07:42 +0000 (0:00:00.202)       0:00:14.056 ********
2026-03-19 12:07:43.345804 | controller | changed: [instance]
2026-03-19 12:07:43.912465 | controller |
2026-03-19 12:07:43.912488 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2026-03-19 12:07:43.912496 | controller | Thursday 19 March 2026  12:07:43 +0000 (0:00:00.476)       0:00:14.532 ********
2026-03-19 12:07:43.912505 | controller | changed: [instance]
2026-03-19 12:07:44.101827 | controller |
2026-03-19 12:07:44.101846 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2026-03-19 12:07:44.101853 | controller | Thursday 19 March 2026  12:07:43 +0000 (0:00:00.566)       0:00:15.099 ********
2026-03-19 12:07:44.101862 | controller | ok: [instance]
2026-03-19 12:07:44.750031 | controller |
2026-03-19 12:07:44.750059 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2026-03-19 12:07:44.750067 | controller | Thursday 19 March 2026  12:07:44 +0000 (0:00:00.189)       0:00:15.288 ********
2026-03-19 12:07:44.750078 | controller | ok: [instance]
2026-03-19 12:07:45.483172 | controller |
2026-03-19 12:07:45.483201 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2026-03-19 12:07:45.483209 | controller | Thursday 19 March 2026  12:07:44 +0000 (0:00:00.648)       0:00:15.936 ********
2026-03-19 12:07:45.483219 | controller | changed: [instance]
2026-03-19 12:07:45.564195 | controller |
2026-03-19 12:07:45.564230 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2026-03-19 12:07:45.564240 | controller | Thursday 19 March 2026  12:07:45 +0000 (0:00:00.733)       0:00:16.669 ********
2026-03-19 12:07:45.564252 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2026-03-19 12:07:45.564283 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2026-03-19 12:07:45.564292 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2026-03-19 12:07:45.564301 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2026-03-19 12:07:45.564981 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2026-03-19 12:07:45.893516 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2026-03-19 12:07:45.893543 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2026-03-19 12:07:45.893550 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2026-03-19 12:07:45.893556 | controller |
2026-03-19 12:07:45.893563 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2026-03-19 12:07:45.893569 | controller | Thursday 19 March 2026  12:07:45 +0000 (0:00:00.081)       0:00:16.751 ********
2026-03-19 12:07:45.893578 | controller | ok: [instance]
2026-03-19 12:07:46.205678 | controller |
2026-03-19 12:07:46.205697 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2026-03-19 12:07:46.205704 | controller | Thursday 19 March 2026  12:07:45 +0000 (0:00:00.329)       0:00:17.080 ********
2026-03-19 12:07:46.205712 | controller | ok: [instance]
2026-03-19 12:07:46.509260 | controller |
2026-03-19 12:07:46.509279 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2026-03-19 12:07:46.509292 | controller | Thursday 19 March 2026  12:07:46 +0000 (0:00:00.312)       0:00:17.392 ********
2026-03-19 12:07:46.509301 | controller | ok: [instance]
2026-03-19 12:07:46.820161 | controller |
2026-03-19 12:07:46.820199 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2026-03-19 12:07:46.820209 | controller | Thursday 19 March 2026  12:07:46 +0000 (0:00:00.303)       0:00:17.695 ********
2026-03-19 12:07:46.820222 | controller | ok: [instance]
2026-03-19 12:07:46.820254 | controller |
2026-03-19 12:07:46.820645 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2026-03-19 12:07:47.128949 | controller | Thursday 19 March 2026  12:07:46 +0000 (0:00:00.311)       0:00:18.007 ********
2026-03-19 12:07:47.128988 | controller | ok: [instance]
2026-03-19 12:07:47.434104 | controller |
2026-03-19 12:07:47.434144 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2026-03-19 12:07:47.434155 | controller | Thursday 19 March 2026  12:07:47 +0000 (0:00:00.308)       0:00:18.315 ********
2026-03-19 12:07:47.434168 | controller | ok: [instance]
2026-03-19 12:07:47.744124 | controller |
2026-03-19 12:07:47.744158 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2026-03-19 12:07:47.744168 | controller | Thursday 19 March 2026  12:07:47 +0000 (0:00:00.305)       0:00:18.620 ********
2026-03-19 12:07:47.744180 | controller | ok: [instance]
2026-03-19 12:07:47.744220 | controller |
2026-03-19 12:07:47.744229 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2026-03-19 12:07:47.744238 | controller | Thursday 19 March 2026  12:07:47 +0000 (0:00:00.310)       0:00:18.930 ********
2026-03-19 12:07:48.046582 | controller | ok: [instance]
2026-03-19 12:07:48.361146 | controller |
2026-03-19 12:07:48.361179 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2026-03-19 12:07:48.361187 | controller | Thursday 19 March 2026  12:07:48 +0000 (0:00:00.302)       0:00:19.233 ********
2026-03-19 12:07:48.361197 | controller | ok: [instance]
2026-03-19 12:07:48.361529 | controller |
2026-03-19 12:07:48.361565 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2026-03-19 12:07:48.665092 | controller | Thursday 19 March 2026  12:07:48 +0000 (0:00:00.314)       0:00:19.547 ********
2026-03-19 12:07:48.665130 | controller | ok: [instance]
2026-03-19 12:07:48.965739 | controller |
2026-03-19 12:07:48.965778 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2026-03-19 12:07:48.965791 | controller | Thursday 19 March 2026  12:07:48 +0000 (0:00:00.303)       0:00:19.851 ********
2026-03-19 12:07:48.965805 | controller | ok: [instance]
2026-03-19 12:07:49.269940 | controller |
2026-03-19 12:07:49.269964 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2026-03-19 12:07:49.269973 | controller | Thursday 19 March 2026  12:07:48 +0000 (0:00:00.300)       0:00:20.152 ********
2026-03-19 12:07:49.269984 | controller | ok: [instance]
2026-03-19 12:07:49.571086 | controller |
2026-03-19 12:07:49.571119 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2026-03-19 12:07:49.571128 | controller | Thursday 19 March 2026  12:07:49 +0000 (0:00:00.304)       0:00:20.456 ********
2026-03-19 12:07:49.571138 | controller | ok: [instance]
2026-03-19 12:07:49.571162 | controller |
2026-03-19 12:07:49.571171 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2026-03-19 12:07:49.571248 | controller | Thursday 19 March 2026  12:07:49 +0000 (0:00:00.301)       0:00:20.757 ********
2026-03-19 12:07:49.882618 | controller | ok: [instance]
2026-03-19 12:07:50.192671 | controller |
2026-03-19 12:07:50.192702 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2026-03-19 12:07:50.192714 | controller | Thursday 19 March 2026  12:07:49 +0000 (0:00:00.311)       0:00:21.069 ********
2026-03-19 12:07:50.192729 | controller | ok: [instance]
2026-03-19 12:07:50.492705 | controller |
2026-03-19 12:07:50.492724 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2026-03-19 12:07:50.492732 | controller | Thursday 19 March 2026  12:07:50 +0000 (0:00:00.310)       0:00:21.379 ********
2026-03-19 12:07:50.492741 | controller | ok: [instance]
2026-03-19 12:07:50.789582 | controller |
2026-03-19 12:07:50.789605 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2026-03-19 12:07:50.789621 | controller | Thursday 19 March 2026  12:07:50 +0000 (0:00:00.299)       0:00:21.679 ********
2026-03-19 12:07:50.789632 | controller | ok: [instance]
2026-03-19 12:07:51.094892 | controller |
2026-03-19 12:07:51.094912 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2026-03-19 12:07:51.094919 | controller | Thursday 19 March 2026  12:07:50 +0000 (0:00:00.297)       0:00:21.976 ********
2026-03-19 12:07:51.094928 | controller | ok: [instance]
2026-03-19 12:07:51.397604 | controller |
2026-03-19 12:07:51.397623 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2026-03-19 12:07:51.397630 | controller | Thursday 19 March 2026  12:07:51 +0000 (0:00:00.305)       0:00:22.281 ********
2026-03-19 12:07:51.397639 | controller | ok: [instance]
2026-03-19 12:07:51.700090 | controller |
2026-03-19 12:07:51.700123 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2026-03-19 12:07:51.700131 | controller | Thursday 19 March 2026  12:07:51 +0000 (0:00:00.302)       0:00:22.584 ********
2026-03-19 12:07:51.700146 | controller | ok: [instance]
2026-03-19 12:07:52.000653 | controller |
2026-03-19 12:07:52.000684 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2026-03-19 12:07:52.000693 | controller | Thursday 19 March 2026  12:07:51 +0000 (0:00:00.302)       0:00:22.887 ********
2026-03-19 12:07:52.000703 | controller | ok: [instance]
2026-03-19 12:07:52.305185 | controller |
2026-03-19 12:07:52.305234 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2026-03-19 12:07:52.305247 | controller | Thursday 19 March 2026  12:07:51 +0000 (0:00:00.300)       0:00:23.187 ********
2026-03-19 12:07:52.305264 | controller | ok: [instance]
2026-03-19 12:07:52.305318 | controller |
2026-03-19 12:07:52.305348 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2026-03-19 12:07:52.611621 | controller | Thursday 19 March 2026  12:07:52 +0000 (0:00:00.304)       0:00:23.491 ********
2026-03-19 12:07:52.611667 | controller | ok: [instance]
2026-03-19 12:07:52.912471 | controller |
2026-03-19 12:07:52.912498 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2026-03-19 12:07:52.912506 | controller | Thursday 19 March 2026  12:07:52 +0000 (0:00:00.306)       0:00:23.798 ********
2026-03-19 12:07:52.912516 | controller | ok: [instance]
2026-03-19 12:07:52.932087 | controller |
2026-03-19 12:07:52.932128 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2026-03-19 12:07:52.932137 | controller | Thursday 19 March 2026  12:07:52 +0000 (0:00:00.300)       0:00:24.099 ********
2026-03-19 12:07:52.932147 | controller | skipping: [instance]
2026-03-19 12:07:52.932173 | controller |
2026-03-19 12:07:52.932350 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2026-03-19 12:07:53.209457 | controller | Thursday 19 March 2026  12:07:52 +0000 (0:00:00.019)       0:00:24.119 ********
2026-03-19 12:07:53.209480 | controller | ok: [instance]
2026-03-19 12:07:53.577649 | controller |
2026-03-19 12:07:53.577671 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2026-03-19 12:07:53.577679 | controller | Thursday 19 March 2026  12:07:53 +0000 (0:00:00.277)       0:00:24.396 ********
2026-03-19 12:07:53.577688 | controller | ok: [instance]
2026-03-19 12:07:53.873802 | controller |
2026-03-19 12:07:53.873826 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2026-03-19 12:07:53.873835 | controller | Thursday 19 March 2026  12:07:53 +0000 (0:00:00.368)       0:00:24.764 ********
2026-03-19 12:07:53.873846 | controller | changed: [instance]
2026-03-19 12:07:54.141316 | controller |
2026-03-19 12:07:54.141364 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2026-03-19 12:07:54.141374 | controller | Thursday 19 March 2026  12:07:53 +0000 (0:00:00.295)       0:00:25.060 ********
2026-03-19 12:07:54.141386 | controller | [WARNING]: Reset is not implemented for this connection
2026-03-19 12:07:54.151143 | controller | changed: [instance]
2026-03-19 12:07:54.151229 | controller |
2026-03-19 12:07:54.151250 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2026-03-19 12:07:54.151259 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.262)       0:00:25.322 ********
2026-03-19 12:07:54.151266 | controller |
2026-03-19 12:07:54.151280 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2026-03-19 12:07:54.151291 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.015)       0:00:25.337 ********
2026-03-19 12:07:54.224253 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2026-03-19 12:07:54.265138 | controller |
2026-03-19 12:07:54.265162 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2026-03-19 12:07:54.265172 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.073)       0:00:25.411 ********
2026-03-19 12:07:54.265183 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2026-03-19 12:07:54.265212 | controller |
2026-03-19 12:07:54.265220 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-19 12:07:54.265229 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.040)       0:00:25.451 ********
2026-03-19 12:07:54.311769 | controller | ok: [instance] => (item=compute)
2026-03-19 12:07:54.352240 | controller | ok: [instance] => (item=controller)
2026-03-19 12:07:54.352263 | controller | ok: [instance] => (item=crc)
2026-03-19 12:07:54.352272 | controller |
2026-03-19 12:07:54.352280 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-19 12:07:54.352287 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.046)       0:00:25.498 ********
2026-03-19 12:07:54.352297 | controller | ok: [instance]
2026-03-19 12:07:54.352478 | controller |
2026-03-19 12:07:54.352641 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-19 12:07:54.352798 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.041)       0:00:25.539 ********
2026-03-19 12:07:54.394948 | controller | ok: [instance] => changed=false
2026-03-19 12:07:54.395123 | controller |   msg: All assertions passed
2026-03-19 12:07:54.395255 | controller |
2026-03-19 12:07:54.395396 | controller | TASK [Ensure we get latest OCP config] *****************************************
2026-03-19 12:07:54.395531 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.042)       0:00:25.582 ********
2026-03-19 12:07:54.451842 | controller |
2026-03-19 12:07:54.451998 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2026-03-19 12:07:54.452170 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.056)       0:00:25.639 ********
2026-03-19 12:07:54.528185 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.54', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2026-03-19 12:07:54.528404 | controller | ok: [instance] => (item={})
2026-03-19 12:07:54.528533 | controller |
2026-03-19 12:07:54.528664 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2026-03-19 12:07:54.528791 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.076)       0:00:25.715 ********
2026-03-19 12:07:54.544217 | controller | skipping: [instance]
2026-03-19 12:07:54.544503 | controller |
2026-03-19 12:07:54.544752 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2026-03-19 12:07:54.544964 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.016)       0:00:25.731 ********
2026-03-19 12:07:54.746991 | controller | ok: [instance]
2026-03-19 12:07:54.747228 | controller |
2026-03-19 12:07:54.747437 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2026-03-19 12:07:54.747617 | controller | Thursday 19 March 2026  12:07:54 +0000 (0:00:00.202)       0:00:25.934 ********
2026-03-19 12:07:55.082094 | controller | changed: [instance]
2026-03-19 12:07:55.082192 | controller |
2026-03-19 12:07:55.082210 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2026-03-19 12:07:55.082228 | controller | Thursday 19 March 2026  12:07:55 +0000 (0:00:00.334)       0:00:26.269 ********
2026-03-19 12:07:55.799024 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2026-03-19 12:07:55.823670 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2026-03-19 12:07:55.823701 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2026-03-19 12:07:55.823714 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2026-03-19 12:07:55.823724 | controller |
2026-03-19 12:07:55.823735 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2026-03-19 12:07:55.823745 | controller | Thursday 19 March 2026  12:07:55 +0000 (0:00:00.716)       0:00:26.985 ********
2026-03-19 12:07:55.823757 | controller | skipping: [instance]
2026-03-19 12:07:56.178149 | controller |
2026-03-19 12:07:56.178184 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2026-03-19 12:07:56.178194 | controller | Thursday 19 March 2026  12:07:55 +0000 (0:00:00.024)       0:00:27.010 ********
2026-03-19 12:07:56.178205 | controller | changed: [instance]
2026-03-19 12:07:56.178236 | controller |
2026-03-19 12:07:56.178246 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2026-03-19 12:07:56.178596 | controller | Thursday 19 March 2026  12:07:56 +0000 (0:00:00.346)       0:00:27.356 ********
2026-03-19 12:07:56.604102 | controller |
2026-03-19 12:07:56.604136 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-19 12:07:56.604145 | controller | Thursday 19 March 2026  12:07:56 +0000 (0:00:00.008)       0:00:27.365 ********
2026-03-19 12:07:56.604156 | controller | changed: [instance]
2026-03-19 12:07:56.604187 | controller |
2026-03-19 12:07:56.604197 | controller | TASK [Ensure no default networks exists] ***************************************
2026-03-19 12:07:56.604285 | controller | Thursday 19 March 2026  12:07:56 +0000 (0:00:00.425)       0:00:27.790 ********
2026-03-19 12:07:56.676651 | controller |
2026-03-19 12:07:57.818031 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2026-03-19 12:07:57.818070 | controller | Thursday 19 March 2026  12:07:56 +0000 (0:00:00.072)       0:00:27.863 ********
2026-03-19 12:07:57.818084 | controller | ok: [instance]
2026-03-19 12:07:58.035586 | controller |
2026-03-19 12:07:58.035615 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2026-03-19 12:07:58.035623 | controller | Thursday 19 March 2026  12:07:57 +0000 (0:00:01.140)       0:00:29.004 ********
2026-03-19 12:07:58.035633 | controller | ok: [instance]
2026-03-19 12:07:58.546763 | controller |
2026-03-19 12:07:58.546797 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2026-03-19 12:07:58.546805 | controller | Thursday 19 March 2026  12:07:58 +0000 (0:00:00.218)       0:00:29.222 ********
2026-03-19 12:07:58.546815 | controller | ok: [instance]
2026-03-19 12:07:58.762808 | controller |
2026-03-19 12:07:58.762837 | controller | TASK [libvirt_manager : Removing default] **************************************
2026-03-19 12:07:58.762848 | controller | Thursday 19 March 2026  12:07:58 +0000 (0:00:00.510)       0:00:29.733 ********
2026-03-19 12:07:58.762858 | controller | ok: [instance]
2026-03-19 12:07:59.945101 | controller |
2026-03-19 12:07:59.945135 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2026-03-19 12:07:59.945143 | controller | Thursday 19 March 2026  12:07:58 +0000 (0:00:00.216)       0:00:29.949 ********
2026-03-19 12:07:59.945154 | controller | ok: [instance]
2026-03-19 12:07:59.945178 | controller |
2026-03-19 12:07:59.945186 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2026-03-19 12:07:59.945348 | controller | Thursday 19 March 2026  12:07:59 +0000 (0:00:01.182)       0:00:31.131 ********
2026-03-19 12:08:00.241726 | controller | ok: [instance]
2026-03-19 12:08:00.530892 | controller |
2026-03-19 12:08:00.530919 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2026-03-19 12:08:00.530927 | controller | Thursday 19 March 2026  12:08:00 +0000 (0:00:00.296)       0:00:31.428 ********
2026-03-19 12:08:00.530937 | controller | changed: [instance]
2026-03-19 12:08:01.823173 | controller |
2026-03-19 12:08:01.823211 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2026-03-19 12:08:01.823231 | controller | Thursday 19 March 2026  12:08:00 +0000 (0:00:00.289)       0:00:31.717 ********
2026-03-19 12:08:01.823244 | controller | changed: [instance]
2026-03-19 12:08:02.379120 | controller |
2026-03-19 12:08:02.379150 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2026-03-19 12:08:02.379158 | controller | Thursday 19 March 2026  12:08:01 +0000 (0:00:01.292)       0:00:33.009 ********
2026-03-19 12:08:02.379168 | controller | changed: [instance] => (item=arptables)
2026-03-19 12:08:02.379193 | controller | changed: [instance] => (item=iptables)
2026-03-19 12:08:02.379200 | controller | changed: [instance] => (item=ip6tables)
2026-03-19 12:08:02.379507 | controller |
2026-03-19 12:08:02.691461 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2026-03-19 12:08:02.691495 | controller | Thursday 19 March 2026  12:08:02 +0000 (0:00:00.556)       0:00:33.565 ********
2026-03-19 12:08:02.691509 | controller | ok: [instance]
2026-03-19 12:08:02.780058 | controller |
2026-03-19 12:08:02.780077 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2026-03-19 12:08:02.780085 | controller | Thursday 19 March 2026  12:08:02 +0000 (0:00:00.312)       0:00:33.878 ********
2026-03-19 12:08:02.780094 | controller | ok: [instance]
2026-03-19 12:08:02.820156 | controller |
2026-03-19 12:08:02.820196 | controller | TASK [Ensure the required network configurations are applied] ******************
2026-03-19 12:08:02.820207 | controller | Thursday 19 March 2026  12:08:02 +0000 (0:00:00.088)       0:00:33.966 ********
2026-03-19 12:08:02.820220 | controller |
2026-03-19 12:08:02.820256 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2026-03-19 12:08:02.820336 | controller | Thursday 19 March 2026  12:08:02 +0000 (0:00:00.040)       0:00:34.007 ********
2026-03-19 12:08:02.840954 | controller | skipping: [instance]
2026-03-19 12:08:02.861084 | controller |
2026-03-19 12:08:02.861106 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2026-03-19 12:08:02.861114 | controller | Thursday 19 March 2026  12:08:02 +0000 (0:00:00.020)       0:00:34.027 ********
2026-03-19 12:08:02.861123 | controller | skipping: [instance]
2026-03-19 12:08:02.861147 | controller |
2026-03-19 12:08:02.861423 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-19 12:08:02.882202 | controller | Thursday 19 March 2026  12:08:02 +0000 (0:00:00.020)       0:00:34.048 ********
2026-03-19 12:08:02.882220 | controller | skipping: [instance]
2026-03-19 12:08:02.882339 | controller |
2026-03-19 12:08:02.882391 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2026-03-19 12:08:02.930114 | controller | Thursday 19 March 2026  12:08:02 +0000 (0:00:00.020)       0:00:34.068 ********
2026-03-19 12:08:02.930146 | controller | skipping: [instance]
2026-03-19 12:08:02.930230 | controller |
2026-03-19 12:08:02.930348 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2026-03-19 12:08:02.930473 | controller | Thursday 19 March 2026  12:08:02 +0000 (0:00:00.048)       0:00:34.117 ********
2026-03-19 12:08:02.968761 | controller | ok: [instance]
2026-03-19 12:08:02.968866 | controller |
2026-03-19 12:08:02.969062 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2026-03-19 12:08:02.969169 | controller | Thursday 19 March 2026  12:08:02 +0000 (0:00:00.038)       0:00:34.155 ********
2026-03-19 12:08:03.002040 | controller | skipping: [instance]
2026-03-19 12:08:03.002083 | controller |
2026-03-19 12:08:03.002227 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2026-03-19 12:08:03.002347 | controller | Thursday 19 March 2026  12:08:02 +0000 (0:00:00.033)       0:00:34.189 ********
2026-03-19 12:08:03.023693 | controller | skipping: [instance]
2026-03-19 12:08:03.023781 | controller |
2026-03-19 12:08:03.023919 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2026-03-19 12:08:03.024085 | controller | Thursday 19 March 2026  12:08:03 +0000 (0:00:00.021)       0:00:34.210 ********
2026-03-19 12:08:03.079043 | controller | ok: [instance]
2026-03-19 12:08:03.079200 | controller |
2026-03-19 12:08:03.079363 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2026-03-19 12:08:03.079461 | controller | Thursday 19 March 2026  12:08:03 +0000 (0:00:00.055)       0:00:34.266 ********
2026-03-19 12:08:03.101083 | controller | skipping: [instance]
2026-03-19 12:08:03.101257 | controller |
2026-03-19 12:08:03.101385 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2026-03-19 12:08:03.101514 | controller | Thursday 19 March 2026  12:08:03 +0000 (0:00:00.021)       0:00:34.288 ********
2026-03-19 12:08:03.150662 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2026-03-19 12:08:03.150816 | controller |
2026-03-19 12:08:03.150956 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-03-19 12:08:03.151089 | controller | Thursday 19 March 2026  12:08:03 +0000 (0:00:00.049)       0:00:34.337 ********
2026-03-19 12:08:03.458805 | controller | ok: [instance -> localhost]
2026-03-19 12:08:08.508632 | controller |
2026-03-19 12:08:08.508663 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2026-03-19 12:08:08.508671 | controller | Thursday 19 March 2026  12:08:03 +0000 (0:00:00.307)       0:00:34.645 ********
2026-03-19 12:08:08.508681 | controller | changed: [instance -> localhost]
2026-03-19 12:08:08.695954 | controller |
2026-03-19 12:08:08.695986 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-03-19 12:08:08.695993 | controller | Thursday 19 March 2026  12:08:08 +0000 (0:00:05.049)       0:00:39.695 ********
2026-03-19 12:08:08.696023 | controller | changed: [instance]
2026-03-19 12:08:09.020549 | controller |
2026-03-19 12:08:09.020585 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2026-03-19 12:08:09.020595 | controller | Thursday 19 March 2026  12:08:08 +0000 (0:00:00.187)       0:00:39.882 ********
2026-03-19 12:08:09.020608 | controller | changed: [instance]
2026-03-19 12:08:10.615649 | controller |
2026-03-19 12:08:10.615681 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2026-03-19 12:08:10.615689 | controller | Thursday 19 March 2026  12:08:09 +0000 (0:00:00.324)       0:00:40.207 ********
2026-03-19 12:08:10.615699 | controller | changed: [instance -> localhost]
2026-03-19 12:08:10.955130 | controller |
2026-03-19 12:08:10.955162 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2026-03-19 12:08:10.955170 | controller | Thursday 19 March 2026  12:08:10 +0000 (0:00:01.594)       0:00:41.801 ********
2026-03-19 12:08:10.955181 | controller | changed: [instance]
2026-03-19 12:08:10.955206 | controller |
2026-03-19 12:08:10.955417 | controller | TASK [reproducer : Select right domain] ****************************************
2026-03-19 12:08:10.985160 | controller | Thursday 19 March 2026  12:08:10 +0000 (0:00:00.340)       0:00:42.142 ********
2026-03-19 12:08:10.985186 | controller | ok: [instance]
2026-03-19 12:08:10.985415 | controller |
2026-03-19 12:08:10.985433 | controller | TASK [Create the virtual networks] *********************************************
2026-03-19 12:08:11.103615 | controller | Thursday 19 March 2026  12:08:10 +0000 (0:00:00.030)       0:00:42.172 ********
2026-03-19 12:08:11.103637 | controller |
2026-03-19 12:08:11.122730 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2026-03-19 12:08:11.122752 | controller | Thursday 19 March 2026  12:08:11 +0000 (0:00:00.118)       0:00:42.290 ********
2026-03-19 12:08:11.122764 | controller | ok: [instance]
2026-03-19 12:08:11.305701 | controller |
2026-03-19 12:08:11.305727 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2026-03-19 12:08:11.305737 | controller | Thursday 19 March 2026  12:08:11 +0000 (0:00:00.018)       0:00:42.309 ********
2026-03-19 12:08:11.305748 | controller | ok: [instance]
2026-03-19 12:08:11.334146 | controller |
2026-03-19 12:08:11.334182 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2026-03-19 12:08:11.334192 | controller | Thursday 19 March 2026  12:08:11 +0000 (0:00:00.183)       0:00:42.492 ********
2026-03-19 12:08:11.334204 | controller | skipping: [instance]
2026-03-19 12:08:11.334233 | controller |
2026-03-19 12:08:11.334243 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2026-03-19 12:08:11.334354 | controller | Thursday 19 March 2026  12:08:11 +0000 (0:00:00.028)       0:00:42.521 ********
2026-03-19 12:08:11.361843 | controller | skipping: [instance]
2026-03-19 12:08:11.413936 | controller |
2026-03-19 12:08:11.413960 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2026-03-19 12:08:11.413977 | controller | Thursday 19 March 2026  12:08:11 +0000 (0:00:00.027)       0:00:42.548 ********
2026-03-19 12:08:11.413988 | controller | ok: [instance]
2026-03-19 12:08:11.414178 | controller |
2026-03-19 12:08:11.414329 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2026-03-19 12:08:11.414464 | controller | Thursday 19 March 2026  12:08:11 +0000 (0:00:00.052)       0:00:42.601 ********
2026-03-19 12:08:11.533126 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-19 12:08:11.533343 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-19 12:08:11.533491 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-19 12:08:11.533614 | controller |
2026-03-19 12:08:11.533753 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2026-03-19 12:08:11.533882 | controller | Thursday 19 March 2026  12:08:11 +0000 (0:00:00.119)       0:00:42.720 ********
2026-03-19 12:08:11.565615 | controller | skipping: [instance]
2026-03-19 12:08:11.899812 | controller |
2026-03-19 12:08:11.899849 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2026-03-19 12:08:11.899859 | controller | Thursday 19 March 2026  12:08:11 +0000 (0:00:00.032)       0:00:42.752 ********
2026-03-19 12:08:11.899871 | controller | changed: [instance]
2026-03-19 12:08:11.989790 | controller |
2026-03-19 12:08:11.989808 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2026-03-19 12:08:11.989814 | controller | Thursday 19 March 2026  12:08:11 +0000 (0:00:00.333)       0:00:43.086 ********
2026-03-19 12:08:11.989823 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes)
2026-03-19 12:08:12.039481 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers)
2026-03-19 12:08:12.039499 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps)
2026-03-19 12:08:12.039507 | controller |
2026-03-19 12:08:12.039514 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-19 12:08:12.039520 | controller | Thursday 19 March 2026  12:08:11 +0000 (0:00:00.090)       0:00:43.176 ********
2026-03-19 12:08:12.039530 | controller | changed: [instance]
2026-03-19 12:08:12.331103 | controller |
2026-03-19 12:08:12.331136 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-19 12:08:12.331145 | controller | Thursday 19 March 2026  12:08:12 +0000 (0:00:00.049)       0:00:43.226 ********
2026-03-19 12:08:12.331155 | controller | changed: [instance]
2026-03-19 12:08:12.532585 | controller |
2026-03-19 12:08:12.532614 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-19 12:08:12.532623 | controller | Thursday 19 March 2026  12:08:12 +0000 (0:00:00.291)       0:00:43.518 ********
2026-03-19 12:08:12.532633 | controller | changed: [instance]
2026-03-19 12:08:12.583889 | controller |
2026-03-19 12:08:12.583908 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-19 12:08:12.583915 | controller | Thursday 19 March 2026  12:08:12 +0000 (0:00:00.201)       0:00:43.719 ********
2026-03-19 12:08:12.583924 | controller | changed: [instance]
2026-03-19 12:08:12.784596 | controller |
2026-03-19 12:08:12.784619 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-19 12:08:12.784629 | controller | Thursday 19 March 2026  12:08:12 +0000 (0:00:00.051)       0:00:43.770 ********
2026-03-19 12:08:12.784639 | controller | changed: [instance]
2026-03-19 12:08:12.994597 | controller |
2026-03-19 12:08:12.994620 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-19 12:08:12.994629 | controller | Thursday 19 March 2026  12:08:12 +0000 (0:00:00.200)       0:00:43.971 ********
2026-03-19 12:08:12.994640 | controller | changed: [instance]
2026-03-19 12:08:13.047856 | controller |
2026-03-19 12:08:13.047897 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-19 12:08:13.047911 | controller | Thursday 19 March 2026  12:08:12 +0000 (0:00:00.210)       0:00:44.181 ********
2026-03-19 12:08:13.047926 | controller | changed: [instance]
2026-03-19 12:08:13.246800 | controller |
2026-03-19 12:08:13.246818 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-19 12:08:13.246826 | controller | Thursday 19 March 2026  12:08:13 +0000 (0:00:00.053)       0:00:44.234 ********
2026-03-19 12:08:13.246834 | controller | changed: [instance]
2026-03-19 12:08:13.453459 | controller |
2026-03-19 12:08:13.453483 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-19 12:08:13.453492 | controller | Thursday 19 March 2026  12:08:13 +0000 (0:00:00.199)       0:00:44.433 ********
2026-03-19 12:08:13.453502 | controller | changed: [instance]
2026-03-19 12:08:13.643716 | controller |
2026-03-19 12:08:13.643736 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ********************
2026-03-19 12:08:13.643744 | controller | Thursday 19 March 2026  12:08:13 +0000 (0:00:00.206)       0:00:44.640 ********
2026-03-19 12:08:13.643753 | controller | ok: [instance]
2026-03-19 12:08:14.124165 | controller |
2026-03-19 12:08:14.124196 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ******************
2026-03-19 12:08:14.124204 | controller | Thursday 19 March 2026  12:08:13 +0000 (0:00:00.190)       0:00:44.830 ********
2026-03-19 12:08:14.124220 | controller | changed: [instance]
2026-03-19 12:08:14.301880 | controller |
2026-03-19 12:08:14.301902 | controller | TASK [libvirt_manager : Remove ini file after conversion] **********************
2026-03-19 12:08:14.301910 | controller | Thursday 19 March 2026  12:08:14 +0000 (0:00:00.480)       0:00:45.310 ********
2026-03-19 12:08:14.301919 | controller | changed: [instance]
2026-03-19 12:08:14.325547 | controller |
2026-03-19 12:08:14.325569 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-19 12:08:14.325578 | controller | Thursday 19 March 2026  12:08:14 +0000 (0:00:00.177)       0:00:45.488 ********
2026-03-19 12:08:14.325589 | controller | skipping: [instance]
2026-03-19 12:08:14.348871 | controller |
2026-03-19 12:08:14.348892 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-19 12:08:14.348900 | controller | Thursday 19 March 2026  12:08:14 +0000 (0:00:00.023)       0:00:45.512 ********
2026-03-19 12:08:14.348908 | controller | skipping: [instance]
2026-03-19 12:08:14.374140 | controller |
2026-03-19 12:08:14.374163 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-19 12:08:14.374173 | controller | Thursday 19 March 2026  12:08:14 +0000 (0:00:00.023)       0:00:45.535 ********
2026-03-19 12:08:14.374184 | controller | skipping: [instance]
2026-03-19 12:08:14.374211 | controller |
2026-03-19 12:08:14.374221 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-19 12:08:14.374295 | controller | Thursday 19 March 2026  12:08:14 +0000 (0:00:00.025)       0:00:45.561 ********
2026-03-19 12:08:14.398745 | controller | skipping: [instance]
2026-03-19 12:08:14.417899 | controller |
2026-03-19 12:08:14.417940 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-19 12:08:14.417954 | controller | Thursday 19 March 2026  12:08:14 +0000 (0:00:00.024)       0:00:45.585 ********
2026-03-19 12:08:14.417970 | controller | ok: [instance]
2026-03-19 12:08:14.494490 | controller |
2026-03-19 12:08:14.494511 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-19 12:08:14.494520 | controller | Thursday 19 March 2026  12:08:14 +0000 (0:00:00.018)       0:00:45.604 ********
2026-03-19 12:08:14.494532 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-03-19 12:08:14.511826 | controller |
2026-03-19 12:08:14.511848 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-19 12:08:14.511857 | controller | Thursday 19 March 2026  12:08:14 +0000 (0:00:00.076)       0:00:45.681 ********
2026-03-19 12:08:14.511868 | controller | skipping: [instance]
2026-03-19 12:08:14.710388 | controller |
2026-03-19 12:08:14.710412 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-19 12:08:14.710421 | controller | Thursday 19 March 2026  12:08:14 +0000 (0:00:00.017)       0:00:45.698 ********
2026-03-19 12:08:14.710430 | controller | changed: [instance]
2026-03-19 12:08:15.104138 | controller |
2026-03-19 12:08:15.104175 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-19 12:08:15.104185 | controller | Thursday 19 March 2026  12:08:14 +0000 (0:00:00.198)       0:00:45.896 ********
2026-03-19 12:08:15.104197 | controller | changed: [instance]
2026-03-19 12:08:15.164114 | controller |
2026-03-19 12:08:15.164137 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-19 12:08:15.164147 | controller | Thursday 19 March 2026  12:08:15 +0000 (0:00:00.393)       0:00:46.290 ********
2026-03-19 12:08:15.164157 | controller | ok: [instance]
2026-03-19 12:08:15.194595 | controller |
2026-03-19 12:08:15.194621 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-19 12:08:15.194631 | controller | Thursday 19 March 2026  12:08:15 +0000 (0:00:00.060)       0:00:46.351 ********
2026-03-19 12:08:15.194643 | controller | ok: [instance]
2026-03-19 12:08:15.565209 | controller |
2026-03-19 12:08:15.565241 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-19 12:08:15.565249 | controller | Thursday 19 March 2026  12:08:15 +0000 (0:00:00.030)       0:00:46.381 ********
2026-03-19 12:08:15.565260 | controller | changed: [instance]
2026-03-19 12:08:15.649639 | controller |
2026-03-19 12:08:15.649659 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2026-03-19 12:08:15.649668 | controller | Thursday 19 March 2026  12:08:15 +0000 (0:00:00.370)       0:00:46.751 ********
2026-03-19 12:08:15.649679 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2026-03-19 12:08:15.699522 | controller |
2026-03-19 12:08:15.699538 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2026-03-19 12:08:15.699545 | controller | Thursday 19 March 2026  12:08:15 +0000 (0:00:00.084)       0:00:46.836 ********
2026-03-19 12:08:15.699553 | controller | ok: [instance] => (item=public)
2026-03-19 12:08:16.120042 | controller | ok: [instance] => (item=osp_trunk)
2026-03-19 12:08:16.120073 | controller |
2026-03-19 12:08:16.120081 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2026-03-19 12:08:16.120095 | controller | Thursday 19 March 2026  12:08:15 +0000 (0:00:00.049)       0:00:46.886 ********
2026-03-19 12:08:16.120104 | controller | changed: [instance] => (item=cifmw-public)
2026-03-19 12:08:16.683458 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:08:16.683488 | controller |
2026-03-19 12:08:16.683496 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2026-03-19 12:08:16.683502 | controller | Thursday 19 March 2026  12:08:16 +0000 (0:00:00.420)       0:00:47.306 ********
2026-03-19 12:08:16.683512 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 12:08:17.103999 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:08:17.104065 | controller |
2026-03-19 12:08:17.104073 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2026-03-19 12:08:17.104079 | controller | Thursday 19 March 2026  12:08:16 +0000 (0:00:00.563)       0:00:47.869 ********
2026-03-19 12:08:17.104090 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 12:08:17.512395 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:08:17.512428 | controller |
2026-03-19 12:08:17.512436 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2026-03-19 12:08:17.512442 | controller | Thursday 19 March 2026  12:08:17 +0000 (0:00:00.420)       0:00:48.290 ********
2026-03-19 12:08:17.512453 | controller | changed: [instance] => (item=cifmw-public)
2026-03-19 12:08:17.571727 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:08:17.571749 | controller |
2026-03-19 12:08:17.571758 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2026-03-19 12:08:17.571765 | controller | Thursday 19 March 2026  12:08:17 +0000 (0:00:00.408)       0:00:48.699 ********
2026-03-19 12:08:17.571776 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2026-03-19 12:08:17.750923 | controller |
2026-03-19 12:08:17.750942 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2026-03-19 12:08:17.750950 | controller | Thursday 19 March 2026  12:08:17 +0000 (0:00:00.059)       0:00:48.758 ********
2026-03-19 12:08:17.750958 | controller | ok: [instance]
2026-03-19 12:08:18.126677 | controller |
2026-03-19 12:08:18.126709 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2026-03-19 12:08:18.126718 | controller | Thursday 19 March 2026  12:08:17 +0000 (0:00:00.179)       0:00:48.937 ********
2026-03-19 12:08:18.126728 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 12:08:18.195578 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:08:18.195609 | controller |
2026-03-19 12:08:18.195619 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2026-03-19 12:08:18.195627 | controller | Thursday 19 March 2026  12:08:18 +0000 (0:00:00.375)       0:00:49.313 ********
2026-03-19 12:08:18.195640 | controller |
2026-03-19 12:08:18.231142 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-03-19 12:08:18.231168 | controller | Thursday 19 March 2026  12:08:18 +0000 (0:00:00.069)       0:00:49.382 ********
2026-03-19 12:08:18.231183 | controller | skipping: [instance]
2026-03-19 12:08:18.231412 | controller |
2026-03-19 12:08:18.231434 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2026-03-19 12:08:19.482704 | controller | Thursday 19 March 2026  12:08:18 +0000 (0:00:00.035)       0:00:49.418 ********
2026-03-19 12:08:19.482740 | controller | ok: [instance]
2026-03-19 12:08:19.667890 | controller |
2026-03-19 12:08:19.667913 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-03-19 12:08:19.667920 | controller | Thursday 19 March 2026  12:08:19 +0000 (0:00:01.251)       0:00:50.669 ********
2026-03-19 12:08:19.667930 | controller | ok: [instance]
2026-03-19 12:08:20.025713 | controller |
2026-03-19 12:08:20.025734 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2026-03-19 12:08:20.025742 | controller | Thursday 19 March 2026  12:08:19 +0000 (0:00:00.185)       0:00:50.854 ********
2026-03-19 12:08:20.025755 | controller | changed: [instance]
2026-03-19 12:08:21.671105 | controller |
2026-03-19 12:08:21.671139 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2026-03-19 12:08:21.671149 | controller | Thursday 19 March 2026  12:08:20 +0000 (0:00:00.357)       0:00:51.212 ********
2026-03-19 12:08:21.671161 | controller | changed: [instance]
2026-03-19 12:08:21.671428 | controller |
2026-03-19 12:08:21.671469 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2026-03-19 12:08:22.018893 | controller | Thursday 19 March 2026  12:08:21 +0000 (0:00:01.645)       0:00:52.857 ********
2026-03-19 12:08:22.018920 | controller | changed: [instance]
2026-03-19 12:08:22.050531 | controller |
2026-03-19 12:08:22.050555 | controller | TASK [Create extra network configuration] **************************************
2026-03-19 12:08:22.050562 | controller | Thursday 19 March 2026  12:08:22 +0000 (0:00:00.347)       0:00:53.205 ********
2026-03-19 12:08:22.050572 | controller | skipping: [instance]
2026-03-19 12:08:22.080087 | controller |
2026-03-19 12:08:22.080119 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2026-03-19 12:08:22.080127 | controller | Thursday 19 March 2026  12:08:22 +0000 (0:00:00.031)       0:00:53.237 ********
2026-03-19 12:08:22.080143 | controller | skipping: [instance]
2026-03-19 12:08:22.080170 | controller |
2026-03-19 12:08:22.080430 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2026-03-19 12:08:22.513678 | controller | Thursday 19 March 2026  12:08:22 +0000 (0:00:00.029)       0:00:53.267 ********
2026-03-19 12:08:22.513701 | controller | ok: [instance]
2026-03-19 12:08:22.652586 | controller |
2026-03-19 12:08:22.652603 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2026-03-19 12:08:22.652610 | controller | Thursday 19 March 2026  12:08:22 +0000 (0:00:00.433)       0:00:53.700 ********
2026-03-19 12:08:22.652618 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 12:08:23.873790 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:08:23.873811 | controller |
2026-03-19 12:08:23.873818 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2026-03-19 12:08:23.873824 | controller | Thursday 19 March 2026  12:08:22 +0000 (0:00:00.139)       0:00:53.839 ********
2026-03-19 12:08:23.873833 | controller | ok: [instance]
2026-03-19 12:08:27.453356 | controller |
2026-03-19 12:08:27.453388 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2026-03-19 12:08:27.453396 | controller | Thursday 19 March 2026  12:08:23 +0000 (0:00:01.221)       0:00:55.060 ********
2026-03-19 12:08:27.453406 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2026-03-19 12:08:27.665619 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2026-03-19 12:08:27.665653 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2026-03-19 12:08:27.665667 | controller |
2026-03-19 12:08:27.665677 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2026-03-19 12:08:27.665687 | controller | Thursday 19 March 2026  12:08:27 +0000 (0:00:03.579)       0:00:58.639 ********
2026-03-19 12:08:27.665702 | controller | changed: [instance]
2026-03-19 12:08:28.022964 | controller |
2026-03-19 12:08:28.022999 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2026-03-19 12:08:28.023054 | controller | Thursday 19 March 2026  12:08:27 +0000 (0:00:00.212)       0:00:58.852 ********
2026-03-19 12:08:28.023077 | controller | changed: [instance]
2026-03-19 12:08:28.409752 | controller |
2026-03-19 12:08:28.409785 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2026-03-19 12:08:28.409799 | controller | Thursday 19 March 2026  12:08:28 +0000 (0:00:00.357)       0:00:59.209 ********
2026-03-19 12:08:28.409815 | controller | changed: [instance]
2026-03-19 12:08:28.441753 | controller |
2026-03-19 12:08:28.441772 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2026-03-19 12:08:28.441779 | controller | Thursday 19 March 2026  12:08:28 +0000 (0:00:00.386)       0:00:59.596 ********
2026-03-19 12:08:28.441788 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2026-03-19 12:08:28.827032 | controller |
2026-03-19 12:08:28.827059 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2026-03-19 12:08:28.827066 | controller | Thursday 19 March 2026  12:08:28 +0000 (0:00:00.032)       0:00:59.628 ********
2026-03-19 12:08:28.827076 | controller | changed: [instance]
2026-03-19 12:08:28.845626 | controller |
2026-03-19 12:08:28.845642 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2026-03-19 12:08:28.845649 | controller | Thursday 19 March 2026  12:08:28 +0000 (0:00:00.385)       0:01:00.013 ********
2026-03-19 12:08:28.845657 | controller | skipping: [instance]
2026-03-19 12:08:28.880226 | controller |
2026-03-19 12:08:28.880249 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2026-03-19 12:08:28.880256 | controller | Thursday 19 March 2026  12:08:28 +0000 (0:00:00.018)       0:01:00.032 ********
2026-03-19 12:08:28.880266 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2026-03-19 12:08:29.256816 | controller |
2026-03-19 12:08:29.256841 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2026-03-19 12:08:29.256850 | controller | Thursday 19 March 2026  12:08:28 +0000 (0:00:00.034)       0:01:00.067 ********
2026-03-19 12:08:29.256863 | controller | changed: [instance]
2026-03-19 12:08:29.276702 | controller |
2026-03-19 12:08:29.276719 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2026-03-19 12:08:29.276726 | controller | Thursday 19 March 2026  12:08:29 +0000 (0:00:00.376)       0:01:00.443 ********
2026-03-19 12:08:29.276734 | controller | skipping: [instance]
2026-03-19 12:08:29.487657 | controller |
2026-03-19 12:08:29.487677 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2026-03-19 12:08:29.487685 | controller | Thursday 19 March 2026  12:08:29 +0000 (0:00:00.020)       0:01:00.463 ********
2026-03-19 12:08:29.487694 | controller | ok: [instance] => (item=127.0.0.2)
2026-03-19 12:08:30.189108 | controller |
2026-03-19 12:08:30.189136 | controller | TASK [dnsmasq : Enable and start service] **************************************
2026-03-19 12:08:30.189145 | controller | Thursday 19 March 2026  12:08:29 +0000 (0:00:00.210)       0:01:00.674 ********
2026-03-19 12:08:30.189155 | controller | changed: [instance]
2026-03-19 12:08:30.209651 | controller |
2026-03-19 12:08:30.209667 | controller | TASK [dnsmasq : Stop service] **************************************************
2026-03-19 12:08:30.209680 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.701)       0:01:01.375 ********
2026-03-19 12:08:30.209688 | controller | skipping: [instance]
2026-03-19 12:08:30.227849 | controller |
2026-03-19 12:08:30.227863 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2026-03-19 12:08:30.227869 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.020)       0:01:01.396 ********
2026-03-19 12:08:30.227877 | controller | skipping: [instance]
2026-03-19 12:08:30.256154 | controller |
2026-03-19 12:08:30.256173 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2026-03-19 12:08:30.256179 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.018)       0:01:01.414 ********
2026-03-19 12:08:30.256188 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-03-19 12:08:30.372648 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2026-03-19 12:08:30.372681 | controller | skipping: [instance]
2026-03-19 12:08:30.372694 | controller |
2026-03-19 12:08:30.372705 | controller | TASK [Create dnsmasq networks] *************************************************
2026-03-19 12:08:30.372715 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.028)       0:01:01.442 ********
2026-03-19 12:08:30.372730 | controller |
2026-03-19 12:08:30.400891 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-03-19 12:08:30.400912 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.116)       0:01:01.559 ********
2026-03-19 12:08:30.400923 | controller | ok: [instance] => changed=false
2026-03-19 12:08:30.437213 | controller |   msg: All assertions passed
2026-03-19 12:08:30.437249 | controller |
2026-03-19 12:08:30.437258 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-03-19 12:08:30.437272 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.028)       0:01:01.587 ********
2026-03-19 12:08:30.437283 | controller | ok: [instance] => changed=false
2026-03-19 12:08:30.437310 | controller |   msg: All assertions passed
2026-03-19 12:08:30.437318 | controller |
2026-03-19 12:08:30.437327 | controller | TASK [dnsmasq : Create network] ************************************************
2026-03-19 12:08:30.858963 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.036)       0:01:01.623 ********
2026-03-19 12:08:30.858998 | controller | changed: [instance]
2026-03-19 12:08:30.877381 | controller |
2026-03-19 12:08:30.877398 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-03-19 12:08:30.877405 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.421)       0:01:02.045 ********
2026-03-19 12:08:30.877413 | controller | skipping: [instance]
2026-03-19 12:08:30.902497 | controller |
2026-03-19 12:08:30.902519 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-03-19 12:08:30.902528 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.018)       0:01:02.064 ********
2026-03-19 12:08:30.902539 | controller | skipping: [instance]
2026-03-19 12:08:30.932211 | controller |
2026-03-19 12:08:30.932246 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-03-19 12:08:30.932256 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.024)       0:01:02.089 ********
2026-03-19 12:08:30.932268 | controller | ok: [instance] => changed=false
2026-03-19 12:08:30.932312 | controller |   msg: All assertions passed
2026-03-19 12:08:30.932322 | controller |
2026-03-19 12:08:30.932331 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-03-19 12:08:30.970193 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.029)       0:01:02.118 ********
2026-03-19 12:08:30.970235 | controller | ok: [instance] => changed=false
2026-03-19 12:08:30.970310 | controller |   msg: All assertions passed
2026-03-19 12:08:30.970330 | controller |
2026-03-19 12:08:30.970338 | controller | TASK [dnsmasq : Create network] ************************************************
2026-03-19 12:08:30.970347 | controller | Thursday 19 March 2026  12:08:30 +0000 (0:00:00.038)       0:01:02.157 ********
2026-03-19 12:08:31.400430 | controller | changed: [instance]
2026-03-19 12:08:31.418927 | controller |
2026-03-19 12:08:31.418948 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-03-19 12:08:31.418956 | controller | Thursday 19 March 2026  12:08:31 +0000 (0:00:00.430)       0:01:02.587 ********
2026-03-19 12:08:31.418965 | controller | skipping: [instance]
2026-03-19 12:08:31.442982 | controller |
2026-03-19 12:08:31.443001 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-03-19 12:08:31.443027 | controller | Thursday 19 March 2026  12:08:31 +0000 (0:00:00.018)       0:01:02.605 ********
2026-03-19 12:08:31.443038 | controller | skipping: [instance]
2026-03-19 12:08:31.474913 | controller |
2026-03-19 12:08:31.474932 | controller | TASK [Deploy radvd for IPv6 router advertisements] *****************************
2026-03-19 12:08:31.474940 | controller | Thursday 19 March 2026  12:08:31 +0000 (0:00:00.024)       0:01:02.629 ********
2026-03-19 12:08:31.474950 | controller | skipping: [instance]
2026-03-19 12:08:31.985632 | controller |
2026-03-19 12:08:31.985662 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2026-03-19 12:08:31.985670 | controller | Thursday 19 March 2026  12:08:31 +0000 (0:00:00.031)       0:01:02.661 ********
2026-03-19 12:08:31.985685 | controller | changed: [instance] => (item=cifmw-public)
2026-03-19 12:08:32.019767 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:08:32.019793 | controller |
2026-03-19 12:08:32.019801 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-19 12:08:32.019807 | controller | Thursday 19 March 2026  12:08:31 +0000 (0:00:00.510)       0:01:03.172 ********
2026-03-19 12:08:32.019817 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2026-03-19 12:08:32.342651 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2026-03-19 12:08:32.342686 | controller |
2026-03-19 12:08:32.342695 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-19 12:08:32.342701 | controller | Thursday 19 March 2026  12:08:32 +0000 (0:00:00.034)       0:01:03.206 ********
2026-03-19 12:08:32.342711 | controller | ok: [instance]
2026-03-19 12:08:32.376710 | controller |
2026-03-19 12:08:32.376736 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-03-19 12:08:32.376743 | controller | Thursday 19 March 2026  12:08:32 +0000 (0:00:00.318)       0:01:03.525 ********
2026-03-19 12:08:32.376754 | controller | ok: [instance]
2026-03-19 12:08:32.578835 | controller |
2026-03-19 12:08:32.578865 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-19 12:08:32.578874 | controller | Thursday 19 March 2026  12:08:32 +0000 (0:00:00.038)       0:01:03.563 ********
2026-03-19 12:08:32.578884 | controller | ok: [instance]
2026-03-19 12:08:32.614024 | controller |
2026-03-19 12:08:32.614056 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-03-19 12:08:32.614064 | controller | Thursday 19 March 2026  12:08:32 +0000 (0:00:00.201)       0:01:03.765 ********
2026-03-19 12:08:32.614075 | controller | ok: [instance]
2026-03-19 12:08:32.955118 | controller |
2026-03-19 12:08:32.955148 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2026-03-19 12:08:32.955156 | controller | Thursday 19 March 2026  12:08:32 +0000 (0:00:00.035)       0:01:03.800 ********
2026-03-19 12:08:32.955166 | controller | changed: [instance]
2026-03-19 12:08:32.955191 | controller |
2026-03-19 12:08:32.955199 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2026-03-19 12:08:32.955304 | controller | Thursday 19 March 2026  12:08:32 +0000 (0:00:00.341)       0:01:04.142 ********
2026-03-19 12:08:33.291754 | controller | changed: [instance]
2026-03-19 12:08:33.627871 | controller |
2026-03-19 12:08:33.627909 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2026-03-19 12:08:33.627919 | controller | Thursday 19 March 2026  12:08:33 +0000 (0:00:00.336)       0:01:04.478 ********
2026-03-19 12:08:33.627929 | controller | changed: [instance]
2026-03-19 12:08:33.722198 | controller |
2026-03-19 12:08:33.722246 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2026-03-19 12:08:33.722258 | controller | Thursday 19 March 2026  12:08:33 +0000 (0:00:00.336)       0:01:04.814 ********
2026-03-19 12:08:33.722273 | controller | ok: [instance]
2026-03-19 12:08:34.052172 | controller |
2026-03-19 12:08:34.052214 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2026-03-19 12:08:34.052224 | controller | Thursday 19 March 2026  12:08:33 +0000 (0:00:00.094)       0:01:04.908 ********
2026-03-19 12:08:34.052235 | controller | changed: [instance]
2026-03-19 12:08:34.052260 | controller |
2026-03-19 12:08:34.052268 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-19 12:08:34.052277 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.330)       0:01:05.239 ********
2026-03-19 12:08:34.076141 | controller | skipping: [instance]
2026-03-19 12:08:34.076184 | controller |
2026-03-19 12:08:34.076196 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-19 12:08:34.076339 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.024)       0:01:05.263 ********
2026-03-19 12:08:34.099753 | controller | skipping: [instance]
2026-03-19 12:08:34.124058 | controller |
2026-03-19 12:08:34.124089 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-19 12:08:34.124098 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.023)       0:01:05.286 ********
2026-03-19 12:08:34.124107 | controller | skipping: [instance]
2026-03-19 12:08:34.148172 | controller |
2026-03-19 12:08:34.148194 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-19 12:08:34.148203 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.024)       0:01:05.310 ********
2026-03-19 12:08:34.148213 | controller | skipping: [instance]
2026-03-19 12:08:34.148279 | controller |
2026-03-19 12:08:34.148306 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-19 12:08:34.148316 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.024)       0:01:05.335 ********
2026-03-19 12:08:34.168003 | controller | ok: [instance]
2026-03-19 12:08:34.260769 | controller |
2026-03-19 12:08:34.260792 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-19 12:08:34.260808 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.019)       0:01:05.354 ********
2026-03-19 12:08:34.260822 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-03-19 12:08:34.261040 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2026-03-19 12:08:34.261222 | controller |
2026-03-19 12:08:34.261388 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-19 12:08:34.261516 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.093)       0:01:05.447 ********
2026-03-19 12:08:34.280619 | controller | skipping: [instance]
2026-03-19 12:08:34.280795 | controller |
2026-03-19 12:08:34.280959 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-19 12:08:34.281146 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.019)       0:01:05.467 ********
2026-03-19 12:08:34.480567 | controller | ok: [instance]
2026-03-19 12:08:34.859566 | controller |
2026-03-19 12:08:34.859594 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-19 12:08:34.859601 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.199)       0:01:05.667 ********
2026-03-19 12:08:34.859610 | controller | changed: [instance]
2026-03-19 12:08:34.919077 | controller |
2026-03-19 12:08:34.919112 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-19 12:08:34.919122 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.379)       0:01:06.046 ********
2026-03-19 12:08:34.919134 | controller | ok: [instance]
2026-03-19 12:08:34.950752 | controller |
2026-03-19 12:08:34.950775 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-19 12:08:34.950783 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.059)       0:01:06.105 ********
2026-03-19 12:08:34.950792 | controller | ok: [instance]
2026-03-19 12:08:35.351197 | controller |
2026-03-19 12:08:35.351231 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-19 12:08:35.351239 | controller | Thursday 19 March 2026  12:08:34 +0000 (0:00:00.031)       0:01:06.137 ********
2026-03-19 12:08:35.351250 | controller | changed: [instance]
2026-03-19 12:08:35.378792 | controller |
2026-03-19 12:08:35.378817 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2026-03-19 12:08:35.378825 | controller | Thursday 19 March 2026  12:08:35 +0000 (0:00:00.400)       0:01:06.537 ********
2026-03-19 12:08:35.378835 | controller | ok: [instance]
2026-03-19 12:08:35.421893 | controller |
2026-03-19 12:08:35.421923 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2026-03-19 12:08:35.421931 | controller | Thursday 19 March 2026  12:08:35 +0000 (0:00:00.027)       0:01:06.565 ********
2026-03-19 12:08:35.421941 | controller | ok: [instance]
2026-03-19 12:08:35.442062 | controller |
2026-03-19 12:08:35.442087 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2026-03-19 12:08:35.442096 | controller | Thursday 19 March 2026  12:08:35 +0000 (0:00:00.043)       0:01:06.608 ********
2026-03-19 12:08:35.442108 | controller | ok: [instance]
2026-03-19 12:08:35.519214 | controller |
2026-03-19 12:08:35.519245 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2026-03-19 12:08:35.519254 | controller | Thursday 19 March 2026  12:08:35 +0000 (0:00:00.020)       0:01:06.628 ********
2026-03-19 12:08:35.519265 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2026-03-19 12:08:35.652767 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2026-03-19 12:08:35.652793 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2026-03-19 12:08:35.652803 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2026-03-19 12:08:35.652810 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2026-03-19 12:08:35.652816 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2026-03-19 12:08:35.652823 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2026-03-19 12:08:35.652830 | controller |
2026-03-19 12:08:35.652837 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 12:08:35.652844 | controller | Thursday 19 March 2026  12:08:35 +0000 (0:00:00.076)       0:01:06.705 ********
2026-03-19 12:08:35.652855 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2026-03-19 12:08:35.732085 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2026-03-19 12:08:35.732114 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2026-03-19 12:08:35.732122 | controller |
2026-03-19 12:08:35.732128 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 12:08:35.732134 | controller | Thursday 19 March 2026  12:08:35 +0000 (0:00:00.134)       0:01:06.839 ********
2026-03-19 12:08:35.732143 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2026-03-19 12:08:35.732302 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2026-03-19 12:08:35.732439 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2026-03-19 12:08:35.732565 | controller | skipping: [instance]
2026-03-19 12:08:35.732683 | controller |
2026-03-19 12:08:35.732815 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 12:08:35.732948 | controller | Thursday 19 March 2026  12:08:35 +0000 (0:00:00.079)       0:01:06.919 ********
2026-03-19 12:08:35.814300 | controller | skipping: [instance] => (item=compute-0 - storage)
2026-03-19 12:08:35.814489 | controller | skipping: [instance] => (item=controller-0 - storage)
2026-03-19 12:08:35.814652 | controller | skipping: [instance] => (item=crc-0 - storage)
2026-03-19 12:08:35.814803 | controller | skipping: [instance]
2026-03-19 12:08:35.814944 | controller |
2026-03-19 12:08:35.815129 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 12:08:35.815298 | controller | Thursday 19 March 2026  12:08:35 +0000 (0:00:00.082)       0:01:07.001 ********
2026-03-19 12:08:35.896496 | controller | skipping: [instance] => (item=compute-0 - tenant)
2026-03-19 12:08:35.896680 | controller | skipping: [instance] => (item=controller-0 - tenant)
2026-03-19 12:08:35.896840 | controller | skipping: [instance] => (item=crc-0 - tenant)
2026-03-19 12:08:35.896994 | controller | skipping: [instance]
2026-03-19 12:08:35.897190 | controller |
2026-03-19 12:08:35.897372 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 12:08:35.897508 | controller | Thursday 19 March 2026  12:08:35 +0000 (0:00:00.081)       0:01:07.083 ********
2026-03-19 12:08:35.978947 | controller | skipping: [instance] => (item=compute-0 - external)
2026-03-19 12:08:35.979173 | controller | skipping: [instance] => (item=controller-0 - external)
2026-03-19 12:08:35.979364 | controller | skipping: [instance] => (item=crc-0 - external)
2026-03-19 12:08:35.979522 | controller | skipping: [instance]
2026-03-19 12:08:35.979648 | controller |
2026-03-19 12:08:35.979773 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 12:08:35.979905 | controller | Thursday 19 March 2026  12:08:35 +0000 (0:00:00.082)       0:01:07.166 ********
2026-03-19 12:08:36.057173 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2026-03-19 12:08:36.057356 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2026-03-19 12:08:36.057504 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2026-03-19 12:08:36.057641 | controller | skipping: [instance]
2026-03-19 12:08:36.057773 | controller |
2026-03-19 12:08:36.057886 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 12:08:36.057998 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.078)       0:01:07.244 ********
2026-03-19 12:08:36.194268 | controller | ok: [instance] => (item=compute-0 - public)
2026-03-19 12:08:36.194470 | controller | ok: [instance] => (item=controller-0 - public)
2026-03-19 12:08:36.194632 | controller | ok: [instance] => (item=crc-0 - public)
2026-03-19 12:08:36.194778 | controller |
2026-03-19 12:08:36.194933 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2026-03-19 12:08:36.195107 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.136)       0:01:07.381 ********
2026-03-19 12:08:36.304345 | controller |
2026-03-19 12:08:36.304524 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2026-03-19 12:08:36.304673 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.110)       0:01:07.491 ********
2026-03-19 12:08:36.341718 | controller | ok: [instance]
2026-03-19 12:08:36.341887 | controller |
2026-03-19 12:08:36.342064 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2026-03-19 12:08:36.342216 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.037)       0:01:07.528 ********
2026-03-19 12:08:36.437473 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b8:cb:4e', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-03-19 12:08:36.437656 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:ae:d4:54', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-03-19 12:08:36.437808 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:4a:11:55', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-03-19 12:08:36.437956 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:26:78:19', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-03-19 12:08:36.438139 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:1e:60:a9', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-03-19 12:08:36.438312 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:ca:e7:70', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-03-19 12:08:36.438445 | controller |
2026-03-19 12:08:36.438563 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2026-03-19 12:08:36.438677 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.095)       0:01:07.624 ********
2026-03-19 12:08:36.486728 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2026-03-19 12:08:36.486911 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2026-03-19 12:08:36.487079 | controller |
2026-03-19 12:08:36.487234 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-03-19 12:08:36.487405 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.049)       0:01:07.673 ********
2026-03-19 12:08:36.663176 | controller | ok: [instance]
2026-03-19 12:08:36.663226 | controller |
2026-03-19 12:08:36.663238 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-03-19 12:08:36.663329 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.175)       0:01:07.849 ********
2026-03-19 12:08:36.685706 | controller | ok: [instance]
2026-03-19 12:08:36.685766 | controller |
2026-03-19 12:08:36.685892 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-03-19 12:08:36.685990 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.022)       0:01:07.872 ********
2026-03-19 12:08:36.861496 | controller | ok: [instance]
2026-03-19 12:08:36.861545 | controller |
2026-03-19 12:08:36.861677 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-03-19 12:08:36.861730 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.175)       0:01:08.048 ********
2026-03-19 12:08:36.885110 | controller | ok: [instance]
2026-03-19 12:08:36.885150 | controller |
2026-03-19 12:08:36.885249 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2026-03-19 12:08:36.885337 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.024)       0:01:08.072 ********
2026-03-19 12:08:36.905144 | controller | ok: [instance]
2026-03-19 12:08:36.905487 | controller |
2026-03-19 12:08:37.076202 | controller | TASK [dnsmasq : Compute entry] *************************************************
2026-03-19 12:08:37.076249 | controller | Thursday 19 March 2026  12:08:36 +0000 (0:00:00.019)       0:01:08.092 ********
2026-03-19 12:08:37.076270 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b8:cb:4e', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-03-19 12:08:37.076334 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:ae:d4:54', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-03-19 12:08:37.076351 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:4a:11:55', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-03-19 12:08:37.076957 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:26:78:19', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-03-19 12:08:37.114280 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:1e:60:a9', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-03-19 12:08:37.114331 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:ca:e7:70', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-03-19 12:08:37.114345 | controller |
2026-03-19 12:08:37.114356 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2026-03-19 12:08:37.114366 | controller | Thursday 19 March 2026  12:08:37 +0000 (0:00:00.170)       0:01:08.263 ********
2026-03-19 12:08:37.114392 | controller | ok: [instance]
2026-03-19 12:08:39.115184 | controller |
2026-03-19 12:08:39.115220 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2026-03-19 12:08:39.115230 | controller | Thursday 19 March 2026  12:08:37 +0000 (0:00:00.037)       0:01:08.301 ********
2026-03-19 12:08:39.115243 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:b8:cb:4e', 'entry': 'set:compute,52:54:00:b8:cb:4e,192.168.140.100,compute-0', 'state': 'present'})
2026-03-19 12:08:39.115274 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:ae:d4:54', 'entry': 'set:controller,52:54:01:ae:d4:54,192.168.140.9,controller-0', 'state': 'present'})
2026-03-19 12:08:39.115293 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:4a:11:55', 'entry': 'set:ocp,52:54:02:4a:11:55,192.168.140.10,crc-0', 'state': 'present'})
2026-03-19 12:08:39.115301 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:26:78:19', 'entry': 'set:compute,52:54:00:26:78:19,192.168.101.100,compute-0', 'state': 'present'})
2026-03-19 12:08:39.115308 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:1e:60:a9', 'entry': 'set:controller,52:54:01:1e:60:a9,192.168.101.9,controller-0', 'state': 'present'})
2026-03-19 12:08:39.115317 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:ca:e7:70', 'entry': 'set:ocp,52:54:02:ca:e7:70,192.168.101.10,crc-0', 'state': 'present'})
2026-03-19 12:08:39.115503 | controller |
2026-03-19 12:08:39.115522 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2026-03-19 12:08:39.139050 | controller | Thursday 19 March 2026  12:08:39 +0000 (0:00:02.000)       0:01:10.301 ********
2026-03-19 12:08:39.139070 | controller | skipping: [instance]
2026-03-19 12:08:39.349049 | controller |
2026-03-19 12:08:39.349078 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2026-03-19 12:08:39.349091 | controller | Thursday 19 March 2026  12:08:39 +0000 (0:00:00.024)       0:01:10.326 ********
2026-03-19 12:08:39.349101 | controller | ok: [instance] => (item=compute-0)
2026-03-19 12:08:39.465814 | controller | ok: [instance] => (item=controller-0)
2026-03-19 12:08:39.465839 | controller | ok: [instance] => (item=crc-0)
2026-03-19 12:08:39.465848 | controller |
2026-03-19 12:08:39.465855 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2026-03-19 12:08:39.465862 | controller | Thursday 19 March 2026  12:08:39 +0000 (0:00:00.209)       0:01:10.535 ********
2026-03-19 12:08:39.465894 | controller |
2026-03-19 12:08:39.506701 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-19 12:08:39.506718 | controller | Thursday 19 March 2026  12:08:39 +0000 (0:00:00.117)       0:01:10.652 ********
2026-03-19 12:08:39.506729 | controller | ok: [instance]
2026-03-19 12:08:39.701274 | controller |
2026-03-19 12:08:39.701332 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-19 12:08:39.701345 | controller | Thursday 19 March 2026  12:08:39 +0000 (0:00:00.040)       0:01:10.693 ********
2026-03-19 12:08:39.701362 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 12:08:39.701405 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 12:08:39.701416 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-19 12:08:39.701426 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-19 12:08:39.701436 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-19 12:08:39.701445 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-19 12:08:39.701462 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-19 12:08:39.701481 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 12:08:39.701490 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 12:08:39.701504 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-19 12:08:39.701520 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 12:08:39.701553 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 12:08:39.701565 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-19 12:08:39.701987 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-19 12:08:39.702027 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-19 12:08:42.746791 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-19 12:08:42.746823 | controller |
2026-03-19 12:08:42.746831 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-19 12:08:42.746837 | controller | Thursday 19 March 2026  12:08:39 +0000 (0:00:00.194)       0:01:10.887 ********
2026-03-19 12:08:42.746847 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120175 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120207 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120216 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120222 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120229 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120235 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120241 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 12:08:43.120248 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 12:08:43.120254 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-19 12:08:43.120267 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 12:08:43.120273 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 12:08:43.120290 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-19 12:08:43.120297 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-19 12:08:43.120303 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-19 12:08:43.120309 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-19 12:08:43.120316 | controller |
2026-03-19 12:08:43.120323 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-19 12:08:43.120330 | controller | Thursday 19 March 2026  12:08:42 +0000 (0:00:03.044)       0:01:13.932 ********
2026-03-19 12:08:43.120341 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120369 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120376 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120383 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120389 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120395 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120401 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-19 12:08:43.120407 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 12:08:43.120413 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 12:08:43.120421 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-19 12:08:43.120444 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 12:08:43.120450 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 12:08:43.120458 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-19 12:08:43.120959 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-19 12:08:43.140162 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-19 12:08:43.140191 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-19 12:08:43.140206 | controller |
2026-03-19 12:08:43.140214 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] ****************
2026-03-19 12:08:43.140221 | controller | Thursday 19 March 2026  12:08:43 +0000 (0:00:00.374)       0:01:14.306 ********
2026-03-19 12:08:43.140231 | controller | ok: [instance]
2026-03-19 12:08:43.140263 | controller |
2026-03-19 12:08:43.140489 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] **************
2026-03-19 12:08:43.183184 | controller | Thursday 19 March 2026  12:08:43 +0000 (0:00:00.020)       0:01:14.327 ********
2026-03-19 12:08:43.183225 | controller | skipping: [instance] => (item=compute)
2026-03-19 12:08:43.214364 | controller | skipping: [instance] => (item=controller)
2026-03-19 12:08:43.214397 | controller | skipping: [instance] => (item=crc)
2026-03-19 12:08:43.214414 | controller | skipping: [instance]
2026-03-19 12:08:43.214425 | controller |
2026-03-19 12:08:43.214435 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] *******
2026-03-19 12:08:43.214445 | controller | Thursday 19 March 2026  12:08:43 +0000 (0:00:00.042)       0:01:14.369 ********
2026-03-19 12:08:43.214460 | controller | skipping: [instance]
2026-03-19 12:08:43.214504 | controller |
2026-03-19 12:08:43.214518 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2026-03-19 12:08:43.214565 | controller | Thursday 19 March 2026  12:08:43 +0000 (0:00:00.031)       0:01:14.401 ********
2026-03-19 12:08:43.582061 | controller | changed: [instance]
2026-03-19 12:08:44.206096 | controller |
2026-03-19 12:08:44.206127 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2026-03-19 12:08:44.206135 | controller | Thursday 19 March 2026  12:08:43 +0000 (0:00:00.356)       0:01:14.757 ********
2026-03-19 12:08:44.206141 | controller |
2026-03-19 12:08:44.206146 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-03-19 12:08:44.206151 | controller | Thursday 19 March 2026  12:08:43 +0000 (0:00:00.010)       0:01:14.768 ********
2026-03-19 12:08:44.206161 | controller | changed: [instance]
2026-03-19 12:08:44.558832 | controller |
2026-03-19 12:08:44.558861 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-19 12:08:44.558870 | controller | Thursday 19 March 2026  12:08:44 +0000 (0:00:00.624)       0:01:15.392 ********
2026-03-19 12:08:44.558880 | controller | changed: [instance]
2026-03-19 12:08:44.906121 | controller |
2026-03-19 12:08:44.906153 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2026-03-19 12:08:44.906161 | controller | Thursday 19 March 2026  12:08:44 +0000 (0:00:00.352)       0:01:15.745 ********
2026-03-19 12:08:44.906172 | controller | changed: [instance]
2026-03-19 12:08:45.273536 | controller |
2026-03-19 12:08:45.273565 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2026-03-19 12:08:45.273573 | controller | Thursday 19 March 2026  12:08:44 +0000 (0:00:00.347)       0:01:16.092 ********
2026-03-19 12:08:45.273583 | controller | changed: [instance]
2026-03-19 12:08:45.643870 | controller |
2026-03-19 12:08:45.643899 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2026-03-19 12:08:45.643908 | controller | Thursday 19 March 2026  12:08:45 +0000 (0:00:00.367)       0:01:16.460 ********
2026-03-19 12:08:45.643917 | controller | changed: [instance]
2026-03-19 12:08:45.676750 | controller |
2026-03-19 12:08:45.676769 | controller | TASK [Build utility records dataset] *******************************************
2026-03-19 12:08:45.676778 | controller | Thursday 19 March 2026  12:08:45 +0000 (0:00:00.370)       0:01:16.830 ********
2026-03-19 12:08:45.676794 | controller |
2026-03-19 12:08:45.769080 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-19 12:08:45.769111 | controller | Thursday 19 March 2026  12:08:45 +0000 (0:00:00.033)       0:01:16.863 ********
2026-03-19 12:08:45.769122 | controller | ok: [instance]
2026-03-19 12:08:45.769146 | controller |
2026-03-19 12:08:45.769155 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-19 12:08:45.769184 | controller | Thursday 19 March 2026  12:08:45 +0000 (0:00:00.092)       0:01:16.956 ********
2026-03-19 12:08:45.867162 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-19 12:08:45.867265 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 12:08:45.867297 | controller |
2026-03-19 12:08:45.867305 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-19 12:08:45.867314 | controller | Thursday 19 March 2026  12:08:45 +0000 (0:00:00.097)       0:01:17.053 ********
2026-03-19 12:08:46.328174 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-19 12:08:46.612116 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 12:08:46.612156 | controller |
2026-03-19 12:08:46.612168 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-19 12:08:46.612177 | controller | Thursday 19 March 2026  12:08:46 +0000 (0:00:00.460)       0:01:17.514 ********
2026-03-19 12:08:46.612191 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-19 12:08:46.612223 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 12:08:46.612234 | controller |
2026-03-19 12:08:46.612902 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-03-19 12:08:47.046536 | controller | Thursday 19 March 2026  12:08:46 +0000 (0:00:00.273)       0:01:17.788 ********
2026-03-19 12:08:47.046572 | controller |
2026-03-19 12:08:47.046580 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-19 12:08:47.046585 | controller | Thursday 19 March 2026  12:08:46 +0000 (0:00:00.010)       0:01:17.798 ********
2026-03-19 12:08:47.046596 | controller | changed: [instance]
2026-03-19 12:08:47.399696 | controller |
2026-03-19 12:08:47.399725 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-19 12:08:47.399733 | controller | Thursday 19 March 2026  12:08:47 +0000 (0:00:00.434)       0:01:18.233 ********
2026-03-19 12:08:47.399743 | controller | changed: [instance]
2026-03-19 12:08:47.432484 | controller |
2026-03-19 12:08:47.432502 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2026-03-19 12:08:47.432509 | controller | Thursday 19 March 2026  12:08:47 +0000 (0:00:00.353)       0:01:18.586 ********
2026-03-19 12:08:47.432517 | controller | skipping: [instance]
2026-03-19 12:08:47.511000 | controller |
2026-03-19 12:08:47.511064 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2026-03-19 12:08:47.511078 | controller | Thursday 19 March 2026  12:08:47 +0000 (0:00:00.032)       0:01:18.619 ********
2026-03-19 12:08:47.511095 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2026-03-19 12:08:47.705827 | controller |
2026-03-19 12:08:47.705846 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2026-03-19 12:08:47.705854 | controller | Thursday 19 March 2026  12:08:47 +0000 (0:00:00.078)       0:01:18.697 ********
2026-03-19 12:08:47.705863 | controller | ok: [instance]
2026-03-19 12:08:47.725556 | controller |
2026-03-19 12:08:47.725575 | controller | TASK [Deploy CRC if needed] ****************************************************
2026-03-19 12:08:47.725584 | controller | Thursday 19 March 2026  12:08:47 +0000 (0:00:00.195)       0:01:18.892 ********
2026-03-19 12:08:47.725594 | controller | skipping: [instance]
2026-03-19 12:08:48.072090 | controller |
2026-03-19 12:08:48.072349 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2026-03-19 12:08:48.072357 | controller | Thursday 19 March 2026  12:08:47 +0000 (0:00:00.019)       0:01:18.912 ********
2026-03-19 12:08:48.072372 | controller | ok: [instance]
2026-03-19 12:08:48.072394 | controller |
2026-03-19 12:08:48.072401 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2026-03-19 12:08:48.072409 | controller | Thursday 19 March 2026  12:08:48 +0000 (0:00:00.346)       0:01:19.258 ********
2026-03-19 12:08:48.298173 | controller | ok: [instance]
2026-03-19 12:08:48.298230 | controller |
2026-03-19 12:08:48.298243 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2026-03-19 12:08:48.298373 | controller | Thursday 19 March 2026  12:08:48 +0000 (0:00:00.226)       0:01:19.485 ********
2026-03-19 12:08:48.517130 | controller | ok: [instance]
2026-03-19 12:08:48.517188 | controller |
2026-03-19 12:08:48.517293 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2026-03-19 12:08:48.517388 | controller | Thursday 19 March 2026  12:08:48 +0000 (0:00:00.219)       0:01:19.704 ********
2026-03-19 12:08:48.737536 | controller | ok: [instance]
2026-03-19 12:08:48.737585 | controller |
2026-03-19 12:08:48.737684 | controller | TASK [rhol_crc : Destroy default network] **************************************
2026-03-19 12:08:48.737780 | controller | Thursday 19 March 2026  12:08:48 +0000 (0:00:00.220)       0:01:19.924 ********
2026-03-19 12:08:48.958769 | controller | ok: [instance]
2026-03-19 12:08:48.958818 | controller |
2026-03-19 12:08:48.958914 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-19 12:08:48.959022 | controller | Thursday 19 March 2026  12:08:48 +0000 (0:00:00.221)       0:01:20.146 ********
2026-03-19 12:08:48.999188 | controller |
2026-03-19 12:08:48.999338 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-03-19 12:08:49.192586 | controller | Thursday 19 March 2026  12:08:48 +0000 (0:00:00.040)       0:01:20.186 ********
2026-03-19 12:08:49.192619 | controller | ok: [instance]
2026-03-19 12:08:49.214148 | controller |
2026-03-19 12:08:49.214199 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-03-19 12:08:49.214210 | controller | Thursday 19 March 2026  12:08:49 +0000 (0:00:00.193)       0:01:20.379 ********
2026-03-19 12:08:49.214224 | controller | ok: [instance]
2026-03-19 12:08:49.239181 | controller |
2026-03-19 12:08:49.239216 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-03-19 12:08:49.239225 | controller | Thursday 19 March 2026  12:08:49 +0000 (0:00:00.021)       0:01:20.400 ********
2026-03-19 12:08:49.239236 | controller | skipping: [instance]
2026-03-19 12:08:49.239267 | controller |
2026-03-19 12:08:49.239289 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2026-03-19 12:08:49.239458 | controller | Thursday 19 March 2026  12:08:49 +0000 (0:00:00.025)       0:01:20.425 ********
2026-03-19 12:08:49.532521 | controller | ok: [instance]
2026-03-19 12:08:49.787741 | controller |
2026-03-19 12:08:49.787760 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2026-03-19 12:08:49.787767 | controller | Thursday 19 March 2026  12:08:49 +0000 (0:00:00.293)       0:01:20.719 ********
2026-03-19 12:08:49.787776 | controller | ok: [instance]
2026-03-19 12:08:49.959713 | controller |
2026-03-19 12:08:49.959733 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2026-03-19 12:08:49.959740 | controller | Thursday 19 March 2026  12:08:49 +0000 (0:00:00.254)       0:01:20.974 ********
2026-03-19 12:08:49.959748 | controller | ok: [instance]
2026-03-19 12:08:50.018167 | controller |
2026-03-19 12:08:50.018204 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2026-03-19 12:08:50.018213 | controller | Thursday 19 March 2026  12:08:49 +0000 (0:00:00.172)       0:01:21.146 ********
2026-03-19 12:08:50.018224 | controller |
2026-03-19 12:08:50.060151 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-19 12:08:50.060175 | controller | Thursday 19 March 2026  12:08:50 +0000 (0:00:00.058)       0:01:21.204 ********
2026-03-19 12:08:50.060188 | controller | ok: [instance] => changed=false
2026-03-19 12:08:50.060224 | controller |   msg: All assertions passed
2026-03-19 12:08:50.060530 | controller |
2026-03-19 12:08:50.243764 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-19 12:08:50.243788 | controller | Thursday 19 March 2026  12:08:50 +0000 (0:00:00.042)       0:01:21.247 ********
2026-03-19 12:08:50.243805 | controller | ok: [instance]
2026-03-19 12:08:50.434362 | controller |
2026-03-19 12:08:50.434381 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-19 12:08:50.434389 | controller | Thursday 19 March 2026  12:08:50 +0000 (0:00:00.183)       0:01:21.430 ********
2026-03-19 12:08:50.434398 | controller | ok: [instance]
2026-03-19 12:08:50.458772 | controller |
2026-03-19 12:08:50.458791 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-19 12:08:50.458800 | controller | Thursday 19 March 2026  12:08:50 +0000 (0:00:00.190)       0:01:21.621 ********
2026-03-19 12:08:50.458810 | controller | ok: [instance] => changed=false
2026-03-19 12:08:50.645246 | controller |   msg: All assertions passed
2026-03-19 12:08:50.645314 | controller |
2026-03-19 12:08:50.645329 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-19 12:08:50.645340 | controller | Thursday 19 March 2026  12:08:50 +0000 (0:00:00.024)       0:01:21.645 ********
2026-03-19 12:08:50.645358 | controller | ok: [instance]
2026-03-19 12:08:50.823466 | controller |
2026-03-19 12:08:50.823500 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-19 12:08:50.823508 | controller | Thursday 19 March 2026  12:08:50 +0000 (0:00:00.186)       0:01:21.832 ********
2026-03-19 12:08:50.823518 | controller | ok: [instance]
2026-03-19 12:08:50.874225 | controller |
2026-03-19 12:08:50.874264 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-19 12:08:50.874297 | controller | Thursday 19 March 2026  12:08:50 +0000 (0:00:00.178)       0:01:22.010 ********
2026-03-19 12:08:50.874314 | controller | ok: [instance]
2026-03-19 12:08:50.874352 | controller |
2026-03-19 12:08:50.874367 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2026-03-19 12:08:51.259088 | controller | Thursday 19 March 2026  12:08:50 +0000 (0:00:00.050)       0:01:22.061 ********
2026-03-19 12:08:51.259124 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2026-03-19 12:08:51.259150 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2026-03-19 12:08:51.259159 | controller |
2026-03-19 12:08:51.259346 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2026-03-19 12:08:51.279129 | controller | Thursday 19 March 2026  12:08:51 +0000 (0:00:00.384)       0:01:22.445 ********
2026-03-19 12:08:51.279158 | controller | skipping: [instance]
2026-03-19 12:08:51.279401 | controller |
2026-03-19 12:08:51.279430 | controller | TASK [Load the architecture local kustomize patches] ***************************
2026-03-19 12:08:51.304766 | controller | Thursday 19 March 2026  12:08:51 +0000 (0:00:00.020)       0:01:22.466 ********
2026-03-19 12:08:51.304787 | controller | skipping: [instance]
2026-03-19 12:08:51.438465 | controller |
2026-03-19 12:08:51.438496 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2026-03-19 12:08:51.438508 | controller | Thursday 19 March 2026  12:08:51 +0000 (0:00:00.025)       0:01:22.491 ********
2026-03-19 12:08:51.438523 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2026-03-19 12:08:51.462975 | controller |
2026-03-19 12:08:51.462991 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2026-03-19 12:08:51.462998 | controller | Thursday 19 March 2026  12:08:51 +0000 (0:00:00.133)       0:01:22.625 ********
2026-03-19 12:08:51.463022 | controller | skipping: [instance]
2026-03-19 12:08:51.867814 | controller |
2026-03-19 12:08:51.867833 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2026-03-19 12:08:51.867841 | controller | Thursday 19 March 2026  12:08:51 +0000 (0:00:00.024)       0:01:22.649 ********
2026-03-19 12:08:51.867849 | controller | changed: [instance]
2026-03-19 12:08:52.355102 | controller |
2026-03-19 12:08:52.355147 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2026-03-19 12:08:52.355158 | controller | Thursday 19 March 2026  12:08:51 +0000 (0:00:00.404)       0:01:23.054 ********
2026-03-19 12:08:52.355172 | controller | changed: [instance]
2026-03-19 12:08:52.355213 | controller |
2026-03-19 12:08:52.355224 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2026-03-19 12:08:52.355631 | controller | Thursday 19 March 2026  12:08:52 +0000 (0:00:00.476)       0:01:23.531 ********
2026-03-19 12:08:52.772575 | controller |
2026-03-19 12:08:52.772600 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-19 12:08:52.772608 | controller | Thursday 19 March 2026  12:08:52 +0000 (0:00:00.010)       0:01:23.541 ********
2026-03-19 12:08:52.772617 | controller | changed: [instance]
2026-03-19 12:08:53.415751 | controller |
2026-03-19 12:08:53.415779 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-03-19 12:08:53.415787 | controller | Thursday 19 March 2026  12:08:52 +0000 (0:00:00.417)       0:01:23.959 ********
2026-03-19 12:08:53.415797 | controller | changed: [instance]
2026-03-19 12:08:53.447120 | controller |
2026-03-19 12:08:53.447159 | controller | TASK [Deploy virtualbmc] *******************************************************
2026-03-19 12:08:53.447170 | controller | Thursday 19 March 2026  12:08:53 +0000 (0:00:00.643)       0:01:24.602 ********
2026-03-19 12:08:53.447184 | controller | skipping: [instance]
2026-03-19 12:08:53.478713 | controller |
2026-03-19 12:08:53.478744 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2026-03-19 12:08:53.478753 | controller | Thursday 19 March 2026  12:08:53 +0000 (0:00:00.031)       0:01:24.634 ********
2026-03-19 12:08:53.478763 | controller | skipping: [instance]
2026-03-19 12:08:53.478787 | controller |
2026-03-19 12:08:53.478795 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2026-03-19 12:08:53.478869 | controller | Thursday 19 March 2026  12:08:53 +0000 (0:00:00.031)       0:01:24.665 ********
2026-03-19 12:08:54.010866 | controller | changed: [instance] => (item=workload)
2026-03-19 12:08:54.410775 | controller | changed: [instance] => (item=reproducer-inventory)
2026-03-19 12:08:54.410806 | controller | ok: [instance] => (item=volumes)
2026-03-19 12:08:54.410814 | controller |
2026-03-19 12:08:54.410820 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2026-03-19 12:08:54.410826 | controller | Thursday 19 March 2026  12:08:54 +0000 (0:00:00.531)       0:01:25.197 ********
2026-03-19 12:08:54.410835 | controller | changed: [instance] => (item=workload)
2026-03-19 12:08:54.435167 | controller | changed: [instance] => (item=volumes)
2026-03-19 12:08:54.435199 | controller |
2026-03-19 12:08:54.435209 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2026-03-19 12:08:54.435217 | controller | Thursday 19 March 2026  12:08:54 +0000 (0:00:00.400)       0:01:25.597 ********
2026-03-19 12:08:54.435230 | controller | skipping: [instance]
2026-03-19 12:08:54.435260 | controller |
2026-03-19 12:08:54.435279 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2026-03-19 12:08:54.435398 | controller | Thursday 19 March 2026  12:08:54 +0000 (0:00:00.024)       0:01:25.622 ********
2026-03-19 12:08:55.434182 | controller | changed: [instance] => (item=compute)
2026-03-19 12:08:55.434218 | controller | changed: [instance] => (item=controller)
2026-03-19 12:08:55.434227 | controller | changed: [instance] => (item=crc)
2026-03-19 12:08:55.434235 | controller |
2026-03-19 12:08:55.434242 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2026-03-19 12:08:55.434252 | controller | Thursday 19 March 2026  12:08:55 +0000 (0:00:00.998)       0:01:26.620 ********
2026-03-19 12:08:55.466974 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance
2026-03-19 12:08:55.467121 | controller |
2026-03-19 12:08:55.467162 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] *****************
2026-03-19 12:08:55.467180 | controller | Thursday 19 March 2026  12:08:55 +0000 (0:00:00.033)       0:01:26.653 ********
2026-03-19 12:08:55.637121 | controller | ok: [instance]
2026-03-19 12:08:55.657072 | controller |
2026-03-19 12:08:55.657092 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] *************
2026-03-19 12:08:55.657101 | controller | Thursday 19 March 2026  12:08:55 +0000 (0:00:00.170)       0:01:26.823 ********
2026-03-19 12:08:55.657111 | controller | skipping: [instance]
2026-03-19 12:08:55.657136 | controller |
2026-03-19 12:08:55.657143 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] ***
2026-03-19 12:08:55.657151 | controller | Thursday 19 March 2026  12:08:55 +0000 (0:00:00.019)       0:01:26.843 ********
2026-03-19 12:08:56.055407 | controller | changed: [instance]
2026-03-19 12:08:56.075106 | controller |
2026-03-19 12:08:56.075128 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] *********************
2026-03-19 12:08:56.075137 | controller | Thursday 19 March 2026  12:08:56 +0000 (0:00:00.398)       0:01:27.242 ********
2026-03-19 12:08:56.075148 | controller | skipping: [instance]
2026-03-19 12:08:56.093418 | controller |
2026-03-19 12:08:56.093436 | controller | TASK [libvirt_manager : Write merged all-group.yml] ****************************
2026-03-19 12:08:56.093444 | controller | Thursday 19 March 2026  12:08:56 +0000 (0:00:00.019)       0:01:27.261 ********
2026-03-19 12:08:56.093452 | controller | skipping: [instance]
2026-03-19 12:08:56.131184 | controller |
2026-03-19 12:08:56.131221 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2026-03-19 12:08:56.131231 | controller | Thursday 19 March 2026  12:08:56 +0000 (0:00:00.018)       0:01:27.280 ********
2026-03-19 12:08:56.131243 | controller | skipping: [instance]
2026-03-19 12:08:56.131519 | controller |
2026-03-19 12:08:56.131555 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2026-03-19 12:08:56.194192 | controller | Thursday 19 March 2026  12:08:56 +0000 (0:00:00.037)       0:01:27.318 ********
2026-03-19 12:08:56.194232 | controller | skipping: [instance] => (item=crc)
2026-03-19 12:08:56.194278 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2026-03-19 12:08:56.194291 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2026-03-19 12:08:56.194587 | controller |
2026-03-19 12:08:56.393410 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-03-19 12:08:56.393435 | controller | Thursday 19 March 2026  12:08:56 +0000 (0:00:00.062)       0:01:27.380 ********
2026-03-19 12:08:56.393446 | controller | changed: [instance]
2026-03-19 12:08:56.569596 | controller |
2026-03-19 12:08:56.569615 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-03-19 12:08:56.569623 | controller | Thursday 19 March 2026  12:08:56 +0000 (0:00:00.199)       0:01:27.579 ********
2026-03-19 12:08:56.569631 | controller | ok: [instance]
2026-03-19 12:09:26.915721 | controller |
2026-03-19 12:09:26.915755 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-03-19 12:09:26.915763 | controller | Thursday 19 March 2026  12:08:56 +0000 (0:00:00.176)       0:01:27.756 ********
2026-03-19 12:09:26.915773 | controller | changed: [instance]
2026-03-19 12:09:27.108575 | controller |
2026-03-19 12:09:27.108605 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-03-19 12:09:27.108613 | controller | Thursday 19 March 2026  12:09:26 +0000 (0:00:30.345)       0:01:58.102 ********
2026-03-19 12:09:27.108622 | controller | ok: [instance]
2026-03-19 12:09:27.150643 | controller |
2026-03-19 12:09:27.150666 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-03-19 12:09:27.150675 | controller | Thursday 19 March 2026  12:09:27 +0000 (0:00:00.193)       0:01:58.295 ********
2026-03-19 12:09:27.150686 | controller | ok: [instance] => changed=false
2026-03-19 12:09:27.355750 | controller |   msg: All assertions passed
2026-03-19 12:09:27.355774 | controller |
2026-03-19 12:09:27.355781 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-03-19 12:09:27.355788 | controller | Thursday 19 March 2026  12:09:27 +0000 (0:00:00.042)       0:01:58.337 ********
2026-03-19 12:09:27.355797 | controller | changed: [instance]
2026-03-19 12:09:27.562451 | controller |
2026-03-19 12:09:27.562473 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-03-19 12:09:27.562480 | controller | Thursday 19 March 2026  12:09:27 +0000 (0:00:00.204)       0:01:58.542 ********
2026-03-19 12:09:27.562493 | controller | ok: [instance]
2026-03-19 12:09:27.756397 | controller |
2026-03-19 12:09:27.756421 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-03-19 12:09:27.756429 | controller | Thursday 19 March 2026  12:09:27 +0000 (0:00:00.207)       0:01:58.749 ********
2026-03-19 12:09:27.756438 | controller | ok: [instance]
2026-03-19 12:09:27.779769 | controller |
2026-03-19 12:09:27.779797 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-03-19 12:09:27.779806 | controller | Thursday 19 March 2026  12:09:27 +0000 (0:00:00.193)       0:01:58.943 ********
2026-03-19 12:09:27.779817 | controller | skipping: [instance]
2026-03-19 12:09:27.975795 | controller |
2026-03-19 12:09:27.975817 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-03-19 12:09:27.975824 | controller | Thursday 19 March 2026  12:09:27 +0000 (0:00:00.023)       0:01:58.966 ********
2026-03-19 12:09:27.975833 | controller | ok: [instance]
2026-03-19 12:09:28.019825 | controller |
2026-03-19 12:09:28.019849 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-03-19 12:09:28.019858 | controller | Thursday 19 March 2026  12:09:27 +0000 (0:00:00.195)       0:01:59.162 ********
2026-03-19 12:09:28.019869 | controller | ok: [instance] => changed=false
2026-03-19 12:09:28.224890 | controller |   msg: All assertions passed
2026-03-19 12:09:28.224910 | controller |
2026-03-19 12:09:28.224917 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-03-19 12:09:28.224923 | controller | Thursday 19 March 2026  12:09:28 +0000 (0:00:00.043)       0:01:59.206 ********
2026-03-19 12:09:28.224931 | controller | ok: [instance]
2026-03-19 12:09:28.398350 | controller |
2026-03-19 12:09:28.398369 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2026-03-19 12:09:28.398376 | controller | Thursday 19 March 2026  12:09:28 +0000 (0:00:00.205)       0:01:59.411 ********
2026-03-19 12:09:28.398385 | controller | ok: [instance]
2026-03-19 12:09:28.790595 | controller |
2026-03-19 12:09:28.790625 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2026-03-19 12:09:28.790633 | controller | Thursday 19 March 2026  12:09:28 +0000 (0:00:00.173)       0:01:59.585 ********
2026-03-19 12:09:28.790643 | controller | changed: [instance]
2026-03-19 12:09:28.963194 | controller |
2026-03-19 12:09:28.963241 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2026-03-19 12:09:28.963255 | controller | Thursday 19 March 2026  12:09:28 +0000 (0:00:00.391)       0:01:59.977 ********
2026-03-19 12:09:28.963272 | controller | ok: [instance]
2026-03-19 12:09:29.137748 | controller |
2026-03-19 12:09:29.137781 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2026-03-19 12:09:29.137791 | controller | Thursday 19 March 2026  12:09:28 +0000 (0:00:00.172)       0:02:00.150 ********
2026-03-19 12:09:29.137802 | controller | ok: [instance]
2026-03-19 12:09:29.543111 | controller |
2026-03-19 12:09:29.543136 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2026-03-19 12:09:29.543143 | controller | Thursday 19 March 2026  12:09:29 +0000 (0:00:00.174)       0:02:00.324 ********
2026-03-19 12:09:29.543153 | controller | changed: [instance]
2026-03-19 12:09:29.543177 | controller |
2026-03-19 12:09:29.543422 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2026-03-19 12:09:29.564028 | controller | Thursday 19 March 2026  12:09:29 +0000 (0:00:00.405)       0:02:00.730 ********
2026-03-19 12:09:29.564051 | controller | ok: [instance]
2026-03-19 12:09:29.788804 | controller |
2026-03-19 12:09:29.788835 | controller | TASK [libvirt_manager : List existing networks] ********************************
2026-03-19 12:09:29.788844 | controller | Thursday 19 March 2026  12:09:29 +0000 (0:00:00.020)       0:02:00.750 ********
2026-03-19 12:09:29.788861 | controller | ok: [instance]
2026-03-19 12:09:30.251163 | controller |
2026-03-19 12:09:30.251192 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2026-03-19 12:09:30.251201 | controller | Thursday 19 March 2026  12:09:29 +0000 (0:00:00.224)       0:02:00.975 ********
2026-03-19 12:09:30.251211 | controller | ok: [instance]
2026-03-19 12:09:30.370128 | controller |
2026-03-19 12:09:30.370164 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2026-03-19 12:09:30.370174 | controller | Thursday 19 March 2026  12:09:30 +0000 (0:00:00.462)       0:02:01.437 ********
2026-03-19 12:09:30.370186 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-19 12:09:30.370220 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-19 12:09:30.370662 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-19 12:09:30.621680 | controller |
2026-03-19 12:09:30.621708 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2026-03-19 12:09:30.621716 | controller | Thursday 19 March 2026  12:09:30 +0000 (0:00:00.119)       0:02:01.556 ********
2026-03-19 12:09:30.621726 | controller | changed: [instance]
2026-03-19 12:09:30.849649 | controller |
2026-03-19 12:09:30.849679 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2026-03-19 12:09:30.849689 | controller | Thursday 19 March 2026  12:09:30 +0000 (0:00:00.251)       0:02:01.808 ********
2026-03-19 12:09:30.849699 | controller | changed: [instance]
2026-03-19 12:09:31.136380 | controller |
2026-03-19 12:09:31.136412 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2026-03-19 12:09:31.136421 | controller | Thursday 19 March 2026  12:09:30 +0000 (0:00:00.227)       0:02:02.036 ********
2026-03-19 12:09:31.136433 | controller | changed: [instance]
2026-03-19 12:09:31.165960 | controller |
2026-03-19 12:09:31.165982 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2026-03-19 12:09:31.165990 | controller | Thursday 19 March 2026  12:09:31 +0000 (0:00:00.286)       0:02:02.322 ********
2026-03-19 12:09:31.166000 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-19 12:09:31.211152 | controller |
2026-03-19 12:09:31.211203 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-19 12:09:31.211216 | controller | Thursday 19 March 2026  12:09:31 +0000 (0:00:00.029)       0:02:02.352 ********
2026-03-19 12:09:31.211232 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-19 12:09:31.211805 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-19 12:09:31.439083 | controller |
2026-03-19 12:09:31.439114 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 12:09:31.439122 | controller | Thursday 19 March 2026  12:09:31 +0000 (0:00:00.045)       0:02:02.398 ********
2026-03-19 12:09:31.439132 | controller | ok: [instance]
2026-03-19 12:09:31.439158 | controller |
2026-03-19 12:09:31.439180 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 12:09:31.439326 | controller | Thursday 19 March 2026  12:09:31 +0000 (0:00:00.228)       0:02:02.626 ********
2026-03-19 12:09:31.483167 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:09:31.483377 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 12:09:31.483399 | controller |
2026-03-19 12:09:31.483412 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 12:09:31.709749 | controller | Thursday 19 March 2026  12:09:31 +0000 (0:00:00.043)       0:02:02.670 ********
2026-03-19 12:09:31.709788 | controller | ok: [instance]
2026-03-19 12:09:31.912126 | controller |
2026-03-19 12:09:31.912161 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 12:09:31.912171 | controller | Thursday 19 March 2026  12:09:31 +0000 (0:00:00.226)       0:02:02.896 ********
2026-03-19 12:09:31.912183 | controller | ok: [instance]
2026-03-19 12:09:31.912212 | controller |
2026-03-19 12:09:31.912398 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2026-03-19 12:09:32.233913 | controller | Thursday 19 March 2026  12:09:31 +0000 (0:00:00.202)       0:02:03.099 ********
2026-03-19 12:09:32.233947 | controller | changed: [instance]
2026-03-19 12:09:32.459033 | controller |
2026-03-19 12:09:32.459063 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 12:09:32.459071 | controller | Thursday 19 March 2026  12:09:32 +0000 (0:00:00.321)       0:02:03.420 ********
2026-03-19 12:09:32.459086 | controller | ok: [instance]
2026-03-19 12:09:32.502683 | controller |
2026-03-19 12:09:32.502707 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 12:09:32.502715 | controller | Thursday 19 March 2026  12:09:32 +0000 (0:00:00.225)       0:02:03.645 ********
2026-03-19 12:09:32.502724 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:09:32.733140 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 12:09:32.733174 | controller |
2026-03-19 12:09:32.733184 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 12:09:32.733191 | controller | Thursday 19 March 2026  12:09:32 +0000 (0:00:00.043)       0:02:03.689 ********
2026-03-19 12:09:32.733203 | controller | ok: [instance]
2026-03-19 12:09:32.733234 | controller |
2026-03-19 12:09:32.733451 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 12:09:32.939157 | controller | Thursday 19 March 2026  12:09:32 +0000 (0:00:00.230)       0:02:03.920 ********
2026-03-19 12:09:32.939191 | controller | ok: [instance]
2026-03-19 12:09:32.939403 | controller |
2026-03-19 12:09:32.939421 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2026-03-19 12:09:33.258521 | controller | Thursday 19 March 2026  12:09:32 +0000 (0:00:00.205)       0:02:04.125 ********
2026-03-19 12:09:33.258556 | controller | changed: [instance]
2026-03-19 12:09:33.279146 | controller |
2026-03-19 12:09:33.279185 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2026-03-19 12:09:33.279196 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.319)       0:02:04.445 ********
2026-03-19 12:09:33.279209 | controller | skipping: [instance]
2026-03-19 12:09:33.279243 | controller |
2026-03-19 12:09:33.279253 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2026-03-19 12:09:33.279342 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.020)       0:02:04.466 ********
2026-03-19 12:09:33.305185 | controller | skipping: [instance]
2026-03-19 12:09:33.305230 | controller |
2026-03-19 12:09:33.305492 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2026-03-19 12:09:33.332962 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.026)       0:02:04.492 ********
2026-03-19 12:09:33.332989 | controller | skipping: [instance]
2026-03-19 12:09:33.358933 | controller |
2026-03-19 12:09:33.358961 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2026-03-19 12:09:33.358970 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.027)       0:02:04.519 ********
2026-03-19 12:09:33.358981 | controller | skipping: [instance]
2026-03-19 12:09:33.573575 | controller |
2026-03-19 12:09:33.573606 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-19 12:09:33.573614 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.025)       0:02:04.545 ********
2026-03-19 12:09:33.573624 | controller | changed: [instance]
2026-03-19 12:09:33.612155 | controller |
2026-03-19 12:09:33.612186 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-19 12:09:33.612196 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.214)       0:02:04.760 ********
2026-03-19 12:09:33.612208 | controller | ok: [instance]
2026-03-19 12:09:33.664524 | controller |
2026-03-19 12:09:33.664567 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-19 12:09:33.664582 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.038)       0:02:04.799 ********
2026-03-19 12:09:33.664606 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-03-19 12:09:33.664791 | controller |
2026-03-19 12:09:33.664832 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-03-19 12:09:33.862805 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.052)       0:02:04.851 ********
2026-03-19 12:09:33.862863 | controller | ok: [instance]
2026-03-19 12:09:33.862933 | controller |
2026-03-19 12:09:33.863078 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-03-19 12:09:33.863194 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.198)       0:02:05.049 ********
2026-03-19 12:09:33.925063 | controller | ok: [instance]
2026-03-19 12:09:33.925133 | controller |
2026-03-19 12:09:33.925262 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-03-19 12:09:33.925395 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.062)       0:02:05.111 ********
2026-03-19 12:09:33.972932 | controller | ok: [instance]
2026-03-19 12:09:33.973105 | controller |
2026-03-19 12:09:33.973257 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-03-19 12:09:33.973388 | controller | Thursday 19 March 2026  12:09:33 +0000 (0:00:00.047)       0:02:05.159 ********
2026-03-19 12:09:34.022450 | controller | skipping: [instance]
2026-03-19 12:09:34.022556 | controller |
2026-03-19 12:09:34.022667 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-03-19 12:09:34.022774 | controller | Thursday 19 March 2026  12:09:34 +0000 (0:00:00.049)       0:02:05.209 ********
2026-03-19 12:09:34.074643 | controller | skipping: [instance]
2026-03-19 12:09:34.074789 | controller |
2026-03-19 12:09:34.074924 | controller | TASK [Call the config_drive role] **********************************************
2026-03-19 12:09:34.075083 | controller | Thursday 19 March 2026  12:09:34 +0000 (0:00:00.052)       0:02:05.261 ********
2026-03-19 12:09:34.143419 | controller |
2026-03-19 12:09:34.143562 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-03-19 12:09:34.143668 | controller | Thursday 19 March 2026  12:09:34 +0000 (0:00:00.068)       0:02:05.330 ********
2026-03-19 12:09:34.554024 | controller | ok: [instance] => (item=artifacts)
2026-03-19 12:09:35.815093 | controller | ok: [instance] => (item=logs)
2026-03-19 12:09:35.815123 | controller |
2026-03-19 12:09:35.815131 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-03-19 12:09:35.815137 | controller | Thursday 19 March 2026  12:09:34 +0000 (0:00:00.410)       0:02:05.740 ********
2026-03-19 12:09:35.815146 | controller | ok: [instance]
2026-03-19 12:09:35.815174 | controller |
2026-03-19 12:09:35.815182 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-03-19 12:09:35.815338 | controller | Thursday 19 March 2026  12:09:35 +0000 (0:00:01.261)       0:02:07.001 ********
2026-03-19 12:09:36.027713 | controller | changed: [instance]
2026-03-19 12:09:36.399158 | controller |
2026-03-19 12:09:36.399211 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-03-19 12:09:36.399225 | controller | Thursday 19 March 2026  12:09:36 +0000 (0:00:00.212)       0:02:07.214 ********
2026-03-19 12:09:36.399244 | controller | changed: [instance]
2026-03-19 12:09:36.769726 | controller |
2026-03-19 12:09:36.769761 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-03-19 12:09:36.769774 | controller | Thursday 19 March 2026  12:09:36 +0000 (0:00:00.371)       0:02:07.585 ********
2026-03-19 12:09:36.769784 | controller | changed: [instance]
2026-03-19 12:09:36.815921 | controller |
2026-03-19 12:09:36.815952 | controller | TASK [config_drive : Generate network-data] ************************************
2026-03-19 12:09:36.815961 | controller | Thursday 19 March 2026  12:09:36 +0000 (0:00:00.370)       0:02:07.956 ********
2026-03-19 12:09:36.815972 | controller | skipping: [instance]
2026-03-19 12:09:37.019188 | controller |
2026-03-19 12:09:37.019225 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-03-19 12:09:37.019233 | controller | Thursday 19 March 2026  12:09:36 +0000 (0:00:00.046)       0:02:08.002 ********
2026-03-19 12:09:37.019244 | controller | ok: [instance]
2026-03-19 12:09:37.063896 | controller |
2026-03-19 12:09:37.063924 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-03-19 12:09:37.063934 | controller | Thursday 19 March 2026  12:09:37 +0000 (0:00:00.203)       0:02:08.205 ********
2026-03-19 12:09:37.063946 | controller | skipping: [instance]
2026-03-19 12:09:37.302869 | controller |
2026-03-19 12:09:37.302903 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-03-19 12:09:37.302911 | controller | Thursday 19 March 2026  12:09:37 +0000 (0:00:00.044)       0:02:08.250 ********
2026-03-19 12:09:37.302921 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2026-03-19 12:09:37.578728 | controller | changed: [instance]
2026-03-19 12:09:37.578763 | controller |
2026-03-19 12:09:37.578771 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-19 12:09:37.578782 | controller | Thursday 19 March 2026  12:09:37 +0000 (0:00:00.238)       0:02:08.489 ********
2026-03-19 12:09:37.578792 | controller | changed: [instance]
2026-03-19 12:09:37.627911 | controller |
2026-03-19 12:09:37.627943 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-19 12:09:37.627952 | controller | Thursday 19 March 2026  12:09:37 +0000 (0:00:00.275)       0:02:08.765 ********
2026-03-19 12:09:37.627962 | controller | skipping: [instance]
2026-03-19 12:09:37.657503 | controller |
2026-03-19 12:09:37.657527 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ********************
2026-03-19 12:09:37.657535 | controller | Thursday 19 March 2026  12:09:37 +0000 (0:00:00.049)       0:02:08.814 ********
2026-03-19 12:09:37.657544 | controller | skipping: [instance]
2026-03-19 12:09:37.902546 | controller |
2026-03-19 12:09:37.902585 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2026-03-19 12:09:37.902594 | controller | Thursday 19 March 2026  12:09:37 +0000 (0:00:00.029)       0:02:08.844 ********
2026-03-19 12:09:37.902606 | controller | changed: [instance]
2026-03-19 12:09:38.127002 | controller |
2026-03-19 12:09:38.127054 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2026-03-19 12:09:38.127063 | controller | Thursday 19 March 2026  12:09:37 +0000 (0:00:00.244)       0:02:09.089 ********
2026-03-19 12:09:38.127073 | controller | changed: [instance]
2026-03-19 12:09:38.415108 | controller |
2026-03-19 12:09:38.415146 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2026-03-19 12:09:38.415156 | controller | Thursday 19 March 2026  12:09:38 +0000 (0:00:00.224)       0:02:09.313 ********
2026-03-19 12:09:38.415168 | controller | changed: [instance]
2026-03-19 12:09:38.415372 | controller |
2026-03-19 12:09:38.415388 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2026-03-19 12:09:38.443794 | controller | Thursday 19 March 2026  12:09:38 +0000 (0:00:00.288)       0:02:09.601 ********
2026-03-19 12:09:38.443814 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-19 12:09:38.488166 | controller |
2026-03-19 12:09:38.488196 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-19 12:09:38.488203 | controller | Thursday 19 March 2026  12:09:38 +0000 (0:00:00.028)       0:02:09.630 ********
2026-03-19 12:09:38.488213 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-19 12:09:38.711383 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-19 12:09:38.711413 | controller |
2026-03-19 12:09:38.711421 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 12:09:38.711427 | controller | Thursday 19 March 2026  12:09:38 +0000 (0:00:00.044)       0:02:09.675 ********
2026-03-19 12:09:38.711437 | controller | ok: [instance]
2026-03-19 12:09:38.756953 | controller |
2026-03-19 12:09:38.756978 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 12:09:38.756987 | controller | Thursday 19 March 2026  12:09:38 +0000 (0:00:00.223)       0:02:09.898 ********
2026-03-19 12:09:38.756998 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:09:38.995088 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 12:09:38.995121 | controller |
2026-03-19 12:09:38.995129 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 12:09:38.995140 | controller | Thursday 19 March 2026  12:09:38 +0000 (0:00:00.045)       0:02:09.943 ********
2026-03-19 12:09:38.995151 | controller | ok: [instance]
2026-03-19 12:09:38.995407 | controller |
2026-03-19 12:09:39.196768 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 12:09:39.196803 | controller | Thursday 19 March 2026  12:09:38 +0000 (0:00:00.238)       0:02:10.182 ********
2026-03-19 12:09:39.196817 | controller | ok: [instance]
2026-03-19 12:09:39.474109 | controller |
2026-03-19 12:09:39.474142 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2026-03-19 12:09:39.474154 | controller | Thursday 19 March 2026  12:09:39 +0000 (0:00:00.201)       0:02:10.383 ********
2026-03-19 12:09:39.474165 | controller | changed: [instance]
2026-03-19 12:09:39.474189 | controller |
2026-03-19 12:09:39.474197 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 12:09:39.474279 | controller | Thursday 19 March 2026  12:09:39 +0000 (0:00:00.277)       0:02:10.661 ********
2026-03-19 12:09:39.699543 | controller | ok: [instance]
2026-03-19 12:09:39.743105 | controller |
2026-03-19 12:09:39.743139 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 12:09:39.743148 | controller | Thursday 19 March 2026  12:09:39 +0000 (0:00:00.225)       0:02:10.886 ********
2026-03-19 12:09:39.743158 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:09:39.743181 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 12:09:39.743189 | controller |
2026-03-19 12:09:39.743398 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 12:09:39.974097 | controller | Thursday 19 March 2026  12:09:39 +0000 (0:00:00.043)       0:02:10.930 ********
2026-03-19 12:09:39.974137 | controller | ok: [instance]
2026-03-19 12:09:40.176787 | controller |
2026-03-19 12:09:40.176823 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 12:09:40.176833 | controller | Thursday 19 March 2026  12:09:39 +0000 (0:00:00.230)       0:02:11.160 ********
2026-03-19 12:09:40.176845 | controller | ok: [instance]
2026-03-19 12:09:40.504094 | controller |
2026-03-19 12:09:40.504126 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2026-03-19 12:09:40.504134 | controller | Thursday 19 March 2026  12:09:40 +0000 (0:00:00.202)       0:02:11.363 ********
2026-03-19 12:09:40.504145 | controller | changed: [instance]
2026-03-19 12:09:40.525915 | controller |
2026-03-19 12:09:40.525954 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2026-03-19 12:09:40.525964 | controller | Thursday 19 March 2026  12:09:40 +0000 (0:00:00.327)       0:02:11.690 ********
2026-03-19 12:09:40.525976 | controller | skipping: [instance]
2026-03-19 12:09:40.554893 | controller |
2026-03-19 12:09:40.554912 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2026-03-19 12:09:40.554919 | controller | Thursday 19 March 2026  12:09:40 +0000 (0:00:00.021)       0:02:11.712 ********
2026-03-19 12:09:40.554928 | controller | skipping: [instance]
2026-03-19 12:09:40.582190 | controller |
2026-03-19 12:09:40.582226 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2026-03-19 12:09:40.582236 | controller | Thursday 19 March 2026  12:09:40 +0000 (0:00:00.028)       0:02:11.741 ********
2026-03-19 12:09:40.582247 | controller | skipping: [instance]
2026-03-19 12:09:40.582273 | controller |
2026-03-19 12:09:40.582283 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2026-03-19 12:09:40.609880 | controller | Thursday 19 March 2026  12:09:40 +0000 (0:00:00.027)       0:02:11.769 ********
2026-03-19 12:09:40.609902 | controller | skipping: [instance]
2026-03-19 12:09:40.830132 | controller |
2026-03-19 12:09:40.830172 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-19 12:09:40.830181 | controller | Thursday 19 March 2026  12:09:40 +0000 (0:00:00.027)       0:02:11.796 ********
2026-03-19 12:09:40.830191 | controller | changed: [instance]
2026-03-19 12:09:40.867074 | controller |
2026-03-19 12:09:40.867092 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-19 12:09:40.867100 | controller | Thursday 19 March 2026  12:09:40 +0000 (0:00:00.220)       0:02:12.016 ********
2026-03-19 12:09:40.867108 | controller | ok: [instance]
2026-03-19 12:09:40.867197 | controller |
2026-03-19 12:09:40.867207 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-19 12:09:40.867215 | controller | Thursday 19 March 2026  12:09:40 +0000 (0:00:00.037)       0:02:12.054 ********
2026-03-19 12:09:40.958592 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-03-19 12:09:41.156948 | controller |
2026-03-19 12:09:41.156966 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-03-19 12:09:41.156979 | controller | Thursday 19 March 2026  12:09:40 +0000 (0:00:00.091)       0:02:12.145 ********
2026-03-19 12:09:41.156992 | controller | ok: [instance]
2026-03-19 12:09:41.255874 | controller |
2026-03-19 12:09:41.255896 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-03-19 12:09:41.255905 | controller | Thursday 19 March 2026  12:09:41 +0000 (0:00:00.198)       0:02:12.343 ********
2026-03-19 12:09:41.255916 | controller | ok: [instance]
2026-03-19 12:09:41.302201 | controller |
2026-03-19 12:09:41.302241 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-03-19 12:09:41.302251 | controller | Thursday 19 March 2026  12:09:41 +0000 (0:00:00.099)       0:02:12.442 ********
2026-03-19 12:09:41.302264 | controller | ok: [instance]
2026-03-19 12:09:41.347625 | controller |
2026-03-19 12:09:41.347651 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-03-19 12:09:41.347661 | controller | Thursday 19 March 2026  12:09:41 +0000 (0:00:00.046)       0:02:12.488 ********
2026-03-19 12:09:41.347672 | controller | skipping: [instance]
2026-03-19 12:09:41.391164 | controller |
2026-03-19 12:09:41.391197 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-03-19 12:09:41.391207 | controller | Thursday 19 March 2026  12:09:41 +0000 (0:00:00.045)       0:02:12.534 ********
2026-03-19 12:09:41.391219 | controller | skipping: [instance]
2026-03-19 12:09:41.391260 | controller |
2026-03-19 12:09:41.391278 | controller | TASK [Call the config_drive role] **********************************************
2026-03-19 12:09:41.391289 | controller | Thursday 19 March 2026  12:09:41 +0000 (0:00:00.043)       0:02:12.578 ********
2026-03-19 12:09:41.451142 | controller |
2026-03-19 12:09:41.451365 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-03-19 12:09:41.451438 | controller | Thursday 19 March 2026  12:09:41 +0000 (0:00:00.060)       0:02:12.638 ********
2026-03-19 12:09:41.851145 | controller | ok: [instance] => (item=artifacts)
2026-03-19 12:09:41.851180 | controller | ok: [instance] => (item=logs)
2026-03-19 12:09:41.851189 | controller |
2026-03-19 12:09:41.851197 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-03-19 12:09:41.851207 | controller | Thursday 19 March 2026  12:09:41 +0000 (0:00:00.399)       0:02:13.037 ********
2026-03-19 12:09:43.127092 | controller | ok: [instance]
2026-03-19 12:09:43.344361 | controller |
2026-03-19 12:09:43.344392 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-03-19 12:09:43.344402 | controller | Thursday 19 March 2026  12:09:43 +0000 (0:00:01.275)       0:02:14.313 ********
2026-03-19 12:09:43.344414 | controller | changed: [instance]
2026-03-19 12:09:43.713767 | controller |
2026-03-19 12:09:43.713791 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-03-19 12:09:43.713799 | controller | Thursday 19 March 2026  12:09:43 +0000 (0:00:00.217)       0:02:14.531 ********
2026-03-19 12:09:43.713808 | controller | changed: [instance]
2026-03-19 12:09:44.087885 | controller |
2026-03-19 12:09:44.087911 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-03-19 12:09:44.087919 | controller | Thursday 19 March 2026  12:09:43 +0000 (0:00:00.369)       0:02:14.900 ********
2026-03-19 12:09:44.087928 | controller | changed: [instance]
2026-03-19 12:09:44.134680 | controller |
2026-03-19 12:09:44.134699 | controller | TASK [config_drive : Generate network-data] ************************************
2026-03-19 12:09:44.134707 | controller | Thursday 19 March 2026  12:09:44 +0000 (0:00:00.374)       0:02:15.274 ********
2026-03-19 12:09:44.134716 | controller | skipping: [instance]
2026-03-19 12:09:44.337716 | controller |
2026-03-19 12:09:44.337747 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-03-19 12:09:44.337760 | controller | Thursday 19 March 2026  12:09:44 +0000 (0:00:00.046)       0:02:15.321 ********
2026-03-19 12:09:44.337774 | controller | ok: [instance]
2026-03-19 12:09:44.379578 | controller |
2026-03-19 12:09:44.379600 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-03-19 12:09:44.379609 | controller | Thursday 19 March 2026  12:09:44 +0000 (0:00:00.202)       0:02:15.524 ********
2026-03-19 12:09:44.379620 | controller | skipping: [instance]
2026-03-19 12:09:44.615790 | controller |
2026-03-19 12:09:44.615810 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-03-19 12:09:44.615821 | controller | Thursday 19 March 2026  12:09:44 +0000 (0:00:00.042)       0:02:15.566 ********
2026-03-19 12:09:44.615830 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2026-03-19 12:09:44.892380 | controller | changed: [instance]
2026-03-19 12:09:44.892405 | controller |
2026-03-19 12:09:44.892412 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-19 12:09:44.892419 | controller | Thursday 19 March 2026  12:09:44 +0000 (0:00:00.236)       0:02:15.802 ********
2026-03-19 12:09:44.892431 | controller | changed: [instance]
2026-03-19 12:09:44.941818 | controller |
2026-03-19 12:09:44.941840 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-19 12:09:44.941850 | controller | Thursday 19 March 2026  12:09:44 +0000 (0:00:00.276)       0:02:16.079 ********
2026-03-19 12:09:44.941860 | controller | skipping: [instance]
2026-03-19 12:09:44.971146 | controller |
2026-03-19 12:09:44.971191 | controller | TASK [libvirt_manager : Configure boot order for controller-0] *****************
2026-03-19 12:09:44.971202 | controller | Thursday 19 March 2026  12:09:44 +0000 (0:00:00.049)       0:02:16.128 ********
2026-03-19 12:09:44.971215 | controller | skipping: [instance]
2026-03-19 12:09:44.971223 | controller |
2026-03-19 12:09:44.971232 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2026-03-19 12:09:45.218537 | controller | Thursday 19 March 2026  12:09:44 +0000 (0:00:00.029)       0:02:16.158 ********
2026-03-19 12:09:45.218566 | controller | changed: [instance]
2026-03-19 12:09:45.446040 | controller |
2026-03-19 12:09:45.446071 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2026-03-19 12:09:45.446079 | controller | Thursday 19 March 2026  12:09:45 +0000 (0:00:00.247)       0:02:16.405 ********
2026-03-19 12:09:45.446089 | controller | changed: [instance]
2026-03-19 12:09:45.742817 | controller |
2026-03-19 12:09:45.742849 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2026-03-19 12:09:45.742857 | controller | Thursday 19 March 2026  12:09:45 +0000 (0:00:00.227)       0:02:16.632 ********
2026-03-19 12:09:45.742867 | controller | changed: [instance]
2026-03-19 12:09:45.771607 | controller |
2026-03-19 12:09:45.771625 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2026-03-19 12:09:45.771633 | controller | Thursday 19 March 2026  12:09:45 +0000 (0:00:00.296)       0:02:16.929 ********
2026-03-19 12:09:45.771642 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-19 12:09:45.816135 | controller |
2026-03-19 12:09:45.816158 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-19 12:09:45.816167 | controller | Thursday 19 March 2026  12:09:45 +0000 (0:00:00.029)       0:02:16.958 ********
2026-03-19 12:09:45.816178 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-19 12:09:45.816208 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-19 12:09:45.816216 | controller |
2026-03-19 12:09:45.816225 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 12:09:45.816343 | controller | Thursday 19 March 2026  12:09:45 +0000 (0:00:00.044)       0:02:17.003 ********
2026-03-19 12:09:46.045906 | controller | ok: [instance]
2026-03-19 12:09:46.091113 | controller |
2026-03-19 12:09:46.091136 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 12:09:46.091146 | controller | Thursday 19 March 2026  12:09:46 +0000 (0:00:00.229)       0:02:17.232 ********
2026-03-19 12:09:46.091157 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:09:46.091406 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 12:09:46.091424 | controller |
2026-03-19 12:09:46.319637 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 12:09:46.319667 | controller | Thursday 19 March 2026  12:09:46 +0000 (0:00:00.045)       0:02:17.277 ********
2026-03-19 12:09:46.319684 | controller | ok: [instance]
2026-03-19 12:09:46.518924 | controller |
2026-03-19 12:09:46.518956 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 12:09:46.518964 | controller | Thursday 19 March 2026  12:09:46 +0000 (0:00:00.228)       0:02:17.506 ********
2026-03-19 12:09:46.518974 | controller | ok: [instance]
2026-03-19 12:09:46.805838 | controller |
2026-03-19 12:09:46.805865 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2026-03-19 12:09:46.805874 | controller | Thursday 19 March 2026  12:09:46 +0000 (0:00:00.199)       0:02:17.705 ********
2026-03-19 12:09:46.805883 | controller | changed: [instance]
2026-03-19 12:09:47.036395 | controller |
2026-03-19 12:09:47.036438 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 12:09:47.036448 | controller | Thursday 19 March 2026  12:09:46 +0000 (0:00:00.286)       0:02:17.992 ********
2026-03-19 12:09:47.036460 | controller | ok: [instance]
2026-03-19 12:09:47.080892 | controller |
2026-03-19 12:09:47.080914 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 12:09:47.080923 | controller | Thursday 19 March 2026  12:09:47 +0000 (0:00:00.230)       0:02:18.223 ********
2026-03-19 12:09:47.080934 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 12:09:47.310604 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 12:09:47.310634 | controller |
2026-03-19 12:09:47.310643 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 12:09:47.310649 | controller | Thursday 19 March 2026  12:09:47 +0000 (0:00:00.044)       0:02:18.267 ********
2026-03-19 12:09:47.310659 | controller | ok: [instance]
2026-03-19 12:09:47.514118 | controller |
2026-03-19 12:09:47.514150 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 12:09:47.514162 | controller | Thursday 19 March 2026  12:09:47 +0000 (0:00:00.229)       0:02:18.497 ********
2026-03-19 12:09:47.514172 | controller | ok: [instance]
2026-03-19 12:09:47.514220 | controller |
2026-03-19 12:09:47.514244 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2026-03-19 12:09:47.514256 | controller | Thursday 19 March 2026  12:09:47 +0000 (0:00:00.203)       0:02:18.701 ********
2026-03-19 12:09:47.804714 | controller | changed: [instance]
2026-03-19 12:09:47.825128 | controller |
2026-03-19 12:09:47.825165 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2026-03-19 12:09:47.825176 | controller | Thursday 19 March 2026  12:09:47 +0000 (0:00:00.290)       0:02:18.991 ********
2026-03-19 12:09:47.825189 | controller | skipping: [instance]
2026-03-19 12:09:47.825220 | controller |
2026-03-19 12:09:47.825230 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2026-03-19 12:09:47.825375 | controller | Thursday 19 March 2026  12:09:47 +0000 (0:00:00.020)       0:02:19.012 ********
2026-03-19 12:09:47.853795 | controller | skipping: [instance]
2026-03-19 12:09:47.882227 | controller |
2026-03-19 12:09:47.882266 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2026-03-19 12:09:47.882277 | controller | Thursday 19 March 2026  12:09:47 +0000 (0:00:00.028)       0:02:19.040 ********
2026-03-19 12:09:47.882290 | controller | skipping: [instance]
2026-03-19 12:09:47.909200 | controller |
2026-03-19 12:09:47.909234 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2026-03-19 12:09:47.909245 | controller | Thursday 19 March 2026  12:09:47 +0000 (0:00:00.028)       0:02:19.068 ********
2026-03-19 12:09:47.909257 | controller | skipping: [instance]
2026-03-19 12:09:48.121228 | controller |
2026-03-19 12:09:48.121256 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-19 12:09:48.121266 | controller | Thursday 19 March 2026  12:09:47 +0000 (0:00:00.026)       0:02:19.095 ********
2026-03-19 12:09:48.121275 | controller | changed: [instance]
2026-03-19 12:09:48.158089 | controller |
2026-03-19 12:09:48.158122 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-19 12:09:48.158131 | controller | Thursday 19 March 2026  12:09:48 +0000 (0:00:00.212)       0:02:19.308 ********
2026-03-19 12:09:48.158141 | controller | ok: [instance]
2026-03-19 12:09:48.158166 | controller |
2026-03-19 12:09:48.158174 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-19 12:09:48.158305 | controller | Thursday 19 March 2026  12:09:48 +0000 (0:00:00.037)       0:02:19.345 ********
2026-03-19 12:09:48.185631 | controller | skipping: [instance]
2026-03-19 12:09:48.213419 | controller |
2026-03-19 12:09:48.213444 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-19 12:09:48.213451 | controller | Thursday 19 March 2026  12:09:48 +0000 (0:00:00.027)       0:02:19.372 ********
2026-03-19 12:09:48.213460 | controller | skipping: [instance]
2026-03-19 12:09:48.259165 | controller |
2026-03-19 12:09:48.259203 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-19 12:09:48.259214 | controller | Thursday 19 March 2026  12:09:48 +0000 (0:00:00.027)       0:02:19.400 ********
2026-03-19 12:09:48.259226 | controller | skipping: [instance]
2026-03-19 12:09:48.259259 | controller |
2026-03-19 12:09:48.259269 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************
2026-03-19 12:09:48.259296 | controller | Thursday 19 March 2026  12:09:48 +0000 (0:00:00.045)       0:02:19.446 ********
2026-03-19 12:09:48.286141 | controller | skipping: [instance]
2026-03-19 12:09:48.286351 | controller |
2026-03-19 12:09:48.286374 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2026-03-19 12:09:48.349889 | controller | Thursday 19 March 2026  12:09:48 +0000 (0:00:00.026)       0:02:19.472 ********
2026-03-19 12:09:48.349916 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2026-03-19 12:09:48.594824 | controller |
2026-03-19 12:09:48.594850 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2026-03-19 12:09:48.594859 | controller | Thursday 19 March 2026  12:09:48 +0000 (0:00:00.063)       0:02:19.536 ********
2026-03-19 12:09:48.594868 | controller | ok: [instance] => (item=crc)
2026-03-19 12:09:50.663913 | controller |
2026-03-19 12:09:50.663950 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2026-03-19 12:09:50.663961 | controller | Thursday 19 March 2026  12:09:48 +0000 (0:00:00.244)       0:02:19.781 ********
2026-03-19 12:09:50.663973 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-19 12:09:50.664187 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-19 12:09:50.664375 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-19 12:09:50.664526 | controller |
2026-03-19 12:09:50.664689 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-19 12:09:50.664834 | controller | Thursday 19 March 2026  12:09:50 +0000 (0:00:02.069)       0:02:21.850 ********
2026-03-19 12:09:51.225471 | controller | changed: [instance]
2026-03-19 12:09:51.696583 | controller |
2026-03-19 12:09:51.696618 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-19 12:09:51.696628 | controller | Thursday 19 March 2026  12:09:51 +0000 (0:00:00.561)       0:02:22.412 ********
2026-03-19 12:09:51.696640 | controller | changed: [instance]
2026-03-19 12:09:52.227582 | controller |
2026-03-19 12:09:52.227612 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-19 12:09:52.227620 | controller | Thursday 19 March 2026  12:09:51 +0000 (0:00:00.471)       0:02:22.883 ********
2026-03-19 12:09:52.227630 | controller | changed: [instance]
2026-03-19 12:09:52.966068 | controller |
2026-03-19 12:09:52.966103 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2026-03-19 12:09:52.966111 | controller | Thursday 19 March 2026  12:09:52 +0000 (0:00:00.530)       0:02:23.414 ********
2026-03-19 12:09:52.966123 | controller | changed: [instance] => (item=compute-0.utility)
2026-03-19 12:09:52.967057 | controller | changed: [instance] => (item=controller-0.utility)
2026-03-19 12:09:52.967072 | controller | changed: [instance] => (item=crc-0.utility)
2026-03-19 12:10:16.033469 | controller |
2026-03-19 12:10:16.033501 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2026-03-19 12:10:16.033516 | controller | Thursday 19 March 2026  12:09:52 +0000 (0:00:00.738)       0:02:24.152 ********
2026-03-19 12:10:16.033527 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2026-03-19 12:10:16.153227 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2026-03-19 12:10:16.153255 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2026-03-19 12:10:16.153262 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2026-03-19 12:10:16.153268 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2026-03-19 12:10:16.153274 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left).
2026-03-19 12:10:16.153279 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left).
2026-03-19 12:10:16.153285 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j223729203165.22216', 'results_file': '/home/zuul/.ansible_async/j223729203165.22216', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2026-03-19 12:10:16.153297 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j815531626911.22233', 'results_file': '/home/zuul/.ansible_async/j815531626911.22233', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2026-03-19 12:10:16.153304 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j749592119400.22249', 'results_file': '/home/zuul/.ansible_async/j749592119400.22249', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2026-03-19 12:10:16.153309 | controller |
2026-03-19 12:10:16.153315 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2026-03-19 12:10:16.153351 | controller | Thursday 19 March 2026  12:10:16 +0000 (0:00:23.066)       0:02:47.219 ********
2026-03-19 12:10:16.153363 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-19 12:10:16.177721 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-19 12:10:16.177741 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-19 12:10:16.177749 | controller |
2026-03-19 12:10:16.177755 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-19 12:10:16.177761 | controller | Thursday 19 March 2026  12:10:16 +0000 (0:00:00.120)       0:02:47.339 ********
2026-03-19 12:10:16.177769 | controller | skipping: [instance]
2026-03-19 12:10:16.218258 | controller |
2026-03-19 12:10:16.218277 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2026-03-19 12:10:16.218300 | controller | Thursday 19 March 2026  12:10:16 +0000 (0:00:00.024)       0:02:47.364 ********
2026-03-19 12:10:16.218310 | controller |
2026-03-19 12:10:16.301503 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-19 12:10:16.301521 | controller | Thursday 19 March 2026  12:10:16 +0000 (0:00:00.040)       0:02:47.405 ********
2026-03-19 12:10:16.301535 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-03-19 12:10:16.528715 | controller |
2026-03-19 12:10:16.528746 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-19 12:10:16.528760 | controller | Thursday 19 March 2026  12:10:16 +0000 (0:00:00.083)       0:02:47.488 ********
2026-03-19 12:10:16.528770 | controller | changed: [instance]
2026-03-19 12:10:16.735485 | controller |
2026-03-19 12:10:16.735520 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-19 12:10:16.735528 | controller | Thursday 19 March 2026  12:10:16 +0000 (0:00:00.226)       0:02:47.715 ********
2026-03-19 12:10:16.735539 | controller | changed: [instance]
2026-03-19 12:10:16.735563 | controller |
2026-03-19 12:10:16.735572 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2026-03-19 12:10:17.126004 | controller | Thursday 19 March 2026  12:10:16 +0000 (0:00:00.206)       0:02:47.921 ********
2026-03-19 12:10:17.126057 | controller | changed: [instance]
2026-03-19 12:10:17.156031 | controller |
2026-03-19 12:10:17.156052 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2026-03-19 12:10:17.156059 | controller | Thursday 19 March 2026  12:10:17 +0000 (0:00:00.390)       0:02:48.312 ********
2026-03-19 12:10:17.156068 | controller | skipping: [instance]
2026-03-19 12:10:17.185973 | controller |
2026-03-19 12:10:17.185993 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-19 12:10:17.186001 | controller | Thursday 19 March 2026  12:10:17 +0000 (0:00:00.030)       0:02:48.342 ********
2026-03-19 12:10:17.186030 | controller | skipping: [instance]
2026-03-19 12:10:17.235080 | controller |
2026-03-19 12:10:17.235105 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2026-03-19 12:10:17.235113 | controller | Thursday 19 March 2026  12:10:17 +0000 (0:00:00.030)       0:02:48.372 ********
2026-03-19 12:10:17.235123 | controller | skipping: [instance]
2026-03-19 12:10:17.288397 | controller |
2026-03-19 12:10:17.288420 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2026-03-19 12:10:17.288427 | controller | Thursday 19 March 2026  12:10:17 +0000 (0:00:00.048)       0:02:48.421 ********
2026-03-19 12:10:17.288437 | controller | skipping: [instance]
2026-03-19 12:10:17.312586 | controller |
2026-03-19 12:10:17.312604 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-19 12:10:17.312611 | controller | Thursday 19 March 2026  12:10:17 +0000 (0:00:00.053)       0:02:48.475 ********
2026-03-19 12:10:17.312619 | controller | skipping: [instance]
2026-03-19 12:10:17.351298 | controller |
2026-03-19 12:10:17.351317 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2026-03-19 12:10:17.351325 | controller | Thursday 19 March 2026  12:10:17 +0000 (0:00:00.024)       0:02:48.499 ********
2026-03-19 12:10:17.351348 | controller |
2026-03-19 12:10:17.433412 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-19 12:10:17.433450 | controller | Thursday 19 March 2026  12:10:17 +0000 (0:00:00.038)       0:02:48.538 ********
2026-03-19 12:10:17.433476 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-03-19 12:10:17.433496 | controller |
2026-03-19 12:10:17.433503 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-19 12:10:17.433511 | controller | Thursday 19 March 2026  12:10:17 +0000 (0:00:00.081)       0:02:48.620 ********
2026-03-19 12:10:17.672433 | controller | ok: [instance]
2026-03-19 12:10:17.672486 | controller |
2026-03-19 12:10:17.672586 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-19 12:10:17.672689 | controller | Thursday 19 March 2026  12:10:17 +0000 (0:00:00.239)       0:02:48.859 ********
2026-03-19 12:10:17.897890 | controller | ok: [instance]
2026-03-19 12:10:17.897943 | controller |
2026-03-19 12:10:17.898045 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2026-03-19 12:10:17.898145 | controller | Thursday 19 March 2026  12:10:17 +0000 (0:00:00.225)       0:02:49.084 ********
2026-03-19 12:10:18.310257 | controller | changed: [instance]
2026-03-19 12:10:18.310511 | controller |
2026-03-19 12:10:18.340951 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2026-03-19 12:10:18.340984 | controller | Thursday 19 March 2026  12:10:18 +0000 (0:00:00.412)       0:02:49.497 ********
2026-03-19 12:10:18.340997 | controller | skipping: [instance]
2026-03-19 12:10:18.341036 | controller |
2026-03-19 12:10:18.341062 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-19 12:10:18.341081 | controller | Thursday 19 March 2026  12:10:18 +0000 (0:00:00.030)       0:02:49.527 ********
2026-03-19 12:10:18.369574 | controller | skipping: [instance]
2026-03-19 12:10:18.369692 | controller |
2026-03-19 12:10:18.369988 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2026-03-19 12:10:20.081401 | controller | Thursday 19 March 2026  12:10:18 +0000 (0:00:00.028)       0:02:49.556 ********
2026-03-19 12:10:20.081445 | controller | changed: [instance -> controller-0.instance]
2026-03-19 12:10:21.216432 | controller |
2026-03-19 12:10:21.216470 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2026-03-19 12:10:21.216478 | controller | Thursday 19 March 2026  12:10:20 +0000 (0:00:01.711)       0:02:51.267 ********
2026-03-19 12:10:21.216489 | controller | changed: [instance -> controller-0.instance]
2026-03-19 12:10:21.256884 | controller |
2026-03-19 12:10:21.256903 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-19 12:10:21.256910 | controller | Thursday 19 March 2026  12:10:21 +0000 (0:00:01.135)       0:02:52.403 ********
2026-03-19 12:10:21.256918 | controller |
2026-03-19 12:10:21.477240 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-03-19 12:10:21.477283 | controller | Thursday 19 March 2026  12:10:21 +0000 (0:00:00.040)       0:02:52.443 ********
2026-03-19 12:10:21.477296 | controller | ok: [instance]
2026-03-19 12:10:21.477316 | controller |
2026-03-19 12:10:21.477389 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-03-19 12:10:21.477479 | controller | Thursday 19 March 2026  12:10:21 +0000 (0:00:00.220)       0:02:52.664 ********
2026-03-19 12:10:21.510746 | controller | ok: [instance]
2026-03-19 12:10:21.510825 | controller |
2026-03-19 12:10:21.510923 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-03-19 12:10:21.511038 | controller | Thursday 19 March 2026  12:10:21 +0000 (0:00:00.033)       0:02:52.697 ********
2026-03-19 12:10:21.542531 | controller | skipping: [instance]
2026-03-19 12:10:21.542913 | controller |
2026-03-19 12:10:21.590836 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2026-03-19 12:10:21.590862 | controller | Thursday 19 March 2026  12:10:21 +0000 (0:00:00.031)       0:02:52.729 ********
2026-03-19 12:10:21.590876 | controller |
2026-03-19 12:10:21.590921 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-19 12:10:21.591057 | controller | Thursday 19 March 2026  12:10:21 +0000 (0:00:00.048)       0:02:52.778 ********
2026-03-19 12:10:21.691077 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2026-03-19 12:10:21.691313 | controller |
2026-03-19 12:10:21.691728 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-19 12:10:21.950987 | controller | Thursday 19 March 2026  12:10:21 +0000 (0:00:00.099)       0:02:52.877 ********
2026-03-19 12:10:21.951042 | controller | ok: [instance]
2026-03-19 12:10:22.180455 | controller |
2026-03-19 12:10:22.180487 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-19 12:10:22.180495 | controller | Thursday 19 March 2026  12:10:21 +0000 (0:00:00.259)       0:02:53.137 ********
2026-03-19 12:10:22.180506 | controller | ok: [instance]
2026-03-19 12:10:22.594773 | controller |
2026-03-19 12:10:22.594810 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2026-03-19 12:10:22.594829 | controller | Thursday 19 March 2026  12:10:22 +0000 (0:00:00.229)       0:02:53.366 ********
2026-03-19 12:10:22.594841 | controller | changed: [instance]
2026-03-19 12:10:22.594859 | controller |
2026-03-19 12:10:22.594866 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2026-03-19 12:10:22.595049 | controller | Thursday 19 March 2026  12:10:22 +0000 (0:00:00.414)       0:02:53.781 ********
2026-03-19 12:10:23.442541 | controller | changed: [instance]
2026-03-19 12:10:23.442601 | controller |
2026-03-19 12:10:23.442681 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-19 12:10:23.442773 | controller | Thursday 19 March 2026  12:10:23 +0000 (0:00:00.847)       0:02:54.629 ********
2026-03-19 12:10:23.473381 | controller | skipping: [instance]
2026-03-19 12:10:23.473462 | controller |
2026-03-19 12:10:23.473564 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2026-03-19 12:10:23.473653 | controller | Thursday 19 March 2026  12:10:23 +0000 (0:00:00.031)       0:02:54.660 ********
2026-03-19 12:10:23.521426 | controller | skipping: [instance]
2026-03-19 12:10:23.521504 | controller |
2026-03-19 12:10:23.521596 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2026-03-19 12:10:23.521684 | controller | Thursday 19 March 2026  12:10:23 +0000 (0:00:00.048)       0:02:54.708 ********
2026-03-19 12:10:23.570046 | controller | skipping: [instance]
2026-03-19 12:10:23.570169 | controller |
2026-03-19 12:10:23.570268 | controller | TASK [Create VBMC entity] ******************************************************
2026-03-19 12:10:23.570375 | controller | Thursday 19 March 2026  12:10:23 +0000 (0:00:00.048)       0:02:54.757 ********
2026-03-19 12:10:23.620444 | controller | skipping: [instance] => (item=compute-0)
2026-03-19 12:10:23.620545 | controller | skipping: [instance] => (item=controller-0)
2026-03-19 12:10:23.620642 | controller | skipping: [instance] => (item=crc-0)
2026-03-19 12:10:23.620739 | controller | skipping: [instance]
2026-03-19 12:10:23.620826 | controller |
2026-03-19 12:10:23.620915 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2026-03-19 12:10:23.621039 | controller | Thursday 19 March 2026  12:10:23 +0000 (0:00:00.050)       0:02:54.807 ********
2026-03-19 12:10:23.876299 | controller | ok: [instance]
2026-03-19 12:10:23.876381 | controller |
2026-03-19 12:10:23.876443 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2026-03-19 12:10:23.876546 | controller | Thursday 19 March 2026  12:10:23 +0000 (0:00:00.255)       0:02:55.063 ********
2026-03-19 12:10:24.273476 | controller | changed: [instance]
2026-03-19 12:10:24.273526 | controller |
2026-03-19 12:10:24.273619 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2026-03-19 12:10:24.273720 | controller | Thursday 19 March 2026  12:10:24 +0000 (0:00:00.397)       0:02:55.460 ********
2026-03-19 12:10:24.314845 | controller | skipping: [instance]
2026-03-19 12:10:24.314923 | controller |
2026-03-19 12:10:24.315047 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2026-03-19 12:10:24.315125 | controller | Thursday 19 March 2026  12:10:24 +0000 (0:00:00.037)       0:02:55.497 ********
2026-03-19 12:10:24.359669 | controller | skipping: [instance]
2026-03-19 12:10:24.359736 | controller |
2026-03-19 12:10:24.359813 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2026-03-19 12:10:24.359900 | controller | Thursday 19 March 2026  12:10:24 +0000 (0:00:00.046)       0:02:55.543 ********
2026-03-19 12:10:24.405423 | controller | skipping: [instance]
2026-03-19 12:10:24.405472 | controller |
2026-03-19 12:10:24.405579 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2026-03-19 12:10:24.405663 | controller | Thursday 19 March 2026  12:10:24 +0000 (0:00:00.048)       0:02:55.592 ********
2026-03-19 12:10:25.239221 | controller | changed: [instance]
2026-03-19 12:10:25.239276 | controller |
2026-03-19 12:10:25.239401 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2026-03-19 12:10:25.239485 | controller | Thursday 19 March 2026  12:10:25 +0000 (0:00:00.833)       0:02:56.426 ********
2026-03-19 12:10:26.065251 | controller | changed: [instance]
2026-03-19 12:10:26.065307 | controller |
2026-03-19 12:10:26.065416 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2026-03-19 12:10:26.065542 | controller | Thursday 19 March 2026  12:10:26 +0000 (0:00:00.824)       0:02:57.250 ********
2026-03-19 12:10:26.110378 | controller | skipping: [instance]
2026-03-19 12:10:26.110446 | controller |
2026-03-19 12:10:26.110551 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2026-03-19 12:10:26.110650 | controller | Thursday 19 March 2026  12:10:26 +0000 (0:00:00.046)       0:02:57.297 ********
2026-03-19 12:10:26.178566 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2026-03-19 12:10:26.178626 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2026-03-19 12:10:26.178723 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2026-03-19 12:10:26.178809 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2026-03-19 12:10:26.178889 | controller |
2026-03-19 12:10:26.178978 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2026-03-19 12:10:26.179092 | controller | Thursday 19 March 2026  12:10:26 +0000 (0:00:00.068)       0:02:57.365 ********
2026-03-19 12:10:26.228286 | controller | skipping: [instance]
2026-03-19 12:10:26.228363 | controller |
2026-03-19 12:10:26.228457 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2026-03-19 12:10:26.228565 | controller | Thursday 19 March 2026  12:10:26 +0000 (0:00:00.046)       0:02:57.411 ********
2026-03-19 12:10:26.265973 | controller | skipping: [instance]
2026-03-19 12:10:26.266089 | controller |
2026-03-19 12:10:26.266165 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2026-03-19 12:10:26.266253 | controller | Thursday 19 March 2026  12:10:26 +0000 (0:00:00.041)       0:02:57.453 ********
2026-03-19 12:10:26.303213 | controller | skipping: [instance]
2026-03-19 12:10:26.303293 | controller |
2026-03-19 12:10:26.303395 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2026-03-19 12:10:26.303485 | controller | Thursday 19 March 2026  12:10:26 +0000 (0:00:00.037)       0:02:57.490 ********
2026-03-19 12:10:26.341085 | controller | skipping: [instance]
2026-03-19 12:10:26.341167 | controller |
2026-03-19 12:10:26.341276 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2026-03-19 12:10:26.341368 | controller | Thursday 19 March 2026  12:10:26 +0000 (0:00:00.036)       0:02:57.526 ********
2026-03-19 12:10:27.024212 | controller | changed: [instance]
2026-03-19 12:10:27.024272 | controller |
2026-03-19 12:10:27.024355 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2026-03-19 12:10:27.024453 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.684)       0:02:58.211 ********
2026-03-19 12:10:27.059385 | controller | skipping: [instance]
2026-03-19 12:10:27.059471 | controller |
2026-03-19 12:10:27.059583 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2026-03-19 12:10:27.059692 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.035)       0:02:58.246 ********
2026-03-19 12:10:27.106336 | controller | skipping: [instance]
2026-03-19 12:10:27.106430 | controller |
2026-03-19 12:10:27.106536 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2026-03-19 12:10:27.106616 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.047)       0:02:58.293 ********
2026-03-19 12:10:27.149580 | controller | skipping: [instance]
2026-03-19 12:10:27.149629 | controller |
2026-03-19 12:10:27.149827 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-19 12:10:27.186606 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.043)       0:02:58.336 ********
2026-03-19 12:10:27.186635 | controller | skipping: [instance]
2026-03-19 12:10:27.186716 | controller |
2026-03-19 12:10:27.186800 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-19 12:10:27.186902 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.036)       0:02:58.373 ********
2026-03-19 12:10:27.227528 | controller | skipping: [instance]
2026-03-19 12:10:27.227611 | controller |
2026-03-19 12:10:27.227708 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-19 12:10:27.227801 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.040)       0:02:58.414 ********
2026-03-19 12:10:27.264808 | controller | skipping: [instance]
2026-03-19 12:10:27.264900 | controller |
2026-03-19 12:10:27.264994 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-19 12:10:27.265112 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.037)       0:02:58.451 ********
2026-03-19 12:10:27.312134 | controller | skipping: [instance]
2026-03-19 12:10:27.312221 | controller |
2026-03-19 12:10:27.312328 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-19 12:10:27.312439 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.046)       0:02:58.498 ********
2026-03-19 12:10:27.353166 | controller | skipping: [instance]
2026-03-19 12:10:27.353234 | controller |
2026-03-19 12:10:27.353331 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-19 12:10:27.353444 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.041)       0:02:58.540 ********
2026-03-19 12:10:27.388389 | controller | skipping: [instance]
2026-03-19 12:10:27.388482 | controller |
2026-03-19 12:10:27.388580 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-19 12:10:27.388668 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.035)       0:02:58.575 ********
2026-03-19 12:10:27.434799 | controller | skipping: [instance]
2026-03-19 12:10:27.434856 | controller |
2026-03-19 12:10:27.434993 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2026-03-19 12:10:27.435167 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.045)       0:02:58.621 ********
2026-03-19 12:10:27.470855 | controller | skipping: [instance]
2026-03-19 12:10:27.470944 | controller |
2026-03-19 12:10:27.471066 | controller | TASK [reproducer : Configure Controller node] **********************************
2026-03-19 12:10:27.471163 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.036)       0:02:58.658 ********
2026-03-19 12:10:27.624217 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2026-03-19 12:10:27.624275 | controller |
2026-03-19 12:10:27.624359 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-03-19 12:10:27.624458 | controller | Thursday 19 March 2026  12:10:27 +0000 (0:00:00.153)       0:02:58.811 ********
2026-03-19 12:10:29.021577 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-03-19 12:10:29.021627 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-03-19 12:10:29.021694 | controller |
2026-03-19 12:10:29.021796 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-03-19 12:10:29.021885 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:01.396)       0:03:00.208 ********
2026-03-19 12:10:29.042841 | controller | skipping: [instance]
2026-03-19 12:10:29.043031 | controller |
2026-03-19 12:10:29.043236 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-19 12:10:29.043418 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:00.021)       0:03:00.229 ********
2026-03-19 12:10:29.703303 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:29.703360 | controller |
2026-03-19 12:10:29.703383 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-19 12:10:29.703479 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:00.660)       0:03:00.890 ********
2026-03-19 12:10:29.738847 | controller | skipping: [instance]
2026-03-19 12:10:29.738929 | controller |
2026-03-19 12:10:29.739045 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-19 12:10:29.739168 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:00.035)       0:03:00.925 ********
2026-03-19 12:10:29.772622 | controller | skipping: [instance]
2026-03-19 12:10:29.772712 | controller |
2026-03-19 12:10:29.772828 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-19 12:10:29.772938 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:00.033)       0:03:00.959 ********
2026-03-19 12:10:29.806563 | controller | skipping: [instance]
2026-03-19 12:10:29.806644 | controller |
2026-03-19 12:10:29.806809 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-19 12:10:29.806864 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:00.033)       0:03:00.993 ********
2026-03-19 12:10:29.848762 | controller | skipping: [instance]
2026-03-19 12:10:29.848882 | controller |
2026-03-19 12:10:29.848988 | controller | TASK [reproducer : Get rhos-release] *******************************************
2026-03-19 12:10:29.849108 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:00.042)       0:03:01.035 ********
2026-03-19 12:10:29.881879 | controller | skipping: [instance]
2026-03-19 12:10:29.881997 | controller |
2026-03-19 12:10:29.882112 | controller | TASK [reproducer : Install repos] **********************************************
2026-03-19 12:10:29.882201 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:00.033)       0:03:01.068 ********
2026-03-19 12:10:29.917599 | controller | skipping: [instance]
2026-03-19 12:10:29.917700 | controller |
2026-03-19 12:10:29.917814 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2026-03-19 12:10:29.917923 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:00.035)       0:03:01.104 ********
2026-03-19 12:10:29.952033 | controller | skipping: [instance]
2026-03-19 12:10:29.952129 | controller |
2026-03-19 12:10:29.952222 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2026-03-19 12:10:29.952312 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:00.034)       0:03:01.139 ********
2026-03-19 12:10:29.984053 | controller | skipping: [instance]
2026-03-19 12:10:29.984154 | controller |
2026-03-19 12:10:29.984258 | controller | TASK [reproducer : Install some tools] *****************************************
2026-03-19 12:10:29.984370 | controller | Thursday 19 March 2026  12:10:29 +0000 (0:00:00.032)       0:03:01.171 ********
2026-03-19 12:10:31.110755 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:31.110800 | controller |
2026-03-19 12:10:31.110863 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2026-03-19 12:10:31.110954 | controller | Thursday 19 March 2026  12:10:31 +0000 (0:00:01.126)       0:03:02.297 ********
2026-03-19 12:10:32.333057 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:33.036503 | controller |
2026-03-19 12:10:33.036534 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2026-03-19 12:10:33.036542 | controller | Thursday 19 March 2026  12:10:32 +0000 (0:00:01.222)       0:03:03.519 ********
2026-03-19 12:10:33.036552 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:34.113273 | controller |
2026-03-19 12:10:34.113308 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2026-03-19 12:10:34.113316 | controller | Thursday 19 March 2026  12:10:33 +0000 (0:00:00.703)       0:03:04.223 ********
2026-03-19 12:10:34.113326 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:35.152644 | controller |
2026-03-19 12:10:35.152678 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2026-03-19 12:10:35.152686 | controller | Thursday 19 March 2026  12:10:34 +0000 (0:00:01.071)       0:03:05.294 ********
2026-03-19 12:10:35.152697 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-03-19 12:10:35.914048 | controller | skipping: [instance] => (item=compute-0)
2026-03-19 12:10:35.914081 | controller | skipping: [instance] => (item=controller-0)
2026-03-19 12:10:35.914088 | controller | skipping: [instance] => (item=crc-0)
2026-03-19 12:10:35.914094 | controller |
2026-03-19 12:10:35.914100 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2026-03-19 12:10:35.914107 | controller | Thursday 19 March 2026  12:10:35 +0000 (0:00:01.044)       0:03:06.338 ********
2026-03-19 12:10:35.914117 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-03-19 12:10:37.800861 | controller | skipping: [instance] => (item=compute-0)
2026-03-19 12:10:37.800892 | controller | skipping: [instance] => (item=controller-0)
2026-03-19 12:10:37.800900 | controller | skipping: [instance] => (item=crc-0)
2026-03-19 12:10:37.800912 | controller |
2026-03-19 12:10:37.800918 | controller | TASK [reproducer : Inject SSH configuration] ***********************************
2026-03-19 12:10:37.800924 | controller | Thursday 19 March 2026  12:10:35 +0000 (0:00:00.761)       0:03:07.100 ********
2026-03-19 12:10:37.800934 | controller | skipping: [instance] => (item=instance)
2026-03-19 12:10:38.447569 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
2026-03-19 12:10:38.447602 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-03-19 12:10:38.447610 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
2026-03-19 12:10:38.447616 | controller |
2026-03-19 12:10:38.447621 | controller | TASK [reproducer : Create kube directory] **************************************
2026-03-19 12:10:38.447627 | controller | Thursday 19 March 2026  12:10:37 +0000 (0:00:01.886)       0:03:08.987 ********
2026-03-19 12:10:38.447637 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:39.444654 | controller |
2026-03-19 12:10:39.444686 | controller | TASK [reproducer : Inject kubeconfig content] **********************************
2026-03-19 12:10:39.444695 | controller | Thursday 19 March 2026  12:10:38 +0000 (0:00:00.646)       0:03:09.634 ********
2026-03-19 12:10:39.444705 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:40.430713 | controller |
2026-03-19 12:10:40.430746 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************
2026-03-19 12:10:40.430754 | controller | Thursday 19 March 2026  12:10:39 +0000 (0:00:00.997)       0:03:10.631 ********
2026-03-19 12:10:40.430765 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:40.466450 | controller |
2026-03-19 12:10:40.466476 | controller | TASK [reproducer : Inject devscripts private key if set] ***********************
2026-03-19 12:10:40.466484 | controller | Thursday 19 March 2026  12:10:40 +0000 (0:00:00.985)       0:03:11.617 ********
2026-03-19 12:10:40.466495 | controller | skipping: [instance]
2026-03-19 12:10:41.066355 | controller |
2026-03-19 12:10:41.066391 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ******************************
2026-03-19 12:10:41.066399 | controller | Thursday 19 March 2026  12:10:40 +0000 (0:00:00.035)       0:03:11.653 ********
2026-03-19 12:10:41.066409 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:41.629857 | controller |
2026-03-19 12:10:41.629894 | controller | TASK [manage_secrets : Ensure directory tree exist] ****************************
2026-03-19 12:10:41.629902 | controller | Thursday 19 March 2026  12:10:41 +0000 (0:00:00.595)       0:03:12.249 ********
2026-03-19 12:10:41.629912 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:41.668117 | controller |
2026-03-19 12:10:41.668141 | controller | TASK [manage_secrets : Assert we get needed data] ******************************
2026-03-19 12:10:41.668151 | controller | Thursday 19 March 2026  12:10:41 +0000 (0:00:00.567)       0:03:12.816 ********
2026-03-19 12:10:41.668163 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:41.727677 | controller |
2026-03-19 12:10:41.727701 | controller | TASK [manage_secrets : Push reproducer secrets] ********************************
2026-03-19 12:10:41.727708 | controller | Thursday 19 March 2026  12:10:41 +0000 (0:00:00.038)       0:03:12.854 ********
2026-03-19 12:10:41.727716 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
2026-03-19 12:10:41.780487 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
2026-03-19 12:10:41.780507 | controller |
2026-03-19 12:10:41.780514 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-03-19 12:10:41.780520 | controller | Thursday 19 March 2026  12:10:41 +0000 (0:00:00.058)       0:03:12.913 ********
2026-03-19 12:10:41.780533 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 12:10:41.830545 | controller |   _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
2026-03-19 12:10:41.830569 | controller |
2026-03-19 12:10:41.830576 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-03-19 12:10:41.830582 | controller | Thursday 19 March 2026  12:10:41 +0000 (0:00:00.053)       0:03:12.966 ********
2026-03-19 12:10:41.830590 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 12:10:41.830733 | controller |   _secret_file: ''
2026-03-19 12:10:41.830879 | controller |
2026-03-19 12:10:41.831027 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-03-19 12:10:41.831172 | controller | Thursday 19 March 2026  12:10:41 +0000 (0:00:00.050)       0:03:13.017 ********
2026-03-19 12:10:41.877611 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 12:10:41.877779 | controller |   _secret_content: my-default-location-place
2026-03-19 12:10:41.877910 | controller |
2026-03-19 12:10:41.878065 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-03-19 12:10:41.878201 | controller | Thursday 19 March 2026  12:10:41 +0000 (0:00:00.047)       0:03:13.064 ********
2026-03-19 12:10:41.925219 | controller | skipping: [instance]
2026-03-19 12:10:41.925364 | controller |
2026-03-19 12:10:41.925499 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-03-19 12:10:41.925621 | controller | Thursday 19 March 2026  12:10:41 +0000 (0:00:00.047)       0:03:13.112 ********
2026-03-19 12:10:41.971772 | controller | skipping: [instance]
2026-03-19 12:10:41.971916 | controller |
2026-03-19 12:10:41.972074 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-03-19 12:10:41.972211 | controller | Thursday 19 March 2026  12:10:41 +0000 (0:00:00.046)       0:03:13.158 ********
2026-03-19 12:10:42.021648 | controller | skipping: [instance]
2026-03-19 12:10:42.021807 | controller |
2026-03-19 12:10:42.021947 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-03-19 12:10:42.022103 | controller | Thursday 19 March 2026  12:10:42 +0000 (0:00:00.049)       0:03:13.208 ********
2026-03-19 12:10:43.016475 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:43.016703 | controller |
2026-03-19 12:10:43.016840 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-03-19 12:10:43.016963 | controller | Thursday 19 March 2026  12:10:43 +0000 (0:00:00.993)       0:03:14.202 ********
2026-03-19 12:10:43.069692 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 12:10:43.069895 | controller |   _secret_dest: /home/zuul/ipmi-things
2026-03-19 12:10:43.070051 | controller |
2026-03-19 12:10:43.070178 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-03-19 12:10:43.070310 | controller | Thursday 19 March 2026  12:10:43 +0000 (0:00:00.053)       0:03:14.256 ********
2026-03-19 12:10:43.116001 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 12:10:43.116233 | controller |   _secret_file: /tmp/ipmi-things
2026-03-19 12:10:43.116420 | controller |
2026-03-19 12:10:43.116595 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-03-19 12:10:43.116786 | controller | Thursday 19 March 2026  12:10:43 +0000 (0:00:00.046)       0:03:14.303 ********
2026-03-19 12:10:43.162093 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 12:10:43.162270 | controller |   _secret_content: ''
2026-03-19 12:10:43.162435 | controller |
2026-03-19 12:10:43.162590 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-03-19 12:10:43.162743 | controller | Thursday 19 March 2026  12:10:43 +0000 (0:00:00.046)       0:03:14.349 ********
2026-03-19 12:10:43.215179 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false
2026-03-19 12:10:43.215334 | controller |   msg: All assertions passed
2026-03-19 12:10:43.215465 | controller |
2026-03-19 12:10:43.215588 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-03-19 12:10:43.215724 | controller | Thursday 19 March 2026  12:10:43 +0000 (0:00:00.053)       0:03:14.402 ********
2026-03-19 12:10:43.794373 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:44.874862 | controller |
2026-03-19 12:10:44.874894 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-03-19 12:10:44.874907 | controller | Thursday 19 March 2026  12:10:43 +0000 (0:00:00.578)       0:03:14.981 ********
2026-03-19 12:10:44.874918 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:44.928650 | controller |
2026-03-19 12:10:44.928671 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-03-19 12:10:44.928679 | controller | Thursday 19 March 2026  12:10:44 +0000 (0:00:01.080)       0:03:16.061 ********
2026-03-19 12:10:44.928688 | controller | skipping: [instance]
2026-03-19 12:10:45.546718 | controller |
2026-03-19 12:10:45.546750 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
2026-03-19 12:10:45.546758 | controller | Thursday 19 March 2026  12:10:44 +0000 (0:00:00.054)       0:03:16.115 ********
2026-03-19 12:10:45.546768 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:10:46.208071 | controller |
2026-03-19 12:10:46.208106 | controller | TASK [reproducer : Check if async file is still available] *********************
2026-03-19 12:10:46.208114 | controller | Thursday 19 March 2026  12:10:45 +0000 (0:00:00.617)       0:03:16.732 ********
2026-03-19 12:10:46.208124 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:30.818278 | controller |
2026-03-19 12:11:30.818321 | controller | TASK [reproducer : Check package install status] *******************************
2026-03-19 12:11:30.818333 | controller | Thursday 19 March 2026  12:10:46 +0000 (0:00:00.662)       0:03:17.394 ********
2026-03-19 12:11:30.818344 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
2026-03-19 12:11:31.396253 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
2026-03-19 12:11:31.396276 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
2026-03-19 12:11:31.396283 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
2026-03-19 12:11:31.396288 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
2026-03-19 12:11:31.396294 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
2026-03-19 12:11:31.396299 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
2026-03-19 12:11:31.396304 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left).
2026-03-19 12:11:31.396310 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:31.396315 | controller |
2026-03-19 12:11:31.396321 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
2026-03-19 12:11:31.396326 | controller | Thursday 19 March 2026  12:11:30 +0000 (0:00:44.609)       0:04:02.004 ********
2026-03-19 12:11:31.396335 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:33.851695 | controller |
2026-03-19 12:11:33.851725 | controller | TASK [sushy_emulator : Install required packages] ******************************
2026-03-19 12:11:33.851733 | controller | Thursday 19 March 2026  12:11:31 +0000 (0:00:00.578)       0:04:02.583 ********
2026-03-19 12:11:33.851743 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:33.895512 | controller |
2026-03-19 12:11:33.895542 | controller | TASK [sushy_emulator : Get ingresses domain] ***********************************
2026-03-19 12:11:33.895550 | controller | Thursday 19 March 2026  12:11:33 +0000 (0:00:02.455)       0:04:05.038 ********
2026-03-19 12:11:33.895559 | controller | skipping: [instance]
2026-03-19 12:11:33.937205 | controller |
2026-03-19 12:11:33.937235 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] *********************
2026-03-19 12:11:33.937242 | controller | Thursday 19 March 2026  12:11:33 +0000 (0:00:00.043)       0:04:05.082 ********
2026-03-19 12:11:33.937252 | controller | skipping: [instance]
2026-03-19 12:11:34.526794 | controller |
2026-03-19 12:11:34.526826 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
2026-03-19 12:11:34.526834 | controller | Thursday 19 March 2026  12:11:33 +0000 (0:00:00.041)       0:04:05.123 ********
2026-03-19 12:11:34.526844 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:35.056842 | controller |
2026-03-19 12:11:35.056873 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ********************
2026-03-19 12:11:35.056881 | controller | Thursday 19 March 2026  12:11:34 +0000 (0:00:00.589)       0:04:05.713 ********
2026-03-19 12:11:35.056891 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:35.416260 | controller |
2026-03-19 12:11:35.416290 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
2026-03-19 12:11:35.416298 | controller | Thursday 19 March 2026  12:11:35 +0000 (0:00:00.530)       0:04:06.243 ********
2026-03-19 12:11:35.416307 | controller | changed: [instance]
2026-03-19 12:11:36.029826 | controller |
2026-03-19 12:11:36.029859 | controller | TASK [sushy_emulator : Run ssh-keyscan] ****************************************
2026-03-19 12:11:36.029867 | controller | Thursday 19 March 2026  12:11:35 +0000 (0:00:00.358)       0:04:06.602 ********
2026-03-19 12:11:36.029877 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:36.993069 | controller |
2026-03-19 12:11:36.993103 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************
2026-03-19 12:11:36.993111 | controller | Thursday 19 March 2026  12:11:36 +0000 (0:00:00.614)       0:04:07.216 ********
2026-03-19 12:11:36.993121 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:37.044675 | controller |
2026-03-19 12:11:37.044707 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-19 12:11:37.044715 | controller | Thursday 19 March 2026  12:11:36 +0000 (0:00:00.963)       0:04:08.179 ********
2026-03-19 12:11:37.044725 | controller | skipping: [instance]
2026-03-19 12:11:37.090737 | controller |
2026-03-19 12:11:37.090769 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-19 12:11:37.090777 | controller | Thursday 19 March 2026  12:11:37 +0000 (0:00:00.051)       0:04:08.231 ********
2026-03-19 12:11:37.090786 | controller | skipping: [instance]
2026-03-19 12:11:37.127726 | controller |
2026-03-19 12:11:37.127753 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-19 12:11:37.127760 | controller | Thursday 19 March 2026  12:11:37 +0000 (0:00:00.045)       0:04:08.277 ********
2026-03-19 12:11:37.127770 | controller | skipping: [instance]
2026-03-19 12:11:37.178131 | controller |
2026-03-19 12:11:37.178163 | controller | TASK [sushy_emulator : Generate list of filtered VMs] **************************
2026-03-19 12:11:37.178172 | controller | Thursday 19 March 2026  12:11:37 +0000 (0:00:00.037)       0:04:08.314 ********
2026-03-19 12:11:37.178187 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:37.212989 | controller |
2026-03-19 12:11:37.213051 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
2026-03-19 12:11:37.213063 | controller | Thursday 19 March 2026  12:11:37 +0000 (0:00:00.050)       0:04:08.364 ********
2026-03-19 12:11:37.213074 | controller | skipping: [instance]
2026-03-19 12:11:37.247973 | controller |
2026-03-19 12:11:37.248003 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
2026-03-19 12:11:37.248033 | controller | Thursday 19 March 2026  12:11:37 +0000 (0:00:00.035)       0:04:08.399 ********
2026-03-19 12:11:37.248044 | controller | skipping: [instance]
2026-03-19 12:11:37.286064 | controller |
2026-03-19 12:11:37.286087 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
2026-03-19 12:11:37.286094 | controller | Thursday 19 March 2026  12:11:37 +0000 (0:00:00.034)       0:04:08.434 ********
2026-03-19 12:11:37.286105 | controller | skipping: [instance]
2026-03-19 12:11:37.900250 | controller |
2026-03-19 12:11:37.900279 | controller | TASK [sushy_emulator : Generate htpasswd string] *******************************
2026-03-19 12:11:37.900287 | controller | Thursday 19 March 2026  12:11:37 +0000 (0:00:00.037)       0:04:08.472 ********
2026-03-19 12:11:37.900297 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:37.998583 | controller |
2026-03-19 12:11:37.998611 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] *********************
2026-03-19 12:11:37.998618 | controller | Thursday 19 March 2026  12:11:37 +0000 (0:00:00.614)       0:04:09.086 ********
2026-03-19 12:11:37.998633 | controller | skipping: [instance] => (item=secret)
2026-03-19 12:11:39.054656 | controller | skipping: [instance] => (item=configmap)
2026-03-19 12:11:39.054687 | controller | skipping: [instance] => (item=pod)
2026-03-19 12:11:39.054694 | controller | skipping: [instance] => (item=service)
2026-03-19 12:11:39.054700 | controller | skipping: [instance] => (item=route)
2026-03-19 12:11:39.054705 | controller | skipping: [instance]
2026-03-19 12:11:39.054711 | controller |
2026-03-19 12:11:39.054733 | controller | TASK [sushy_emulator : Write sushy emulator config] ****************************
2026-03-19 12:11:39.054739 | controller | Thursday 19 March 2026  12:11:37 +0000 (0:00:00.098)       0:04:09.185 ********
2026-03-19 12:11:39.054748 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:40.008477 | controller |
2026-03-19 12:11:40.008510 | controller | TASK [sushy_emulator : Write htpasswd string to file] **************************
2026-03-19 12:11:40.008518 | controller | Thursday 19 March 2026  12:11:39 +0000 (0:00:01.056)       0:04:10.241 ********
2026-03-19 12:11:40.008528 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:40.045839 | controller |
2026-03-19 12:11:40.045870 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
2026-03-19 12:11:40.045879 | controller | Thursday 19 March 2026  12:11:40 +0000 (0:00:00.953)       0:04:11.194 ********
2026-03-19 12:11:40.045889 | controller | skipping: [instance]
2026-03-19 12:11:40.080477 | controller |
2026-03-19 12:11:40.080497 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
2026-03-19 12:11:40.080504 | controller | Thursday 19 March 2026  12:11:40 +0000 (0:00:00.037)       0:04:11.232 ********
2026-03-19 12:11:40.080513 | controller | skipping: [instance]
2026-03-19 12:11:40.154591 | controller |
2026-03-19 12:11:40.154624 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
2026-03-19 12:11:40.154632 | controller | Thursday 19 March 2026  12:11:40 +0000 (0:00:00.034)       0:04:11.267 ********
2026-03-19 12:11:40.154643 | controller | skipping: [instance] => (item=secret)
2026-03-19 12:11:40.189664 | controller | skipping: [instance] => (item=configmap)
2026-03-19 12:11:40.189686 | controller | skipping: [instance] => (item=service)
2026-03-19 12:11:40.189695 | controller | skipping: [instance] => (item=route)
2026-03-19 12:11:40.189703 | controller | skipping: [instance]
2026-03-19 12:11:40.189710 | controller |
2026-03-19 12:11:40.189717 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
2026-03-19 12:11:40.189724 | controller | Thursday 19 March 2026  12:11:40 +0000 (0:00:00.073)       0:04:11.340 ********
2026-03-19 12:11:40.189734 | controller | skipping: [instance]
2026-03-19 12:11:41.656203 | controller |
2026-03-19 12:11:41.656234 | controller | TASK [podman : Ensure podman is installed] *************************************
2026-03-19 12:11:41.656242 | controller | Thursday 19 March 2026  12:11:40 +0000 (0:00:00.035)       0:04:11.376 ********
2026-03-19 12:11:41.656253 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:41.656404 | controller |
2026-03-19 12:11:41.656548 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] *********************
2026-03-19 12:11:41.656678 | controller | Thursday 19 March 2026  12:11:41 +0000 (0:00:01.466)       0:04:12.842 ********
2026-03-19 12:11:42.408941 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:42.451660 | controller |
2026-03-19 12:11:42.451677 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
2026-03-19 12:11:42.451684 | controller | Thursday 19 March 2026  12:11:42 +0000 (0:00:00.753)       0:04:13.595 ********
2026-03-19 12:11:42.451693 | controller | skipping: [instance]
2026-03-19 12:11:42.490108 | controller |
2026-03-19 12:11:42.490126 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
2026-03-19 12:11:42.490133 | controller | Thursday 19 March 2026  12:11:42 +0000 (0:00:00.042)       0:04:13.638 ********
2026-03-19 12:11:42.490141 | controller | skipping: [instance]
2026-03-19 12:11:42.533139 | controller |
2026-03-19 12:11:42.533163 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
2026-03-19 12:11:42.533178 | controller | Thursday 19 March 2026  12:11:42 +0000 (0:00:00.038)       0:04:13.677 ********
2026-03-19 12:11:42.533190 | controller | skipping: [instance]
2026-03-19 12:11:53.212505 | controller |
2026-03-19 12:11:53.212540 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
2026-03-19 12:11:53.212548 | controller | Thursday 19 March 2026  12:11:42 +0000 (0:00:00.042)       0:04:13.719 ********
2026-03-19 12:11:53.212558 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:54.630001 | controller |
2026-03-19 12:11:54.630061 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] **************
2026-03-19 12:11:54.630070 | controller | Thursday 19 March 2026  12:11:53 +0000 (0:00:10.679)       0:04:24.399 ********
2026-03-19 12:11:54.630079 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:55.765634 | controller |
2026-03-19 12:11:55.765668 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-03-19 12:11:55.765676 | controller | Thursday 19 March 2026  12:11:54 +0000 (0:00:01.417)       0:04:25.816 ********
2026-03-19 12:11:55.765686 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-03-19 12:11:55.803407 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-03-19 12:11:55.803436 | controller |
2026-03-19 12:11:55.803443 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] *************
2026-03-19 12:11:55.803449 | controller | Thursday 19 March 2026  12:11:55 +0000 (0:00:01.135)       0:04:26.952 ********
2026-03-19 12:11:55.803458 | controller | skipping: [instance]
2026-03-19 12:11:56.361104 | controller |
2026-03-19 12:11:56.361131 | controller | TASK [reproducer : Check if baremetal-info.yml exists] *************************
2026-03-19 12:11:56.361139 | controller | Thursday 19 March 2026  12:11:55 +0000 (0:00:00.038)       0:04:26.990 ********
2026-03-19 12:11:56.361148 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:56.397448 | controller |
2026-03-19 12:11:56.397473 | controller | TASK [reproducer : Get content of baremetal-info file] *************************
2026-03-19 12:11:56.397481 | controller | Thursday 19 March 2026  12:11:56 +0000 (0:00:00.557)       0:04:27.547 ********
2026-03-19 12:11:56.397491 | controller | skipping: [instance]
2026-03-19 12:11:56.442580 | controller |
2026-03-19 12:11:56.442600 | controller | TASK [reproducer : Interpret remote file content as yaml] **********************
2026-03-19 12:11:56.442607 | controller | Thursday 19 March 2026  12:11:56 +0000 (0:00:00.036)       0:04:27.584 ********
2026-03-19 12:11:56.442616 | controller | skipping: [instance]
2026-03-19 12:11:56.483685 | controller |
2026-03-19 12:11:56.483709 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-03-19 12:11:56.483717 | controller | Thursday 19 March 2026  12:11:56 +0000 (0:00:00.045)       0:04:27.629 ********
2026-03-19 12:11:56.483726 | controller | skipping: [instance]
2026-03-19 12:11:56.519180 | controller |
2026-03-19 12:11:56.519203 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-03-19 12:11:56.519211 | controller | Thursday 19 March 2026  12:11:56 +0000 (0:00:00.040)       0:04:27.670 ********
2026-03-19 12:11:56.519220 | controller | skipping: [instance]
2026-03-19 12:11:56.649485 | controller |
2026-03-19 12:11:56.649513 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
2026-03-19 12:11:56.649521 | controller | Thursday 19 March 2026  12:11:56 +0000 (0:00:00.035)       0:04:27.706 ********
2026-03-19 12:11:56.649531 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'})
2026-03-19 12:11:56.649736 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'})
2026-03-19 12:11:56.649748 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'})
2026-03-19 12:11:56.649755 | controller |
2026-03-19 12:11:56.649763 | controller | TASK [reproducer : Output baremetal info file] *********************************
2026-03-19 12:11:57.599547 | controller | Thursday 19 March 2026  12:11:56 +0000 (0:00:00.129)       0:04:27.836 ********
2026-03-19 12:11:57.599580 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:57.637337 | controller |
2026-03-19 12:11:57.637371 | controller | TASK [reproducer : Output ironic_nodes to file] ********************************
2026-03-19 12:11:57.637379 | controller | Thursday 19 March 2026  12:11:57 +0000 (0:00:00.950)       0:04:28.786 ********
2026-03-19 12:11:57.637388 | controller | skipping: [instance]
2026-03-19 12:11:57.771043 | controller |
2026-03-19 12:11:57.771062 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
2026-03-19 12:11:57.771070 | controller | Thursday 19 March 2026  12:11:57 +0000 (0:00:00.037)       0:04:28.824 ********
2026-03-19 12:11:57.771078 | controller |
2026-03-19 12:11:57.816241 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
2026-03-19 12:11:57.816259 | controller | Thursday 19 March 2026  12:11:57 +0000 (0:00:00.133)       0:04:28.957 ********
2026-03-19 12:11:57.816269 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:11:57.857793 | controller |
2026-03-19 12:11:57.857811 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-03-19 12:11:57.857819 | controller | Thursday 19 March 2026  12:11:57 +0000 (0:00:00.045)       0:04:29.003 ********
2026-03-19 12:11:57.857829 | controller | skipping: [instance]
2026-03-19 12:11:57.894915 | controller |
2026-03-19 12:11:57.894934 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-03-19 12:11:57.894941 | controller | Thursday 19 March 2026  12:11:57 +0000 (0:00:00.041)       0:04:29.044 ********
2026-03-19 12:11:57.894950 | controller | skipping: [instance]
2026-03-19 12:11:59.218416 | controller |
2026-03-19 12:11:59.218445 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
2026-03-19 12:11:59.218453 | controller | Thursday 19 March 2026  12:11:57 +0000 (0:00:00.037)       0:04:29.081 ********
2026-03-19 12:11:59.218467 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:06.035879 | controller |
2026-03-19 12:12:06.035915 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
2026-03-19 12:12:06.035923 | controller | Thursday 19 March 2026  12:11:59 +0000 (0:00:01.323)       0:04:30.404 ********
2026-03-19 12:12:06.035934 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1)
2026-03-19 12:12:06.137223 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b)
2026-03-19 12:12:06.137251 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282)
2026-03-19 12:12:06.137259 | controller |
2026-03-19 12:12:06.137266 | controller | TASK [sushy_emulator : Verify baremetal VM power status] ***********************
2026-03-19 12:12:06.137272 | controller | Thursday 19 March 2026  12:12:06 +0000 (0:00:06.817)       0:04:37.222 ********
2026-03-19 12:12:06.137281 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
2026-03-19 12:12:06.348865 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
2026-03-19 12:12:06.348892 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
2026-03-19 12:12:06.348900 | controller |
2026-03-19 12:12:06.348906 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
2026-03-19 12:12:06.348912 | controller | Thursday 19 March 2026  12:12:06 +0000 (0:00:00.101)       0:04:37.323 ********
2026-03-19 12:12:06.348921 | controller | ok: [instance -> localhost]
2026-03-19 12:12:08.199663 | controller |
2026-03-19 12:12:08.199697 | controller | TASK [reproducer : Sync local repositories to other hosts if present] **********
2026-03-19 12:12:08.199707 | controller | Thursday 19 March 2026  12:12:06 +0000 (0:00:00.211)       0:04:37.535 ********
2026-03-19 12:12:08.199718 | controller | changed: [instance -> localhost] => (item=controller-0)
2026-03-19 12:12:08.857396 | controller |
2026-03-19 12:12:08.857430 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
2026-03-19 12:12:08.857439 | controller | Thursday 19 March 2026  12:12:08 +0000 (0:00:01.850)       0:04:39.386 ********
2026-03-19 12:12:08.857448 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:09.590523 | controller |
2026-03-19 12:12:09.590552 | controller | TASK [reproducer : Install ansible dependencies] *******************************
2026-03-19 12:12:09.590560 | controller | Thursday 19 March 2026  12:12:08 +0000 (0:00:00.657)       0:04:40.043 ********
2026-03-19 12:12:09.590570 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:10.624663 | controller |
2026-03-19 12:12:10.624691 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
2026-03-19 12:12:10.624699 | controller | Thursday 19 March 2026  12:12:09 +0000 (0:00:00.729)       0:04:40.772 ********
2026-03-19 12:12:10.624709 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:11.251241 | controller |
2026-03-19 12:12:11.251267 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
2026-03-19 12:12:11.251274 | controller | Thursday 19 March 2026  12:12:10 +0000 (0:00:01.034)       0:04:41.807 ********
2026-03-19 12:12:11.251284 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:12.309944 | controller |
2026-03-19 12:12:12.309976 | controller | TASK [reproducer : Inject local environment parameters] ************************
2026-03-19 12:12:12.309985 | controller | Thursday 19 March 2026  12:12:11 +0000 (0:00:00.627)       0:04:42.435 ********
2026-03-19 12:12:12.309995 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:12.937560 | controller |
2026-03-19 12:12:12.937590 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
2026-03-19 12:12:12.937597 | controller | Thursday 19 March 2026  12:12:12 +0000 (0:00:01.061)       0:04:43.496 ********
2026-03-19 12:12:12.937606 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:13.532039 | controller |
2026-03-19 12:12:13.532072 | controller | TASK [reproducer : Get interfaces-info content] ********************************
2026-03-19 12:12:13.532080 | controller | Thursday 19 March 2026  12:12:12 +0000 (0:00:00.627)       0:04:44.124 ********
2026-03-19 12:12:13.532090 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:14.821331 | controller |
2026-03-19 12:12:14.821376 | controller | TASK [reproducer : Wait for OCP nodes to be ready] *****************************
2026-03-19 12:12:14.821384 | controller | Thursday 19 March 2026  12:12:13 +0000 (0:00:00.594)       0:04:44.718 ********
2026-03-19 12:12:14.821394 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-03-19 12:12:14.821410 | controller |
2026-03-19 12:12:14.821417 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-19 12:12:14.821488 | controller | Thursday 19 March 2026  12:12:14 +0000 (0:00:01.289)       0:04:46.008 ********
2026-03-19 12:12:14.854300 | controller | skipping: [instance]
2026-03-19 12:12:14.854399 | controller |
2026-03-19 12:12:14.854498 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-19 12:12:14.854625 | controller | Thursday 19 March 2026  12:12:14 +0000 (0:00:00.033)       0:04:46.041 ********
2026-03-19 12:12:14.887687 | controller | skipping: [instance]
2026-03-19 12:12:14.887766 | controller |
2026-03-19 12:12:14.887858 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-19 12:12:14.887957 | controller | Thursday 19 March 2026  12:12:14 +0000 (0:00:00.033)       0:04:46.074 ********
2026-03-19 12:12:14.920550 | controller | skipping: [instance]
2026-03-19 12:12:14.920639 | controller |
2026-03-19 12:12:14.920732 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-19 12:12:14.920820 | controller | Thursday 19 March 2026  12:12:14 +0000 (0:00:00.032)       0:04:46.107 ********
2026-03-19 12:12:14.952992 | controller | skipping: [instance]
2026-03-19 12:12:14.953087 | controller |
2026-03-19 12:12:14.953199 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-19 12:12:14.953275 | controller | Thursday 19 March 2026  12:12:14 +0000 (0:00:00.032)       0:04:46.140 ********
2026-03-19 12:12:14.989434 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:14.989515 | controller |
2026-03-19 12:12:14.989620 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-19 12:12:14.989709 | controller | Thursday 19 March 2026  12:12:14 +0000 (0:00:00.036)       0:04:46.176 ********
2026-03-19 12:12:15.093086 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
2026-03-19 12:12:15.093166 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={})
2026-03-19 12:12:15.093251 | controller |
2026-03-19 12:12:15.093341 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-19 12:12:15.093439 | controller | Thursday 19 March 2026  12:12:15 +0000 (0:00:00.103)       0:04:46.280 ********
2026-03-19 12:12:15.138324 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
2026-03-19 12:12:15.138417 | controller |
2026-03-19 12:12:15.138521 | controller | TASK [networking_mapper : Gather the facts] ************************************
2026-03-19 12:12:15.138607 | controller | Thursday 19 March 2026  12:12:15 +0000 (0:00:00.045)       0:04:46.325 ********
2026-03-19 12:12:18.411898 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-03-19 12:12:18.411973 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
2026-03-19 12:12:18.412097 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-03-19 12:12:18.412221 | controller |
2026-03-19 12:12:18.412391 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
2026-03-19 12:12:18.412527 | controller | Thursday 19 March 2026  12:12:18 +0000 (0:00:03.273)       0:04:49.598 ********
2026-03-19 12:12:19.550410 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:20.023921 | controller |
2026-03-19 12:12:20.023954 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-19 12:12:20.023962 | controller | Thursday 19 March 2026  12:12:19 +0000 (0:00:01.136)       0:04:50.735 ********
2026-03-19 12:12:20.023977 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:20.913027 | controller |
2026-03-19 12:12:20.913057 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-19 12:12:20.913065 | controller | Thursday 19 March 2026  12:12:20 +0000 (0:00:00.475)       0:04:51.210 ********
2026-03-19 12:12:20.913075 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:20.997187 | controller |
2026-03-19 12:12:20.997212 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-19 12:12:20.997220 | controller | Thursday 19 March 2026  12:12:20 +0000 (0:00:00.888)       0:04:52.099 ********
2026-03-19 12:12:20.997230 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:21.047266 | controller |
2026-03-19 12:12:21.047290 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-19 12:12:21.047298 | controller | Thursday 19 March 2026  12:12:20 +0000 (0:00:00.084)       0:04:52.184 ********
2026-03-19 12:12:21.047308 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:21.966217 | controller |
2026-03-19 12:12:21.966246 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-19 12:12:21.966254 | controller | Thursday 19 March 2026  12:12:21 +0000 (0:00:00.050)       0:04:52.234 ********
2026-03-19 12:12:21.966265 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:22.810063 | controller |
2026-03-19 12:12:22.810091 | controller | TASK [reproducer : Inject CRC ssh key] *****************************************
2026-03-19 12:12:22.810099 | controller | Thursday 19 March 2026  12:12:21 +0000 (0:00:00.918)       0:04:53.152 ********
2026-03-19 12:12:22.810108 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:28.749667 | controller |
2026-03-19 12:12:28.749695 | controller | TASK [reproducer : Ensure we have all dependencies installed] ******************
2026-03-19 12:12:28.749702 | controller | Thursday 19 March 2026  12:12:22 +0000 (0:00:00.843)       0:04:53.996 ********
2026-03-19 12:12:28.749712 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
2026-03-19 12:12:28.952923 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:28.952946 | controller |
2026-03-19 12:12:28.952954 | controller | TASK [Configure ntp service] ***************************************************
2026-03-19 12:12:28.952964 | controller | Thursday 19 March 2026  12:12:28 +0000 (0:00:05.939)       0:04:59.936 ********
2026-03-19 12:12:28.952973 | controller |
2026-03-19 12:12:29.932431 | controller | TASK [cifmw_ntp : Install chrony] **********************************************
2026-03-19 12:12:29.932467 | controller | Thursday 19 March 2026  12:12:28 +0000 (0:00:00.203)       0:05:00.139 ********
2026-03-19 12:12:29.932478 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:30.850730 | controller |
2026-03-19 12:12:30.850762 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] *************************
2026-03-19 12:12:30.850770 | controller | Thursday 19 March 2026  12:12:29 +0000 (0:00:00.978)       0:05:01.118 ********
2026-03-19 12:12:30.850784 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
2026-03-19 12:12:31.757391 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
2026-03-19 12:12:31.757423 | controller |
2026-03-19 12:12:31.757431 | controller | TASK [cifmw_ntp : Render chrony extra config file] *****************************
2026-03-19 12:12:31.757437 | controller | Thursday 19 March 2026  12:12:30 +0000 (0:00:00.918)       0:05:02.037 ********
2026-03-19 12:12:31.757448 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:32.384252 | controller |
2026-03-19 12:12:32.384282 | controller | TASK [cifmw_ntp : Enable chrony service] ***************************************
2026-03-19 12:12:32.384290 | controller | Thursday 19 March 2026  12:12:31 +0000 (0:00:00.906)       0:05:02.944 ********
2026-03-19 12:12:32.384300 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:32.531133 | controller |
2026-03-19 12:12:32.531176 | controller | TASK [reproducer : Configure CRC node if available] ****************************
2026-03-19 12:12:32.531185 | controller | Thursday 19 March 2026  12:12:32 +0000 (0:00:00.626)       0:05:03.570 ********
2026-03-19 12:12:32.531196 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
2026-03-19 12:12:32.965219 | controller |
2026-03-19 12:12:32.965249 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] ***
2026-03-19 12:12:32.965258 | controller | Thursday 19 March 2026  12:12:32 +0000 (0:00:00.146)       0:05:03.717 ********
2026-03-19 12:12:32.965269 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:33.454487 | controller |
2026-03-19 12:12:33.454519 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ********************
2026-03-19 12:12:33.454528 | controller | Thursday 19 March 2026  12:12:32 +0000 (0:00:00.434)       0:05:04.151 ********
2026-03-19 12:12:33.454538 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-03-19 12:12:34.106537 | controller |
2026-03-19 12:12:34.106571 | controller | TASK [reproducer : Configure local DNS for CRC pod] ****************************
2026-03-19 12:12:34.106580 | controller | Thursday 19 March 2026  12:12:33 +0000 (0:00:00.488)       0:05:04.640 ********
2026-03-19 12:12:34.106590 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-19 12:12:34.623123 | controller |
2026-03-19 12:12:34.623152 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
2026-03-19 12:12:34.623160 | controller | Thursday 19 March 2026  12:12:34 +0000 (0:00:00.652)       0:05:05.293 ********
2026-03-19 12:12:34.623170 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-19 12:12:34.671508 | controller |
2026-03-19 12:12:34.671544 | controller | TASK [Restart DNS in CRC VM] ***************************************************
2026-03-19 12:12:34.671553 | controller | Thursday 19 March 2026  12:12:34 +0000 (0:00:00.516)       0:05:05.809 ********
2026-03-19 12:12:34.671564 | controller |
2026-03-19 12:12:35.139716 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
2026-03-19 12:12:35.139749 | controller | Thursday 19 March 2026  12:12:34 +0000 (0:00:00.048)       0:05:05.858 ********
2026-03-19 12:12:35.139760 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-03-19 12:12:35.861777 | controller |
2026-03-19 12:12:35.861807 | controller | TASK [openshift_setup : Restart dnsmasq service if used] ***********************
2026-03-19 12:12:35.861815 | controller | Thursday 19 March 2026  12:12:35 +0000 (0:00:00.468)       0:05:06.326 ********
2026-03-19 12:12:35.861825 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-19 12:12:35.887887 | controller |
2026-03-19 12:12:35.887915 | controller | TASK [openshift_setup : Stop dnsmasq] ******************************************
2026-03-19 12:12:35.887922 | controller | Thursday 19 March 2026  12:12:35 +0000 (0:00:00.722)       0:05:07.048 ********
2026-03-19 12:12:35.887931 | controller | skipping: [instance]
2026-03-19 12:12:35.926611 | controller |
2026-03-19 12:12:35.926637 | controller | TASK [openshift_setup : Start dnsmasq] *****************************************
2026-03-19 12:12:35.926644 | controller | Thursday 19 March 2026  12:12:35 +0000 (0:00:00.026)       0:05:07.074 ********
2026-03-19 12:12:35.926654 | controller | skipping: [instance]
2026-03-19 12:12:36.128431 | controller |
2026-03-19 12:12:36.128540 | controller | TASK [reproducer : Remove entry from /etc/hosts] *******************************
2026-03-19 12:12:36.128550 | controller | Thursday 19 March 2026  12:12:35 +0000 (0:00:00.031)       0:05:07.106 ********
2026-03-19 12:12:36.128642 | controller | changed: [instance]
2026-03-19 12:12:36.129133 | controller |
2026-03-19 12:12:36.129723 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
2026-03-19 12:12:36.130240 | controller | Thursday 19 March 2026  12:12:36 +0000 (0:00:00.207)       0:05:07.314 ********
2026-03-19 12:12:36.206026 | controller | skipping: [instance] => (item=)
2026-03-19 12:12:36.237580 | controller |
2026-03-19 12:12:36.237604 | controller | TASK [dnsmasq : Assert we have needed address data] ****************************
2026-03-19 12:12:36.237616 | controller | Thursday 19 March 2026  12:12:36 +0000 (0:00:00.078)       0:05:07.392 ********
2026-03-19 12:12:36.237625 | controller | ok: [instance]
2026-03-19 12:12:36.308157 | controller |
2026-03-19 12:12:36.308181 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-19 12:12:36.308189 | controller | Thursday 19 March 2026  12:12:36 +0000 (0:00:00.031)       0:05:07.424 ********
2026-03-19 12:12:36.308198 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-03-19 12:12:36.536296 | controller |
2026-03-19 12:12:36.536338 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-19 12:12:36.536346 | controller | Thursday 19 March 2026  12:12:36 +0000 (0:00:00.070)       0:05:07.494 ********
2026-03-19 12:12:36.536357 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-03-19 12:12:36.583651 | controller |
2026-03-19 12:12:36.583672 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
2026-03-19 12:12:36.583679 | controller | Thursday 19 March 2026  12:12:36 +0000 (0:00:00.227)       0:05:07.722 ********
2026-03-19 12:12:36.583688 | controller |
2026-03-19 12:12:36.735379 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-19 12:12:36.735400 | controller | Thursday 19 March 2026  12:12:36 +0000 (0:00:00.047)       0:05:07.770 ********
2026-03-19 12:12:36.735411 | controller | ok: [instance]
2026-03-19 12:12:36.791652 | controller |
2026-03-19 12:12:36.791678 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-19 12:12:36.791686 | controller | Thursday 19 March 2026  12:12:36 +0000 (0:00:00.151)       0:05:07.922 ********
2026-03-19 12:12:36.791696 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-19 12:12:37.029262 | controller |
2026-03-19 12:12:37.029292 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-19 12:12:37.029300 | controller | Thursday 19 March 2026  12:12:36 +0000 (0:00:00.056)       0:05:07.978 ********
2026-03-19 12:12:37.029321 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-19 12:12:37.087062 | controller |
2026-03-19 12:12:37.087086 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-19 12:12:37.087094 | controller | Thursday 19 March 2026  12:12:37 +0000 (0:00:00.237)       0:05:08.215 ********
2026-03-19 12:12:37.087117 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-19 12:12:37.495897 | controller | skipping: [instance]
2026-03-19 12:12:37.495927 | controller |
2026-03-19 12:12:37.495935 | controller | TASK [reproducer : Ensure "testing" domain is "local"] *************************
2026-03-19 12:12:37.495942 | controller | Thursday 19 March 2026  12:12:37 +0000 (0:00:00.057)       0:05:08.273 ********
2026-03-19 12:12:37.495951 | controller | changed: [instance]
2026-03-19 12:12:38.168112 | controller |
2026-03-19 12:12:38.168142 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-03-19 12:12:38.168150 | controller | Thursday 19 March 2026  12:12:37 +0000 (0:00:00.397)       0:05:08.670 ********
2026-03-19 12:12:38.168156 | controller |
2026-03-19 12:12:38.168162 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
2026-03-19 12:12:38.168167 | controller | Thursday 19 March 2026  12:12:37 +0000 (0:00:00.011)       0:05:08.682 ********
2026-03-19 12:12:38.168177 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 12:12:38.534206 | controller |
2026-03-19 12:12:38.534241 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-19 12:12:38.534250 | controller | Thursday 19 March 2026  12:12:38 +0000 (0:00:00.672)       0:05:09.354 ********
2026-03-19 12:12:38.534261 | controller | changed: [instance]
2026-03-19 12:12:38.707078 | controller |
2026-03-19 12:12:38.707129 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
2026-03-19 12:12:38.707139 | controller | Thursday 19 March 2026  12:12:38 +0000 (0:00:00.366)       0:05:09.720 ********
2026-03-19 12:12:38.707153 | controller | skipping: [instance] => (item=controller-0)
2026-03-19 12:12:38.707180 | controller | skipping: [instance] => (item=crc-0)
2026-03-19 12:12:38.707218 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
2026-03-19 12:12:38.707306 | controller |
2026-03-19 12:12:38.707406 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
2026-03-19 12:12:38.707538 | controller | Thursday 19 March 2026  12:12:38 +0000 (0:00:00.173)       0:05:09.893 ********
2026-03-19 12:12:40.165787 | controller | changed: [instance -> compute-0(compute-0.instance)]
2026-03-19 12:12:40.165831 | controller |
2026-03-19 12:12:40.165901 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-03-19 12:12:40.165985 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:01.458)       0:05:11.352 ********
2026-03-19 12:12:40.185140 | controller | skipping: [instance]
2026-03-19 12:12:40.185216 | controller |
2026-03-19 12:12:40.185354 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-19 12:12:40.185551 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:00.019)       0:05:11.372 ********
2026-03-19 12:12:40.639488 | controller | ok: [instance -> compute-0(compute-0.instance)]
2026-03-19 12:12:40.639554 | controller |
2026-03-19 12:12:40.639589 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-19 12:12:40.639682 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:00.454)       0:05:11.826 ********
2026-03-19 12:12:40.673706 | controller | skipping: [instance]
2026-03-19 12:12:40.673803 | controller |
2026-03-19 12:12:40.673928 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-19 12:12:40.674053 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:00.034)       0:05:11.860 ********
2026-03-19 12:12:40.707646 | controller | skipping: [instance]
2026-03-19 12:12:40.707801 | controller |
2026-03-19 12:12:40.707973 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-19 12:12:40.708186 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:00.033)       0:05:11.894 ********
2026-03-19 12:12:40.739845 | controller | skipping: [instance]
2026-03-19 12:12:40.739926 | controller |
2026-03-19 12:12:40.740034 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-19 12:12:40.740143 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:00.032)       0:05:11.927 ********
2026-03-19 12:12:40.784023 | controller | skipping: [instance]
2026-03-19 12:12:40.784081 | controller |
2026-03-19 12:12:40.784251 | controller | TASK [reproducer : Get rhos-release and setup repos] ***************************
2026-03-19 12:12:40.784331 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:00.043)       0:05:11.970 ********
2026-03-19 12:12:40.818120 | controller | skipping: [instance]
2026-03-19 12:12:40.818223 | controller |
2026-03-19 12:12:40.818354 | controller | TASK [reproducer : Create repositories on computes] ****************************
2026-03-19 12:12:40.818456 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:00.034)       0:05:12.005 ********
2026-03-19 12:12:40.838272 | controller | skipping: [instance]
2026-03-19 12:12:40.838372 | controller |
2026-03-19 12:12:40.838496 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
2026-03-19 12:12:40.838605 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:00.020)       0:05:12.025 ********
2026-03-19 12:12:40.865815 | controller | skipping: [instance]
2026-03-19 12:12:40.865909 | controller |
2026-03-19 12:12:40.866042 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2026-03-19 12:12:40.866157 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:00.027)       0:05:12.053 ********
2026-03-19 12:12:40.905090 | controller | ok: [instance]
2026-03-19 12:12:40.905179 | controller |
2026-03-19 12:12:40.905253 | controller | TASK [reproducer : Push local code] ********************************************
2026-03-19 12:12:40.905365 | controller | Thursday 19 March 2026  12:12:40 +0000 (0:00:00.039)       0:05:12.092 ********
2026-03-19 12:12:41.003492 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
2026-03-19 12:12:41.003547 | controller |
2026-03-19 12:12:41.003638 | controller | TASK [reproducer : Check if repository directories already exist] **************
2026-03-19 12:12:41.003728 | controller | Thursday 19 March 2026  12:12:41 +0000 (0:00:00.097)       0:05:12.190 ********
2026-03-19 12:12:41.041517 | controller | skipping: [instance]
2026-03-19 12:12:41.041606 | controller |
2026-03-19 12:12:41.041721 | controller | TASK [reproducer : Ensure we are not in the job_id branch] *********************
2026-03-19 12:12:41.041833 | controller | Thursday 19 March 2026  12:12:41 +0000 (0:00:00.038)       0:05:12.228 ********
2026-03-19 12:12:41.080742 | controller | skipping: [instance]
2026-03-19 12:12:41.080813 | controller |
2026-03-19 12:12:41.080906 | controller | TASK [reproducer : Fetch zuul.items repositories] ******************************
2026-03-19 12:12:41.080996 | controller | Thursday 19 March 2026  12:12:41 +0000 (0:00:00.039)       0:05:12.267 ********
2026-03-19 12:12:41.118126 | controller | skipping: [instance]
2026-03-19 12:12:41.118209 | controller |
2026-03-19 12:12:41.118300 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
2026-03-19 12:12:41.118403 | controller | Thursday 19 March 2026  12:12:41 +0000 (0:00:00.037)       0:05:12.305 ********
2026-03-19 12:12:41.158138 | controller | skipping: [instance]
2026-03-19 12:12:41.158192 | controller |
2026-03-19 12:12:41.158302 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
2026-03-19 12:12:41.158407 | controller | Thursday 19 March 2026  12:12:41 +0000 (0:00:00.040)       0:05:12.345 ********
2026-03-19 12:12:41.192132 | controller | skipping: [instance]
2026-03-19 12:12:41.192421 | controller |
2026-03-19 12:12:41.633584 | controller | TASK [reproducer : Create target directories beforehand] ***********************
2026-03-19 12:12:41.633614 | controller | Thursday 19 March 2026  12:12:41 +0000 (0:00:00.033)       0:05:12.379 ********
2026-03-19 12:12:41.633626 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
2026-03-19 12:12:42.197132 | controller |
2026-03-19 12:12:42.197187 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2026-03-19 12:12:42.197199 | controller | Thursday 19 March 2026  12:12:41 +0000 (0:00:00.440)       0:05:12.820 ********
2026-03-19 12:12:42.197213 | controller | ok: [instance -> localhost] => (item=ci-framework)
2026-03-19 12:12:42.197362 | controller |
2026-03-19 12:12:42.197394 | controller | TASK [reproducer : Sync remote repositories] ***********************************
2026-03-19 12:12:42.237531 | controller | Thursday 19 March 2026  12:12:42 +0000 (0:00:00.563)       0:05:13.384 ********
2026-03-19 12:12:42.237569 | controller | skipping: [instance] => (item=ci-framework)
2026-03-19 12:12:42.237597 | controller | skipping: [instance]
2026-03-19 12:12:42.237874 | controller |
2026-03-19 12:12:42.258491 | controller | TASK [reproducer : Ensure default repositories are present] ********************
2026-03-19 12:12:42.258514 | controller | Thursday 19 March 2026  12:12:42 +0000 (0:00:00.040)       0:05:13.424 ********
2026-03-19 12:12:42.258525 | controller | fatal: [instance]: FAILED! =>
2026-03-19 12:12:42.267102 | controller |   msg: '[{''src'': ''{{ cifmw_repo_url }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_repo_relative }}''}, {''src'': ''{{ cifmw_install_yamls_src }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_installyamls_repos_relative }}''}, {''src'': ''{{ cifmw_architecture_repo_url }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_architecture_repo_relative }}''}]: ''cifmw_repo_url'' is undefined. ''cifmw_repo_url'' is undefined. [{''src'': ''{{ cifmw_repo_url }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_repo_relative }}''}, {''src'': ''{{ cifmw_install_yamls_src }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_installyamls_repos_relative }}''}, {''src'': ''{{ cifmw_architecture_repo_url }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_architecture_repo_relative }}''}]: ''cifmw_repo_url'' is undefined. ''cifmw_repo_url'' is undefined'
2026-03-19 12:12:42.267129 | controller |
2026-03-19 12:12:42.456505 | controller | TASK [Create dnsmasq dir] ******************************************************
2026-03-19 12:12:42.456536 | controller | Thursday 19 March 2026  12:12:42 +0000 (0:00:00.029)       0:05:13.454 ********
2026-03-19 12:12:42.456547 | controller | changed: [instance]
2026-03-19 12:12:42.665871 | controller |
2026-03-19 12:12:42.665899 | controller | TASK [Get journalctl in a file] ************************************************
2026-03-19 12:12:42.665907 | controller | Thursday 19 March 2026  12:12:42 +0000 (0:00:00.188)       0:05:13.643 ********
2026-03-19 12:12:42.665917 | controller | changed: [instance]
2026-03-19 12:12:43.030752 | controller |
2026-03-19 12:12:43.030781 | controller | TASK [Dump journalctl output] **************************************************
2026-03-19 12:12:43.030790 | controller | Thursday 19 March 2026  12:12:42 +0000 (0:00:00.209)       0:05:13.852 ********
2026-03-19 12:12:43.030799 | controller | changed: [instance]
2026-03-19 12:12:43.517141 | controller |
2026-03-19 12:12:43.517177 | controller | TASK [Copy all dnsmasq config] *************************************************
2026-03-19 12:12:43.517185 | controller | Thursday 19 March 2026  12:12:43 +0000 (0:00:00.364)       0:05:14.217 ********
2026-03-19 12:12:43.517197 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-03-19 12:12:43.708402 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2026-03-19 12:12:43.708501 | controller |
2026-03-19 12:12:43.708513 | controller | TASK [Create log directory] ****************************************************
2026-03-19 12:12:43.708520 | controller | Thursday 19 March 2026  12:12:43 +0000 (0:00:00.486)       0:05:14.703 ********
2026-03-19 12:12:43.708530 | controller | changed: [instance]
2026-03-19 12:12:44.630104 | controller |
2026-03-19 12:12:44.630137 | controller | TASK [Sync logs from controller-0] *********************************************
2026-03-19 12:12:44.630144 | controller | Thursday 19 March 2026  12:12:43 +0000 (0:00:00.191)       0:05:14.895 ********
2026-03-19 12:12:44.630154 | controller | changed: [instance]
2026-03-19 12:12:44.630176 | controller |
2026-03-19 12:12:44.630182 | controller | PLAY RECAP *********************************************************************
2026-03-19 12:12:44.630188 | controller | instance                   : ok=495  changed=186  unreachable=0    failed=1    skipped=182  rescued=0    ignored=0
2026-03-19 12:12:44.630193 | controller |
2026-03-19 12:12:44.630198 | controller | Thursday 19 March 2026  12:12:44 +0000 (0:00:00.919)       0:05:15.814 ********
2026-03-19 12:12:44.630203 | controller | ===============================================================================
2026-03-19 12:12:44.630208 | controller | reproducer : Check package install status ------------------------------ 44.61s
2026-03-19 12:12:44.630213 | controller | libvirt_manager : Download base image ---------------------------------- 30.35s
2026-03-19 12:12:44.630218 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.07s
2026-03-19 12:12:44.630222 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.68s
2026-03-19 12:12:44.630227 | controller | libvirt_manager : Install packages required for using KVM --------------- 9.70s
2026-03-19 12:12:44.630232 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 6.82s
2026-03-19 12:12:44.630237 | controller | reproducer : Ensure we have all dependencies installed ------------------ 5.94s
2026-03-19 12:12:44.630242 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.05s
2026-03-19 12:12:44.630247 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.58s
2026-03-19 12:12:44.630252 | controller | networking_mapper : Gather the facts ------------------------------------ 3.27s
2026-03-19 12:12:44.630257 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.04s
2026-03-19 12:12:44.630262 | controller | sushy_emulator : Install required packages ------------------------------ 2.46s
2026-03-19 12:12:44.630267 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s
2026-03-19 12:12:44.630271 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.00s
2026-03-19 12:12:44.630280 | controller | reproducer : Inject SSH configuration ----------------------------------- 1.89s
2026-03-19 12:12:44.630285 | controller | reproducer : Sync local repositories to other hosts if present ---------- 1.85s
2026-03-19 12:12:44.630291 | controller | libvirt_manager : Inject private key on hosts controller-0 -------------- 1.71s
2026-03-19 12:12:44.630474 | controller | ci_nmstate : Apply the desidered state on instance ---------------------- 1.65s
2026-03-19 12:12:44.724798 | controller | ci_nmstate : Apply the desidered state on localhost --------------------- 1.59s
2026-03-19 12:12:44.724859 | controller | discover_latest_image : Get latest image for the current entry ---------- 1.48s
2026-03-19 12:12:44.724876 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml']
2026-03-19 12:12:44.724985 | controller | WARNING  An error occurred during the test sequence action: 'converge'. Cleaning up.
2026-03-19 12:12:44.732638 | controller | INFO     Running crc_layout > cleanup
2026-03-19 12:12:44.732983 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-19 12:12:44.740117 | controller | INFO     Running crc_layout > destroy
2026-03-19 12:12:44.740420 | controller | WARNING  Skipping, instances are delegated.
2026-03-19 12:12:44.740701 | controller | INFO     Pruning extra files from scenario ephemeral directory
2026-03-19 12:12:44.742037 | controller | INFO     Writing /tmp/report.html report.
2026-03-19 12:12:45.163989 | [controller] Waiting on logger
2026-03-19 12:12:50.293902 | [controller] Waiting on logger
2026-03-19 12:13:00.725813 | [controller] Waiting on logger
2026-03-19 12:13:11.158501 | [controller] Waiting on logger
2026-03-19 12:13:14.841936 | [Zuul] Log Stream did not terminate
2026-03-19 12:13:14.842299 | controller | ERROR
2026-03-19 12:13:14.842384 | controller | {
2026-03-19 12:13:14.842415 | controller |   "delta": "0:06:59.306682",
2026-03-19 12:13:14.842436 | controller |   "end": "2026-03-19 12:12:44.798216",
2026-03-19 12:13:14.842454 | controller |   "msg": "non-zero return code",
2026-03-19 12:13:14.842472 | controller |   "rc": 1,
2026-03-19 12:13:14.842489 | controller |   "start": "2026-03-19 12:05:45.491534"
2026-03-19 12:13:14.842504 | controller | }
failure
2026-03-19 12:13:14.892041 | 
2026-03-19 12:13:14.892096 | PLAY RECAP
2026-03-19 12:13:14.892136 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0
2026-03-19 12:13:14.892158 | 
2026-03-19 12:13:14.956699 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-03-19 12:13:14.957513 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-03-19 12:13:15.481875 | 
2026-03-19 12:13:15.481990 | PLAY [Run ci/playbooks/collect-logs.yml]
2026-03-19 12:13:15.502152 | 
2026-03-19 12:13:15.502225 | TASK [Filter out host if needed]
2026-03-19 12:13:15.510735 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2026-03-19 12:13:15.515115 | 
2026-03-19 12:13:15.515182 | TASK [Ensure file is present]
2026-03-19 12:13:15.889507 | controller | ok
2026-03-19 12:13:15.895093 | 
2026-03-19 12:13:15.895164 | TASK [Manage molecule report file]
2026-03-19 12:13:15.915628 | [controller] Waiting on logger
2026-03-19 12:13:25.274529 | [controller] Waiting on logger
2026-03-19 12:13:35.669758 | [controller] Waiting on logger
2026-03-19 12:13:46.101810 | [controller] Waiting on logger
2026-03-19 12:13:46.279328 | [Zuul] Log Stream did not terminate
2026-03-19 12:13:46.279656 | controller | changed
2026-03-19 12:13:46.286541 | 
2026-03-19 12:13:46.286608 | TASK [Check if we get ci-framework-data basedir]
2026-03-19 12:13:46.539739 | controller | ok
2026-03-19 12:13:46.544756 | 
2026-03-19 12:13:46.544820 | TASK [Create ci-framework-data log directory for zuul]
2026-03-19 12:13:46.919129 | controller | changed
2026-03-19 12:13:46.924186 | 
2026-03-19 12:13:46.924255 | TASK [Copy ci-framework interesting files]
2026-03-19 12:13:51.951181 | controller | changed
2026-03-19 12:13:51.956583 | 
2026-03-19 12:13:51.956653 | TASK [Get SELinux listing]
2026-03-19 12:13:53.013713 | [controller] Waiting on logger
2026-03-19 12:14:02.357875 | [controller] Waiting on logger
2026-03-19 12:14:12.789841 | [controller] Waiting on logger
2026-03-19 12:14:22.170943 | [controller] Waiting on logger
2026-03-19 12:14:22.238964 | [Zuul] Log Stream did not terminate
2026-03-19 12:14:22.239221 | controller | changed
2026-03-19 12:14:22.245807 | 
2026-03-19 12:14:22.245890 | TASK [Generate log index]
2026-03-19 12:14:24.289416 | controller | changed
2026-03-19 12:14:24.294429 | 
2026-03-19 12:14:24.294502 | TASK [Get some env related data]
2026-03-19 12:14:24.318647 | [controller] Waiting on logger
2026-03-19 12:14:42.934095 | [controller] Waiting on logger
2026-03-19 12:14:43.893780 | [controller] Waiting on logger
2026-03-19 12:14:56.104296 | [Zuul] Log Stream did not terminate
2026-03-19 12:14:56.104604 | controller | changed
2026-03-19 12:14:56.111207 | 
2026-03-19 12:14:56.111301 | TASK [Generate list of logs to collect in home directory]
2026-03-19 12:14:56.626706 | controller | ok: All paths examined
2026-03-19 12:14:56.632384 | 
2026-03-19 12:14:56.632453 | LOOP [Copy logs from home directory]
2026-03-19 12:14:57.635815 | controller | changed:
2026-03-19 12:14:57.636100 | controller | {
2026-03-19 12:14:57.636128 | controller |   "atime": 1773350327.2786021,
2026-03-19 12:14:57.636146 | controller |   "ctime": 1773351461.47114,
2026-03-19 12:14:57.636170 | controller |   "dev": 64513,
2026-03-19 12:14:57.636186 | controller |   "gid": 1000,
2026-03-19 12:14:57.636200 | controller |   "gr_name": "zuul",
2026-03-19 12:14:57.636216 | controller |   "inode": 6822,
2026-03-19 12:14:57.636231 | controller |   "isblk": false,
2026-03-19 12:14:57.636247 | controller |   "ischr": false,
2026-03-19 12:14:57.636275 | controller |   "isdir": false,
2026-03-19 12:14:57.636299 | controller |   "isfifo": false,
2026-03-19 12:14:57.636316 | controller |   "isgid": false,
2026-03-19 12:14:57.636331 | controller |   "islnk": false,
2026-03-19 12:14:57.636345 | controller |   "isreg": true,
2026-03-19 12:14:57.636358 | controller |   "issock": false,
2026-03-19 12:14:57.636371 | controller |   "isuid": false,
2026-03-19 12:14:57.636387 | controller |   "mode": "0644",
2026-03-19 12:14:57.636401 | controller |   "mtime": 1773351461.47114,
2026-03-19 12:14:57.636415 | controller |   "nlink": 1,
2026-03-19 12:14:57.636429 | controller |   "path": "/home/zuul/crc-setup.log",
2026-03-19 12:14:57.636442 | controller |   "pw_name": "zuul",
2026-03-19 12:14:57.636455 | controller |   "rgrp": true,
2026-03-19 12:14:57.636467 | controller |   "roth": true,
2026-03-19 12:14:57.636479 | controller |   "rusr": true,
2026-03-19 12:14:57.636492 | controller |   "size": 4108,
2026-03-19 12:14:57.636505 | controller |   "uid": 1000,
2026-03-19 12:14:57.636517 | controller |   "wgrp": false,
2026-03-19 12:14:57.636530 | controller |   "woth": false,
2026-03-19 12:14:57.636543 | controller |   "wusr": true,
2026-03-19 12:14:57.636556 | controller |   "xgrp": false,
2026-03-19 12:14:57.636568 | controller |   "xoth": false,
2026-03-19 12:14:57.636581 | controller |   "xusr": false
2026-03-19 12:14:57.636595 | controller | }
2026-03-19 12:14:58.387112 | controller | changed:
2026-03-19 12:14:58.387216 | controller | {
2026-03-19 12:14:58.387243 | controller |   "atime": 1773351463.1371913,
2026-03-19 12:14:58.387287 | controller |   "ctime": 1773352236.2951868,
2026-03-19 12:14:58.387314 | controller |   "dev": 64513,
2026-03-19 12:14:58.387333 | controller |   "gid": 1000,
2026-03-19 12:14:58.387349 | controller |   "gr_name": "zuul",
2026-03-19 12:14:58.387365 | controller |   "inode": 6833,
2026-03-19 12:14:58.387380 | controller |   "isblk": false,
2026-03-19 12:14:58.387395 | controller |   "ischr": false,
2026-03-19 12:14:58.387410 | controller |   "isdir": false,
2026-03-19 12:14:58.387425 | controller |   "isfifo": false,
2026-03-19 12:14:58.387439 | controller |   "isgid": false,
2026-03-19 12:14:58.387453 | controller |   "islnk": false,
2026-03-19 12:14:58.387468 | controller |   "isreg": true,
2026-03-19 12:14:58.387482 | controller |   "issock": false,
2026-03-19 12:14:58.387496 | controller |   "isuid": false,
2026-03-19 12:14:58.387510 | controller |   "mode": "0644",
2026-03-19 12:14:58.387524 | controller |   "mtime": 1773352236.2951868,
2026-03-19 12:14:58.387540 | controller |   "nlink": 1,
2026-03-19 12:14:58.387555 | controller |   "path": "/home/zuul/crc-start.log",
2026-03-19 12:14:58.387570 | controller |   "pw_name": "zuul",
2026-03-19 12:14:58.387584 | controller |   "rgrp": true,
2026-03-19 12:14:58.387598 | controller |   "roth": true,
2026-03-19 12:14:58.387611 | controller |   "rusr": true,
2026-03-19 12:14:58.387625 | controller |   "size": 4527,
2026-03-19 12:14:58.387639 | controller |   "uid": 1000,
2026-03-19 12:14:58.387652 | controller |   "wgrp": false,
2026-03-19 12:14:58.387665 | controller |   "woth": false,
2026-03-19 12:14:58.387678 | controller |   "wusr": true,
2026-03-19 12:14:58.387691 | controller |   "xgrp": false,
2026-03-19 12:14:58.387704 | controller |   "xoth": false,
2026-03-19 12:14:58.387717 | controller |   "xusr": false
2026-03-19 12:14:58.387731 | controller | }
2026-03-19 12:14:59.040666 | controller | changed:
2026-03-19 12:14:59.040723 | controller | {
2026-03-19 12:14:59.040750 | controller |   "atime": 1773921927.4857678,
2026-03-19 12:14:59.040769 | controller |   "ctime": 1773921943.1460102,
2026-03-19 12:14:59.040794 | controller |   "dev": 64513,
2026-03-19 12:14:59.040811 | controller |   "gid": 1000,
2026-03-19 12:14:59.040826 | controller |   "gr_name": "zuul",
2026-03-19 12:14:59.040843 | controller |   "inode": 1427726,
2026-03-19 12:14:59.040870 | controller |   "isblk": false,
2026-03-19 12:14:59.040890 | controller |   "ischr": false,
2026-03-19 12:14:59.040908 | controller |   "isdir": false,
2026-03-19 12:14:59.040923 | controller |   "isfifo": false,
2026-03-19 12:14:59.040941 | controller |   "isgid": false,
2026-03-19 12:14:59.040957 | controller |   "islnk": false,
2026-03-19 12:14:59.040971 | controller |   "isreg": true,
2026-03-19 12:14:59.040985 | controller |   "issock": false,
2026-03-19 12:14:59.040999 | controller |   "isuid": false,
2026-03-19 12:14:59.041013 | controller |   "mode": "0644",
2026-03-19 12:14:59.041026 | controller |   "mtime": 1773921943.1460102,
2026-03-19 12:14:59.041041 | controller |   "nlink": 1,
2026-03-19 12:14:59.041056 | controller |   "path": "/home/zuul/ansible.log",
2026-03-19 12:14:59.041071 | controller |   "pw_name": "zuul",
2026-03-19 12:14:59.041085 | controller |   "rgrp": true,
2026-03-19 12:14:59.041099 | controller |   "roth": true,
2026-03-19 12:14:59.041112 | controller |   "rusr": true,
2026-03-19 12:14:59.041126 | controller |   "size": 6749,
2026-03-19 12:14:59.041140 | controller |   "uid": 1000,
2026-03-19 12:14:59.041154 | controller |   "wgrp": false,
2026-03-19 12:14:59.041169 | controller |   "woth": false,
2026-03-19 12:14:59.041184 | controller |   "wusr": true,
2026-03-19 12:14:59.041200 | controller |   "xgrp": false,
2026-03-19 12:14:59.041215 | controller |   "xoth": false,
2026-03-19 12:14:59.041229 | controller |   "xusr": false
2026-03-19 12:14:59.041243 | controller | }
2026-03-19 12:14:59.052641 | 
2026-03-19 12:14:59.052786 | TASK [Copy crio stats log file]
2026-03-19 12:14:59.067533 | controller | skipping: Conditional result was False
2026-03-19 12:14:59.073559 | 
2026-03-19 12:14:59.073626 | TASK [Get SELinux related data]
2026-03-19 12:14:59.509719 | [controller] Waiting on logger
2026-03-19 12:15:02.197796 | [controller] Waiting on logger
2026-03-19 12:15:12.629960 | [controller] Waiting on logger
2026-03-19 12:15:23.062035 | [controller] Waiting on logger
2026-03-19 12:15:29.438097 | [Zuul] Log Stream did not terminate
2026-03-19 12:15:29.438365 | controller | ERROR
2026-03-19 12:15:29.438491 | controller | {
2026-03-19 12:15:29.438526 | controller |   "delta": "0:00:00.015183",
2026-03-19 12:15:29.438551 | controller |   "end": "2026-03-19 12:14:59.401210",
2026-03-19 12:15:29.438573 | controller |   "msg": "non-zero return code",
2026-03-19 12:15:29.438593 | controller |   "rc": 1,
2026-03-19 12:15:29.438612 | controller |   "start": "2026-03-19 12:14:59.386027"
2026-03-19 12:15:29.438631 | controller | }
2026-03-19 12:15:29.438657 | controller | ERROR: Ignoring Errors
2026-03-19 12:15:29.443851 | 
2026-03-19 12:15:29.443924 | TASK [Create system configuration directory]
2026-03-19 12:15:30.060741 | controller | changed
2026-03-19 12:15:30.066217 | 
2026-03-19 12:15:30.066320 | TASK [Get some of the system configurations]
2026-03-19 12:15:31.126012 | [controller] Waiting on logger
2026-03-19 12:15:35.542149 | [controller] Waiting on logger
2026-03-19 12:15:45.654379 | [controller] Waiting on logger
2026-03-19 12:15:56.086451 | [controller] Waiting on logger
2026-03-19 12:16:00.606020 | [Zuul] Log Stream did not terminate
2026-03-19 12:16:00.606399 | controller | changed
2026-03-19 12:16:00.614113 | 
2026-03-19 12:16:00.614184 | TASK [Copy generated documentation if available]
2026-03-19 12:16:00.640062 | controller | skipping: Conditional result was False
2026-03-19 12:16:00.646875 | 
2026-03-19 12:16:00.646948 | TASK [Copy generated AsciiDoc documentation if available]
2026-03-19 12:16:00.672576 | controller | skipping: Conditional result was False
2026-03-19 12:16:00.679105 | 
2026-03-19 12:16:00.679174 | TASK [Compress logs bigger than 2MB]
2026-03-19 12:16:00.704306 | [controller] Waiting on logger
2026-03-19 12:16:13.173743 | [controller] Waiting on logger
2026-03-19 12:16:22.517983 | [controller] Waiting on logger
2026-03-19 12:16:31.562093 | [Zuul] Log Stream did not terminate
2026-03-19 12:16:31.562617 | controller | changed
2026-03-19 12:16:31.574983 | 
2026-03-19 12:16:31.575069 | TASK [Copy files from workspace on node]
2026-03-19 12:16:31.596036 | controller | ok
2026-03-19 12:16:31.619300 | 
2026-03-19 12:16:31.619387 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-19 12:16:31.644572 | controller | skipping: Conditional result was False
2026-03-19 12:16:31.651999 | 
2026-03-19 12:16:31.652083 | TASK [fetch-output : Set log path for single node]
2026-03-19 12:16:31.683612 | controller | ok
2026-03-19 12:16:31.688870 | 
2026-03-19 12:16:31.688985 | LOOP [fetch-output : Ensure local output dirs]
2026-03-19 12:16:31.887888 | controller -> localhost | ok: "/var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/logs"
2026-03-19 12:16:31.888228 | controller -> localhost | changed: All items complete
2026-03-19 12:16:31.888261 | 
2026-03-19 12:16:32.081107 | controller -> localhost | changed: "/var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/artifacts"
2026-03-19 12:16:32.272146 | controller -> localhost | changed: "/var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/docs"
2026-03-19 12:16:32.283218 | 
2026-03-19 12:16:32.283388 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-19 12:16:32.949642 | [controller] Waiting on logger
2026-03-19 12:16:32.989728 | controller | changed:
2026-03-19 12:16:32.990002 | controller | .d..t...... ./
2026-03-19 12:16:32.990043 | controller | >f+++++++++ README.html
2026-03-19 12:16:32.990067 | controller | >f+++++++++ ansible-execution.log
2026-03-19 12:16:32.990088 | controller | >f+++++++++ ansible.log
2026-03-19 12:16:32.990107 | controller | >f+++++++++ crc-setup.log
2026-03-19 12:16:32.990125 | controller | >f+++++++++ crc-start.log
2026-03-19 12:16:32.990142 | controller | >f+++++++++ dmesg.log
2026-03-19 12:16:32.990160 | controller | >f+++++++++ installed-pkgs.log
2026-03-19 12:16:32.990176 | controller | >f+++++++++ python.log
2026-03-19 12:16:32.990193 | controller | >f+++++++++ registries.conf
2026-03-19 12:16:32.990208 | controller | >f+++++++++ report.html
2026-03-19 12:16:32.990224 | controller | >f+++++++++ selinux-denials.log
2026-03-19 12:16:32.990239 | controller | >f+++++++++ selinux-listing.log
2026-03-19 12:16:32.990254 | controller | cd+++++++++ ci-framework-data/
2026-03-19 12:16:32.990294 | controller | cd+++++++++ ci-framework-data/artifacts/
2026-03-19 12:16:32.990314 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2026-03-19 12:16:32.990332 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2026-03-19 12:16:32.990347 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf
2026-03-19 12:16:32.990365 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2026-03-19 12:16:32.990381 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf
2026-03-19 12:16:32.990398 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2026-03-19 12:16:32.990413 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2026-03-19 12:16:32.990429 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2026-03-19 12:16:32.990445 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2026-03-19 12:16:32.990460 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2026-03-19 12:16:32.990475 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2026-03-19 12:16:32.990490 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2026-03-19 12:16:32.990504 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2026-03-19 12:16:32.990521 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:b8:cb:4e
2026-03-19 12:16:32.990549 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:ae:d4:54
2026-03-19 12:16:32.990566 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:4a:11:55
2026-03-19 12:16:32.990582 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:26:78:19
2026-03-19 12:16:32.990599 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:1e:60:a9
2026-03-19 12:16:32.990615 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:ca:e7:70
2026-03-19 12:16:32.990632 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2026-03-19 12:16:32.990649 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2026-03-19 12:16:32.990665 | controller | cd+++++++++ ci-framework-data/logs/
2026-03-19 12:16:32.990681 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2026-03-19 12:16:32.990697 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2026-03-19 12:16:32.990712 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2026-03-19 12:16:32.990727 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2026-03-19 12:16:32.990743 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml
2026-03-19 12:16:32.990761 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2026-03-19 12:16:32.990777 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/
2026-03-19 12:16:32.990793 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd
2026-03-19 12:16:32.990807 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf
2026-03-19 12:16:32.990822 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts
2026-03-19 12:16:32.990837 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2026-03-19 12:16:32.990863 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml
2026-03-19 12:16:32.990882 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2026-03-19 12:16:32.990898 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml
2026-03-19 12:16:32.990914 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml
2026-03-19 12:16:32.990929 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/
2026-03-19 12:16:32.990944 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt
2026-03-19 12:16:32.990959 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2026-03-19 12:16:32.990974 | controller | cd+++++++++ registries.conf.d/
2026-03-19 12:16:32.990989 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2026-03-19 12:16:32.991004 | controller | cd+++++++++ system-config/
2026-03-19 12:16:32.991019 | controller | cd+++++++++ system-config/libvirt/
2026-03-19 12:16:32.991033 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2026-03-19 12:16:32.991048 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2026-03-19 12:16:32.991063 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2026-03-19 12:16:32.991077 | controller | >f+++++++++ system-config/libvirt/network.conf
2026-03-19 12:16:32.991092 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2026-03-19 12:16:32.991106 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2026-03-19 12:16:32.991126 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2026-03-19 12:16:32.991142 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2026-03-19 12:16:32.991157 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2026-03-19 12:16:32.991171 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2026-03-19 12:16:32.991186 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2026-03-19 12:16:32.991200 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2026-03-19 12:16:32.991214 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2026-03-19 12:16:32.991229 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2026-03-19 12:16:32.991243 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2026-03-19 12:16:32.991257 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2026-03-19 12:16:33.488216 | controller | changed: .d..t...... ./
2026-03-19 12:16:34.060376 | controller | changed: .d..t...... ./
2026-03-19 12:16:34.076551 | 
2026-03-19 12:16:34.076713 | TASK [Return artifact to Zuul]
2026-03-19 12:16:34.108763 | controller | ok
2026-03-19 12:16:34.127505 | 
2026-03-19 12:16:34.127568 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2026-03-19 12:16:34.127676 | 
2026-03-19 12:16:34.127703 | PLAY RECAP
2026-03-19 12:16:34.127747 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2026-03-19 12:16:34.127769 | 
2026-03-19 12:16:34.227337 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-03-19 12:16:34.228177 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-19 12:16:34.756707 | 
2026-03-19 12:16:34.756864 | PLAY [all]
2026-03-19 12:16:34.775453 | 
2026-03-19 12:16:34.775533 | TASK [include_role : fetch-output]
2026-03-19 12:16:34.806628 | controller | ok
2026-03-19 12:16:34.823206 | 
2026-03-19 12:16:34.823309 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-19 12:16:34.869472 | controller | skipping: Conditional result was False
2026-03-19 12:16:34.875731 | 
2026-03-19 12:16:34.875812 | TASK [fetch-output : Set log path for single node]
2026-03-19 12:16:34.906368 | controller | ok
2026-03-19 12:16:34.911234 | 
2026-03-19 12:16:34.911322 | LOOP [fetch-output : Ensure local output dirs]
2026-03-19 12:16:35.264929 | controller -> localhost | ok: "/var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/logs"
2026-03-19 12:16:35.468846 | controller -> localhost | ok: "/var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/artifacts"
2026-03-19 12:16:35.671208 | controller -> localhost | ok: "/var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/docs"
2026-03-19 12:16:35.685659 | 
2026-03-19 12:16:35.685817 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-19 12:16:36.354636 | controller | ok
2026-03-19 12:16:36.354876 | controller | ok: All items complete
2026-03-19 12:16:36.354908 | 
2026-03-19 12:16:36.852432 | controller | ok
2026-03-19 12:16:37.331227 | controller | ok
2026-03-19 12:16:37.348349 | 
2026-03-19 12:16:37.348506 | TASK [include_role : fetch-output-openshift]
2026-03-19 12:16:37.364202 | controller | skipping: Conditional result was False
2026-03-19 12:16:37.370405 | 
2026-03-19 12:16:37.370479 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-19 12:16:37.732708 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.007616
2026-03-19 12:16:37.924576 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.007015
2026-03-19 12:16:37.956992 | 
2026-03-19 12:16:37.957121 | PLAY [all]
2026-03-19 12:16:37.970964 | 
2026-03-19 12:16:37.971032 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-19 12:16:38.592284 | controller | changed
2026-03-19 12:16:38.613445 | 
2026-03-19 12:16:38.613498 | PLAY RECAP
2026-03-19 12:16:38.613543 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2026-03-19 12:16:38.613584 | 
2026-03-19 12:16:38.692101 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-19 12:16:38.693005 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2026-03-19 12:16:39.253668 | 
2026-03-19 12:16:39.253824 | PLAY [localhost]
2026-03-19 12:16:39.271629 | 
2026-03-19 12:16:39.271707 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-19 12:16:39.595805 | localhost | changed
2026-03-19 12:16:39.600722 | 
2026-03-19 12:16:39.600802 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-19 12:16:39.629363 | localhost | ok
2026-03-19 12:16:39.636994 | 
2026-03-19 12:16:39.637061 | TASK [add-fileserver : Create SSH private key tempfile]
2026-03-19 12:16:39.959501 | localhost | changed
2026-03-19 12:16:39.965546 | 
2026-03-19 12:16:39.965626 | TASK [add-fileserver : Create SSH private key from secret]
2026-03-19 12:16:40.531760 | localhost | changed
2026-03-19 12:16:40.536900 | 
2026-03-19 12:16:40.536970 | TASK [add-fileserver : Add fileserver ssh key]
2026-03-19 12:16:40.890396 | localhost | Identity added: /var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/tmp/ansible.p1xuqmy3 (/var/lib/zuul/builds/9c441b7272884649bdfe4c82f4bf76ab/work/tmp/ansible.p1xuqmy3)
2026-03-19 12:16:40.890620 | localhost | ok: Runtime: 0:00:00.006734
2026-03-19 12:16:40.895041 | 
2026-03-19 12:16:40.895112 | TASK [add-fileserver : Remove SSH private key from disk]
2026-03-19 12:16:41.126763 | localhost | ok: Runtime: 0:00:00.004469
2026-03-19 12:16:41.131446 | 
2026-03-19 12:16:41.131514 | TASK [add-fileserver : Add fileserver to inventory]
2026-03-19 12:16:41.180929 | localhost | changed
2026-03-19 12:16:41.185170 | 
2026-03-19 12:16:41.185245 | TASK [add-fileserver : Add fileserver server to known hosts]
2026-03-19 12:16:41.518036 | localhost | changed
2026-03-19 12:16:41.537912 | 
2026-03-19 12:16:41.538001 | PLAY [localhost]
2026-03-19 12:16:41.549892 | 
2026-03-19 12:16:41.550051 | TASK [Generate bulk log download script]
2026-03-19 12:16:41.570100 | localhost | ok
2026-03-19 12:16:41.581254 | 
2026-03-19 12:16:41.581335 | TASK [local-log-download : Check API endpoint is defined]
2026-03-19 12:16:41.609335 | localhost | ok: All assertions passed
2026-03-19 12:16:41.613661 | 
2026-03-19 12:16:41.613724 | TASK [local-log-download : Create download script]
2026-03-19 12:16:41.971919 | localhost -> localhost | changed
2026-03-19 12:16:41.980954 | 
2026-03-19 12:16:41.981024 | TASK [Register quick-download link]
2026-03-19 12:16:42.010495 | localhost | ok
2026-03-19 12:16:42.053073 | 
2026-03-19 12:16:42.053164 | PLAY [logserver.rdoproject.org]
2026-03-19 12:16:42.063077 | 
2026-03-19 12:16:42.063160 | TASK [Set zuul-log-path fact]
2026-03-19 12:16:42.081039 | logserver.rdoproject.org | ok
2026-03-19 12:16:42.089919 | 
2026-03-19 12:16:42.089989 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-19 12:16:42.117551 | logserver.rdoproject.org | ok
2026-03-19 12:16:42.122677 | 
2026-03-19 12:16:42.122741 | TASK [upload-logs : Create log directories]
2026-03-19 12:16:43.950932 | logserver.rdoproject.org | changed
2026-03-19 12:16:43.954110 | 
2026-03-19 12:16:43.954182 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-19 12:16:44.180963 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.006126
2026-03-19 12:16:44.185976 | 
2026-03-19 12:16:44.186052 | TASK [upload-logs : Upload logs to log server]
2026-03-19 12:16:45.716478 | logserver.rdoproject.org | Output suppressed because no_log was given
2026-03-19 12:16:45.719600 | 
2026-03-19 12:16:45.719673 | LOOP [upload-logs : Compress console log and json output]
2026-03-19 12:16:45.764208 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-19 12:16:45.771819 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-19 12:16:45.779955 | 
2026-03-19 12:16:45.780082 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-19 12:16:45.821923 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-19 12:16:45.822192 | 
2026-03-19 12:16:45.824974 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-19 12:16:45.830387 | 
2026-03-19 12:16:45.830507 | LOOP [upload-logs : Upload console log and json output]