2025-11-27 09:39:10.113108 | Job console starting...
2025-11-27 09:39:10.331997 | Updating repositories
2025-11-27 09:39:11.090499 | Preparing job workspace
2025-11-27 09:39:18.020297 | Running Ansible setup...
2025-11-27 09:39:21.576124 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2025-11-27 09:39:22.045279 | 
2025-11-27 09:39:22.045413 | PLAY [localhost]
2025-11-27 09:39:22.053097 | 
2025-11-27 09:39:22.053161 | TASK [Gathering Facts]
2025-11-27 09:39:22.805935 | localhost | ok
2025-11-27 09:39:22.818118 | 
2025-11-27 09:39:22.818192 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2025-11-27 09:39:23.115427 | localhost -> localhost | changed
2025-11-27 09:39:23.120219 | 
2025-11-27 09:39:23.120284 | TASK [log-inventory : Copy ansible inventory to logs dir]
2025-11-27 09:39:23.752829 | localhost -> localhost | changed
2025-11-27 09:39:23.760567 | 
2025-11-27 09:39:23.760632 | TASK [Setup log path fact]
2025-11-27 09:39:23.777580 | localhost | ok
2025-11-27 09:39:23.787601 | 
2025-11-27 09:39:23.787663 | TASK [set-zuul-log-path-fact : Set log path for a build]
2025-11-27 09:39:23.804692 | localhost | ok
2025-11-27 09:39:23.811457 | 
2025-11-27 09:39:23.811519 | TASK [emit-job-header : Print job information]
2025-11-27 09:39:23.839034 | # Job Information
2025-11-27 09:39:23.839186 | Ansible Version: 2.15.12
2025-11-27 09:39:23.839216 | Job: cifmw-molecule-reproducer
2025-11-27 09:39:23.839239 | Pipeline: github-check
2025-11-27 09:39:23.839259 | Executor: ibm-bm3-ze.softwarefactory-project.io
2025-11-27 09:39:23.839279 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3505
2025-11-27 09:39:23.839298 | Log URL (when completed): https://logserver.rdoproject.org/a93/rdoproject.org/a93b4cbdecfb434f8e5d42900d3b1332/
2025-11-27 09:39:23.839318 | Event ID: cc763870-cb74-11f0-92b6-b7768b5a29fb
2025-11-27 09:39:23.842860 | 
2025-11-27 09:39:23.842921 | LOOP [emit-job-header : Print node information]
2025-11-27 09:39:23.921363 | localhost | ok:
2025-11-27 09:39:23.921491 | localhost | # Node Information
2025-11-27 09:39:23.921520 | localhost | Inventory Hostname: controller
2025-11-27 09:39:23.921543 | localhost | Hostname: np0005537582
2025-11-27 09:39:23.921563 | localhost | Username: zuul
2025-11-27 09:39:23.921583 | localhost | Distro: CentOS 9
2025-11-27 09:39:23.921601 | localhost | Provider: ibm-bm3-nodepool
2025-11-27 09:39:23.921619 | localhost | Region: regionOne
2025-11-27 09:39:23.921636 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2025-11-27 09:39:23.921653 | localhost | Product Name: OpenStack Compute
2025-11-27 09:39:23.921670 | localhost | Interface IP: 192.168.25.242
2025-11-27 09:39:23.944130 | 
2025-11-27 09:39:23.944184 | PLAY [all]
2025-11-27 09:39:23.950129 | 
2025-11-27 09:39:23.950191 | TASK [Gather network facts]
2025-11-27 09:39:24.383482 | controller | ok
2025-11-27 09:39:24.397109 | 
2025-11-27 09:39:24.397184 | TASK [include_role : start-zuul-console]
2025-11-27 09:39:24.414633 | controller | ok
2025-11-27 09:39:24.425211 | 
2025-11-27 09:39:24.425277 | TASK [start-zuul-console : Start zuul_console daemon.]
2025-11-27 09:39:24.796693 | controller | ok
2025-11-27 09:39:24.806631 | 
2025-11-27 09:39:24.806729 | TASK [include_role : add-build-sshkey]
2025-11-27 09:39:24.826436 | controller | ok
2025-11-27 09:39:24.838583 | 
2025-11-27 09:39:24.838648 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2025-11-27 09:39:25.023803 | controller -> localhost | ok
2025-11-27 09:39:25.029065 | 
2025-11-27 09:39:25.029139 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2025-11-27 09:39:25.047173 | controller | ok
2025-11-27 09:39:25.058950 | controller | included: /var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2025-11-27 09:39:25.064269 | 
2025-11-27 09:39:25.064331 | TASK [add-build-sshkey : Create Temp SSH key]
2025-11-27 09:39:25.573817 | controller -> localhost | Generating public/private rsa key pair.
2025-11-27 09:39:25.574001 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/a93b4cbdecfb434f8e5d42900d3b1332_id_rsa.
2025-11-27 09:39:25.574033 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/a93b4cbdecfb434f8e5d42900d3b1332_id_rsa.pub.
2025-11-27 09:39:25.574057 | controller -> localhost | The key fingerprint is:
2025-11-27 09:39:25.574077 | controller -> localhost | SHA256:FGy5Ga3KIJXNqmB1XHtwvhi+8j86A+HL/Sc68Bv4IVE zuul-build-sshkey
2025-11-27 09:39:25.574097 | controller -> localhost | The key's randomart image is:
2025-11-27 09:39:25.574116 | controller -> localhost | +---[RSA 3072]----+
2025-11-27 09:39:25.574134 | controller -> localhost | |    .+.+.+       |
2025-11-27 09:39:25.574153 | controller -> localhost | |   .ooo X..      |
2025-11-27 09:39:25.574171 | controller -> localhost | |  .... E.B       |
2025-11-27 09:39:25.574189 | controller -> localhost | |... o.o.B .      |
2025-11-27 09:39:25.574206 | controller -> localhost | |.. o.+.+S.       |
2025-11-27 09:39:25.574222 | controller -> localhost | |  .  += .        |
2025-11-27 09:39:25.574238 | controller -> localhost | |    .+*+         |
2025-11-27 09:39:25.574258 | controller -> localhost | |     o=*oo .     |
2025-11-27 09:39:25.574275 | controller -> localhost | |       *Xo+      |
2025-11-27 09:39:25.574292 | controller -> localhost | +----[SHA256]-----+
2025-11-27 09:39:25.574334 | controller -> localhost | ok: Runtime: 0:00:00.197478
2025-11-27 09:39:25.579695 | 
2025-11-27 09:39:25.579769 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2025-11-27 09:39:25.597195 | controller | ok
2025-11-27 09:39:25.605858 | controller | included: /var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2025-11-27 09:39:25.613008 | 
2025-11-27 09:39:25.613066 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2025-11-27 09:39:25.626058 | controller | skipping: Conditional result was False
2025-11-27 09:39:25.630827 | 
2025-11-27 09:39:25.630887 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2025-11-27 09:39:26.106179 | controller | changed
2025-11-27 09:39:26.110895 | 
2025-11-27 09:39:26.110954 | TASK [add-build-sshkey : Make sure user has a .ssh]
2025-11-27 09:39:26.371138 | controller | ok
2025-11-27 09:39:26.375910 | 
2025-11-27 09:39:26.375976 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2025-11-27 09:39:27.576571 | controller | changed
2025-11-27 09:39:27.580966 | 
2025-11-27 09:39:27.581025 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2025-11-27 09:39:28.757990 | controller | changed
2025-11-27 09:39:28.762645 | 
2025-11-27 09:39:28.762718 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2025-11-27 09:39:28.775903 | controller | skipping: Conditional result was False
2025-11-27 09:39:28.780682 | 
2025-11-27 09:39:28.780748 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2025-11-27 09:39:29.056791 | controller -> localhost | changed
2025-11-27 09:39:29.065313 | 
2025-11-27 09:39:29.065373 | TASK [add-build-sshkey : Add back temp key]
2025-11-27 09:39:29.282039 | controller -> localhost | Identity added: /var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/a93b4cbdecfb434f8e5d42900d3b1332_id_rsa (zuul-build-sshkey)
2025-11-27 09:39:29.282224 | controller -> localhost | ok: Runtime: 0:00:00.006727
2025-11-27 09:39:29.287439 | 
2025-11-27 09:39:29.287501 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2025-11-27 09:39:29.670294 | controller | ok
2025-11-27 09:39:29.674616 | 
2025-11-27 09:39:29.674680 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2025-11-27 09:39:29.697988 | controller | skipping: Conditional result was False
2025-11-27 09:39:29.706758 | 
2025-11-27 09:39:29.706820 | TASK [include_role : validate-host]
2025-11-27 09:39:29.723469 | controller | ok
2025-11-27 09:39:29.740311 | 
2025-11-27 09:39:29.740370 | TASK [validate-host : Define zuul_info_dir fact]
2025-11-27 09:39:29.766969 | controller | ok
2025-11-27 09:39:29.771102 | 
2025-11-27 09:39:29.771159 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2025-11-27 09:39:29.946423 | controller -> localhost | ok
2025-11-27 09:39:29.951506 | 
2025-11-27 09:39:29.951567 | TASK [validate-host : Collect information about the host]
2025-11-27 09:39:30.666190 | controller | ok
2025-11-27 09:39:30.673302 | 
2025-11-27 09:39:30.673361 | TASK [validate-host : Sanitize hostname]
2025-11-27 09:39:30.710150 | controller | ok
2025-11-27 09:39:30.714283 | 
2025-11-27 09:39:30.714342 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2025-11-27 09:39:31.071372 | controller -> localhost | changed
2025-11-27 09:39:31.076563 | 
2025-11-27 09:39:31.076629 | TASK [validate-host : Collect information about zuul worker]
2025-11-27 09:39:31.479155 | controller | ok
2025-11-27 09:39:31.483347 | 
2025-11-27 09:39:31.483424 | TASK [validate-host : Write out all zuul information for each host]
2025-11-27 09:39:31.824503 | controller -> localhost | changed
2025-11-27 09:39:31.832841 | 
2025-11-27 09:39:31.832899 | TASK [include_role : prepare-workspace-openshift]
2025-11-27 09:39:31.845770 | controller | skipping: Conditional result was False
2025-11-27 09:39:31.849754 | 
2025-11-27 09:39:31.849808 | TASK [include_role : remove-zuul-sshkey]
2025-11-27 09:39:31.862109 | controller | skipping: Conditional result was False
2025-11-27 09:39:31.866504 | 
2025-11-27 09:39:31.866562 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2025-11-27 09:39:32.136778 | controller | ok: "logs"
2025-11-27 09:39:32.136981 | controller | ok: All items complete
2025-11-27 09:39:32.137009 | 
2025-11-27 09:39:32.390728 | controller | ok: "artifacts"
2025-11-27 09:39:32.638933 | controller | ok: "docs"
2025-11-27 09:39:32.655182 | 
2025-11-27 09:39:32.655274 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2025-11-27 09:39:32.938987 | controller | changed: "logs"
2025-11-27 09:39:33.195486 | controller | changed: "artifacts"
2025-11-27 09:39:33.451268 | controller | changed: "docs"
2025-11-27 09:39:33.471726 | 
2025-11-27 09:39:33.471838 | PLAY RECAP
2025-11-27 09:39:33.471884 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2025-11-27 09:39:33.471912 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2025-11-27 09:39:33.471931 | 
2025-11-27 09:39:33.545622 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2025-11-27 09:39:33.546247 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2025-11-27 09:39:34.040094 | 
2025-11-27 09:39:34.040209 | PLAY [all]
2025-11-27 09:39:34.057861 | 
2025-11-27 09:39:34.057935 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2025-11-27 09:39:34.106157 | controller | ok
2025-11-27 09:39:34.110627 | 
2025-11-27 09:39:34.110703 | TASK [mirror-info-fork : Create /etc/ci]
2025-11-27 09:39:34.524627 | controller | changed
2025-11-27 09:39:34.529988 | 
2025-11-27 09:39:34.530064 | TASK [mirror-info-fork : Install ci_mirror script]
2025-11-27 09:39:35.897062 | controller | changed
2025-11-27 09:39:35.906678 | 
2025-11-27 09:39:35.906757 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2025-11-27 09:39:36.353073 | controller | changed:
2025-11-27 09:39:36.353254 | controller | {
2025-11-27 09:39:36.353287 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2025-11-27 09:39:36.353320 | controller | }
2025-11-27 09:39:36.656862 | controller | changed:
2025-11-27 09:39:36.656911 | controller | {
2025-11-27 09:39:36.656938 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2025-11-27 09:39:36.656958 | controller | }
2025-11-27 09:39:36.954320 | controller | changed:
2025-11-27 09:39:36.954428 | controller | {
2025-11-27 09:39:36.954459 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2025-11-27 09:39:36.954479 | controller | }
2025-11-27 09:39:37.251203 | controller | changed:
2025-11-27 09:39:37.251253 | controller | {
2025-11-27 09:39:37.251279 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2025-11-27 09:39:37.251298 | controller | }
2025-11-27 09:39:37.602927 | controller | changed:
2025-11-27 09:39:37.603020 | controller | {
2025-11-27 09:39:37.603048 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2025-11-27 09:39:37.603069 | controller | }
2025-11-27 09:39:37.912780 | controller | changed:
2025-11-27 09:39:37.912874 | controller | {
2025-11-27 09:39:37.912902 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2025-11-27 09:39:37.912925 | controller | }
2025-11-27 09:39:38.207263 | controller | changed:
2025-11-27 09:39:38.207312 | controller | {
2025-11-27 09:39:38.207337 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2025-11-27 09:39:38.207356 | controller | }
2025-11-27 09:39:38.507589 | controller | changed:
2025-11-27 09:39:38.507645 | controller | {
2025-11-27 09:39:38.507673 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2025-11-27 09:39:38.507694 | controller | }
2025-11-27 09:39:38.810944 | controller | changed:
2025-11-27 09:39:38.811002 | controller | {
2025-11-27 09:39:38.811030 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2025-11-27 09:39:38.811049 | controller | }
2025-11-27 09:39:39.116564 | controller | changed:
2025-11-27 09:39:39.116627 | controller | {
2025-11-27 09:39:39.116654 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2025-11-27 09:39:39.116675 | controller | }
2025-11-27 09:39:39.421460 | controller | changed:
2025-11-27 09:39:39.421550 | controller | {
2025-11-27 09:39:39.421578 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2025-11-27 09:39:39.421598 | controller | }
2025-11-27 09:39:39.727847 | controller | changed:
2025-11-27 09:39:39.727919 | controller | {
2025-11-27 09:39:39.727946 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2025-11-27 09:39:39.727968 | controller | }
2025-11-27 09:39:40.027365 | controller | changed:
2025-11-27 09:39:40.027436 | controller | {
2025-11-27 09:39:40.027463 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith"
2025-11-27 09:39:40.027482 | controller | }
2025-11-27 09:39:40.327062 | controller | changed:
2025-11-27 09:39:40.327147 | controller | {
2025-11-27 09:39:40.327175 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2025-11-27 09:39:40.327198 | controller | }
2025-11-27 09:39:40.626322 | controller | changed:
2025-11-27 09:39:40.626374 | controller | {
2025-11-27 09:39:40.626423 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2025-11-27 09:39:40.626445 | controller | }
2025-11-27 09:39:40.937896 | controller | changed:
2025-11-27 09:39:40.937970 | controller | {
2025-11-27 09:39:40.938019 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2025-11-27 09:39:40.938042 | controller | }
2025-11-27 09:39:41.249985 | controller | changed:
2025-11-27 09:39:41.250059 | controller | {
2025-11-27 09:39:41.250086 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2025-11-27 09:39:41.250107 | controller | }
2025-11-27 09:39:41.561814 | controller | changed:
2025-11-27 09:39:41.561907 | controller | {
2025-11-27 09:39:41.561936 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2025-11-27 09:39:41.561970 | controller | }
2025-11-27 09:39:41.875928 | controller | changed:
2025-11-27 09:39:41.875985 | controller | {
2025-11-27 09:39:41.876012 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2025-11-27 09:39:41.876033 | controller | }
2025-11-27 09:39:42.196950 | controller | changed:
2025-11-27 09:39:42.197038 | controller | {
2025-11-27 09:39:42.197065 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2025-11-27 09:39:42.197085 | controller | }
2025-11-27 09:39:42.504309 | controller | changed:
2025-11-27 09:39:42.504481 | controller | {
2025-11-27 09:39:42.504510 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2025-11-27 09:39:42.504531 | controller | }
2025-11-27 09:39:42.807507 | controller | changed:
2025-11-27 09:39:42.807592 | controller | {
2025-11-27 09:39:42.807616 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2025-11-27 09:39:42.807635 | controller | }
2025-11-27 09:39:43.106457 | controller | changed:
2025-11-27 09:39:43.106544 | controller | {
2025-11-27 09:39:43.106571 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2025-11-27 09:39:43.106593 | controller | }
2025-11-27 09:39:43.412768 | controller | changed:
2025-11-27 09:39:43.412851 | controller | {
2025-11-27 09:39:43.412877 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2025-11-27 09:39:43.412896 | controller | }
2025-11-27 09:39:43.712781 | controller | changed:
2025-11-27 09:39:43.712925 | controller | {
2025-11-27 09:39:43.712949 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2025-11-27 09:39:43.712968 | controller | }
2025-11-27 09:39:44.012879 | controller | changed:
2025-11-27 09:39:44.012956 | controller | {
2025-11-27 09:39:44.012979 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2025-11-27 09:39:44.012997 | controller | }
2025-11-27 09:39:44.041482 | 
2025-11-27 09:39:44.041593 | TASK [Set timezone to UTC]
2025-11-27 09:39:44.567506 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2025-11-27 09:39:44.572097 | 
2025-11-27 09:39:44.572164 | TASK [Create nodepool directory]
2025-11-27 09:39:44.855172 | controller | changed
2025-11-27 09:39:44.860283 | 
2025-11-27 09:39:44.860348 | TASK [Create nodepool sub_nodes file]
2025-11-27 09:39:45.880181 | controller | changed
2025-11-27 09:39:45.884980 | 
2025-11-27 09:39:45.885046 | TASK [Create nodepool sub_nodes_private file]
2025-11-27 09:39:46.915281 | controller | changed
2025-11-27 09:39:46.920015 | 
2025-11-27 09:39:46.920076 | LOOP [Populate nodepool sub_nodes file]
2025-11-27 09:39:46.949184 | 
2025-11-27 09:39:46.949306 | LOOP [Populate nodepool sub_nodes_private file]
2025-11-27 09:39:46.978004 | 
2025-11-27 09:39:46.978122 | TASK [Create nodepool primary file]
2025-11-27 09:39:47.001541 | controller | skipping: Conditional result was False
2025-11-27 09:39:47.006750 | 
2025-11-27 09:39:47.006821 | TASK [Create nodepool node_private for this node]
2025-11-27 09:39:48.091913 | controller | changed
2025-11-27 09:39:48.097080 | 
2025-11-27 09:39:48.097141 | LOOP [Copy ssh keys to nodepool directory]
2025-11-27 09:39:48.486298 | controller | ok: Item: id_rsa Runtime: 0:00:00.006750
2025-11-27 09:39:48.486592 | 
2025-11-27 09:39:48.732704 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.006398
2025-11-27 09:39:48.747061 | 
2025-11-27 09:39:48.747141 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2025-11-27 09:39:49.833577 | controller | changed
2025-11-27 09:39:49.838225 | 
2025-11-27 09:39:49.838288 | TASK [Validate sudoers config after edits]
2025-11-27 09:39:50.128213 | controller | /etc/sudoers: parsed OK
2025-11-27 09:39:50.128306 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2025-11-27 09:39:50.128318 | controller | /etc/sudoers.d/zuul: parsed OK
2025-11-27 09:39:50.128324 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2025-11-27 09:39:50.363530 | controller | ok: Runtime: 0:00:00.007337
2025-11-27 09:39:50.368271 | 
2025-11-27 09:39:50.368326 | TASK [Show the environment passed in to job shell scripts]
2025-11-27 09:39:50.651277 | controller | SHELL=/bin/bash
2025-11-27 09:39:50.651332 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2025-11-27 09:39:50.651361 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2025-11-27 09:39:50.651369 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/05/3505/0fcb2992b8c05752ea3689b81659f0d0931b2a33
2025-11-27 09:39:50.651423 | controller | PWD=/home/zuul
2025-11-27 09:39:50.651431 | controller | ZUUL_PIPELINE=github-check
2025-11-27 09:39:50.651437 | controller | LOGNAME=zuul
2025-11-27 09:39:50.651442 | controller | XDG_SESSION_TYPE=tty
2025-11-27 09:39:50.651447 | controller | _=/usr/bin/env
2025-11-27 09:39:50.651452 | controller | MOTD_SHOWN=pam
2025-11-27 09:39:50.651457 | controller | HOME=/home/zuul
2025-11-27 09:39:50.651461 | controller | LANG=en_US.UTF-8
2025-11-27 09:39:50.651466 | controller | SSH_CONNECTION=192.168.25.12 59840 192.168.25.242 22
2025-11-27 09:39:50.651471 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2025-11-27 09:39:50.651481 | controller | ZUUL_CHANGE_IDS=3505,0fcb2992b8c05752ea3689b81659f0d0931b2a33
2025-11-27 09:39:50.651486 | controller | WORKSPACE=/home/zuul/workspace
2025-11-27 09:39:50.651491 | controller | XDG_SESSION_CLASS=user
2025-11-27 09:39:50.651497 | controller | SELINUX_ROLE_REQUESTED=
2025-11-27 09:39:50.651502 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2025-11-27 09:39:50.651506 | controller | USER=zuul
2025-11-27 09:39:50.651511 | controller | ZUUL_VOTING=True
2025-11-27 09:39:50.651516 | controller | BUILD_TIMEOUT=5400000
2025-11-27 09:39:50.651521 | controller | SELINUX_USE_CURRENT_RANGE=
2025-11-27 09:39:50.651526 | controller | SHLVL=1
2025-11-27 09:39:50.651531 | controller | ZUUL_PATCHSET=0fcb2992b8c05752ea3689b81659f0d0931b2a33
2025-11-27 09:39:50.651536 | controller | XDG_SESSION_ID=1
2025-11-27 09:39:50.651541 | controller | ZUUL_BRANCH=main
2025-11-27 09:39:50.651546 | controller | XDG_RUNTIME_DIR=/run/user/1000
2025-11-27 09:39:50.651551 | controller | SSH_CLIENT=192.168.25.12 59840 22
2025-11-27 09:39:50.651559 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2025-11-27 09:39:50.651563 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2025-11-27 09:39:50.651569 | controller | which_declare=declare -f
2025-11-27 09:39:50.651575 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2025-11-27 09:39:50.651580 | controller | SELINUX_LEVEL_REQUESTED=
2025-11-27 09:39:50.651585 | controller | ZUUL_CHANGE=3505
2025-11-27 09:39:50.651590 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2025-11-27 09:39:50.651594 | controller | ZUUL_UUID=a93b4cbdecfb434f8e5d42900d3b1332
2025-11-27 09:39:50.651599 | controller | BASH_FUNC_which%%=() {  ( alias;
2025-11-27 09:39:50.651604 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2025-11-27 09:39:50.651609 | controller | }
2025-11-27 09:39:50.892957 | controller | ok: Runtime: 0:00:00.007151
2025-11-27 09:39:50.897633 | 
2025-11-27 09:39:50.897690 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2025-11-27 09:39:50.911284 | controller | skipping: Conditional result was False
2025-11-27 09:39:50.916220 | 
2025-11-27 09:39:50.916284 | TASK [Symlink /home/zuul-worker/workspace]
2025-11-27 09:39:51.460500 | controller | skipping: Conditional result was False
2025-11-27 09:39:51.466435 | 
2025-11-27 09:39:51.466500 | TASK [Ensure legacy workspace directory]
2025-11-27 09:39:51.732460 | controller | changed
2025-11-27 09:39:51.749690 | 
2025-11-27 09:39:51.749758 | PLAY RECAP
2025-11-27 09:39:51.749803 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2025-11-27 09:39:51.749827 | 
2025-11-27 09:39:51.815302 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2025-11-27 09:39:51.816070 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2025-11-27 09:39:52.275413 | 
2025-11-27 09:39:52.275500 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2025-11-27 09:39:52.293843 | 
2025-11-27 09:39:52.293908 | TASK [Create zuul-output directory]
2025-11-27 09:39:52.668139 | controller | changed
2025-11-27 09:39:52.672551 | 
2025-11-27 09:39:52.672617 | TASK [Slurp Zuul inventory test]
2025-11-27 09:39:52.918887 | controller -> localhost | ok
2025-11-27 09:39:52.924591 | 
2025-11-27 09:39:52.924659 | TASK [Save zuul inventory]
2025-11-27 09:39:54.193493 | controller | changed
2025-11-27 09:39:54.198672 | 
2025-11-27 09:39:54.198744 | TASK [Save zuul vars without the change_message]
2025-11-27 09:39:55.290588 | controller | changed
2025-11-27 09:39:55.308002 | 
2025-11-27 09:39:55.308059 | PLAY RECAP
2025-11-27 09:39:55.308102 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2025-11-27 09:39:55.308124 | 
2025-11-27 09:39:55.368819 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2025-11-27 09:39:55.369610 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2025-11-27 09:39:55.895923 | 
2025-11-27 09:39:55.896017 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2025-11-27 09:39:55.914571 | 
2025-11-27 09:39:55.914642 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2025-11-27 09:39:55.932600 | controller | ok
2025-11-27 09:39:55.948169 | 
2025-11-27 09:39:55.948252 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2025-11-27 09:39:55.971783 | controller | skipping: Conditional result was False
2025-11-27 09:39:55.977012 | 
2025-11-27 09:39:55.977081 | TASK [mirror-info-fork : Create /etc/ci]
2025-11-27 09:39:56.380943 | controller | ok
2025-11-27 09:39:56.386395 | 
2025-11-27 09:39:56.386470 | TASK [mirror-info-fork : Install ci_mirror script]
2025-11-27 09:39:57.432191 | controller | ok
2025-11-27 09:39:57.441320 | 
2025-11-27 09:39:57.441400 | TASK [Prepare workspace]
2025-11-27 09:39:57.459574 | controller | ok
2025-11-27 09:39:57.475667 | 
2025-11-27 09:39:57.475749 | TASK [prepare-workspace : Start zuul_console daemon.]
2025-11-27 09:39:57.860350 | controller | ok
2025-11-27 09:39:57.866079 | 
2025-11-27 09:39:57.866143 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2025-11-27 09:40:00.349875 | controller | Output suppressed because no_log was given
2025-11-27 09:40:00.358113 | 
2025-11-27 09:40:00.358177 | LOOP [Create zuul-output directory]
2025-11-27 09:40:00.631627 | controller | changed: "/home/zuul/ci-framework-data/logs"
2025-11-27 09:40:00.864161 | controller | ok: "/home/zuul/zuul-output/logs"
2025-11-27 09:40:00.876764 | 
2025-11-27 09:40:00.876862 | TASK [Install required packages]
2025-11-27 09:40:22.577877 | controller | ok: Nothing to do
2025-11-27 09:40:22.582750 | 
2025-11-27 09:40:22.582810 | TASK [Install venv]
2025-11-27 09:41:20.910081 | controller | changed
2025-11-27 09:41:20.946651 | 
2025-11-27 09:41:20.946716 | PLAY RECAP
2025-11-27 09:41:20.946764 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2025-11-27 09:41:20.946787 | 
2025-11-27 09:41:20.999627 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2025-11-27 09:41:21.000443 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2025-11-27 09:41:21.489878 | 
2025-11-27 09:41:21.489973 | PLAY [Run ci/playbooks/molecule-test.yml]
2025-11-27 09:41:21.508572 | 
2025-11-27 09:41:21.508641 | TASK [Gather required facts]
2025-11-27 09:41:22.025817 | controller | ok
2025-11-27 09:41:22.030473 | 
2025-11-27 09:41:22.030538 | TASK [Load environment var if instructed to]
2025-11-27 09:41:22.044671 | controller | skipping: Conditional result was False
2025-11-27 09:41:22.049817 | 
2025-11-27 09:41:22.049876 | TASK [Ensure group_vars dir exists]
2025-11-27 09:41:22.392848 | controller | ok
2025-11-27 09:41:22.398077 | 
2025-11-27 09:41:22.398137 | TASK [Print related variables]
2025-11-27 09:41:22.426643 | controller | ok:
2025-11-27 09:41:22.426766 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml
2025-11-27 09:41:22.426797 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer
2025-11-27 09:41:22.431058 | 
2025-11-27 09:41:22.431118 | TASK [Run molecule]
2025-11-27 09:41:23.370452 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2025-11-27 09:41:23.629862 | controller | INFO     Performing prerun with role_name_check=0...
2025-11-27 09:41:39.854515 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.854717 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.854747 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.855178 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.855669 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+0fcb2992 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+0fcb2992 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.856119 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.856584 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.857028 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.857471 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.857906 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.858356 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.858798 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.859215 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.859672 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.860117 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 09:41:39.869748 | controller | INFO     Running crc_layout > prepare
2025-11-27 09:41:40.511888 | controller |
2025-11-27 09:41:41.328188 | controller | PLAY [Prepare] *****************************************************************
2025-11-27 09:41:41.328224 | controller |
2025-11-27 09:41:41.328232 | controller | TASK [Gathering Facts] *********************************************************
2025-11-27 09:41:41.328237 | controller | Thursday 27 November 2025  09:41:40 +0000 (0:00:00.018)       0:00:00.018 *****
2025-11-27 09:41:41.328248 | controller | ok: [instance]
2025-11-27 09:41:41.328404 | controller |
2025-11-27 09:41:41.328420 | controller | TASK [Create custom basedir] ***************************************************
2025-11-27 09:41:41.328527 | controller | Thursday 27 November 2025  09:41:41 +0000 (0:00:00.818)       0:00:00.836 *****
2025-11-27 09:41:41.629144 | controller | changed: [instance]
2025-11-27 09:41:41.629233 | controller |
2025-11-27 09:41:41.629385 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2025-11-27 09:41:41.629501 | controller | Thursday 27 November 2025  09:41:41 +0000 (0:00:00.300)       0:00:01.137 *****
2025-11-27 09:41:41.648176 | controller | skipping: [instance]
2025-11-27 09:41:41.648226 | controller |
2025-11-27 09:41:41.648241 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2025-11-27 09:41:41.648256 | controller | Thursday 27 November 2025  09:41:41 +0000 (0:00:00.018)       0:00:01.155 *****
2025-11-27 09:41:41.688899 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2025-11-27 09:41:41.689168 | controller |
2025-11-27 09:41:41.689217 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2025-11-27 09:41:41.689237 | controller | Thursday 27 November 2025  09:41:41 +0000 (0:00:00.040)       0:00:01.196 *****
2025-11-27 09:41:41.986811 | controller | ok: [instance]
2025-11-27 09:41:41.986959 | controller |
2025-11-27 09:41:41.987090 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2025-11-27 09:41:41.987194 | controller | Thursday 27 November 2025  09:41:41 +0000 (0:00:00.298)       0:00:01.494 *****
2025-11-27 09:41:42.191101 | controller | ok: [instance]
2025-11-27 09:41:42.191167 | controller |
2025-11-27 09:41:42.191271 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2025-11-27 09:41:42.191441 | controller | Thursday 27 November 2025  09:41:42 +0000 (0:00:00.204)       0:00:01.699 *****
2025-11-27 09:41:42.847322 | controller | ok: [instance] => (item=ubi-9-appstream)
2025-11-27 09:41:42.847422 | controller | ok: [instance] => (item=ubi-9-baseos)
2025-11-27 09:41:42.847536 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2025-11-27 09:41:42.847630 | controller |
2025-11-27 09:41:42.847724 | controller | TASK [Deploy repo-setup] *******************************************************
2025-11-27 09:41:42.847828 | controller | Thursday 27 November 2025  09:41:42 +0000 (0:00:00.656)       0:00:02.355 *****
2025-11-27 09:41:42.903579 | controller |
2025-11-27 09:41:42.903689 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2025-11-27 09:41:42.903790 | controller | Thursday 27 November 2025  09:41:42 +0000 (0:00:00.056)       0:00:02.411 *****
2025-11-27 09:41:43.429936 | controller | changed: [instance] => (item=tmp)
2025-11-27 09:41:43.430013 | controller | changed: [instance] => (item=artifacts/repositories)
2025-11-27 09:41:43.430121 | controller | changed: [instance] => (item=venv/repo_setup)
2025-11-27 09:41:43.430222 | controller |
2025-11-27 09:41:43.430353 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2025-11-27 09:41:43.430465 | controller | Thursday 27 November 2025  09:41:43 +0000 (0:00:00.526)       0:00:02.938 *****
2025-11-27 09:41:44.196471 | controller | ok: [instance]
2025-11-27 09:41:44.196523 | controller |
2025-11-27 09:41:44.196778 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2025-11-27 09:41:45.248941 | controller | Thursday 27 November 2025  09:41:44 +0000 (0:00:00.766)       0:00:03.704 *****
2025-11-27 09:41:45.248974 | controller | changed: [instance]
2025-11-27 09:41:52.744967 | controller |
2025-11-27 09:41:52.745009 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2025-11-27 09:41:52.745017 | controller | Thursday 27 November 2025  09:41:45 +0000 (0:00:01.052)       0:00:04.756 *****
2025-11-27 09:41:52.745027 | controller | changed: [instance]
2025-11-27 09:41:53.430290 | controller |
2025-11-27 09:41:53.430318 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2025-11-27 09:41:53.430326 | controller | Thursday 27 November 2025  09:41:52 +0000 (0:00:07.495)       0:00:12.252 *****
2025-11-27 09:41:53.430352 | controller | changed: [instance]
2025-11-27 09:41:53.451940 | controller |
2025-11-27 09:41:53.451962 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2025-11-27 09:41:53.451971 | controller | Thursday 27 November 2025  09:41:53 +0000 (0:00:00.685)       0:00:12.938 *****
2025-11-27 09:41:53.451982 | controller | skipping: [instance]
2025-11-27 09:41:54.224556 | controller |
2025-11-27 09:41:54.224576 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2025-11-27 09:41:54.224583 | controller | Thursday 27 November 2025  09:41:53 +0000 (0:00:00.021)       0:00:12.959 *****
2025-11-27 09:41:54.224591 | controller | changed: [instance]
2025-11-27 09:41:54.260520 | controller |
2025-11-27 09:41:54.260558 | controller | TASK [repo_setup : Get component repo] *****************************************
2025-11-27 09:41:54.260568 | controller | Thursday 27 November 2025  09:41:54 +0000 (0:00:00.772)       0:00:13.732 *****
2025-11-27 09:41:54.260580 | controller | skipping: [instance]
2025-11-27 09:41:54.260612 | controller |
2025-11-27 09:41:54.260620 | controller | TASK [repo_setup : Rename component repo] **************************************
2025-11-27 09:41:54.260629 | controller | Thursday 27 November 2025  09:41:54 +0000 (0:00:00.035)       0:00:13.768 *****
2025-11-27 09:41:54.294296 | controller | skipping: [instance]
2025-11-27 09:41:54.328376 | controller |
2025-11-27 09:41:54.328410 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2025-11-27 09:41:54.328419 | controller | Thursday 27 November 2025  09:41:54 +0000 (0:00:00.033)       0:00:13.802 *****
2025-11-27 09:41:54.328431 | controller | skipping: [instance]
2025-11-27 09:41:54.843159 | controller |
2025-11-27 09:41:54.843182 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2025-11-27 09:41:54.843190 | controller | Thursday 27 November 2025  09:41:54 +0000 (0:00:00.034)       0:00:13.836 *****
2025-11-27 09:41:54.843199 | controller | changed: [instance]
2025-11-27 09:41:55.265285 | controller |
2025-11-27 09:41:55.265306 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2025-11-27 09:41:55.265314 | controller | Thursday 27 November 2025  09:41:54 +0000 (0:00:00.514)       0:00:14.351 *****
2025-11-27 09:41:55.265322 | controller | changed: [instance]
2025-11-27 09:41:55.294194 | controller |
2025-11-27 09:41:55.294210 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2025-11-27 09:41:55.294217 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.422)       0:00:14.773 *****
2025-11-27 09:41:55.294225 | controller | skipping: [instance]
2025-11-27 09:41:55.321461 | controller |
2025-11-27 09:41:55.321521 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2025-11-27 09:41:55.321532 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.028)       0:00:14.801 *****
2025-11-27 09:41:55.321552 | controller | skipping: [instance]
2025-11-27 09:41:55.321600 | controller |
2025-11-27 09:41:55.321923 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2025-11-27 09:41:55.350192 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.027)       0:00:14.829 *****
2025-11-27 09:41:55.350231 | controller | skipping: [instance]
2025-11-27 09:41:55.384416 | controller |
2025-11-27 09:41:55.384449 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2025-11-27 09:41:55.384457 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.028)       0:00:14.857 *****
2025-11-27 09:41:55.384467 | controller | ok: [instance]
2025-11-27 09:41:55.384920 | controller |
2025-11-27 09:41:55.411369 | controller | TASK [repo_setup : Create download directory] **********************************
2025-11-27 09:41:55.411403 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.034)       0:00:14.892 *****
2025-11-27 09:41:55.411422 | controller | skipping: [instance]
2025-11-27 09:41:55.411637 | controller |
2025-11-27 09:41:55.411904 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2025-11-27 09:41:55.412125 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.026)       0:00:14.919 *****
2025-11-27 09:41:55.438363 | controller | skipping: [instance]
2025-11-27 09:41:55.438510 | controller |
2025-11-27 09:41:55.438643 | controller | TASK [Download the RPM] ********************************************************
2025-11-27 09:41:55.438767 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.027)       0:00:14.946 *****
2025-11-27 09:41:55.464737 | controller | skipping: [instance]
2025-11-27 09:41:55.464977 | controller |
2025-11-27 09:41:55.465204 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2025-11-27 09:41:55.465446 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.026)       0:00:14.973 *****
2025-11-27 09:41:55.489924 | controller | skipping: [instance]
2025-11-27 09:41:55.490069 | controller |
2025-11-27 09:41:55.490224 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2025-11-27 09:41:55.490467 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.025)       0:00:14.998 *****
2025-11-27 09:41:55.515268 | controller | skipping: [instance]
2025-11-27 09:41:55.515527 | controller |
2025-11-27 09:41:55.515632 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2025-11-27 09:41:55.515785 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.025)       0:00:15.023 *****
2025-11-27 09:41:55.542604 | controller | skipping: [instance]
2025-11-27 09:41:55.542841 | controller |
2025-11-27 09:41:55.543090 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2025-11-27 09:41:55.543316 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.027)       0:00:15.050 *****
2025-11-27 09:41:55.567920 | controller | skipping: [instance]
2025-11-27 09:41:55.568157 | controller |
2025-11-27 09:41:55.568450 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2025-11-27 09:41:55.568652 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.025)       0:00:15.076 *****
2025-11-27 09:41:55.745416 | controller | ok: [instance]
2025-11-27 09:41:55.745925 | controller |
2025-11-27 09:41:55.961346 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2025-11-27 09:41:55.961372 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.177)       0:00:15.253 *****
2025-11-27 09:41:55.961383 | controller | changed: [instance]
2025-11-27 09:41:56.180805 | controller |
2025-11-27 09:41:56.180823 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2025-11-27 09:41:56.180831 | controller | Thursday 27 November 2025  09:41:55 +0000 (0:00:00.215)       0:00:15.468 *****
2025-11-27 09:41:56.180839 | controller | changed: [instance]
2025-11-27 09:41:56.203465 | controller |
2025-11-27 09:41:56.203505 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2025-11-27 09:41:56.203515 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.219)       0:00:15.688 *****
2025-11-27 09:41:56.203527 | controller | skipping: [instance]
2025-11-27 09:41:56.203549 | controller |
2025-11-27 09:41:56.203559 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2025-11-27 09:41:56.203604 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.022)       0:00:15.711 *****
2025-11-27 09:41:56.225822 | controller | skipping: [instance]
2025-11-27 09:41:56.225916 | controller |
2025-11-27 09:41:56.226032 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2025-11-27 09:41:56.226144 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.022)       0:00:15.734 *****
2025-11-27 09:41:56.247282 | controller | skipping: [instance]
2025-11-27 09:41:56.247328 | controller |
2025-11-27 09:41:56.247479 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2025-11-27 09:41:56.247584 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.021)       0:00:15.755 *****
2025-11-27 09:41:56.269411 | controller | skipping: [instance]
2025-11-27 09:41:56.269735 | controller |
2025-11-27 09:41:56.292147 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2025-11-27 09:41:56.292168 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.022)       0:00:15.777 *****
2025-11-27 09:41:56.292179 | controller | skipping: [instance]
2025-11-27 09:41:56.312479 | controller |
2025-11-27 09:41:56.312509 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] ***
2025-11-27 09:41:56.312518 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.022)       0:00:15.800 *****
2025-11-27 09:41:56.312529 | controller | skipping: [instance]
2025-11-27 09:41:56.312557 | controller |
2025-11-27 09:41:56.312566 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2025-11-27 09:41:56.312724 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.020)       0:00:15.820 *****
2025-11-27 09:41:56.328143 | controller | skipping: [instance]
2025-11-27 09:41:56.357408 | controller |
2025-11-27 09:41:56.357439 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2025-11-27 09:41:56.357446 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.015)       0:00:15.836 *****
2025-11-27 09:41:56.357456 | controller | skipping: [instance]
2025-11-27 09:41:56.357479 | controller |
2025-11-27 09:41:56.357486 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2025-11-27 09:41:56.357648 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.029)       0:00:15.865 *****
2025-11-27 09:41:56.374302 | controller | skipping: [instance]
2025-11-27 09:41:56.391465 | controller |
2025-11-27 09:41:56.391497 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2025-11-27 09:41:56.391506 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.016)       0:00:15.882 *****
2025-11-27 09:41:56.391517 | controller | skipping: [instance]
2025-11-27 09:41:56.391641 | controller |
2025-11-27 09:41:56.391666 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2025-11-27 09:41:56.393071 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.017)       0:00:15.899 *****
2025-11-27 09:41:56.417256 | controller | skipping: [instance]
2025-11-27 09:41:56.417413 | controller |
2025-11-27 09:41:56.417549 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2025-11-27 09:41:56.417687 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.026)       0:00:15.925 *****
2025-11-27 09:41:56.445070 | controller | skipping: [instance]
2025-11-27 09:41:56.445386 | controller |
2025-11-27 09:41:56.445558 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2025-11-27 09:41:56.445700 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.027)       0:00:15.953 *****
2025-11-27 09:41:56.472400 | controller | skipping: [instance]
2025-11-27 09:41:56.472687 | controller |
2025-11-27 09:41:56.472964 | controller | TASK [test_deps : Install additional packages] *********************************
2025-11-27 09:41:56.473218 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.027)       0:00:15.980 *****
2025-11-27 09:41:56.498069 | controller | skipping: [instance]
2025-11-27 09:41:56.498376 | controller |
2025-11-27 09:41:56.498524 | controller | TASK [test_deps : Install selinux python libs] *********************************
2025-11-27 09:41:56.498658 | controller | Thursday 27 November 2025  09:41:56 +0000 (0:00:00.025)       0:00:16.006 *****
2025-11-27 09:42:37.525738 | controller | ok: [instance]
2025-11-27 09:42:38.730552 | controller |
2025-11-27 09:42:38.730584 | controller | TASK [test_deps : Install python yaml libs] ************************************
2025-11-27 09:42:38.730592 | controller | Thursday 27 November 2025  09:42:37 +0000 (0:00:41.026)       0:00:57.033 *****
2025-11-27 09:42:38.730603 | controller | ok: [instance]
2025-11-27 09:42:38.763549 | controller |
2025-11-27 09:42:38.763598 | controller | TASK [test_deps : Install extra packages] **************************************
2025-11-27 09:42:38.763612 | controller | Thursday 27 November 2025  09:42:38 +0000 (0:00:01.204)       0:00:58.238 *****
2025-11-27 09:42:38.763629 | controller | skipping: [instance]
2025-11-27 09:42:38.804129 | controller |
2025-11-27 09:42:38.804161 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2025-11-27 09:42:38.804171 | controller | Thursday 27 November 2025  09:42:38 +0000 (0:00:00.032)       0:00:58.271 *****
2025-11-27 09:42:38.804182 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2025-11-27 09:42:38.825476 | controller |
2025-11-27 09:42:38.825512 | controller | TASK [ci_setup : List packages to install] *************************************
2025-11-27 09:42:38.825522 | controller | Thursday 27 November 2025  09:42:38 +0000 (0:00:00.040)       0:00:58.312 *****
2025-11-27 09:42:38.825534 | controller | ok: [instance] =>
2025-11-27 09:42:38.825566 | controller |   cifmw_ci_setup_packages:
2025-11-27 09:42:38.825573 | controller |   - bash-completion
2025-11-27 09:42:38.825580 | controller |   - ca-certificates
2025-11-27 09:42:38.825586 | controller |   - git-core
2025-11-27 09:42:38.825593 | controller |   - make
2025-11-27 09:42:38.825600 | controller |   - tar
2025-11-27 09:42:38.825607 | controller |   - tmux
2025-11-27 09:42:38.825615 | controller |   - python3-pip
2025-11-27 09:42:38.825641 | controller |
2025-11-27 09:42:38.825860 | controller | TASK [ci_setup : Install needed packages] **************************************
2025-11-27 09:42:42.572189 | controller | Thursday 27 November 2025  09:42:38 +0000 (0:00:00.020)       0:00:58.333 *****
2025-11-27 09:42:42.572223 | controller | changed: [instance]
2025-11-27 09:42:43.119419 | controller |
2025-11-27 09:42:43.119452 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2025-11-27 09:42:43.119460 | controller | Thursday 27 November 2025  09:42:42 +0000 (0:00:03.747)       0:01:02.080 *****
2025-11-27 09:42:43.119470 | controller | ok: [instance]
2025-11-27 09:42:43.119495 | controller |
2025-11-27 09:42:43.119736 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2025-11-27 09:42:43.338894 | controller | Thursday 27 November 2025  09:42:43 +0000 (0:00:00.547)       0:01:02.627 *****
2025-11-27 09:42:43.338926 | controller | changed: [instance]
2025-11-27 09:42:49.247167 | controller |
2025-11-27 09:42:49.247206 | controller | TASK [ci_setup : Install openshift client] *************************************
2025-11-27 09:42:49.247214 | controller | Thursday 27 November 2025  09:42:43 +0000 (0:00:00.219)       0:01:02.846 *****
2025-11-27 09:42:49.247224 | controller | changed: [instance]
2025-11-27 09:42:49.292469 | controller |
2025-11-27 09:42:49.292511 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2025-11-27 09:42:49.292522 | controller | Thursday 27 November 2025  09:42:49 +0000 (0:00:05.907)       0:01:08.754 *****
2025-11-27 09:42:49.292536 | controller | ok: [instance]
2025-11-27 09:42:49.561083 | controller |
2025-11-27 09:42:49.561126 | controller | TASK [ci_setup : Create completion file] ***************************************
2025-11-27 09:42:49.561135 | controller | Thursday 27 November 2025  09:42:49 +0000 (0:00:00.045)       0:01:08.800 *****
2025-11-27 09:42:49.561146 | controller | changed: [instance]
2025-11-27 09:42:49.843171 | controller |
2025-11-27 09:42:49.843198 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2025-11-27 09:42:49.843206 | controller | Thursday 27 November 2025  09:42:49 +0000 (0:00:00.268)       0:01:09.068 *****
2025-11-27 09:42:49.843216 | controller | changed: [instance]
2025-11-27 09:42:49.862459 | controller |
2025-11-27 09:42:49.862495 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2025-11-27 09:42:49.862506 | controller | Thursday 27 November 2025  09:42:49 +0000 (0:00:00.282)       0:01:09.350 *****
2025-11-27 09:42:49.862519 | controller | skipping: [instance]
2025-11-27 09:42:49.862555 | controller |
2025-11-27 09:42:49.862788 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2025-11-27 09:42:49.881838 | controller | Thursday 27 November 2025  09:42:49 +0000 (0:00:00.019)       0:01:09.370 *****
2025-11-27 09:42:49.881860 | controller | skipping: [instance]
2025-11-27 09:42:49.901252 | controller |
2025-11-27 09:42:49.901274 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2025-11-27 09:42:49.901281 | controller | Thursday 27 November 2025  09:42:49 +0000 (0:00:00.019)       0:01:09.389 *****
2025-11-27 09:42:49.901290 | controller | skipping: [instance]
2025-11-27 09:42:49.918933 | controller |
2025-11-27 09:42:49.918951 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2025-11-27 09:42:49.918959 | controller | Thursday 27 November 2025  09:42:49 +0000 (0:00:00.019)       0:01:09.409 *****
2025-11-27 09:42:49.918967 | controller | skipping: [instance]
2025-11-27 09:42:49.936277 | controller |
2025-11-27 09:42:49.936294 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2025-11-27 09:42:49.936309 | controller | Thursday 27 November 2025  09:42:49 +0000 (0:00:00.017)       0:01:09.427 *****
2025-11-27 09:42:49.936318 | controller | skipping: [instance]
2025-11-27 09:42:49.958644 | controller |
2025-11-27 09:42:49.958704 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2025-11-27 09:42:49.958715 | controller | Thursday 27 November 2025  09:42:49 +0000 (0:00:00.017)       0:01:09.444 *****
2025-11-27 09:42:49.958731 | controller | skipping: [instance]
2025-11-27 09:42:50.943266 | controller |
2025-11-27 09:42:50.943298 | controller | TASK [ci_setup : Manage directories] *******************************************
2025-11-27 09:42:50.943306 | controller | Thursday 27 November 2025  09:42:49 +0000 (0:00:00.022)       0:01:09.466 *****
2025-11-27 09:42:50.943316 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2025-11-27 09:42:51.307435 | controller | changed: [instance] => (item=/opt/basedir/logs)
2025-11-27 09:42:51.307463 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2025-11-27 09:42:51.307471 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2025-11-27 09:42:51.307477 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2025-11-27 09:42:51.307484 | controller |
2025-11-27 09:42:51.307489 | controller | TASK [Create secret file] ******************************************************
2025-11-27 09:42:51.307495 | controller | Thursday 27 November 2025  09:42:50 +0000 (0:00:00.983)       0:01:10.450 *****
2025-11-27 09:42:51.307504 | controller | changed: [instance]
2025-11-27 09:42:51.307526 | controller |
2025-11-27 09:42:51.307533 | controller | PLAY RECAP *********************************************************************
2025-11-27 09:42:51.307539 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2025-11-27 09:42:51.307545 | controller |
2025-11-27 09:42:51.307552 | controller | Thursday 27 November 2025  09:42:51 +0000 (0:00:00.364)       0:01:10.815 *****
2025-11-27 09:42:51.309418 | controller | ===============================================================================
2025-11-27 09:42:51.370791 | controller | test_deps : Install selinux python libs -------------------------------- 41.03s
2025-11-27 09:42:51.370825 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.50s
2025-11-27 09:42:51.370833 | controller | ci_setup : Install openshift client ------------------------------------- 5.91s
2025-11-27 09:42:51.370839 | controller | ci_setup : Install needed packages -------------------------------------- 3.75s
2025-11-27 09:42:51.370844 | controller | test_deps : Install python yaml libs ------------------------------------ 1.20s
2025-11-27 09:42:51.370849 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.05s
2025-11-27 09:42:51.370855 | controller | ci_setup : Manage directories ------------------------------------------- 0.98s
2025-11-27 09:42:51.370860 | controller | Gathering Facts --------------------------------------------------------- 0.82s
2025-11-27 09:42:51.370866 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.77s
2025-11-27 09:42:51.370871 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.77s
2025-11-27 09:42:51.370876 | controller | repo_setup : Install repo-setup package --------------------------------- 0.69s
2025-11-27 09:42:51.370881 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.66s
2025-11-27 09:42:51.370887 | controller | ci_setup : Gather version of openshift client --------------------------- 0.55s
2025-11-27 09:42:51.370893 | controller | repo_setup : Ensure directories are present ----------------------------- 0.53s
2025-11-27 09:42:51.370898 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.51s
2025-11-27 09:42:51.370903 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.42s
2025-11-27 09:42:51.370909 | controller | Create secret file ------------------------------------------------------ 0.36s
2025-11-27 09:42:51.370914 | controller | Create custom basedir --------------------------------------------------- 0.30s
2025-11-27 09:42:51.370919 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.30s
2025-11-27 09:42:51.370931 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.28s
2025-11-27 09:42:51.370942 | controller | INFO     Running crc_layout > converge
2025-11-27 09:42:51.961077 | controller |
2025-11-27 09:42:51.961566 | controller | PLAY [Converge] ****************************************************************
2025-11-27 09:42:51.961714 | controller |
2025-11-27 09:42:51.961860 | controller | TASK [Gathering Facts] *********************************************************
2025-11-27 09:42:51.962002 | controller | Thursday 27 November 2025  09:42:51 +0000 (0:00:00.027)       0:00:00.027 *****
2025-11-27 09:42:52.789427 | controller | ok: [instance]
2025-11-27 09:42:52.812472 | controller |
2025-11-27 09:42:52.812497 | controller | TASK [Load networking definition from scenario file] ***************************
2025-11-27 09:42:52.812506 | controller | Thursday 27 November 2025  09:42:52 +0000 (0:00:00.828)       0:00:00.855 *****
2025-11-27 09:42:52.812518 | controller | ok: [instance]
2025-11-27 09:42:54.679765 | controller |
2025-11-27 09:42:54.679828 | controller | TASK [discover_latest_image : Get latest image] ********************************
2025-11-27 09:42:54.679836 | controller | Thursday 27 November 2025  09:42:52 +0000 (0:00:00.023)       0:00:00.879 *****
2025-11-27 09:42:54.679849 | controller | changed: [instance]
2025-11-27 09:42:54.707602 | controller |
2025-11-27 09:42:54.707678 | controller | TASK [discover_latest_image : Export facts accordingly] ************************
2025-11-27 09:42:54.707694 | controller | Thursday 27 November 2025  09:42:54 +0000 (0:00:01.866)       0:00:02.745 *****
2025-11-27 09:42:54.707714 | controller | ok: [instance]
2025-11-27 09:42:54.730942 | controller |
2025-11-27 09:42:54.730979 | controller | TASK [reproducer : Load CI job environment] ************************************
2025-11-27 09:42:54.730997 | controller | Thursday 27 November 2025  09:42:54 +0000 (0:00:00.028)       0:00:02.774 *****
2025-11-27 09:42:54.731009 | controller | skipping: [instance]
2025-11-27 09:42:54.800513 | controller |
2025-11-27 09:42:54.800563 | controller | TASK [Build final libvirt layout] **********************************************
2025-11-27 09:42:54.800578 | controller | Thursday 27 November 2025  09:42:54 +0000 (0:00:00.023)       0:00:02.797 *****
2025-11-27 09:42:54.800597 | controller |
2025-11-27 09:42:54.879358 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2025-11-27 09:42:54.879385 | controller | Thursday 27 November 2025  09:42:54 +0000 (0:00:00.068)       0:00:02.866 *****
2025-11-27 09:42:54.879399 | controller | ok: [instance]
2025-11-27 09:42:54.879611 | controller |
2025-11-27 09:42:54.879721 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2025-11-27 09:42:54.880323 | controller | Thursday 27 November 2025  09:42:54 +0000 (0:00:00.079)       0:00:02.945 *****
2025-11-27 09:42:54.941650 | controller | skipping: [instance]
2025-11-27 09:42:54.941853 | controller |
2025-11-27 09:42:54.941946 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2025-11-27 09:42:54.942058 | controller | Thursday 27 November 2025  09:42:54 +0000 (0:00:00.062)       0:00:03.008 *****
2025-11-27 09:42:54.968765 | controller | ok: [instance]
2025-11-27 09:42:54.968900 | controller |
2025-11-27 09:42:54.969067 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2025-11-27 09:42:54.969168 | controller | Thursday 27 November 2025  09:42:54 +0000 (0:00:00.027)       0:00:03.035 *****
2025-11-27 09:42:54.996171 | controller | ok: [instance] => changed=false
2025-11-27 09:42:54.996296 | controller |   msg: All assertions passed
2025-11-27 09:42:54.996446 | controller |
2025-11-27 09:42:54.996604 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2025-11-27 09:42:54.996725 | controller | Thursday 27 November 2025  09:42:54 +0000 (0:00:00.027)       0:00:03.063 *****
2025-11-27 09:42:55.038828 | controller | ok: [instance]
2025-11-27 09:42:55.038927 | controller |
2025-11-27 09:42:55.039304 | controller | TASK [reproducer : Ensure directories are present] *****************************
2025-11-27 09:42:55.501262 | controller | Thursday 27 November 2025  09:42:55 +0000 (0:00:00.042)       0:00:03.105 *****
2025-11-27 09:42:55.501313 | controller | ok: [instance] => (item=artifacts)
2025-11-27 09:42:55.577135 | controller | ok: [instance] => (item=logs)
2025-11-27 09:42:55.577155 | controller |
2025-11-27 09:42:55.577164 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2025-11-27 09:42:55.577180 | controller | Thursday 27 November 2025  09:42:55 +0000 (0:00:00.461)       0:00:03.567 *****
2025-11-27 09:42:55.577190 | controller |
2025-11-27 09:42:55.774133 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2025-11-27 09:42:55.774165 | controller | Thursday 27 November 2025  09:42:55 +0000 (0:00:00.076)       0:00:03.644 *****
2025-11-27 09:42:55.774183 | controller | ok: [instance]
2025-11-27 09:42:56.027180 | controller |
2025-11-27 09:42:56.027204 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2025-11-27 09:42:56.027212 | controller | Thursday 27 November 2025  09:42:55 +0000 (0:00:00.196)       0:00:03.840 *****
2025-11-27 09:42:56.027222 | controller | changed: [instance]
2025-11-27 09:42:56.322463 | controller |
2025-11-27 09:42:56.322564 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2025-11-27 09:42:56.322574 | controller | Thursday 27 November 2025  09:42:56 +0000 (0:00:00.253)       0:00:04.093 *****
2025-11-27 09:42:56.322592 | controller | ok: [instance]
2025-11-27 09:42:56.354483 | controller |
2025-11-27 09:42:56.354539 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2025-11-27 09:42:56.354551 | controller | Thursday 27 November 2025  09:42:56 +0000 (0:00:00.294)       0:00:04.388 *****
2025-11-27 09:42:56.354567 | controller | skipping: [instance]
2025-11-27 09:42:56.354576 | controller |
2025-11-27 09:42:56.354586 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2025-11-27 09:42:56.374544 | controller | Thursday 27 November 2025  09:42:56 +0000 (0:00:00.032)       0:00:04.421 *****
2025-11-27 09:42:56.374608 | controller | skipping: [instance]
2025-11-27 09:42:56.396616 | controller |
2025-11-27 09:42:56.396658 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2025-11-27 09:42:56.396673 | controller | Thursday 27 November 2025  09:42:56 +0000 (0:00:00.020)       0:00:04.441 *****
2025-11-27 09:42:56.396689 | controller | ok: [instance]
2025-11-27 09:42:56.396735 | controller |
2025-11-27 09:42:56.396749 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2025-11-27 09:42:56.427951 | controller | Thursday 27 November 2025  09:42:56 +0000 (0:00:00.022)       0:00:04.463 *****
2025-11-27 09:42:56.427992 | controller | skipping: [instance]
2025-11-27 09:43:08.743209 | controller |
2025-11-27 09:43:08.743277 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2025-11-27 09:43:08.743295 | controller | Thursday 27 November 2025  09:42:56 +0000 (0:00:00.031)       0:00:04.494 *****
2025-11-27 09:43:08.743309 | controller | changed: [instance]
2025-11-27 09:43:08.743348 | controller |
2025-11-27 09:43:08.743534 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2025-11-27 09:43:08.743588 | controller | Thursday 27 November 2025  09:43:08 +0000 (0:00:12.315)       0:00:16.809 *****
2025-11-27 09:43:08.981028 | controller | changed: [instance]
2025-11-27 09:43:09.512510 | controller |
2025-11-27 09:43:09.512576 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2025-11-27 09:43:09.512588 | controller | Thursday 27 November 2025  09:43:08 +0000 (0:00:00.237)       0:00:17.047 *****
2025-11-27 09:43:09.512605 | controller | changed: [instance]
2025-11-27 09:43:10.168021 | controller |
2025-11-27 09:43:10.168064 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2025-11-27 09:43:10.168073 | controller | Thursday 27 November 2025  09:43:09 +0000 (0:00:00.531)       0:00:17.578 *****
2025-11-27 09:43:10.168086 | controller | changed: [instance]
2025-11-27 09:43:10.369955 | controller |
2025-11-27 09:43:10.369974 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2025-11-27 09:43:10.369981 | controller | Thursday 27 November 2025  09:43:10 +0000 (0:00:00.655)       0:00:18.234 *****
2025-11-27 09:43:10.369990 | controller | ok: [instance]
2025-11-27 09:43:11.046554 | controller |
2025-11-27 09:43:11.046622 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2025-11-27 09:43:11.046634 | controller | Thursday 27 November 2025  09:43:10 +0000 (0:00:00.201)       0:00:18.436 *****
2025-11-27 09:43:11.046652 | controller | ok: [instance]
2025-11-27 09:43:11.963866 | controller |
2025-11-27 09:43:11.963915 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2025-11-27 09:43:11.963932 | controller | Thursday 27 November 2025  09:43:11 +0000 (0:00:00.676)       0:00:19.112 *****
2025-11-27 09:43:11.963945 | controller | changed: [instance]
2025-11-27 09:43:12.054488 | controller |
2025-11-27 09:43:12.054552 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2025-11-27 09:43:12.054567 | controller | Thursday 27 November 2025  09:43:11 +0000 (0:00:00.917)       0:00:20.030 *****
2025-11-27 09:43:12.054588 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2025-11-27 09:43:12.054644 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2025-11-27 09:43:12.054655 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2025-11-27 09:43:12.054669 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2025-11-27 09:43:12.055183 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2025-11-27 09:43:12.055207 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2025-11-27 09:43:12.398352 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2025-11-27 09:43:12.398390 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2025-11-27 09:43:12.398397 | controller |
2025-11-27 09:43:12.398405 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2025-11-27 09:43:12.398411 | controller | Thursday 27 November 2025  09:43:12 +0000 (0:00:00.091)       0:00:20.121 *****
2025-11-27 09:43:12.398420 | controller | ok: [instance]
2025-11-27 09:43:12.733040 | controller |
2025-11-27 09:43:12.733079 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2025-11-27 09:43:12.733089 | controller | Thursday 27 November 2025  09:43:12 +0000 (0:00:00.343)       0:00:20.465 *****
2025-11-27 09:43:12.733112 | controller | ok: [instance]
2025-11-27 09:43:13.078395 | controller |
2025-11-27 09:43:13.078434 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2025-11-27 09:43:13.078442 | controller | Thursday 27 November 2025  09:43:12 +0000 (0:00:00.334)       0:00:20.799 *****
2025-11-27 09:43:13.078454 | controller | ok: [instance]
2025-11-27 09:43:14.415951 | controller |
2025-11-27 09:43:14.415983 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2025-11-27 09:43:14.415991 | controller | Thursday 27 November 2025  09:43:13 +0000 (0:00:00.345)       0:00:21.144 *****
2025-11-27 09:43:14.416001 | controller | ok: [instance]
2025-11-27 09:43:15.758474 | controller |
2025-11-27 09:43:15.758509 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2025-11-27 09:43:15.758519 | controller | Thursday 27 November 2025  09:43:14 +0000 (0:00:01.337)       0:00:22.482 *****
2025-11-27 09:43:15.758530 | controller | ok: [instance]
2025-11-27 09:43:16.097707 | controller |
2025-11-27 09:43:16.097730 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2025-11-27 09:43:16.097737 | controller | Thursday 27 November 2025  09:43:15 +0000 (0:00:01.342)       0:00:23.824 *****
2025-11-27 09:43:16.097747 | controller | ok: [instance]
2025-11-27 09:43:16.437269 | controller |
2025-11-27 09:43:16.437298 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2025-11-27 09:43:16.437306 | controller | Thursday 27 November 2025  09:43:16 +0000 (0:00:00.339)       0:00:24.164 *****
2025-11-27 09:43:16.437315 | controller | ok: [instance]
2025-11-27 09:43:16.774921 | controller |
2025-11-27 09:43:16.774952 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2025-11-27 09:43:16.774960 | controller | Thursday 27 November 2025  09:43:16 +0000 (0:00:00.339)       0:00:24.503 *****
2025-11-27 09:43:16.774983 | controller | ok: [instance]
2025-11-27 09:43:17.117245 | controller |
2025-11-27 09:43:17.117281 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2025-11-27 09:43:17.117289 | controller | Thursday 27 November 2025  09:43:16 +0000 (0:00:00.337)       0:00:24.841 *****
2025-11-27 09:43:17.117300 | controller | ok: [instance]
2025-11-27 09:43:17.470425 | controller |
2025-11-27 09:43:17.470460 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2025-11-27 09:43:17.470468 | controller | Thursday 27 November 2025  09:43:17 +0000 (0:00:00.342)       0:00:25.183 *****
2025-11-27 09:43:17.470479 | controller | ok: [instance]
2025-11-27 09:43:17.826294 | controller |
2025-11-27 09:43:17.826317 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2025-11-27 09:43:17.826325 | controller | Thursday 27 November 2025  09:43:17 +0000 (0:00:00.353)       0:00:25.536 *****
2025-11-27 09:43:17.826351 | controller | ok: [instance]
2025-11-27 09:43:18.158548 | controller |
2025-11-27 09:43:18.158608 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2025-11-27 09:43:18.158620 | controller | Thursday 27 November 2025  09:43:17 +0000 (0:00:00.355)       0:00:25.892 *****
2025-11-27 09:43:18.158637 | controller | ok: [instance]
2025-11-27 09:43:18.490819 | controller |
2025-11-27 09:43:18.490860 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2025-11-27 09:43:18.490871 | controller | Thursday 27 November 2025  09:43:18 +0000 (0:00:00.332)       0:00:26.225 *****
2025-11-27 09:43:18.490884 | controller | ok: [instance]
2025-11-27 09:43:18.818384 | controller |
2025-11-27 09:43:18.818416 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2025-11-27 09:43:18.818424 | controller | Thursday 27 November 2025  09:43:18 +0000 (0:00:00.332)       0:00:26.557 *****
2025-11-27 09:43:18.818435 | controller | ok: [instance]
2025-11-27 09:43:19.152967 | controller |
2025-11-27 09:43:19.153005 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2025-11-27 09:43:19.153015 | controller | Thursday 27 November 2025  09:43:18 +0000 (0:00:00.327)       0:00:26.885 *****
2025-11-27 09:43:19.153028 | controller | ok: [instance]
2025-11-27 09:43:19.484606 | controller |
2025-11-27 09:43:19.484639 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2025-11-27 09:43:19.484647 | controller | Thursday 27 November 2025  09:43:19 +0000 (0:00:00.334)       0:00:27.219 *****
2025-11-27 09:43:19.484657 | controller | ok: [instance]
2025-11-27 09:43:19.817307 | controller |
2025-11-27 09:43:19.817359 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2025-11-27 09:43:19.817371 | controller | Thursday 27 November 2025  09:43:19 +0000 (0:00:00.331)       0:00:27.551 *****
2025-11-27 09:43:19.817381 | controller | ok: [instance]
2025-11-27 09:43:20.151556 | controller |
2025-11-27 09:43:20.151596 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2025-11-27 09:43:20.151604 | controller | Thursday 27 November 2025  09:43:19 +0000 (0:00:00.332)       0:00:27.884 *****
2025-11-27 09:43:20.151615 | controller | ok: [instance]
2025-11-27 09:43:20.151639 | controller |
2025-11-27 09:43:20.151647 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2025-11-27 09:43:20.151732 | controller | Thursday 27 November 2025  09:43:20 +0000 (0:00:00.333)       0:00:28.218 *****
2025-11-27 09:43:20.497429 | controller | ok: [instance]
2025-11-27 09:43:20.498371 | controller |
2025-11-27 09:43:20.832805 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2025-11-27 09:43:20.832842 | controller | Thursday 27 November 2025  09:43:20 +0000 (0:00:00.345)       0:00:28.563 *****
2025-11-27 09:43:20.832854 | controller | ok: [instance]
2025-11-27 09:43:21.152890 | controller |
2025-11-27 09:43:21.152917 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2025-11-27 09:43:21.152925 | controller | Thursday 27 November 2025  09:43:20 +0000 (0:00:00.335)       0:00:28.899 *****
2025-11-27 09:43:21.152936 | controller | ok: [instance]
2025-11-27 09:43:21.471008 | controller |
2025-11-27 09:43:21.471040 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2025-11-27 09:43:21.471047 | controller | Thursday 27 November 2025  09:43:21 +0000 (0:00:00.320)       0:00:29.219 *****
2025-11-27 09:43:21.471065 | controller | ok: [instance]
2025-11-27 09:43:21.788619 | controller |
2025-11-27 09:43:21.788708 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2025-11-27 09:43:21.788718 | controller | Thursday 27 November 2025  09:43:21 +0000 (0:00:00.318)       0:00:29.537 *****
2025-11-27 09:43:21.788737 | controller | ok: [instance]
2025-11-27 09:43:23.125321 | controller |
2025-11-27 09:43:23.125385 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2025-11-27 09:43:23.125401 | controller | Thursday 27 November 2025  09:43:21 +0000 (0:00:00.317)       0:00:29.855 *****
2025-11-27 09:43:23.125414 | controller | ok: [instance]
2025-11-27 09:43:23.151013 | controller |
2025-11-27 09:43:23.151030 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2025-11-27 09:43:23.151037 | controller | Thursday 27 November 2025  09:43:23 +0000 (0:00:01.336)       0:00:31.191 *****
2025-11-27 09:43:23.151046 | controller | skipping: [instance]
2025-11-27 09:43:23.439414 | controller |
2025-11-27 09:43:23.439437 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2025-11-27 09:43:23.439446 | controller | Thursday 27 November 2025  09:43:23 +0000 (0:00:00.026)       0:00:31.217 *****
2025-11-27 09:43:23.439457 | controller | ok: [instance]
2025-11-27 09:43:23.439483 | controller |
2025-11-27 09:43:23.439706 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2025-11-27 09:43:23.829253 | controller | Thursday 27 November 2025  09:43:23 +0000 (0:00:00.288)       0:00:31.506 *****
2025-11-27 09:43:23.829300 | controller | ok: [instance]
2025-11-27 09:43:24.144463 | controller |
2025-11-27 09:43:24.144503 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2025-11-27 09:43:24.144511 | controller | Thursday 27 November 2025  09:43:23 +0000 (0:00:00.389)       0:00:31.895 *****
2025-11-27 09:43:24.144521 | controller | changed: [instance]
2025-11-27 09:43:24.144545 | controller |
2025-11-27 09:43:24.144551 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2025-11-27 09:43:24.144558 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.315)       0:00:32.211 *****
2025-11-27 09:43:24.441449 | controller | [WARNING]: Reset is not implemented for this connection
2025-11-27 09:43:24.451508 | controller | changed: [instance]
2025-11-27 09:43:24.451649 | controller |
2025-11-27 09:43:24.451671 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2025-11-27 09:43:24.451681 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.291)       0:00:32.502 *****
2025-11-27 09:43:24.451690 | controller |
2025-11-27 09:43:24.451698 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2025-11-27 09:43:24.451708 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.015)       0:00:32.517 *****
2025-11-27 09:43:24.563799 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2025-11-27 09:43:24.612399 | controller |
2025-11-27 09:43:24.612421 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2025-11-27 09:43:24.612430 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.112)       0:00:32.630 *****
2025-11-27 09:43:24.612442 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2025-11-27 09:43:24.666071 | controller |
2025-11-27 09:43:24.666090 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2025-11-27 09:43:24.666098 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.048)       0:00:32.679 *****
2025-11-27 09:43:24.666107 | controller | ok: [instance] => (item=compute)
2025-11-27 09:43:24.717463 | controller | ok: [instance] => (item=controller)
2025-11-27 09:43:24.717496 | controller | ok: [instance] => (item=crc)
2025-11-27 09:43:24.717509 | controller |
2025-11-27 09:43:24.717519 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2025-11-27 09:43:24.717529 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.053)       0:00:32.732 *****
2025-11-27 09:43:24.717545 | controller | ok: [instance]
2025-11-27 09:43:24.717804 | controller |
2025-11-27 09:43:24.718051 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2025-11-27 09:43:24.718187 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.051)       0:00:32.784 *****
2025-11-27 09:43:24.765020 | controller | ok: [instance] => changed=false
2025-11-27 09:43:24.765226 | controller |   msg: All assertions passed
2025-11-27 09:43:24.765391 | controller |
2025-11-27 09:43:24.765537 | controller | TASK [Ensure we get latest OCP config] *****************************************
2025-11-27 09:43:24.765681 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.047)       0:00:32.831 *****
2025-11-27 09:43:24.811590 | controller |
2025-11-27 09:43:24.811884 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2025-11-27 09:43:24.812155 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.046)       0:00:32.878 *****
2025-11-27 09:43:24.889998 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2025-11-27 09:43:24.890319 | controller | ok: [instance] => (item={})
2025-11-27 09:43:24.890504 | controller |
2025-11-27 09:43:24.890640 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2025-11-27 09:43:24.890766 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.078)       0:00:32.956 *****
2025-11-27 09:43:24.911892 | controller | skipping: [instance]
2025-11-27 09:43:24.912063 | controller |
2025-11-27 09:43:24.912255 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2025-11-27 09:43:24.912429 | controller | Thursday 27 November 2025  09:43:24 +0000 (0:00:00.022)       0:00:32.979 *****
2025-11-27 09:43:25.133713 | controller | ok: [instance]
2025-11-27 09:43:25.479693 | controller |
2025-11-27 09:43:25.479726 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2025-11-27 09:43:25.479734 | controller | Thursday 27 November 2025  09:43:25 +0000 (0:00:00.221)       0:00:33.200 *****
2025-11-27 09:43:25.479744 | controller | changed: [instance]
2025-11-27 09:43:26.241437 | controller |
2025-11-27 09:43:26.241475 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2025-11-27 09:43:26.241484 | controller | Thursday 27 November 2025  09:43:25 +0000 (0:00:00.345)       0:00:33.546 *****
2025-11-27 09:43:26.241497 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2025-11-27 09:43:26.241528 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2025-11-27 09:43:26.241536 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2025-11-27 09:43:26.241542 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2025-11-27 09:43:26.241549 | controller |
2025-11-27 09:43:26.241558 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2025-11-27 09:43:26.272102 | controller | Thursday 27 November 2025  09:43:26 +0000 (0:00:00.761)       0:00:34.307 *****
2025-11-27 09:43:26.272122 | controller | skipping: [instance]
2025-11-27 09:43:26.665387 | controller |
2025-11-27 09:43:26.665407 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2025-11-27 09:43:26.665415 | controller | Thursday 27 November 2025  09:43:26 +0000 (0:00:00.030)       0:00:34.338 *****
2025-11-27 09:43:26.665424 | controller | changed: [instance]
2025-11-27 09:43:27.126473 | controller |
2025-11-27 09:43:27.126510 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2025-11-27 09:43:27.126519 | controller | Thursday 27 November 2025  09:43:26 +0000 (0:00:00.384)       0:00:34.722 *****
2025-11-27 09:43:27.126525 | controller |
2025-11-27 09:43:27.126530 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-11-27 09:43:27.126536 | controller | Thursday 27 November 2025  09:43:26 +0000 (0:00:00.008)       0:00:34.731 *****
2025-11-27 09:43:27.126554 | controller | changed: [instance]
2025-11-27 09:43:27.205054 | controller |
2025-11-27 09:43:27.205094 | controller | TASK [Ensure no default networks exists] ***************************************
2025-11-27 09:43:27.205104 | controller | Thursday 27 November 2025  09:43:27 +0000 (0:00:00.461)       0:00:35.192 *****
2025-11-27 09:43:27.205117 | controller |
2025-11-27 09:43:28.472901 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2025-11-27 09:43:28.472931 | controller | Thursday 27 November 2025  09:43:27 +0000 (0:00:00.078)       0:00:35.271 *****
2025-11-27 09:43:28.472943 | controller | ok: [instance]
2025-11-27 09:43:28.713884 | controller |
2025-11-27 09:43:28.713914 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2025-11-27 09:43:28.713922 | controller | Thursday 27 November 2025  09:43:28 +0000 (0:00:01.267)       0:00:36.539 *****
2025-11-27 09:43:28.713932 | controller | ok: [instance]
2025-11-27 09:43:29.251374 | controller |
2025-11-27 09:43:29.251405 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2025-11-27 09:43:29.251413 | controller | Thursday 27 November 2025  09:43:28 +0000 (0:00:00.240)       0:00:36.780 *****
2025-11-27 09:43:29.251423 | controller | ok: [instance]
2025-11-27 09:43:29.496454 | controller |
2025-11-27 09:43:29.496482 | controller | TASK [libvirt_manager : Removing default] **************************************
2025-11-27 09:43:29.496492 | controller | Thursday 27 November 2025  09:43:29 +0000 (0:00:00.537)       0:00:37.317 *****
2025-11-27 09:43:29.496503 | controller | ok: [instance]
2025-11-27 09:43:30.750828 | controller |
2025-11-27 09:43:30.750856 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2025-11-27 09:43:30.750864 | controller | Thursday 27 November 2025  09:43:29 +0000 (0:00:00.245)       0:00:37.563 *****
2025-11-27 09:43:30.750873 | controller | ok: [instance]
2025-11-27 09:43:31.073486 | controller |
2025-11-27 09:43:31.073527 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2025-11-27 09:43:31.073537 | controller | Thursday 27 November 2025  09:43:30 +0000 (0:00:01.254)       0:00:38.817 *****
2025-11-27 09:43:31.073550 | controller | ok: [instance]
2025-11-27 09:43:31.073644 | controller |
2025-11-27 09:43:31.073681 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2025-11-27 09:43:31.073695 | controller | Thursday 27 November 2025  09:43:31 +0000 (0:00:00.322)       0:00:39.139 *****
2025-11-27 09:43:31.412509 | controller | changed: [instance]
2025-11-27 09:43:31.412566 | controller |
2025-11-27 09:43:31.412583 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2025-11-27 09:43:31.412594 | controller | Thursday 27 November 2025  09:43:31 +0000 (0:00:00.339)       0:00:39.478 *****
2025-11-27 09:43:31.736154 | controller | changed: [instance]
2025-11-27 09:43:32.389531 | controller |
2025-11-27 09:43:32.389593 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2025-11-27 09:43:32.389605 | controller | Thursday 27 November 2025  09:43:31 +0000 (0:00:00.323)       0:00:39.802 *****
2025-11-27 09:43:32.389622 | controller | changed: [instance] => (item=arptables)
2025-11-27 09:43:32.730242 | controller | changed: [instance] => (item=iptables)
2025-11-27 09:43:32.730284 | controller | changed: [instance] => (item=ip6tables)
2025-11-27 09:43:32.730292 | controller |
2025-11-27 09:43:32.730299 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2025-11-27 09:43:32.730306 | controller | Thursday 27 November 2025  09:43:32 +0000 (0:00:00.653)       0:00:40.455 *****
2025-11-27 09:43:32.730318 | controller | ok: [instance]
2025-11-27 09:43:32.825394 | controller |
2025-11-27 09:43:32.825413 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2025-11-27 09:43:32.825420 | controller | Thursday 27 November 2025  09:43:32 +0000 (0:00:00.340)       0:00:40.796 *****
2025-11-27 09:43:32.825430 | controller | ok: [instance]
2025-11-27 09:43:32.872542 | controller |
2025-11-27 09:43:32.872601 | controller | TASK [Ensure the required network configurations are applied] ******************
2025-11-27 09:43:32.872615 | controller | Thursday 27 November 2025  09:43:32 +0000 (0:00:00.095)       0:00:40.892 *****
2025-11-27 09:43:32.872633 | controller |
2025-11-27 09:43:32.872660 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2025-11-27 09:43:32.872688 | controller | Thursday 27 November 2025  09:43:32 +0000 (0:00:00.047)       0:00:40.939 *****
2025-11-27 09:43:32.899023 | controller | skipping: [instance]
2025-11-27 09:43:32.899075 | controller |
2025-11-27 09:43:32.899323 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2025-11-27 09:43:32.899479 | controller | Thursday 27 November 2025  09:43:32 +0000 (0:00:00.026)       0:00:40.966 *****
2025-11-27 09:43:32.929507 | controller | skipping: [instance]
2025-11-27 09:43:32.929784 | controller |
2025-11-27 09:43:32.929819 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-11-27 09:43:32.958490 | controller | Thursday 27 November 2025  09:43:32 +0000 (0:00:00.029)       0:00:40.996 *****
2025-11-27 09:43:32.958513 | controller | skipping: [instance]
2025-11-27 09:43:32.958532 | controller |
2025-11-27 09:43:32.958541 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2025-11-27 09:43:32.958749 | controller | Thursday 27 November 2025  09:43:32 +0000 (0:00:00.029)       0:00:41.025 *****
2025-11-27 09:43:32.993318 | controller | skipping: [instance]
2025-11-27 09:43:33.040470 | controller |
2025-11-27 09:43:33.040503 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2025-11-27 09:43:33.040514 | controller | Thursday 27 November 2025  09:43:32 +0000 (0:00:00.034)       0:00:41.060 *****
2025-11-27 09:43:33.040525 | controller | ok: [instance]
2025-11-27 09:43:33.079948 | controller |
2025-11-27 09:43:33.079965 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2025-11-27 09:43:33.079973 | controller | Thursday 27 November 2025  09:43:33 +0000 (0:00:00.046)       0:00:41.107 *****
2025-11-27 09:43:33.079982 | controller | skipping: [instance]
2025-11-27 09:43:33.108883 | controller |
2025-11-27 09:43:33.108911 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2025-11-27 09:43:33.108923 | controller | Thursday 27 November 2025  09:43:33 +0000 (0:00:00.039)       0:00:41.146 *****
2025-11-27 09:43:33.108938 | controller | skipping: [instance]
2025-11-27 09:43:33.109132 | controller |
2025-11-27 09:43:33.109271 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2025-11-27 09:43:33.109451 | controller | Thursday 27 November 2025  09:43:33 +0000 (0:00:00.029)       0:00:41.175 *****
2025-11-27 09:43:33.166968 | controller | ok: [instance]
2025-11-27 09:43:33.167138 | controller |
2025-11-27 09:43:33.167465 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2025-11-27 09:43:33.167749 | controller | Thursday 27 November 2025  09:43:33 +0000 (0:00:00.058)       0:00:41.234 *****
2025-11-27 09:43:33.195617 | controller | skipping: [instance]
2025-11-27 09:43:33.195892 | controller |
2025-11-27 09:43:33.196154 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2025-11-27 09:43:33.196414 | controller | Thursday 27 November 2025  09:43:33 +0000 (0:00:00.028)       0:00:41.262 *****
2025-11-27 09:43:33.251089 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2025-11-27 09:43:33.251230 | controller |
2025-11-27 09:43:33.251523 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2025-11-27 09:43:33.251796 | controller | Thursday 27 November 2025  09:43:33 +0000 (0:00:00.055)       0:00:41.318 *****
2025-11-27 09:43:33.605945 | controller | ok: [instance -> localhost]
2025-11-27 09:43:38.524574 | controller |
2025-11-27 09:43:38.524612 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2025-11-27 09:43:38.524622 | controller | Thursday 27 November 2025  09:43:33 +0000 (0:00:00.354)       0:00:41.672 *****
2025-11-27 09:43:38.524635 | controller | changed: [instance -> localhost]
2025-11-27 09:43:38.746782 | controller |
2025-11-27 09:43:38.746802 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2025-11-27 09:43:38.746809 | controller | Thursday 27 November 2025  09:43:38 +0000 (0:00:04.918)       0:00:46.590 *****
2025-11-27 09:43:38.746818 | controller | changed: [instance]
2025-11-27 09:43:39.119424 | controller |
2025-11-27 09:43:39.119457 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2025-11-27 09:43:39.119465 | controller | Thursday 27 November 2025  09:43:38 +0000 (0:00:00.222)       0:00:46.813 *****
2025-11-27 09:43:39.119491 | controller | changed: [instance]
2025-11-27 09:43:39.119518 | controller |
2025-11-27 09:43:39.119741 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2025-11-27 09:43:40.792460 | controller | Thursday 27 November 2025  09:43:39 +0000 (0:00:00.372)       0:00:47.185 *****
2025-11-27 09:43:40.792512 | controller | changed: [instance -> localhost]
2025-11-27 09:43:40.792548 | controller |
2025-11-27 09:43:40.792557 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2025-11-27 09:43:40.792566 | controller | Thursday 27 November 2025  09:43:40 +0000 (0:00:01.672)       0:00:48.858 *****
2025-11-27 09:43:41.170400 | controller | changed: [instance]
2025-11-27 09:43:41.205916 | controller |
2025-11-27 09:43:41.205944 | controller | TASK [reproducer : Select right domain] ****************************************
2025-11-27 09:43:41.205954 | controller | Thursday 27 November 2025  09:43:41 +0000 (0:00:00.377)       0:00:49.236 *****
2025-11-27 09:43:41.205965 | controller | ok: [instance]
2025-11-27 09:43:41.324993 | controller |
2025-11-27 09:43:41.325016 | controller | TASK [Create the virtual networks] *********************************************
2025-11-27 09:43:41.325023 | controller | Thursday 27 November 2025  09:43:41 +0000 (0:00:00.035)       0:00:49.272 *****
2025-11-27 09:43:41.325033 | controller |
2025-11-27 09:43:41.346322 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2025-11-27 09:43:41.346379 | controller | Thursday 27 November 2025  09:43:41 +0000 (0:00:00.119)       0:00:49.391 *****
2025-11-27 09:43:41.346396 | controller | ok: [instance]
2025-11-27 09:43:41.551130 | controller |
2025-11-27 09:43:41.551155 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2025-11-27 09:43:41.551163 | controller | Thursday 27 November 2025  09:43:41 +0000 (0:00:00.021)       0:00:49.413 *****
2025-11-27 09:43:41.551172 | controller | ok: [instance]
2025-11-27 09:43:41.584202 | controller |
2025-11-27 09:43:41.584228 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2025-11-27 09:43:41.584238 | controller | Thursday 27 November 2025  09:43:41 +0000 (0:00:00.204)       0:00:49.617 *****
2025-11-27 09:43:41.584249 | controller | skipping: [instance]
2025-11-27 09:43:41.614429 | controller |
2025-11-27 09:43:41.614495 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2025-11-27 09:43:41.614506 | controller | Thursday 27 November 2025  09:43:41 +0000 (0:00:00.033)       0:00:49.650 *****
2025-11-27 09:43:41.614531 | controller | skipping: [instance]
2025-11-27 09:43:41.614542 | controller |
2025-11-27 09:43:41.614722 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2025-11-27 09:43:41.614867 | controller | Thursday 27 November 2025  09:43:41 +0000 (0:00:00.030)       0:00:49.681 *****
2025-11-27 09:43:41.673375 | controller | ok: [instance]
2025-11-27 09:43:41.673484 | controller |
2025-11-27 09:43:41.673629 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2025-11-27 09:43:41.673917 | controller | Thursday 27 November 2025  09:43:41 +0000 (0:00:00.058)       0:00:49.740 *****
2025-11-27 09:43:41.804770 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2025-11-27 09:43:41.804964 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2025-11-27 09:43:41.805169 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2025-11-27 09:43:41.805352 | controller |
2025-11-27 09:43:41.805589 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2025-11-27 09:43:41.805734 | controller | Thursday 27 November 2025  09:43:41 +0000 (0:00:00.131)       0:00:49.871 *****
2025-11-27 09:43:41.843164 | controller | skipping: [instance]
2025-11-27 09:43:41.843430 | controller |
2025-11-27 09:43:41.843690 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2025-11-27 09:43:41.843837 | controller | Thursday 27 November 2025  09:43:41 +0000 (0:00:00.038)       0:00:49.910 *****
2025-11-27 09:43:42.197446 | controller | changed: [instance]
2025-11-27 09:43:42.197495 | controller |
2025-11-27 09:43:42.197729 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2025-11-27 09:43:42.319121 | controller | Thursday 27 November 2025  09:43:42 +0000 (0:00:00.354)       0:00:50.264 *****
2025-11-27 09:43:42.319157 | controller | changed: [instance] => (item=Adding compute-0 to computes)
2025-11-27 09:43:42.344500 | controller | changed: [instance] => (item=Adding controller-0 to controllers)
2025-11-27 09:43:42.344546 | controller | changed: [instance] => (item=Adding crc-0 to ocps)
2025-11-27 09:43:42.344556 | controller |
2025-11-27 09:43:42.344563 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-11-27 09:43:42.344571 | controller | Thursday 27 November 2025  09:43:42 +0000 (0:00:00.121)       0:00:50.385 *****
2025-11-27 09:43:42.344583 | controller | skipping: [instance]
2025-11-27 09:43:42.369451 | controller |
2025-11-27 09:43:42.369474 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-11-27 09:43:42.369483 | controller | Thursday 27 November 2025  09:43:42 +0000 (0:00:00.025)       0:00:50.411 *****
2025-11-27 09:43:42.369493 | controller | skipping: [instance]
2025-11-27 09:43:42.369797 | controller |
2025-11-27 09:43:42.398173 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-11-27 09:43:42.398199 | controller | Thursday 27 November 2025  09:43:42 +0000 (0:00:00.025)       0:00:50.436 *****
2025-11-27 09:43:42.398212 | controller | skipping: [instance]
2025-11-27 09:43:42.424227 | controller |
2025-11-27 09:43:42.424252 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-11-27 09:43:42.424262 | controller | Thursday 27 November 2025  09:43:42 +0000 (0:00:00.028)       0:00:50.464 *****
2025-11-27 09:43:42.424273 | controller | skipping: [instance]
2025-11-27 09:43:42.443415 | controller |
2025-11-27 09:43:42.443439 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-11-27 09:43:42.443448 | controller | Thursday 27 November 2025  09:43:42 +0000 (0:00:00.026)       0:00:50.491 *****
2025-11-27 09:43:42.443459 | controller | ok: [instance]
2025-11-27 09:43:42.443649 | controller |
2025-11-27 09:43:42.443823 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-11-27 09:43:42.443959 | controller | Thursday 27 November 2025  09:43:42 +0000 (0:00:00.019)       0:00:50.510 *****
2025-11-27 09:43:42.528226 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2025-11-27 09:43:42.528423 | controller |
2025-11-27 09:43:42.528588 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-11-27 09:43:42.528728 | controller | Thursday 27 November 2025  09:43:42 +0000 (0:00:00.084)       0:00:50.595 *****
2025-11-27 09:43:42.548582 | controller | skipping: [instance]
2025-11-27 09:43:42.548729 | controller |
2025-11-27 09:43:42.548873 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-11-27 09:43:42.549010 | controller | Thursday 27 November 2025  09:43:42 +0000 (0:00:00.020)       0:00:50.615 *****
2025-11-27 09:43:42.770933 | controller | changed: [instance]
2025-11-27 09:43:43.178486 | controller |
2025-11-27 09:43:43.178528 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-11-27 09:43:43.178538 | controller | Thursday 27 November 2025  09:43:42 +0000 (0:00:00.221)       0:00:50.837 *****
2025-11-27 09:43:43.178565 | controller | changed: [instance]
2025-11-27 09:43:43.243306 | controller |
2025-11-27 09:43:43.243361 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-11-27 09:43:43.243372 | controller | Thursday 27 November 2025  09:43:43 +0000 (0:00:00.407)       0:00:51.244 *****
2025-11-27 09:43:43.243382 | controller | ok: [instance]
2025-11-27 09:43:43.276439 | controller |
2025-11-27 09:43:43.276468 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-11-27 09:43:43.276479 | controller | Thursday 27 November 2025  09:43:43 +0000 (0:00:00.065)       0:00:51.310 *****
2025-11-27 09:43:43.276492 | controller | ok: [instance]
2025-11-27 09:43:43.276539 | controller |
2025-11-27 09:43:43.276742 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-11-27 09:43:43.660016 | controller | Thursday 27 November 2025  09:43:43 +0000 (0:00:00.033)       0:00:51.343 *****
2025-11-27 09:43:43.660062 | controller | changed: [instance]
2025-11-27 09:43:43.737477 | controller |
2025-11-27 09:43:43.737517 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2025-11-27 09:43:43.737528 | controller | Thursday 27 November 2025  09:43:43 +0000 (0:00:00.383)       0:00:51.726 *****
2025-11-27 09:43:43.737542 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2025-11-27 09:43:43.737594 | controller |
2025-11-27 09:43:43.737606 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2025-11-27 09:43:43.737727 | controller | Thursday 27 November 2025  09:43:43 +0000 (0:00:00.077)       0:00:51.804 *****
2025-11-27 09:43:43.788463 | controller | ok: [instance] => (item=public)
2025-11-27 09:43:43.788817 | controller | ok: [instance] => (item=osp_trunk)
2025-11-27 09:43:43.788841 | controller |
2025-11-27 09:43:44.226044 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2025-11-27 09:43:44.226079 | controller | Thursday 27 November 2025  09:43:43 +0000 (0:00:00.051)       0:00:51.855 *****
2025-11-27 09:43:44.226091 | controller | changed: [instance] => (item=cifmw-public)
2025-11-27 09:43:44.817301 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:43:44.817332 | controller |
2025-11-27 09:43:44.817360 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2025-11-27 09:43:44.817367 | controller | Thursday 27 November 2025  09:43:44 +0000 (0:00:00.437)       0:00:52.292 *****
2025-11-27 09:43:44.817376 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 09:43:45.251484 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:43:45.251515 | controller |
2025-11-27 09:43:45.251524 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2025-11-27 09:43:45.251530 | controller | Thursday 27 November 2025  09:43:44 +0000 (0:00:00.591)       0:00:52.883 *****
2025-11-27 09:43:45.251540 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 09:43:45.679096 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:43:45.679128 | controller |
2025-11-27 09:43:45.679136 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2025-11-27 09:43:45.679142 | controller | Thursday 27 November 2025  09:43:45 +0000 (0:00:00.434)       0:00:53.317 *****
2025-11-27 09:43:45.679158 | controller | changed: [instance] => (item=cifmw-public)
2025-11-27 09:43:45.739309 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:43:45.739354 | controller |
2025-11-27 09:43:45.739366 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2025-11-27 09:43:45.739372 | controller | Thursday 27 November 2025  09:43:45 +0000 (0:00:00.427)       0:00:53.745 *****
2025-11-27 09:43:45.739382 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2025-11-27 09:43:45.925571 | controller |
2025-11-27 09:43:45.925592 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2025-11-27 09:43:45.925609 | controller | Thursday 27 November 2025  09:43:45 +0000 (0:00:00.060)       0:00:53.805 *****
2025-11-27 09:43:45.925619 | controller | ok: [instance]
2025-11-27 09:43:46.301440 | controller |
2025-11-27 09:43:46.301472 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2025-11-27 09:43:46.301481 | controller | Thursday 27 November 2025  09:43:45 +0000 (0:00:00.186)       0:00:53.992 *****
2025-11-27 09:43:46.301493 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 09:43:46.301522 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:43:46.301547 | controller |
2025-11-27 09:43:46.301774 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2025-11-27 09:43:46.371287 | controller | Thursday 27 November 2025  09:43:46 +0000 (0:00:00.375)       0:00:54.368 *****
2025-11-27 09:43:46.371312 | controller |
2025-11-27 09:43:46.437509 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2025-11-27 09:43:46.437530 | controller | Thursday 27 November 2025  09:43:46 +0000 (0:00:00.069)       0:00:54.438 *****
2025-11-27 09:43:46.437542 | controller | skipping: [instance]
2025-11-27 09:43:46.437571 | controller |
2025-11-27 09:43:46.437761 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2025-11-27 09:43:47.709721 | controller | Thursday 27 November 2025  09:43:46 +0000 (0:00:00.066)       0:00:54.504 *****
2025-11-27 09:43:47.709759 | controller | ok: [instance]
2025-11-27 09:43:47.913487 | controller |
2025-11-27 09:43:47.913521 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2025-11-27 09:43:47.913531 | controller | Thursday 27 November 2025  09:43:47 +0000 (0:00:01.271)       0:00:55.776 *****
2025-11-27 09:43:47.913543 | controller | ok: [instance]
2025-11-27 09:43:47.913573 | controller |
2025-11-27 09:43:47.913582 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2025-11-27 09:43:47.913684 | controller | Thursday 27 November 2025  09:43:47 +0000 (0:00:00.204)       0:00:55.980 *****
2025-11-27 09:43:48.277488 | controller | changed: [instance]
2025-11-27 09:43:49.921248 | controller |
2025-11-27 09:43:49.921286 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2025-11-27 09:43:49.921294 | controller | Thursday 27 November 2025  09:43:48 +0000 (0:00:00.363)       0:00:56.344 *****
2025-11-27 09:43:49.921304 | controller | changed: [instance]
2025-11-27 09:43:50.280122 | controller |
2025-11-27 09:43:50.280150 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2025-11-27 09:43:50.280158 | controller | Thursday 27 November 2025  09:43:49 +0000 (0:00:01.643)       0:00:57.987 *****
2025-11-27 09:43:50.280167 | controller | changed: [instance]
2025-11-27 09:43:50.315497 | controller |
2025-11-27 09:43:50.315532 | controller | TASK [Create extra network configuration] **************************************
2025-11-27 09:43:50.315539 | controller | Thursday 27 November 2025  09:43:50 +0000 (0:00:00.359)       0:00:58.346 *****
2025-11-27 09:43:50.315549 | controller | skipping: [instance]
2025-11-27 09:43:50.315578 | controller |
2025-11-27 09:43:50.315586 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2025-11-27 09:43:50.315708 | controller | Thursday 27 November 2025  09:43:50 +0000 (0:00:00.035)       0:00:58.382 *****
2025-11-27 09:43:50.346097 | controller | skipping: [instance]
2025-11-27 09:43:50.797414 | controller |
2025-11-27 09:43:50.797445 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2025-11-27 09:43:50.797459 | controller | Thursday 27 November 2025  09:43:50 +0000 (0:00:00.030)       0:00:58.412 *****
2025-11-27 09:43:50.797471 | controller | ok: [instance]
2025-11-27 09:43:50.943511 | controller |
2025-11-27 09:43:50.943547 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2025-11-27 09:43:50.943557 | controller | Thursday 27 November 2025  09:43:50 +0000 (0:00:00.451)       0:00:58.863 *****
2025-11-27 09:43:50.943570 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 09:43:50.943622 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:43:50.943645 | controller |
2025-11-27 09:43:50.943655 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2025-11-27 09:43:50.943666 | controller | Thursday 27 November 2025  09:43:50 +0000 (0:00:00.146)       0:00:59.010 *****
2025-11-27 09:43:52.187429 | controller | ok: [instance]
2025-11-27 09:43:52.187508 | controller |
2025-11-27 09:43:52.187524 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2025-11-27 09:43:52.187534 | controller | Thursday 27 November 2025  09:43:52 +0000 (0:00:01.243)       0:01:00.254 *****
2025-11-27 09:43:55.908416 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2025-11-27 09:43:55.909031 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2025-11-27 09:43:56.124317 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2025-11-27 09:43:56.124364 | controller |
2025-11-27 09:43:56.124373 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2025-11-27 09:43:56.124379 | controller | Thursday 27 November 2025  09:43:55 +0000 (0:00:03.721)       0:01:03.975 *****
2025-11-27 09:43:56.124389 | controller | changed: [instance]
2025-11-27 09:43:56.485270 | controller |
2025-11-27 09:43:56.485299 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2025-11-27 09:43:56.485308 | controller | Thursday 27 November 2025  09:43:56 +0000 (0:00:00.215)       0:01:04.191 *****
2025-11-27 09:43:56.485318 | controller | changed: [instance]
2025-11-27 09:43:56.873187 | controller |
2025-11-27 09:43:56.873217 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2025-11-27 09:43:56.873225 | controller | Thursday 27 November 2025  09:43:56 +0000 (0:00:00.360)       0:01:04.551 *****
2025-11-27 09:43:56.873236 | controller | changed: [instance]
2025-11-27 09:43:56.906475 | controller |
2025-11-27 09:43:56.906511 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2025-11-27 09:43:56.906520 | controller | Thursday 27 November 2025  09:43:56 +0000 (0:00:00.387)       0:01:04.939 *****
2025-11-27 09:43:56.906533 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2025-11-27 09:43:56.906540 | controller |
2025-11-27 09:43:56.906547 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2025-11-27 09:43:56.906556 | controller | Thursday 27 November 2025  09:43:56 +0000 (0:00:00.033)       0:01:04.973 *****
2025-11-27 09:43:57.300515 | controller | changed: [instance]
2025-11-27 09:43:57.300547 | controller |
2025-11-27 09:43:57.300557 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2025-11-27 09:43:57.300567 | controller | Thursday 27 November 2025  09:43:57 +0000 (0:00:00.393)       0:01:05.367 *****
2025-11-27 09:43:57.322989 | controller | skipping: [instance]
2025-11-27 09:43:57.356949 | controller |
2025-11-27 09:43:57.356973 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2025-11-27 09:43:57.356984 | controller | Thursday 27 November 2025  09:43:57 +0000 (0:00:00.022)       0:01:05.389 *****
2025-11-27 09:43:57.356996 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2025-11-27 09:43:57.732446 | controller |
2025-11-27 09:43:57.732475 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2025-11-27 09:43:57.732485 | controller | Thursday 27 November 2025  09:43:57 +0000 (0:00:00.033)       0:01:05.423 *****
2025-11-27 09:43:57.732496 | controller | changed: [instance]
2025-11-27 09:43:57.732701 | controller |
2025-11-27 09:43:57.732739 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2025-11-27 09:43:57.754482 | controller | Thursday 27 November 2025  09:43:57 +0000 (0:00:00.375)       0:01:05.799 *****
2025-11-27 09:43:57.754528 | controller | skipping: [instance]
2025-11-27 09:43:57.754573 | controller |
2025-11-27 09:43:57.754590 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2025-11-27 09:43:57.754601 | controller | Thursday 27 November 2025  09:43:57 +0000 (0:00:00.022)       0:01:05.821 *****
2025-11-27 09:43:57.967370 | controller | ok: [instance] => (item=127.0.0.2)
2025-11-27 09:43:58.648456 | controller |
2025-11-27 09:43:58.648492 | controller | TASK [dnsmasq : Enable and start service] **************************************
2025-11-27 09:43:58.648503 | controller | Thursday 27 November 2025  09:43:57 +0000 (0:00:00.212)       0:01:06.033 *****
2025-11-27 09:43:58.648515 | controller | changed: [instance]
2025-11-27 09:43:58.648546 | controller |
2025-11-27 09:43:58.648556 | controller | TASK [dnsmasq : Stop service] **************************************************
2025-11-27 09:43:58.648782 | controller | Thursday 27 November 2025  09:43:58 +0000 (0:00:00.681)       0:01:06.714 *****
2025-11-27 09:43:58.669462 | controller | skipping: [instance]
2025-11-27 09:43:58.669831 | controller |
2025-11-27 09:43:58.688507 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2025-11-27 09:43:58.688543 | controller | Thursday 27 November 2025  09:43:58 +0000 (0:00:00.021)       0:01:06.736 *****
2025-11-27 09:43:58.688557 | controller | skipping: [instance]
2025-11-27 09:43:58.688626 | controller |
2025-11-27 09:43:58.688648 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2025-11-27 09:43:58.688662 | controller | Thursday 27 November 2025  09:43:58 +0000 (0:00:00.018)       0:01:06.755 *****
2025-11-27 09:43:58.717543 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2025-11-27 09:43:58.833035 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2025-11-27 09:43:58.833061 | controller | skipping: [instance]
2025-11-27 09:43:58.833072 | controller |
2025-11-27 09:43:58.833080 | controller | TASK [Create dnsmasq networks] *************************************************
2025-11-27 09:43:58.833088 | controller | Thursday 27 November 2025  09:43:58 +0000 (0:00:00.028)       0:01:06.784 *****
2025-11-27 09:43:58.833099 | controller |
2025-11-27 09:43:58.861989 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2025-11-27 09:43:58.862009 | controller | Thursday 27 November 2025  09:43:58 +0000 (0:00:00.115)       0:01:06.899 *****
2025-11-27 09:43:58.862022 | controller | ok: [instance] => changed=false
2025-11-27 09:43:58.897620 | controller |   msg: All assertions passed
2025-11-27 09:43:58.897653 | controller |
2025-11-27 09:43:58.897667 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2025-11-27 09:43:58.897678 | controller | Thursday 27 November 2025  09:43:58 +0000 (0:00:00.028)       0:01:06.928 *****
2025-11-27 09:43:58.897693 | controller | ok: [instance] => changed=false
2025-11-27 09:43:58.897980 | controller |   msg: All assertions passed
2025-11-27 09:43:58.898229 | controller |
2025-11-27 09:43:58.898416 | controller | TASK [dnsmasq : Create network] ************************************************
2025-11-27 09:43:58.898551 | controller | Thursday 27 November 2025  09:43:58 +0000 (0:00:00.035)       0:01:06.964 *****
2025-11-27 09:43:59.361454 | controller | changed: [instance]
2025-11-27 09:43:59.361580 | controller |
2025-11-27 09:43:59.361608 | controller | TASK [dnsmasq : Remove network] ************************************************
2025-11-27 09:43:59.361625 | controller | Thursday 27 November 2025  09:43:59 +0000 (0:00:00.463)       0:01:07.428 *****
2025-11-27 09:43:59.383450 | controller | skipping: [instance]
2025-11-27 09:43:59.383506 | controller |
2025-11-27 09:43:59.383519 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2025-11-27 09:43:59.383671 | controller | Thursday 27 November 2025  09:43:59 +0000 (0:00:00.022)       0:01:07.450 *****
2025-11-27 09:43:59.409462 | controller | skipping: [instance]
2025-11-27 09:43:59.409539 | controller |
2025-11-27 09:43:59.409558 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2025-11-27 09:43:59.409568 | controller | Thursday 27 November 2025  09:43:59 +0000 (0:00:00.025)       0:01:07.476 *****
2025-11-27 09:43:59.439352 | controller | ok: [instance] => changed=false
2025-11-27 09:43:59.477465 | controller |   msg: All assertions passed
2025-11-27 09:43:59.477493 | controller |
2025-11-27 09:43:59.477503 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2025-11-27 09:43:59.477512 | controller | Thursday 27 November 2025  09:43:59 +0000 (0:00:00.029)       0:01:07.505 *****
2025-11-27 09:43:59.477523 | controller | ok: [instance] => changed=false
2025-11-27 09:43:59.477531 | controller |   msg: All assertions passed
2025-11-27 09:43:59.477537 | controller |
2025-11-27 09:43:59.477547 | controller | TASK [dnsmasq : Create network] ************************************************
2025-11-27 09:43:59.477685 | controller | Thursday 27 November 2025  09:43:59 +0000 (0:00:00.038)       0:01:07.544 *****
2025-11-27 09:43:59.954287 | controller | changed: [instance]
2025-11-27 09:43:59.981470 | controller |
2025-11-27 09:43:59.981507 | controller | TASK [dnsmasq : Remove network] ************************************************
2025-11-27 09:43:59.981518 | controller | Thursday 27 November 2025  09:43:59 +0000 (0:00:00.476)       0:01:08.020 *****
2025-11-27 09:43:59.981531 | controller | skipping: [instance]
2025-11-27 09:44:00.013492 | controller |
2025-11-27 09:44:00.013530 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2025-11-27 09:44:00.013540 | controller | Thursday 27 November 2025  09:43:59 +0000 (0:00:00.027)       0:01:08.048 *****
2025-11-27 09:44:00.013552 | controller | skipping: [instance]
2025-11-27 09:44:00.013592 | controller |
2025-11-27 09:44:00.013722 | controller | TASK [Deploy radvd for IPv6 router advertisements] *****************************
2025-11-27 09:44:00.013744 | controller | Thursday 27 November 2025  09:44:00 +0000 (0:00:00.031)       0:01:08.080 *****
2025-11-27 09:44:00.053868 | controller | skipping: [instance]
2025-11-27 09:44:00.569333 | controller |
2025-11-27 09:44:00.569385 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2025-11-27 09:44:00.569393 | controller | Thursday 27 November 2025  09:44:00 +0000 (0:00:00.040)       0:01:08.120 *****
2025-11-27 09:44:00.569411 | controller | changed: [instance] => (item=cifmw-public)
2025-11-27 09:44:00.613866 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:44:00.613902 | controller |
2025-11-27 09:44:00.613911 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-11-27 09:44:00.613917 | controller | Thursday 27 November 2025  09:44:00 +0000 (0:00:00.515)       0:01:08.635 *****
2025-11-27 09:44:00.613927 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2025-11-27 09:44:00.999014 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2025-11-27 09:44:00.999049 | controller |
2025-11-27 09:44:00.999058 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-11-27 09:44:00.999065 | controller | Thursday 27 November 2025  09:44:00 +0000 (0:00:00.044)       0:01:08.680 *****
2025-11-27 09:44:00.999075 | controller | ok: [instance]
2025-11-27 09:44:01.045517 | controller |
2025-11-27 09:44:01.045536 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2025-11-27 09:44:01.045544 | controller | Thursday 27 November 2025  09:44:00 +0000 (0:00:00.384)       0:01:09.065 *****
2025-11-27 09:44:01.045553 | controller | ok: [instance]
2025-11-27 09:44:01.285083 | controller |
2025-11-27 09:44:01.285112 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-11-27 09:44:01.285120 | controller | Thursday 27 November 2025  09:44:01 +0000 (0:00:00.046)       0:01:09.112 *****
2025-11-27 09:44:01.285129 | controller | ok: [instance]
2025-11-27 09:44:01.331450 | controller |
2025-11-27 09:44:01.331483 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2025-11-27 09:44:01.331491 | controller | Thursday 27 November 2025  09:44:01 +0000 (0:00:00.239)       0:01:09.351 *****
2025-11-27 09:44:01.331502 | controller | ok: [instance]
2025-11-27 09:44:01.331534 | controller |
2025-11-27 09:44:01.331540 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2025-11-27 09:44:01.331548 | controller | Thursday 27 November 2025  09:44:01 +0000 (0:00:00.046)       0:01:09.398 *****
2025-11-27 09:44:01.705714 | controller | changed: [instance]
2025-11-27 09:44:01.705767 | controller |
2025-11-27 09:44:01.706011 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2025-11-27 09:44:02.066427 | controller | Thursday 27 November 2025  09:44:01 +0000 (0:00:00.374)       0:01:09.772 *****
2025-11-27 09:44:02.066465 | controller | changed: [instance]
2025-11-27 09:44:02.066474 | controller |
2025-11-27 09:44:02.066480 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2025-11-27 09:44:02.066488 | controller | Thursday 27 November 2025  09:44:02 +0000 (0:00:00.360)       0:01:10.132 *****
2025-11-27 09:44:02.437446 | controller | changed: [instance]
2025-11-27 09:44:02.547474 | controller |
2025-11-27 09:44:02.547509 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2025-11-27 09:44:02.547517 | controller | Thursday 27 November 2025  09:44:02 +0000 (0:00:00.370)       0:01:10.503 *****
2025-11-27 09:44:02.547528 | controller | ok: [instance]
2025-11-27 09:44:02.547557 | controller |
2025-11-27 09:44:02.547565 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2025-11-27 09:44:02.547666 | controller | Thursday 27 November 2025  09:44:02 +0000 (0:00:00.110)       0:01:10.614 *****
2025-11-27 09:44:02.905217 | controller | changed: [instance]
2025-11-27 09:44:02.934470 | controller |
2025-11-27 09:44:02.934505 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-11-27 09:44:02.934515 | controller | Thursday 27 November 2025  09:44:02 +0000 (0:00:00.357)       0:01:10.971 *****
2025-11-27 09:44:02.934527 | controller | skipping: [instance]
2025-11-27 09:44:02.934561 | controller |
2025-11-27 09:44:02.934572 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-11-27 09:44:02.934641 | controller | Thursday 27 November 2025  09:44:02 +0000 (0:00:00.029)       0:01:11.001 *****
2025-11-27 09:44:02.960476 | controller | skipping: [instance]
2025-11-27 09:44:02.960530 | controller |
2025-11-27 09:44:02.960788 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-11-27 09:44:02.987884 | controller | Thursday 27 November 2025  09:44:02 +0000 (0:00:00.026)       0:01:11.027 *****
2025-11-27 09:44:02.987908 | controller | skipping: [instance]
2025-11-27 09:44:03.018455 | controller |
2025-11-27 09:44:03.018492 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-11-27 09:44:03.018504 | controller | Thursday 27 November 2025  09:44:02 +0000 (0:00:00.027)       0:01:11.054 *****
2025-11-27 09:44:03.018517 | controller | skipping: [instance]
2025-11-27 09:44:03.041462 | controller |
2025-11-27 09:44:03.041485 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-11-27 09:44:03.041495 | controller | Thursday 27 November 2025  09:44:03 +0000 (0:00:00.030)       0:01:11.085 *****
2025-11-27 09:44:03.041506 | controller | ok: [instance]
2025-11-27 09:44:03.041541 | controller |
2025-11-27 09:44:03.041549 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-11-27 09:44:03.041566 | controller | Thursday 27 November 2025  09:44:03 +0000 (0:00:00.023)       0:01:11.108 *****
2025-11-27 09:44:03.130636 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2025-11-27 09:44:03.130777 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2025-11-27 09:44:03.130941 | controller |
2025-11-27 09:44:03.131066 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-11-27 09:44:03.131195 | controller | Thursday 27 November 2025  09:44:03 +0000 (0:00:00.089)       0:01:11.197 *****
2025-11-27 09:44:03.150987 | controller | skipping: [instance]
2025-11-27 09:44:03.151373 | controller |
2025-11-27 09:44:03.151401 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-11-27 09:44:03.151414 | controller | Thursday 27 November 2025  09:44:03 +0000 (0:00:00.020)       0:01:11.218 *****
2025-11-27 09:44:03.362515 | controller | ok: [instance]
2025-11-27 09:44:03.362657 | controller |
2025-11-27 09:44:03.362674 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-11-27 09:44:03.362843 | controller | Thursday 27 November 2025  09:44:03 +0000 (0:00:00.210)       0:01:11.429 *****
2025-11-27 09:44:03.779918 | controller | changed: [instance]
2025-11-27 09:44:03.848158 | controller |
2025-11-27 09:44:03.848176 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-11-27 09:44:03.848184 | controller | Thursday 27 November 2025  09:44:03 +0000 (0:00:00.417)       0:01:11.846 *****
2025-11-27 09:44:03.848192 | controller | ok: [instance]
2025-11-27 09:44:03.884149 | controller |
2025-11-27 09:44:03.884166 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-11-27 09:44:03.884173 | controller | Thursday 27 November 2025  09:44:03 +0000 (0:00:00.068)       0:01:11.914 *****
2025-11-27 09:44:03.884182 | controller | ok: [instance]
2025-11-27 09:44:04.320035 | controller |
2025-11-27 09:44:04.320058 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-11-27 09:44:04.320066 | controller | Thursday 27 November 2025  09:44:03 +0000 (0:00:00.035)       0:01:11.950 *****
2025-11-27 09:44:04.320075 | controller | changed: [instance]
2025-11-27 09:44:04.353398 | controller |
2025-11-27 09:44:04.353434 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2025-11-27 09:44:04.353447 | controller | Thursday 27 November 2025  09:44:04 +0000 (0:00:00.435)       0:01:12.386 *****
2025-11-27 09:44:04.353463 | controller | ok: [instance]
2025-11-27 09:44:04.374525 | controller |
2025-11-27 09:44:04.374572 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2025-11-27 09:44:04.374582 | controller | Thursday 27 November 2025  09:44:04 +0000 (0:00:00.033)       0:01:12.419 *****
2025-11-27 09:44:04.374596 | controller | ok: [instance]
2025-11-27 09:44:04.395052 | controller |
2025-11-27 09:44:04.395074 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2025-11-27 09:44:04.395082 | controller | Thursday 27 November 2025  09:44:04 +0000 (0:00:00.021)       0:01:12.441 *****
2025-11-27 09:44:04.395092 | controller | ok: [instance]
2025-11-27 09:44:04.469506 | controller |
2025-11-27 09:44:04.469547 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2025-11-27 09:44:04.469558 | controller | Thursday 27 November 2025  09:44:04 +0000 (0:00:00.020)       0:01:12.461 *****
2025-11-27 09:44:04.469572 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2025-11-27 09:44:04.469609 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2025-11-27 09:44:04.469617 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2025-11-27 09:44:04.469625 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2025-11-27 09:44:04.469635 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2025-11-27 09:44:04.469812 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2025-11-27 09:44:04.469986 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2025-11-27 09:44:04.470099 | controller |
2025-11-27 09:44:04.470214 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 09:44:04.470321 | controller | Thursday 27 November 2025  09:44:04 +0000 (0:00:00.074)       0:01:12.536 *****
2025-11-27 09:44:04.605064 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2025-11-27 09:44:04.605156 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2025-11-27 09:44:04.605311 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2025-11-27 09:44:04.605413 | controller |
2025-11-27 09:44:04.605542 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 09:44:04.605646 | controller | Thursday 27 November 2025  09:44:04 +0000 (0:00:00.136)       0:01:12.672 *****
2025-11-27 09:44:04.685817 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2025-11-27 09:44:04.685848 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2025-11-27 09:44:04.686023 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2025-11-27 09:44:04.686162 | controller | skipping: [instance]
2025-11-27 09:44:04.686319 | controller |
2025-11-27 09:44:04.686455 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 09:44:04.686587 | controller | Thursday 27 November 2025  09:44:04 +0000 (0:00:00.080)       0:01:12.752 *****
2025-11-27 09:44:04.768324 | controller | skipping: [instance] => (item=compute-0 - storage)
2025-11-27 09:44:04.768572 | controller | skipping: [instance] => (item=controller-0 - storage)
2025-11-27 09:44:04.768674 | controller | skipping: [instance] => (item=crc-0 - storage)
2025-11-27 09:44:04.768798 | controller | skipping: [instance]
2025-11-27 09:44:04.768902 | controller |
2025-11-27 09:44:04.769045 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 09:44:04.769152 | controller | Thursday 27 November 2025  09:44:04 +0000 (0:00:00.082)       0:01:12.835 *****
2025-11-27 09:44:04.851228 | controller | skipping: [instance] => (item=compute-0 - tenant)
2025-11-27 09:44:04.851329 | controller | skipping: [instance] => (item=controller-0 - tenant)
2025-11-27 09:44:04.851531 | controller | skipping: [instance] => (item=crc-0 - tenant)
2025-11-27 09:44:04.851646 | controller | skipping: [instance]
2025-11-27 09:44:04.851752 | controller |
2025-11-27 09:44:04.851878 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 09:44:04.851994 | controller | Thursday 27 November 2025  09:44:04 +0000 (0:00:00.082)       0:01:12.918 *****
2025-11-27 09:44:04.932110 | controller | skipping: [instance] => (item=compute-0 - external)
2025-11-27 09:44:04.932360 | controller | skipping: [instance] => (item=controller-0 - external)
2025-11-27 09:44:04.932591 | controller | skipping: [instance] => (item=crc-0 - external)
2025-11-27 09:44:04.932809 | controller | skipping: [instance]
2025-11-27 09:44:04.932921 | controller |
2025-11-27 09:44:04.933039 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 09:44:04.933134 | controller | Thursday 27 November 2025  09:44:04 +0000 (0:00:00.080)       0:01:12.999 *****
2025-11-27 09:44:05.009390 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2025-11-27 09:44:05.009568 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2025-11-27 09:44:05.009686 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2025-11-27 09:44:05.009843 | controller | skipping: [instance]
2025-11-27 09:44:05.009926 | controller |
2025-11-27 09:44:05.010089 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 09:44:05.010189 | controller | Thursday 27 November 2025  09:44:05 +0000 (0:00:00.077)       0:01:13.076 *****
2025-11-27 09:44:05.237688 | controller | ok: [instance] => (item=compute-0 - public)
2025-11-27 09:44:05.237812 | controller | ok: [instance] => (item=controller-0 - public)
2025-11-27 09:44:05.237959 | controller | ok: [instance] => (item=crc-0 - public)
2025-11-27 09:44:05.238113 | controller |
2025-11-27 09:44:05.238257 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2025-11-27 09:44:05.238401 | controller | Thursday 27 November 2025  09:44:05 +0000 (0:00:00.228)       0:01:13.304 *****
2025-11-27 09:44:05.405755 | controller |
2025-11-27 09:44:05.405910 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2025-11-27 09:44:05.406062 | controller | Thursday 27 November 2025  09:44:05 +0000 (0:00:00.168)       0:01:13.472 *****
2025-11-27 09:44:05.451745 | controller | ok: [instance]
2025-11-27 09:44:05.451892 | controller |
2025-11-27 09:44:05.452029 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2025-11-27 09:44:05.452155 | controller | Thursday 27 November 2025  09:44:05 +0000 (0:00:00.045)       0:01:13.518 *****
2025-11-27 09:44:05.565875 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:35:68:6a', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2025-11-27 09:44:05.565977 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:66:67:87', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2025-11-27 09:44:05.566164 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:3f:7f:18', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2025-11-27 09:44:05.566261 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7a:68:be', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2025-11-27 09:44:05.566421 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:c9:1a:5a', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2025-11-27 09:44:05.566575 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:c8:6a:65', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2025-11-27 09:44:05.566681 | controller |
2025-11-27 09:44:05.566801 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2025-11-27 09:44:05.566916 | controller | Thursday 27 November 2025  09:44:05 +0000 (0:00:00.114)       0:01:13.632 *****
2025-11-27 09:44:05.622836 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2025-11-27 09:44:05.622960 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2025-11-27 09:44:05.623102 | controller |
2025-11-27 09:44:05.623222 | controller | TASK [dnsmasq : Check network file status] *************************************
2025-11-27 09:44:05.623398 | controller | Thursday 27 November 2025  09:44:05 +0000 (0:00:00.057)       0:01:13.689 *****
2025-11-27 09:44:05.822911 | controller | ok: [instance]
2025-11-27 09:44:05.851172 | controller |
2025-11-27 09:44:05.851205 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2025-11-27 09:44:05.851228 | controller | Thursday 27 November 2025  09:44:05 +0000 (0:00:00.199)       0:01:13.889 *****
2025-11-27 09:44:05.851244 | controller | ok: [instance]
2025-11-27 09:44:06.060431 | controller |
2025-11-27 09:44:06.060469 | controller | TASK [dnsmasq : Check network file status] *************************************
2025-11-27 09:44:06.060477 | controller | Thursday 27 November 2025  09:44:05 +0000 (0:00:00.028)       0:01:13.917 *****
2025-11-27 09:44:06.060489 | controller | ok: [instance]
2025-11-27 09:44:06.060518 | controller |
2025-11-27 09:44:06.060711 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2025-11-27 09:44:06.091550 | controller | Thursday 27 November 2025  09:44:06 +0000 (0:00:00.209)       0:01:14.127 *****
2025-11-27 09:44:06.091623 | controller | ok: [instance]
2025-11-27 09:44:06.091674 | controller |
2025-11-27 09:44:06.091977 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2025-11-27 09:44:06.116323 | controller | Thursday 27 November 2025  09:44:06 +0000 (0:00:00.031)       0:01:14.158 *****
2025-11-27 09:44:06.116370 | controller | ok: [instance]
2025-11-27 09:44:06.301697 | controller |
2025-11-27 09:44:06.301799 | controller | TASK [dnsmasq : Compute entry] *************************************************
2025-11-27 09:44:06.301812 | controller | Thursday 27 November 2025  09:44:06 +0000 (0:00:00.024)       0:01:14.183 *****
2025-11-27 09:44:06.301835 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:35:68:6a', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2025-11-27 09:44:06.345969 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:66:67:87', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2025-11-27 09:44:06.346015 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:3f:7f:18', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2025-11-27 09:44:06.346024 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7a:68:be', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2025-11-27 09:44:06.346032 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:c9:1a:5a', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2025-11-27 09:44:06.346038 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:c8:6a:65', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2025-11-27 09:44:06.346045 | controller |
2025-11-27 09:44:06.346053 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2025-11-27 09:44:06.346060 | controller | Thursday 27 November 2025  09:44:06 +0000 (0:00:00.184)       0:01:14.367 *****
2025-11-27 09:44:06.346071 | controller | ok: [instance]
2025-11-27 09:44:08.587449 | controller |
2025-11-27 09:44:08.587503 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2025-11-27 09:44:08.587514 | controller | Thursday 27 November 2025  09:44:06 +0000 (0:00:00.044)       0:01:14.412 *****
2025-11-27 09:44:08.587529 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:35:68:6a', 'entry': 'set:compute,52:54:00:35:68:6a,192.168.140.100,compute-0', 'state': 'present'})
2025-11-27 09:44:08.612480 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:66:67:87', 'entry': 'set:controller,52:54:01:66:67:87,192.168.140.9,controller-0', 'state': 'present'})
2025-11-27 09:44:08.612515 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:3f:7f:18', 'entry': 'set:ocp,52:54:02:3f:7f:18,192.168.140.10,crc-0', 'state': 'present'})
2025-11-27 09:44:08.612524 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:7a:68:be', 'entry': 'set:compute,52:54:00:7a:68:be,192.168.101.100,compute-0', 'state': 'present'})
2025-11-27 09:44:08.612531 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:c9:1a:5a', 'entry': 'set:controller,52:54:01:c9:1a:5a,192.168.101.9,controller-0', 'state': 'present'})
2025-11-27 09:44:08.612537 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:c8:6a:65', 'entry': 'set:ocp,52:54:02:c8:6a:65,192.168.101.10,crc-0', 'state': 'present'})
2025-11-27 09:44:08.612549 | controller |
2025-11-27 09:44:08.612556 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2025-11-27 09:44:08.612564 | controller | Thursday 27 November 2025  09:44:08 +0000 (0:00:02.240)       0:01:16.652 *****
2025-11-27 09:44:08.612574 | controller | skipping: [instance]
2025-11-27 09:44:08.612608 | controller |
2025-11-27 09:44:08.612857 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2025-11-27 09:44:08.832076 | controller | Thursday 27 November 2025  09:44:08 +0000 (0:00:00.026)       0:01:16.679 *****
2025-11-27 09:44:08.832104 | controller | ok: [instance] => (item=compute-0)
2025-11-27 09:44:08.956536 | controller | ok: [instance] => (item=controller-0)
2025-11-27 09:44:08.956559 | controller | ok: [instance] => (item=crc-0)
2025-11-27 09:44:08.956568 | controller |
2025-11-27 09:44:08.956574 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2025-11-27 09:44:08.956580 | controller | Thursday 27 November 2025  09:44:08 +0000 (0:00:00.219)       0:01:16.898 *****
2025-11-27 09:44:08.956588 | controller |
2025-11-27 09:44:09.011511 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-11-27 09:44:09.011552 | controller | Thursday 27 November 2025  09:44:08 +0000 (0:00:00.124)       0:01:17.023 *****
2025-11-27 09:44:09.011567 | controller | ok: [instance]
2025-11-27 09:44:09.219475 | controller |
2025-11-27 09:44:09.219524 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-11-27 09:44:09.219538 | controller | Thursday 27 November 2025  09:44:09 +0000 (0:00:00.055)       0:01:17.078 *****
2025-11-27 09:44:09.219558 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-11-27 09:44:09.219761 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-11-27 09:44:09.219998 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2025-11-27 09:44:09.220111 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2025-11-27 09:44:09.220232 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2025-11-27 09:44:09.220331 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2025-11-27 09:44:09.220466 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2025-11-27 09:44:09.220576 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 09:44:09.220685 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 09:44:09.220793 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2025-11-27 09:44:09.220898 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-11-27 09:44:09.221000 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-11-27 09:44:09.221113 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2025-11-27 09:44:09.221216 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2025-11-27 09:44:09.221320 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2025-11-27 09:44:09.221451 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2025-11-27 09:44:09.221561 | controller |
2025-11-27 09:44:09.221668 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-11-27 09:44:09.221778 | controller | Thursday 27 November 2025  09:44:09 +0000 (0:00:00.207)       0:01:17.286 *****
2025-11-27 09:44:12.644460 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-11-27 09:44:12.644511 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-11-27 09:44:12.644520 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2025-11-27 09:44:12.644526 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2025-11-27 09:44:12.644531 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2025-11-27 09:44:12.644536 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2025-11-27 09:44:12.644541 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2025-11-27 09:44:12.644547 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 09:44:12.644552 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 09:44:12.644557 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2025-11-27 09:44:12.644562 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-11-27 09:44:12.644570 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-11-27 09:44:12.644612 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2025-11-27 09:44:12.644710 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2025-11-27 09:44:12.644804 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2025-11-27 09:44:12.644885 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2025-11-27 09:44:12.644968 | controller |
2025-11-27 09:44:12.645059 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] ****************
2025-11-27 09:44:12.645174 | controller | Thursday 27 November 2025  09:44:12 +0000 (0:00:03.423)       0:01:20.710 *****
2025-11-27 09:44:12.674602 | controller | ok: [instance]
2025-11-27 09:44:12.674647 | controller |
2025-11-27 09:44:12.674859 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] **************
2025-11-27 09:44:12.674921 | controller | Thursday 27 November 2025  09:44:12 +0000 (0:00:00.031)       0:01:20.741 *****
2025-11-27 09:44:12.731505 | controller | skipping: [instance] => (item=compute)
2025-11-27 09:44:12.731675 | controller | skipping: [instance] => (item=controller)
2025-11-27 09:44:12.731830 | controller | skipping: [instance] => (item=crc)
2025-11-27 09:44:12.731845 | controller | skipping: [instance]
2025-11-27 09:44:12.732015 | controller |
2025-11-27 09:44:12.732040 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] *******
2025-11-27 09:44:12.732202 | controller | Thursday 27 November 2025  09:44:12 +0000 (0:00:00.056)       0:01:20.798 *****
2025-11-27 09:44:12.768778 | controller | skipping: [instance]
2025-11-27 09:44:12.768823 | controller |
2025-11-27 09:44:12.768957 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2025-11-27 09:44:12.769077 | controller | Thursday 27 November 2025  09:44:12 +0000 (0:00:00.037)       0:01:20.835 *****
2025-11-27 09:44:13.186760 | controller | changed: [instance]
2025-11-27 09:44:13.186806 | controller |
2025-11-27 09:44:13.186948 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2025-11-27 09:44:13.187062 | controller | Thursday 27 November 2025  09:44:13 +0000 (0:00:00.406)       0:01:21.242 *****
2025-11-27 09:44:13.187173 | controller |
2025-11-27 09:44:13.187297 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2025-11-27 09:44:13.187427 | controller | Thursday 27 November 2025  09:44:13 +0000 (0:00:00.011)       0:01:21.253 *****
2025-11-27 09:44:14.045969 | controller | changed: [instance]
2025-11-27 09:44:14.046028 | controller |
2025-11-27 09:44:14.046250 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-11-27 09:44:14.423946 | controller | Thursday 27 November 2025  09:44:14 +0000 (0:00:00.859)       0:01:22.112 *****
2025-11-27 09:44:14.423985 | controller | changed: [instance]
2025-11-27 09:44:14.798979 | controller |
2025-11-27 09:44:14.799016 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2025-11-27 09:44:14.799024 | controller | Thursday 27 November 2025  09:44:14 +0000 (0:00:00.377)       0:01:22.490 *****
2025-11-27 09:44:14.799034 | controller | changed: [instance]
2025-11-27 09:44:15.173420 | controller |
2025-11-27 09:44:15.173453 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2025-11-27 09:44:15.173461 | controller | Thursday 27 November 2025  09:44:14 +0000 (0:00:00.374)       0:01:22.865 *****
2025-11-27 09:44:15.173472 | controller | changed: [instance]
2025-11-27 09:44:15.565164 | controller |
2025-11-27 09:44:15.565214 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2025-11-27 09:44:15.565223 | controller | Thursday 27 November 2025  09:44:15 +0000 (0:00:00.374)       0:01:23.239 *****
2025-11-27 09:44:15.565234 | controller | changed: [instance]
2025-11-27 09:44:15.630700 | controller |
2025-11-27 09:44:15.630732 | controller | TASK [Build utility records dataset] *******************************************
2025-11-27 09:44:15.630740 | controller | Thursday 27 November 2025  09:44:15 +0000 (0:00:00.391)       0:01:23.631 *****
2025-11-27 09:44:15.630754 | controller |
2025-11-27 09:44:15.726585 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-11-27 09:44:15.726665 | controller | Thursday 27 November 2025  09:44:15 +0000 (0:00:00.066)       0:01:23.697 *****
2025-11-27 09:44:15.726682 | controller | ok: [instance]
2025-11-27 09:44:15.828538 | controller |
2025-11-27 09:44:15.828669 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-11-27 09:44:15.828680 | controller | Thursday 27 November 2025  09:44:15 +0000 (0:00:00.095)       0:01:23.793 *****
2025-11-27 09:44:15.828707 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2025-11-27 09:44:16.338448 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 09:44:16.338497 | controller |
2025-11-27 09:44:16.338508 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-11-27 09:44:16.338516 | controller | Thursday 27 November 2025  09:44:15 +0000 (0:00:00.102)       0:01:23.895 *****
2025-11-27 09:44:16.338535 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2025-11-27 09:44:16.338812 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 09:44:16.338848 | controller |
2025-11-27 09:44:16.338856 | controller | TASK [reproducer : Flush handlers] *********************************************
2025-11-27 09:44:16.338862 | controller | Thursday 27 November 2025  09:44:16 +0000 (0:00:00.499)       0:01:24.394 *****
2025-11-27 09:44:16.338872 | controller |
2025-11-27 09:44:16.827420 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-11-27 09:44:16.827461 | controller | Thursday 27 November 2025  09:44:16 +0000 (0:00:00.010)       0:01:24.404 *****
2025-11-27 09:44:16.827474 | controller | changed: [instance]
2025-11-27 09:44:17.222222 | controller |
2025-11-27 09:44:17.222260 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-11-27 09:44:17.222268 | controller | Thursday 27 November 2025  09:44:16 +0000 (0:00:00.489)       0:01:24.893 *****
2025-11-27 09:44:17.222278 | controller | changed: [instance]
2025-11-27 09:44:17.263039 | controller |
2025-11-27 09:44:17.263069 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2025-11-27 09:44:17.263078 | controller | Thursday 27 November 2025  09:44:17 +0000 (0:00:00.394)       0:01:25.288 *****
2025-11-27 09:44:17.263089 | controller | skipping: [instance]
2025-11-27 09:44:17.349524 | controller |
2025-11-27 09:44:17.349562 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2025-11-27 09:44:17.349571 | controller | Thursday 27 November 2025  09:44:17 +0000 (0:00:00.041)       0:01:25.329 *****
2025-11-27 09:44:17.349583 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2025-11-27 09:44:17.552581 | controller |
2025-11-27 09:44:17.552621 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2025-11-27 09:44:17.552630 | controller | Thursday 27 November 2025  09:44:17 +0000 (0:00:00.086)       0:01:25.416 *****
2025-11-27 09:44:17.552642 | controller | ok: [instance]
2025-11-27 09:44:17.580355 | controller |
2025-11-27 09:44:17.580389 | controller | TASK [Deploy CRC if needed] ****************************************************
2025-11-27 09:44:17.580399 | controller | Thursday 27 November 2025  09:44:17 +0000 (0:00:00.202)       0:01:25.618 *****
2025-11-27 09:44:17.580412 | controller | skipping: [instance]
2025-11-27 09:44:17.961952 | controller |
2025-11-27 09:44:17.961990 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2025-11-27 09:44:17.961998 | controller | Thursday 27 November 2025  09:44:17 +0000 (0:00:00.028)       0:01:25.646 *****
2025-11-27 09:44:17.962010 | controller | ok: [instance]
2025-11-27 09:44:18.196200 | controller |
2025-11-27 09:44:18.196224 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2025-11-27 09:44:18.196243 | controller | Thursday 27 November 2025  09:44:17 +0000 (0:00:00.381)       0:01:26.028 *****
2025-11-27 09:44:18.196253 | controller | ok: [instance]
2025-11-27 09:44:18.422501 | controller |
2025-11-27 09:44:18.422549 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2025-11-27 09:44:18.422559 | controller | Thursday 27 November 2025  09:44:18 +0000 (0:00:00.234)       0:01:26.262 *****
2025-11-27 09:44:18.422573 | controller | ok: [instance]
2025-11-27 09:44:18.422613 | controller |
2025-11-27 09:44:18.422623 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2025-11-27 09:44:18.647323 | controller | Thursday 27 November 2025  09:44:18 +0000 (0:00:00.226)       0:01:26.489 *****
2025-11-27 09:44:18.647381 | controller | ok: [instance]
2025-11-27 09:44:18.890504 | controller |
2025-11-27 09:44:18.890545 | controller | TASK [rhol_crc : Destroy default network] **************************************
2025-11-27 09:44:18.890555 | controller | Thursday 27 November 2025  09:44:18 +0000 (0:00:00.224)       0:01:26.713 *****
2025-11-27 09:44:18.890568 | controller | ok: [instance]
2025-11-27 09:44:18.936451 | controller |
2025-11-27 09:44:18.936478 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-11-27 09:44:18.936501 | controller | Thursday 27 November 2025  09:44:18 +0000 (0:00:00.243)       0:01:26.956 *****
2025-11-27 09:44:18.936514 | controller |
2025-11-27 09:44:18.936554 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2025-11-27 09:44:18.936670 | controller | Thursday 27 November 2025  09:44:18 +0000 (0:00:00.046)       0:01:27.003 *****
2025-11-27 09:44:19.149449 | controller | ok: [instance]
2025-11-27 09:44:19.179507 | controller |
2025-11-27 09:44:19.179554 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2025-11-27 09:44:19.179566 | controller | Thursday 27 November 2025  09:44:19 +0000 (0:00:00.212)       0:01:27.215 *****
2025-11-27 09:44:19.179579 | controller | ok: [instance]
2025-11-27 09:44:19.179621 | controller |
2025-11-27 09:44:19.179840 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2025-11-27 09:44:19.179886 | controller | Thursday 27 November 2025  09:44:19 +0000 (0:00:00.030)       0:01:27.246 *****
2025-11-27 09:44:19.211125 | controller | skipping: [instance]
2025-11-27 09:44:19.530502 | controller |
2025-11-27 09:44:19.530551 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2025-11-27 09:44:19.530561 | controller | Thursday 27 November 2025  09:44:19 +0000 (0:00:00.031)       0:01:27.277 *****
2025-11-27 09:44:19.530575 | controller | ok: [instance]
2025-11-27 09:44:19.764314 | controller |
2025-11-27 09:44:19.764363 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2025-11-27 09:44:19.764387 | controller | Thursday 27 November 2025  09:44:19 +0000 (0:00:00.318)       0:01:27.596 *****
2025-11-27 09:44:19.764400 | controller | ok: [instance]
2025-11-27 09:44:19.764430 | controller |
2025-11-27 09:44:19.764671 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2025-11-27 09:44:19.938780 | controller | Thursday 27 November 2025  09:44:19 +0000 (0:00:00.234)       0:01:27.830 *****
2025-11-27 09:44:19.938827 | controller | ok: [instance]
2025-11-27 09:44:20.003675 | controller |
2025-11-27 09:44:20.003711 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2025-11-27 09:44:20.003719 | controller | Thursday 27 November 2025  09:44:19 +0000 (0:00:00.174)       0:01:28.005 *****
2025-11-27 09:44:20.003731 | controller |
2025-11-27 09:44:20.051484 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2025-11-27 09:44:20.051535 | controller | Thursday 27 November 2025  09:44:20 +0000 (0:00:00.065)       0:01:28.070 *****
2025-11-27 09:44:20.051552 | controller | ok: [instance] => changed=false
2025-11-27 09:44:20.051603 | controller |   msg: All assertions passed
2025-11-27 09:44:20.051613 | controller |
2025-11-27 09:44:20.051641 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2025-11-27 09:44:20.051772 | controller | Thursday 27 November 2025  09:44:20 +0000 (0:00:00.048)       0:01:28.118 *****
2025-11-27 09:44:20.255487 | controller | ok: [instance]
2025-11-27 09:44:20.255547 | controller |
2025-11-27 09:44:20.255558 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2025-11-27 09:44:20.255570 | controller | Thursday 27 November 2025  09:44:20 +0000 (0:00:00.203)       0:01:28.322 *****
2025-11-27 09:44:20.474455 | controller | ok: [instance]
2025-11-27 09:44:20.507496 | controller |
2025-11-27 09:44:20.507529 | controller | TASK [openshift_login : Assert files exist] ************************************
2025-11-27 09:44:20.507543 | controller | Thursday 27 November 2025  09:44:20 +0000 (0:00:00.218)       0:01:28.540 *****
2025-11-27 09:44:20.507559 | controller | ok: [instance] => changed=false
2025-11-27 09:44:20.507605 | controller |   msg: All assertions passed
2025-11-27 09:44:20.507619 | controller |
2025-11-27 09:44:20.507848 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2025-11-27 09:44:20.714777 | controller | Thursday 27 November 2025  09:44:20 +0000 (0:00:00.033)       0:01:28.574 *****
2025-11-27 09:44:20.714826 | controller | ok: [instance]
2025-11-27 09:44:20.901499 | controller |
2025-11-27 09:44:20.901559 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2025-11-27 09:44:20.901568 | controller | Thursday 27 November 2025  09:44:20 +0000 (0:00:00.206)       0:01:28.781 *****
2025-11-27 09:44:20.901582 | controller | ok: [instance]
2025-11-27 09:44:20.901620 | controller |
2025-11-27 09:44:20.901630 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2025-11-27 09:44:20.901715 | controller | Thursday 27 November 2025  09:44:20 +0000 (0:00:00.186)       0:01:28.968 *****
2025-11-27 09:44:20.954526 | controller | ok: [instance]
2025-11-27 09:44:20.954572 | controller |
2025-11-27 09:44:20.954583 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2025-11-27 09:44:20.954596 | controller | Thursday 27 November 2025  09:44:20 +0000 (0:00:00.052)       0:01:29.021 *****
2025-11-27 09:44:21.357454 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2025-11-27 09:44:21.357489 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2025-11-27 09:44:21.357497 | controller |
2025-11-27 09:44:21.357509 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2025-11-27 09:44:21.357517 | controller | Thursday 27 November 2025  09:44:21 +0000 (0:00:00.402)       0:01:29.424 *****
2025-11-27 09:44:21.379578 | controller | skipping: [instance]
2025-11-27 09:44:21.406479 | controller |
2025-11-27 09:44:21.406509 | controller | TASK [Load the architecture local kustomize patches] ***************************
2025-11-27 09:44:21.406521 | controller | Thursday 27 November 2025  09:44:21 +0000 (0:00:00.022)       0:01:29.446 *****
2025-11-27 09:44:21.406535 | controller | skipping: [instance]
2025-11-27 09:44:21.574048 | controller |
2025-11-27 09:44:21.574080 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2025-11-27 09:44:21.574090 | controller | Thursday 27 November 2025  09:44:21 +0000 (0:00:00.026)       0:01:29.473 *****
2025-11-27 09:44:21.574101 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2025-11-27 09:44:21.602477 | controller |
2025-11-27 09:44:21.602524 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2025-11-27 09:44:21.602534 | controller | Thursday 27 November 2025  09:44:21 +0000 (0:00:00.167)       0:01:29.640 *****
2025-11-27 09:44:21.602548 | controller | skipping: [instance]
2025-11-27 09:44:22.025916 | controller |
2025-11-27 09:44:22.025956 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2025-11-27 09:44:22.025966 | controller | Thursday 27 November 2025  09:44:21 +0000 (0:00:00.028)       0:01:29.669 *****
2025-11-27 09:44:22.025978 | controller | changed: [instance]
2025-11-27 09:44:22.532501 | controller |
2025-11-27 09:44:22.532546 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2025-11-27 09:44:22.532555 | controller | Thursday 27 November 2025  09:44:22 +0000 (0:00:00.423)       0:01:30.092 *****
2025-11-27 09:44:22.532569 | controller | changed: [instance]
2025-11-27 09:44:22.987512 | controller |
2025-11-27 09:44:22.987546 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2025-11-27 09:44:22.987554 | controller | Thursday 27 November 2025  09:44:22 +0000 (0:00:00.495)       0:01:30.587 *****
2025-11-27 09:44:22.987560 | controller |
2025-11-27 09:44:22.987565 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-11-27 09:44:22.987570 | controller | Thursday 27 November 2025  09:44:22 +0000 (0:00:00.010)       0:01:30.598 *****
2025-11-27 09:44:22.987579 | controller | changed: [instance]
2025-11-27 09:44:23.868897 | controller |
2025-11-27 09:44:23.868936 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2025-11-27 09:44:23.868944 | controller | Thursday 27 November 2025  09:44:22 +0000 (0:00:00.455)       0:01:31.053 *****
2025-11-27 09:44:23.868955 | controller | changed: [instance]
2025-11-27 09:44:23.869224 | controller |
2025-11-27 09:44:23.869259 | controller | TASK [Deploy virtualbmc] *******************************************************
2025-11-27 09:44:23.910859 | controller | Thursday 27 November 2025  09:44:23 +0000 (0:00:00.881)       0:01:31.935 *****
2025-11-27 09:44:23.910882 | controller | skipping: [instance]
2025-11-27 09:44:23.949219 | controller |
2025-11-27 09:44:23.949235 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2025-11-27 09:44:23.949242 | controller | Thursday 27 November 2025  09:44:23 +0000 (0:00:00.042)       0:01:31.977 *****
2025-11-27 09:44:23.949250 | controller | skipping: [instance]
2025-11-27 09:44:24.543497 | controller |
2025-11-27 09:44:24.543550 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2025-11-27 09:44:24.543560 | controller | Thursday 27 November 2025  09:44:23 +0000 (0:00:00.038)       0:01:32.015 *****
2025-11-27 09:44:24.543574 | controller | changed: [instance] => (item=workload)
2025-11-27 09:44:24.998088 | controller | changed: [instance] => (item=reproducer-inventory)
2025-11-27 09:44:24.998123 | controller | ok: [instance] => (item=volumes)
2025-11-27 09:44:24.998130 | controller |
2025-11-27 09:44:24.998136 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2025-11-27 09:44:24.998141 | controller | Thursday 27 November 2025  09:44:24 +0000 (0:00:00.593)       0:01:32.609 *****
2025-11-27 09:44:24.998151 | controller | changed: [instance] => (item=workload)
2025-11-27 09:44:25.027514 | controller | changed: [instance] => (item=volumes)
2025-11-27 09:44:25.027552 | controller |
2025-11-27 09:44:25.027561 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2025-11-27 09:44:25.027569 | controller | Thursday 27 November 2025  09:44:24 +0000 (0:00:00.454)       0:01:33.064 *****
2025-11-27 09:44:25.027581 | controller | skipping: [instance]
2025-11-27 09:44:25.027627 | controller |
2025-11-27 09:44:25.027647 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2025-11-27 09:44:25.027659 | controller | Thursday 27 November 2025  09:44:25 +0000 (0:00:00.030)       0:01:33.094 *****
2025-11-27 09:44:26.129162 | controller | changed: [instance] => (item=compute)
2025-11-27 09:44:26.529796 | controller | changed: [instance] => (item=controller)
2025-11-27 09:44:26.529831 | controller | changed: [instance] => (item=crc)
2025-11-27 09:44:26.529839 | controller |
2025-11-27 09:44:26.529845 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2025-11-27 09:44:26.529856 | controller | Thursday 27 November 2025  09:44:26 +0000 (0:00:01.100)       0:01:34.195 *****
2025-11-27 09:44:26.529866 | controller | changed: [instance]
2025-11-27 09:44:26.575007 | controller |
2025-11-27 09:44:26.575036 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2025-11-27 09:44:26.575044 | controller | Thursday 27 November 2025  09:44:26 +0000 (0:00:00.400)       0:01:34.596 *****
2025-11-27 09:44:26.575053 | controller | skipping: [instance]
2025-11-27 09:44:26.642531 | controller |
2025-11-27 09:44:26.642587 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2025-11-27 09:44:26.642602 | controller | Thursday 27 November 2025  09:44:26 +0000 (0:00:00.045)       0:01:34.641 *****
2025-11-27 09:44:26.642621 | controller | skipping: [instance] => (item=crc)
2025-11-27 09:44:26.876452 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2025-11-27 09:44:26.876495 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2025-11-27 09:44:26.876505 | controller |
2025-11-27 09:44:26.876514 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2025-11-27 09:44:26.876522 | controller | Thursday 27 November 2025  09:44:26 +0000 (0:00:00.067)       0:01:34.708 *****
2025-11-27 09:44:26.876534 | controller | changed: [instance]
2025-11-27 09:44:26.876567 | controller |
2025-11-27 09:44:26.876714 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2025-11-27 09:44:26.876749 | controller | Thursday 27 November 2025  09:44:26 +0000 (0:00:00.234)       0:01:34.943 *****
2025-11-27 09:44:27.080290 | controller | ok: [instance]
2025-11-27 09:44:49.004250 | controller |
2025-11-27 09:44:49.004289 | controller | TASK [libvirt_manager : Download base image] ***********************************
2025-11-27 09:44:49.004298 | controller | Thursday 27 November 2025  09:44:27 +0000 (0:00:00.203)       0:01:35.146 *****
2025-11-27 09:44:49.004309 | controller | changed: [instance]
2025-11-27 09:44:49.214873 | controller |
2025-11-27 09:44:49.214906 | controller | TASK [libvirt_manager : Check image] *******************************************
2025-11-27 09:44:49.214914 | controller | Thursday 27 November 2025  09:44:49 +0000 (0:00:21.923)       0:01:57.070 *****
2025-11-27 09:44:49.214924 | controller | ok: [instance]
2025-11-27 09:44:49.266480 | controller |
2025-11-27 09:44:49.266529 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2025-11-27 09:44:49.266555 | controller | Thursday 27 November 2025  09:44:49 +0000 (0:00:00.210)       0:01:57.281 *****
2025-11-27 09:44:49.266571 | controller | ok: [instance] => changed=false
2025-11-27 09:44:49.500782 | controller |   msg: All assertions passed
2025-11-27 09:44:49.500805 | controller |
2025-11-27 09:44:49.500813 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2025-11-27 09:44:49.500819 | controller | Thursday 27 November 2025  09:44:49 +0000 (0:00:00.051)       0:01:57.333 *****
2025-11-27 09:44:49.500828 | controller | changed: [instance]
2025-11-27 09:44:49.726934 | controller |
2025-11-27 09:44:49.726952 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2025-11-27 09:44:49.726959 | controller | Thursday 27 November 2025  09:44:49 +0000 (0:00:00.234)       0:01:57.567 *****
2025-11-27 09:44:49.726967 | controller | ok: [instance]
2025-11-27 09:44:49.935970 | controller |
2025-11-27 09:44:49.936000 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2025-11-27 09:44:49.936007 | controller | Thursday 27 November 2025  09:44:49 +0000 (0:00:00.226)       0:01:57.793 *****
2025-11-27 09:44:49.936018 | controller | ok: [instance]
2025-11-27 09:44:49.964246 | controller |
2025-11-27 09:44:49.964275 | controller | TASK [libvirt_manager : Download base image] ***********************************
2025-11-27 09:44:49.964289 | controller | Thursday 27 November 2025  09:44:49 +0000 (0:00:00.209)       0:01:58.002 *****
2025-11-27 09:44:49.964303 | controller | skipping: [instance]
2025-11-27 09:44:50.175481 | controller |
2025-11-27 09:44:50.175521 | controller | TASK [libvirt_manager : Check image] *******************************************
2025-11-27 09:44:50.175530 | controller | Thursday 27 November 2025  09:44:49 +0000 (0:00:00.028)       0:01:58.030 *****
2025-11-27 09:44:50.175542 | controller | ok: [instance]
2025-11-27 09:44:50.224073 | controller |
2025-11-27 09:44:50.224093 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2025-11-27 09:44:50.224100 | controller | Thursday 27 November 2025  09:44:50 +0000 (0:00:00.211)       0:01:58.242 *****
2025-11-27 09:44:50.224109 | controller | ok: [instance] => changed=false
2025-11-27 09:44:50.444032 | controller |   msg: All assertions passed
2025-11-27 09:44:50.444054 | controller |
2025-11-27 09:44:50.444062 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2025-11-27 09:44:50.444068 | controller | Thursday 27 November 2025  09:44:50 +0000 (0:00:00.048)       0:01:58.290 *****
2025-11-27 09:44:50.444077 | controller | ok: [instance]
2025-11-27 09:44:50.648286 | controller |
2025-11-27 09:44:50.648310 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2025-11-27 09:44:50.648319 | controller | Thursday 27 November 2025  09:44:50 +0000 (0:00:00.220)       0:01:58.510 *****
2025-11-27 09:44:50.648358 | controller | ok: [instance]
2025-11-27 09:44:51.089594 | controller |
2025-11-27 09:44:51.089668 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2025-11-27 09:44:51.089683 | controller | Thursday 27 November 2025  09:44:50 +0000 (0:00:00.203)       0:01:58.714 *****
2025-11-27 09:44:51.089705 | controller | changed: [instance]
2025-11-27 09:44:51.286474 | controller |
2025-11-27 09:44:51.286523 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2025-11-27 09:44:51.286533 | controller | Thursday 27 November 2025  09:44:51 +0000 (0:00:00.441)       0:01:59.156 *****
2025-11-27 09:44:51.286545 | controller | ok: [instance]
2025-11-27 09:44:51.286571 | controller |
2025-11-27 09:44:51.286579 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2025-11-27 09:44:51.286678 | controller | Thursday 27 November 2025  09:44:51 +0000 (0:00:00.197)       0:01:59.353 *****
2025-11-27 09:44:51.470256 | controller | ok: [instance]
2025-11-27 09:44:51.903813 | controller |
2025-11-27 09:44:51.903840 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2025-11-27 09:44:51.903850 | controller | Thursday 27 November 2025  09:44:51 +0000 (0:00:00.183)       0:01:59.536 *****
2025-11-27 09:44:51.903861 | controller | changed: [instance]
2025-11-27 09:44:51.928046 | controller |
2025-11-27 09:44:51.928062 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2025-11-27 09:44:51.928070 | controller | Thursday 27 November 2025  09:44:51 +0000 (0:00:00.433)       0:01:59.970 *****
2025-11-27 09:44:51.928083 | controller | ok: [instance]
2025-11-27 09:44:52.161530 | controller |
2025-11-27 09:44:52.161625 | controller | TASK [libvirt_manager : List existing networks] ********************************
2025-11-27 09:44:52.161641 | controller | Thursday 27 November 2025  09:44:51 +0000 (0:00:00.024)       0:01:59.994 *****
2025-11-27 09:44:52.161664 | controller | ok: [instance]
2025-11-27 09:44:52.667147 | controller |
2025-11-27 09:44:52.667201 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2025-11-27 09:44:52.667212 | controller | Thursday 27 November 2025  09:44:52 +0000 (0:00:00.232)       0:02:00.227 *****
2025-11-27 09:44:52.667227 | controller | ok: [instance]
2025-11-27 09:44:52.791124 | controller |
2025-11-27 09:44:52.791144 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2025-11-27 09:44:52.791152 | controller | Thursday 27 November 2025  09:44:52 +0000 (0:00:00.505)       0:02:00.733 *****
2025-11-27 09:44:52.791162 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-11-27 09:44:53.095487 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-11-27 09:44:53.095537 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-11-27 09:44:53.095547 | controller |
2025-11-27 09:44:53.095555 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2025-11-27 09:44:53.095563 | controller | Thursday 27 November 2025  09:44:52 +0000 (0:00:00.123)       0:02:00.857 *****
2025-11-27 09:44:53.095578 | controller | changed: [instance]
2025-11-27 09:44:53.334458 | controller |
2025-11-27 09:44:53.334504 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2025-11-27 09:44:53.334513 | controller | Thursday 27 November 2025  09:44:53 +0000 (0:00:00.304)       0:02:01.161 *****
2025-11-27 09:44:53.334525 | controller | changed: [instance]
2025-11-27 09:44:53.676463 | controller |
2025-11-27 09:44:53.676515 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2025-11-27 09:44:53.676523 | controller | Thursday 27 November 2025  09:44:53 +0000 (0:00:00.239)       0:02:01.401 *****
2025-11-27 09:44:53.676535 | controller | changed: [instance]
2025-11-27 09:44:53.707446 | controller |
2025-11-27 09:44:53.707469 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2025-11-27 09:44:53.707478 | controller | Thursday 27 November 2025  09:44:53 +0000 (0:00:00.341)       0:02:01.742 *****
2025-11-27 09:44:53.707490 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-11-27 09:44:53.707928 | controller |
2025-11-27 09:44:53.756473 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-11-27 09:44:53.756498 | controller | Thursday 27 November 2025  09:44:53 +0000 (0:00:00.031)       0:02:01.774 *****
2025-11-27 09:44:53.756511 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-11-27 09:44:53.756544 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-11-27 09:44:53.756551 | controller |
2025-11-27 09:44:53.756560 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 09:44:53.756644 | controller | Thursday 27 November 2025  09:44:53 +0000 (0:00:00.048)       0:02:01.823 *****
2025-11-27 09:44:54.002879 | controller | ok: [instance]
2025-11-27 09:44:54.054221 | controller |
2025-11-27 09:44:54.054242 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 09:44:54.054250 | controller | Thursday 27 November 2025  09:44:53 +0000 (0:00:00.246)       0:02:02.069 *****
2025-11-27 09:44:54.054258 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:44:54.289508 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 09:44:54.289555 | controller |
2025-11-27 09:44:54.289564 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 09:44:54.289578 | controller | Thursday 27 November 2025  09:44:54 +0000 (0:00:00.051)       0:02:02.120 *****
2025-11-27 09:44:54.289590 | controller | ok: [instance]
2025-11-27 09:44:54.289597 | controller |
2025-11-27 09:44:54.289605 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 09:44:54.496454 | controller | Thursday 27 November 2025  09:44:54 +0000 (0:00:00.235)       0:02:02.356 *****
2025-11-27 09:44:54.496480 | controller | ok: [instance]
2025-11-27 09:44:54.496514 | controller |
2025-11-27 09:44:54.496775 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2025-11-27 09:44:54.821472 | controller | Thursday 27 November 2025  09:44:54 +0000 (0:00:00.206)       0:02:02.563 *****
2025-11-27 09:44:54.821523 | controller | changed: [instance]
2025-11-27 09:44:54.821553 | controller |
2025-11-27 09:44:54.821564 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 09:44:54.821589 | controller | Thursday 27 November 2025  09:44:54 +0000 (0:00:00.324)       0:02:02.887 *****
2025-11-27 09:44:55.077140 | controller | ok: [instance]
2025-11-27 09:44:55.126143 | controller |
2025-11-27 09:44:55.126161 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 09:44:55.126168 | controller | Thursday 27 November 2025  09:44:55 +0000 (0:00:00.255)       0:02:03.143 *****
2025-11-27 09:44:55.126177 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:44:55.374746 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 09:44:55.374767 | controller |
2025-11-27 09:44:55.374774 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 09:44:55.374781 | controller | Thursday 27 November 2025  09:44:55 +0000 (0:00:00.049)       0:02:03.192 *****
2025-11-27 09:44:55.374790 | controller | ok: [instance]
2025-11-27 09:44:55.622071 | controller |
2025-11-27 09:44:55.622109 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 09:44:55.622117 | controller | Thursday 27 November 2025  09:44:55 +0000 (0:00:00.248)       0:02:03.441 *****
2025-11-27 09:44:55.622128 | controller | ok: [instance]
2025-11-27 09:44:55.939885 | controller |
2025-11-27 09:44:55.939921 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2025-11-27 09:44:55.939929 | controller | Thursday 27 November 2025  09:44:55 +0000 (0:00:00.246)       0:02:03.688 *****
2025-11-27 09:44:55.939940 | controller | changed: [instance]
2025-11-27 09:44:55.969043 | controller |
2025-11-27 09:44:55.969064 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2025-11-27 09:44:55.969072 | controller | Thursday 27 November 2025  09:44:55 +0000 (0:00:00.317)       0:02:04.006 *****
2025-11-27 09:44:55.969082 | controller | skipping: [instance]
2025-11-27 09:44:56.005155 | controller |
2025-11-27 09:44:56.005175 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2025-11-27 09:44:56.005183 | controller | Thursday 27 November 2025  09:44:55 +0000 (0:00:00.029)       0:02:04.035 *****
2025-11-27 09:44:56.005194 | controller | skipping: [instance]
2025-11-27 09:44:56.039548 | controller |
2025-11-27 09:44:56.039606 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2025-11-27 09:44:56.039621 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.036)       0:02:04.071 *****
2025-11-27 09:44:56.039639 | controller | skipping: [instance]
2025-11-27 09:44:56.039685 | controller |
2025-11-27 09:44:56.039700 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2025-11-27 09:44:56.072996 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.034)       0:02:04.106 *****
2025-11-27 09:44:56.073022 | controller | skipping: [instance]
2025-11-27 09:44:56.310523 | controller |
2025-11-27 09:44:56.310564 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-11-27 09:44:56.310578 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.033)       0:02:04.139 *****
2025-11-27 09:44:56.310593 | controller | changed: [instance]
2025-11-27 09:44:56.310639 | controller |
2025-11-27 09:44:56.310653 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-11-27 09:44:56.310701 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.237)       0:02:04.377 *****
2025-11-27 09:44:56.352220 | controller | ok: [instance]
2025-11-27 09:44:56.410354 | controller |
2025-11-27 09:44:56.410387 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-11-27 09:44:56.410397 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.041)       0:02:04.419 *****
2025-11-27 09:44:56.410408 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2025-11-27 09:44:56.620424 | controller |
2025-11-27 09:44:56.620452 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2025-11-27 09:44:56.620461 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.057)       0:02:04.477 *****
2025-11-27 09:44:56.620477 | controller | ok: [instance]
2025-11-27 09:44:56.620484 | controller |
2025-11-27 09:44:56.620490 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2025-11-27 09:44:56.620499 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.210)       0:02:04.687 *****
2025-11-27 09:44:56.688909 | controller | ok: [instance]
2025-11-27 09:44:56.741558 | controller |
2025-11-27 09:44:56.741618 | controller | TASK [libvirt_manager : Define the user data] **********************************
2025-11-27 09:44:56.741629 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.068)       0:02:04.755 *****
2025-11-27 09:44:56.741645 | controller | ok: [instance]
2025-11-27 09:44:56.791493 | controller |
2025-11-27 09:44:56.791536 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2025-11-27 09:44:56.791547 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.052)       0:02:04.808 *****
2025-11-27 09:44:56.791560 | controller | skipping: [instance]
2025-11-27 09:44:56.791595 | controller |
2025-11-27 09:44:56.791606 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2025-11-27 09:44:56.791635 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.050)       0:02:04.858 *****
2025-11-27 09:44:56.838439 | controller | skipping: [instance]
2025-11-27 09:44:56.838955 | controller |
2025-11-27 09:44:56.908916 | controller | TASK [Call the config_drive role] **********************************************
2025-11-27 09:44:56.908961 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.047)       0:02:04.905 *****
2025-11-27 09:44:56.908981 | controller |
2025-11-27 09:44:57.347510 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2025-11-27 09:44:57.347559 | controller | Thursday 27 November 2025  09:44:56 +0000 (0:00:00.070)       0:02:04.975 *****
2025-11-27 09:44:57.347574 | controller | ok: [instance] => (item=artifacts)
2025-11-27 09:44:58.602706 | controller | ok: [instance] => (item=logs)
2025-11-27 09:44:58.602743 | controller |
2025-11-27 09:44:58.602751 | controller | TASK [config_drive : Install required RPM packages] ****************************
2025-11-27 09:44:58.602757 | controller | Thursday 27 November 2025  09:44:57 +0000 (0:00:00.437)       0:02:05.413 *****
2025-11-27 09:44:58.602767 | controller | ok: [instance]
2025-11-27 09:44:58.831292 | controller |
2025-11-27 09:44:58.831318 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2025-11-27 09:44:58.831326 | controller | Thursday 27 November 2025  09:44:58 +0000 (0:00:01.255)       0:02:06.669 *****
2025-11-27 09:44:58.831350 | controller | changed: [instance]
2025-11-27 09:44:59.205207 | controller |
2025-11-27 09:44:59.205232 | controller | TASK [config_drive : Generate meta-data] ***************************************
2025-11-27 09:44:59.205240 | controller | Thursday 27 November 2025  09:44:58 +0000 (0:00:00.228)       0:02:06.898 *****
2025-11-27 09:44:59.205251 | controller | changed: [instance]
2025-11-27 09:44:59.644876 | controller |
2025-11-27 09:44:59.644899 | controller | TASK [config_drive : Generate user-data] ***************************************
2025-11-27 09:44:59.644906 | controller | Thursday 27 November 2025  09:44:59 +0000 (0:00:00.373)       0:02:07.271 *****
2025-11-27 09:44:59.644915 | controller | changed: [instance]
2025-11-27 09:44:59.693244 | controller |
2025-11-27 09:44:59.693268 | controller | TASK [config_drive : Generate network-data] ************************************
2025-11-27 09:44:59.693278 | controller | Thursday 27 November 2025  09:44:59 +0000 (0:00:00.439)       0:02:07.711 *****
2025-11-27 09:44:59.693295 | controller | skipping: [instance]
2025-11-27 09:44:59.918075 | controller |
2025-11-27 09:44:59.918100 | controller | TASK [config_drive : Check ISO availability] ***********************************
2025-11-27 09:44:59.918108 | controller | Thursday 27 November 2025  09:44:59 +0000 (0:00:00.048)       0:02:07.759 *****
2025-11-27 09:44:59.918117 | controller | ok: [instance]
2025-11-27 09:45:00.011028 | controller |
2025-11-27 09:45:00.011048 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2025-11-27 09:45:00.011056 | controller | Thursday 27 November 2025  09:44:59 +0000 (0:00:00.224)       0:02:07.984 *****
2025-11-27 09:45:00.011067 | controller | skipping: [instance]
2025-11-27 09:45:00.338175 | controller |
2025-11-27 09:45:00.338195 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2025-11-27 09:45:00.338202 | controller | Thursday 27 November 2025  09:45:00 +0000 (0:00:00.093)       0:02:08.077 *****
2025-11-27 09:45:00.338211 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2025-11-27 09:45:00.634364 | controller | changed: [instance]
2025-11-27 09:45:00.634406 | controller |
2025-11-27 09:45:00.634415 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-11-27 09:45:00.634422 | controller | Thursday 27 November 2025  09:45:00 +0000 (0:00:00.326)       0:02:08.404 *****
2025-11-27 09:45:00.634436 | controller | changed: [instance]
2025-11-27 09:45:00.692310 | controller |
2025-11-27 09:45:00.692383 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-11-27 09:45:00.692402 | controller | Thursday 27 November 2025  09:45:00 +0000 (0:00:00.296)       0:02:08.700 *****
2025-11-27 09:45:00.692417 | controller | skipping: [instance]
2025-11-27 09:45:00.727352 | controller |
2025-11-27 09:45:00.727378 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ********************
2025-11-27 09:45:00.727386 | controller | Thursday 27 November 2025  09:45:00 +0000 (0:00:00.057)       0:02:08.758 *****
2025-11-27 09:45:00.727394 | controller | skipping: [instance]
2025-11-27 09:45:00.996502 | controller |
2025-11-27 09:45:00.996554 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2025-11-27 09:45:00.996563 | controller | Thursday 27 November 2025  09:45:00 +0000 (0:00:00.035)       0:02:08.794 *****
2025-11-27 09:45:00.996575 | controller | changed: [instance]
2025-11-27 09:45:00.996597 | controller |
2025-11-27 09:45:00.996714 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2025-11-27 09:45:00.996743 | controller | Thursday 27 November 2025  09:45:00 +0000 (0:00:00.269)       0:02:09.063 *****
2025-11-27 09:45:01.236500 | controller | changed: [instance]
2025-11-27 09:45:01.548064 | controller |
2025-11-27 09:45:01.548112 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2025-11-27 09:45:01.548121 | controller | Thursday 27 November 2025  09:45:01 +0000 (0:00:00.239)       0:02:09.302 *****
2025-11-27 09:45:01.548133 | controller | changed: [instance]
2025-11-27 09:45:01.586972 | controller |
2025-11-27 09:45:01.586998 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2025-11-27 09:45:01.587007 | controller | Thursday 27 November 2025  09:45:01 +0000 (0:00:00.311)       0:02:09.614 *****
2025-11-27 09:45:01.587025 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-11-27 09:45:01.644546 | controller |
2025-11-27 09:45:01.644593 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-11-27 09:45:01.644604 | controller | Thursday 27 November 2025  09:45:01 +0000 (0:00:00.038)       0:02:09.653 *****
2025-11-27 09:45:01.644618 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-11-27 09:45:01.903520 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-11-27 09:45:01.903586 | controller |
2025-11-27 09:45:01.903597 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 09:45:01.903607 | controller | Thursday 27 November 2025  09:45:01 +0000 (0:00:00.057)       0:02:09.711 *****
2025-11-27 09:45:01.903630 | controller | ok: [instance]
2025-11-27 09:45:01.903654 | controller |
2025-11-27 09:45:01.903665 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 09:45:01.960677 | controller | Thursday 27 November 2025  09:45:01 +0000 (0:00:00.259)       0:02:09.970 *****
2025-11-27 09:45:01.960700 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:45:01.960791 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 09:45:01.960891 | controller |
2025-11-27 09:45:01.960994 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 09:45:01.961130 | controller | Thursday 27 November 2025  09:45:01 +0000 (0:00:00.057)       0:02:10.027 *****
2025-11-27 09:45:02.221851 | controller | ok: [instance]
2025-11-27 09:45:02.436733 | controller |
2025-11-27 09:45:02.436766 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 09:45:02.436774 | controller | Thursday 27 November 2025  09:45:02 +0000 (0:00:00.260)       0:02:10.288 *****
2025-11-27 09:45:02.436784 | controller | ok: [instance]
2025-11-27 09:45:02.739477 | controller |
2025-11-27 09:45:02.739523 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2025-11-27 09:45:02.739534 | controller | Thursday 27 November 2025  09:45:02 +0000 (0:00:00.215)       0:02:10.503 *****
2025-11-27 09:45:02.739550 | controller | changed: [instance]
2025-11-27 09:45:02.996300 | controller |
2025-11-27 09:45:02.996327 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 09:45:02.996347 | controller | Thursday 27 November 2025  09:45:02 +0000 (0:00:00.302)       0:02:10.805 *****
2025-11-27 09:45:02.996360 | controller | ok: [instance]
2025-11-27 09:45:03.050978 | controller |
2025-11-27 09:45:03.050992 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 09:45:03.050998 | controller | Thursday 27 November 2025  09:45:02 +0000 (0:00:00.257)       0:02:11.062 *****
2025-11-27 09:45:03.051007 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:45:03.300059 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 09:45:03.300101 | controller |
2025-11-27 09:45:03.300111 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 09:45:03.300119 | controller | Thursday 27 November 2025  09:45:03 +0000 (0:00:00.054)       0:02:11.117 *****
2025-11-27 09:45:03.300132 | controller | ok: [instance]
2025-11-27 09:45:03.513222 | controller |
2025-11-27 09:45:03.513267 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 09:45:03.513277 | controller | Thursday 27 November 2025  09:45:03 +0000 (0:00:00.248)       0:02:11.366 *****
2025-11-27 09:45:03.513296 | controller | ok: [instance]
2025-11-27 09:45:03.513320 | controller |
2025-11-27 09:45:03.513518 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2025-11-27 09:45:03.513560 | controller | Thursday 27 November 2025  09:45:03 +0000 (0:00:00.213)       0:02:11.580 *****
2025-11-27 09:45:03.816319 | controller | changed: [instance]
2025-11-27 09:45:03.843589 | controller |
2025-11-27 09:45:03.843657 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2025-11-27 09:45:03.843672 | controller | Thursday 27 November 2025  09:45:03 +0000 (0:00:00.302)       0:02:11.882 *****
2025-11-27 09:45:03.843693 | controller | skipping: [instance]
2025-11-27 09:45:03.876280 | controller |
2025-11-27 09:45:03.876318 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2025-11-27 09:45:03.876329 | controller | Thursday 27 November 2025  09:45:03 +0000 (0:00:00.027)       0:02:11.910 *****
2025-11-27 09:45:03.876365 | controller | skipping: [instance]
2025-11-27 09:45:03.909774 | controller |
2025-11-27 09:45:03.909806 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2025-11-27 09:45:03.909816 | controller | Thursday 27 November 2025  09:45:03 +0000 (0:00:00.032)       0:02:11.943 *****
2025-11-27 09:45:03.909828 | controller | skipping: [instance]
2025-11-27 09:45:03.910747 | controller |
2025-11-27 09:45:03.946401 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2025-11-27 09:45:03.946426 | controller | Thursday 27 November 2025  09:45:03 +0000 (0:00:00.032)       0:02:11.975 *****
2025-11-27 09:45:03.946445 | controller | skipping: [instance]
2025-11-27 09:45:04.187514 | controller |
2025-11-27 09:45:04.187567 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-11-27 09:45:04.187576 | controller | Thursday 27 November 2025  09:45:03 +0000 (0:00:00.037)       0:02:12.012 *****
2025-11-27 09:45:04.187589 | controller | changed: [instance]
2025-11-27 09:45:04.187628 | controller |
2025-11-27 09:45:04.187834 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-11-27 09:45:04.187890 | controller | Thursday 27 November 2025  09:45:04 +0000 (0:00:00.241)       0:02:12.254 *****
2025-11-27 09:45:04.238510 | controller | ok: [instance]
2025-11-27 09:45:04.238576 | controller |
2025-11-27 09:45:04.238871 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-11-27 09:45:04.299511 | controller | Thursday 27 November 2025  09:45:04 +0000 (0:00:00.051)       0:02:12.305 *****
2025-11-27 09:45:04.299551 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2025-11-27 09:45:04.299716 | controller |
2025-11-27 09:45:04.299735 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2025-11-27 09:45:04.523361 | controller | Thursday 27 November 2025  09:45:04 +0000 (0:00:00.061)       0:02:12.366 *****
2025-11-27 09:45:04.523413 | controller | ok: [instance]
2025-11-27 09:45:04.590982 | controller |
2025-11-27 09:45:04.591004 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2025-11-27 09:45:04.591012 | controller | Thursday 27 November 2025  09:45:04 +0000 (0:00:00.223)       0:02:12.589 *****
2025-11-27 09:45:04.591021 | controller | ok: [instance]
2025-11-27 09:45:04.643996 | controller |
2025-11-27 09:45:04.644025 | controller | TASK [libvirt_manager : Define the user data] **********************************
2025-11-27 09:45:04.644033 | controller | Thursday 27 November 2025  09:45:04 +0000 (0:00:00.068)       0:02:12.657 *****
2025-11-27 09:45:04.644043 | controller | ok: [instance]
2025-11-27 09:45:04.699255 | controller |
2025-11-27 09:45:04.699280 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2025-11-27 09:45:04.699288 | controller | Thursday 27 November 2025  09:45:04 +0000 (0:00:00.052)       0:02:12.710 *****
2025-11-27 09:45:04.699299 | controller | skipping: [instance]
2025-11-27 09:45:04.753412 | controller |
2025-11-27 09:45:04.753438 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2025-11-27 09:45:04.753446 | controller | Thursday 27 November 2025  09:45:04 +0000 (0:00:00.055)       0:02:12.766 *****
2025-11-27 09:45:04.753456 | controller | skipping: [instance]
2025-11-27 09:45:04.819144 | controller |
2025-11-27 09:45:04.819170 | controller | TASK [Call the config_drive role] **********************************************
2025-11-27 09:45:04.819179 | controller | Thursday 27 November 2025  09:45:04 +0000 (0:00:00.053)       0:02:12.820 *****
2025-11-27 09:45:04.819190 | controller |
2025-11-27 09:45:05.241506 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2025-11-27 09:45:05.241543 | controller | Thursday 27 November 2025  09:45:04 +0000 (0:00:00.065)       0:02:12.886 *****
2025-11-27 09:45:05.241563 | controller | ok: [instance] => (item=artifacts)
2025-11-27 09:45:05.241594 | controller | ok: [instance] => (item=logs)
2025-11-27 09:45:05.241617 | controller |
2025-11-27 09:45:05.241885 | controller | TASK [config_drive : Install required RPM packages] ****************************
2025-11-27 09:45:06.496455 | controller | Thursday 27 November 2025  09:45:05 +0000 (0:00:00.422)       0:02:13.308 *****
2025-11-27 09:45:06.496495 | controller | ok: [instance]
2025-11-27 09:45:06.729142 | controller |
2025-11-27 09:45:06.729171 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2025-11-27 09:45:06.729181 | controller | Thursday 27 November 2025  09:45:06 +0000 (0:00:01.254)       0:02:14.562 *****
2025-11-27 09:45:06.729192 | controller | changed: [instance]
2025-11-27 09:45:07.114146 | controller |
2025-11-27 09:45:07.114175 | controller | TASK [config_drive : Generate meta-data] ***************************************
2025-11-27 09:45:07.114184 | controller | Thursday 27 November 2025  09:45:06 +0000 (0:00:00.232)       0:02:14.795 *****
2025-11-27 09:45:07.114193 | controller | changed: [instance]
2025-11-27 09:45:07.520073 | controller |
2025-11-27 09:45:07.520113 | controller | TASK [config_drive : Generate user-data] ***************************************
2025-11-27 09:45:07.520137 | controller | Thursday 27 November 2025  09:45:07 +0000 (0:00:00.385)       0:02:15.180 *****
2025-11-27 09:45:07.520153 | controller | changed: [instance]
2025-11-27 09:45:07.567407 | controller |
2025-11-27 09:45:07.567432 | controller | TASK [config_drive : Generate network-data] ************************************
2025-11-27 09:45:07.567440 | controller | Thursday 27 November 2025  09:45:07 +0000 (0:00:00.405)       0:02:15.586 *****
2025-11-27 09:45:07.567451 | controller | skipping: [instance]
2025-11-27 09:45:07.567757 | controller |
2025-11-27 09:45:07.781562 | controller | TASK [config_drive : Check ISO availability] ***********************************
2025-11-27 09:45:07.781620 | controller | Thursday 27 November 2025  09:45:07 +0000 (0:00:00.047)       0:02:15.634 *****
2025-11-27 09:45:07.781638 | controller | ok: [instance]
2025-11-27 09:45:07.832121 | controller |
2025-11-27 09:45:07.832151 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2025-11-27 09:45:07.832160 | controller | Thursday 27 November 2025  09:45:07 +0000 (0:00:00.213)       0:02:15.848 *****
2025-11-27 09:45:07.832171 | controller | skipping: [instance]
2025-11-27 09:45:08.111445 | controller |
2025-11-27 09:45:08.111483 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2025-11-27 09:45:08.111492 | controller | Thursday 27 November 2025  09:45:07 +0000 (0:00:00.050)       0:02:15.898 *****
2025-11-27 09:45:08.111502 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2025-11-27 09:45:08.111876 | controller | changed: [instance]
2025-11-27 09:45:08.415412 | controller |
2025-11-27 09:45:08.415449 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-11-27 09:45:08.415458 | controller | Thursday 27 November 2025  09:45:08 +0000 (0:00:00.278)       0:02:16.177 *****
2025-11-27 09:45:08.415468 | controller | changed: [instance]
2025-11-27 09:45:08.469169 | controller |
2025-11-27 09:45:08.469192 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-11-27 09:45:08.469200 | controller | Thursday 27 November 2025  09:45:08 +0000 (0:00:00.304)       0:02:16.481 *****
2025-11-27 09:45:08.469209 | controller | skipping: [instance]
2025-11-27 09:45:08.507203 | controller |
2025-11-27 09:45:08.507224 | controller | TASK [libvirt_manager : Configure boot order for controller-0] *****************
2025-11-27 09:45:08.507233 | controller | Thursday 27 November 2025  09:45:08 +0000 (0:00:00.054)       0:02:16.535 *****
2025-11-27 09:45:08.507244 | controller | skipping: [instance]
2025-11-27 09:45:08.784773 | controller |
2025-11-27 09:45:08.784806 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2025-11-27 09:45:08.784814 | controller | Thursday 27 November 2025  09:45:08 +0000 (0:00:00.038)       0:02:16.574 *****
2025-11-27 09:45:08.784825 | controller | changed: [instance]
2025-11-27 09:45:09.032972 | controller |
2025-11-27 09:45:09.033009 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2025-11-27 09:45:09.033018 | controller | Thursday 27 November 2025  09:45:08 +0000 (0:00:00.277)       0:02:16.851 *****
2025-11-27 09:45:09.033028 | controller | changed: [instance]
2025-11-27 09:45:09.415491 | controller |
2025-11-27 09:45:09.415538 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2025-11-27 09:45:09.415550 | controller | Thursday 27 November 2025  09:45:09 +0000 (0:00:00.248)       0:02:17.099 *****
2025-11-27 09:45:09.415564 | controller | changed: [instance]
2025-11-27 09:45:09.415762 | controller |
2025-11-27 09:45:09.415798 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2025-11-27 09:45:09.453281 | controller | Thursday 27 November 2025  09:45:09 +0000 (0:00:00.382)       0:02:17.482 *****
2025-11-27 09:45:09.453316 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-11-27 09:45:09.507156 | controller |
2025-11-27 09:45:09.507174 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-11-27 09:45:09.507182 | controller | Thursday 27 November 2025  09:45:09 +0000 (0:00:00.038)       0:02:17.520 *****
2025-11-27 09:45:09.507191 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-11-27 09:45:09.781157 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-11-27 09:45:09.781179 | controller |
2025-11-27 09:45:09.781187 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 09:45:09.781193 | controller | Thursday 27 November 2025  09:45:09 +0000 (0:00:00.053)       0:02:17.573 *****
2025-11-27 09:45:09.781202 | controller | ok: [instance]
2025-11-27 09:45:09.838245 | controller |
2025-11-27 09:45:09.838262 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 09:45:09.838270 | controller | Thursday 27 November 2025  09:45:09 +0000 (0:00:00.273)       0:02:17.847 *****
2025-11-27 09:45:09.838280 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:45:10.097130 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 09:45:10.097148 | controller |
2025-11-27 09:45:10.097155 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 09:45:10.097161 | controller | Thursday 27 November 2025  09:45:09 +0000 (0:00:00.057)       0:02:17.904 *****
2025-11-27 09:45:10.097169 | controller | ok: [instance]
2025-11-27 09:45:10.324244 | controller |
2025-11-27 09:45:10.324264 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 09:45:10.324272 | controller | Thursday 27 November 2025  09:45:10 +0000 (0:00:00.258)       0:02:18.163 *****
2025-11-27 09:45:10.324281 | controller | ok: [instance]
2025-11-27 09:45:10.638914 | controller |
2025-11-27 09:45:10.638938 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2025-11-27 09:45:10.638947 | controller | Thursday 27 November 2025  09:45:10 +0000 (0:00:00.226)       0:02:18.390 *****
2025-11-27 09:45:10.638958 | controller | changed: [instance]
2025-11-27 09:45:10.904084 | controller |
2025-11-27 09:45:10.904104 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 09:45:10.904111 | controller | Thursday 27 November 2025  09:45:10 +0000 (0:00:00.314)       0:02:18.705 *****
2025-11-27 09:45:10.904119 | controller | ok: [instance]
2025-11-27 09:45:10.962466 | controller |
2025-11-27 09:45:10.962492 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 09:45:10.962502 | controller | Thursday 27 November 2025  09:45:10 +0000 (0:00:00.265)       0:02:18.970 *****
2025-11-27 09:45:10.962514 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 09:45:10.962522 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 09:45:10.962529 | controller |
2025-11-27 09:45:10.962536 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 09:45:10.962545 | controller | Thursday 27 November 2025  09:45:10 +0000 (0:00:00.057)       0:02:19.028 *****
2025-11-27 09:45:11.215097 | controller | ok: [instance]
2025-11-27 09:45:11.433072 | controller |
2025-11-27 09:45:11.433099 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 09:45:11.433110 | controller | Thursday 27 November 2025  09:45:11 +0000 (0:00:00.252)       0:02:19.281 *****
2025-11-27 09:45:11.433122 | controller | ok: [instance]
2025-11-27 09:45:11.726434 | controller |
2025-11-27 09:45:11.726472 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2025-11-27 09:45:11.726481 | controller | Thursday 27 November 2025  09:45:11 +0000 (0:00:00.218)       0:02:19.499 *****
2025-11-27 09:45:11.726491 | controller | changed: [instance]
2025-11-27 09:45:11.726517 | controller |
2025-11-27 09:45:11.726895 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2025-11-27 09:45:11.755534 | controller | Thursday 27 November 2025  09:45:11 +0000 (0:00:00.293)       0:02:19.793 *****
2025-11-27 09:45:11.755601 | controller | skipping: [instance]
2025-11-27 09:45:11.791526 | controller |
2025-11-27 09:45:11.791552 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2025-11-27 09:45:11.791561 | controller | Thursday 27 November 2025  09:45:11 +0000 (0:00:00.028)       0:02:19.821 *****
2025-11-27 09:45:11.791572 | controller | skipping: [instance]
2025-11-27 09:45:11.791610 | controller |
2025-11-27 09:45:11.791617 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2025-11-27 09:45:11.791636 | controller | Thursday 27 November 2025  09:45:11 +0000 (0:00:00.036)       0:02:19.858 *****
2025-11-27 09:45:11.826781 | controller | skipping: [instance]
2025-11-27 09:45:11.827001 | controller |
2025-11-27 09:45:11.827221 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2025-11-27 09:45:11.827484 | controller | Thursday 27 November 2025  09:45:11 +0000 (0:00:00.035)       0:02:19.893 *****
2025-11-27 09:45:11.860652 | controller | skipping: [instance]
2025-11-27 09:45:11.860819 | controller |
2025-11-27 09:45:11.860932 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-11-27 09:45:11.861048 | controller | Thursday 27 November 2025  09:45:11 +0000 (0:00:00.033)       0:02:19.927 *****
2025-11-27 09:45:12.102301 | controller | changed: [instance]
2025-11-27 09:45:12.102600 | controller |
2025-11-27 09:45:12.102886 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-11-27 09:45:12.103057 | controller | Thursday 27 November 2025  09:45:12 +0000 (0:00:00.241)       0:02:20.169 *****
2025-11-27 09:45:12.142072 | controller | ok: [instance]
2025-11-27 09:45:12.142308 | controller |
2025-11-27 09:45:12.142449 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-11-27 09:45:12.142566 | controller | Thursday 27 November 2025  09:45:12 +0000 (0:00:00.039)       0:02:20.209 *****
2025-11-27 09:45:12.172490 | controller | skipping: [instance]
2025-11-27 09:45:12.172608 | controller |
2025-11-27 09:45:12.172748 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-11-27 09:45:12.172879 | controller | Thursday 27 November 2025  09:45:12 +0000 (0:00:00.030)       0:02:20.239 *****
2025-11-27 09:45:12.207627 | controller | skipping: [instance]
2025-11-27 09:45:12.207859 | controller |
2025-11-27 09:45:12.208085 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-11-27 09:45:12.208297 | controller | Thursday 27 November 2025  09:45:12 +0000 (0:00:00.035)       0:02:20.274 *****
2025-11-27 09:45:12.256783 | controller | skipping: [instance]
2025-11-27 09:45:12.257020 | controller |
2025-11-27 09:45:12.257242 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************
2025-11-27 09:45:12.257464 | controller | Thursday 27 November 2025  09:45:12 +0000 (0:00:00.049)       0:02:20.323 *****
2025-11-27 09:45:12.285025 | controller | skipping: [instance]
2025-11-27 09:45:12.285266 | controller |
2025-11-27 09:45:12.285547 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2025-11-27 09:45:12.285667 | controller | Thursday 27 November 2025  09:45:12 +0000 (0:00:00.028)       0:02:20.351 *****
2025-11-27 09:45:12.347851 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2025-11-27 09:45:12.348089 | controller |
2025-11-27 09:45:12.348329 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2025-11-27 09:45:12.348557 | controller | Thursday 27 November 2025  09:45:12 +0000 (0:00:00.062)       0:02:20.414 *****
2025-11-27 09:45:12.609354 | controller | ok: [instance] => (item=crc)
2025-11-27 09:45:14.688554 | controller |
2025-11-27 09:45:14.688605 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2025-11-27 09:45:14.688615 | controller | Thursday 27 November 2025  09:45:12 +0000 (0:00:00.260)       0:02:20.675 *****
2025-11-27 09:45:14.688629 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-11-27 09:45:14.688660 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-11-27 09:45:14.688670 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-11-27 09:45:14.689037 | controller |
2025-11-27 09:45:15.311400 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-11-27 09:45:15.311442 | controller | Thursday 27 November 2025  09:45:14 +0000 (0:00:02.079)       0:02:22.755 *****
2025-11-27 09:45:15.311460 | controller | changed: [instance]
2025-11-27 09:45:15.858998 | controller |
2025-11-27 09:45:15.859036 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-11-27 09:45:15.859044 | controller | Thursday 27 November 2025  09:45:15 +0000 (0:00:00.622)       0:02:23.377 *****
2025-11-27 09:45:15.859054 | controller | changed: [instance]
2025-11-27 09:45:16.421173 | controller |
2025-11-27 09:45:16.421215 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-11-27 09:45:16.421223 | controller | Thursday 27 November 2025  09:45:15 +0000 (0:00:00.547)       0:02:23.925 *****
2025-11-27 09:45:16.421234 | controller | changed: [instance]
2025-11-27 09:45:17.189900 | controller |
2025-11-27 09:45:17.189937 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2025-11-27 09:45:17.189946 | controller | Thursday 27 November 2025  09:45:16 +0000 (0:00:00.561)       0:02:24.487 *****
2025-11-27 09:45:17.189956 | controller | changed: [instance] => (item=compute-0.utility)
2025-11-27 09:45:40.265056 | controller | changed: [instance] => (item=controller-0.utility)
2025-11-27 09:45:40.265130 | controller | changed: [instance] => (item=crc-0.utility)
2025-11-27 09:45:40.265139 | controller |
2025-11-27 09:45:40.265145 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2025-11-27 09:45:40.265151 | controller | Thursday 27 November 2025  09:45:17 +0000 (0:00:00.764)       0:02:25.251 *****
2025-11-27 09:45:40.265168 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2025-11-27 09:45:40.383230 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2025-11-27 09:45:40.383259 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2025-11-27 09:45:40.383267 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2025-11-27 09:45:40.383272 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2025-11-27 09:45:40.383277 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left).
2025-11-27 09:45:40.383283 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j651439009898.21354', 'results_file': '/home/zuul/.ansible_async/j651439009898.21354', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2025-11-27 09:45:40.383296 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j788928934275.21371', 'results_file': '/home/zuul/.ansible_async/j788928934275.21371', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2025-11-27 09:45:40.383302 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2025-11-27 09:45:40.383307 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j877827931351.21387', 'results_file': '/home/zuul/.ansible_async/j877827931351.21387', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2025-11-27 09:45:40.383312 | controller |
2025-11-27 09:45:40.383318 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2025-11-27 09:45:40.383323 | controller | Thursday 27 November 2025  09:45:40 +0000 (0:00:23.077)       0:02:48.329 *****
2025-11-27 09:45:40.383354 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-11-27 09:45:40.407450 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-11-27 09:45:40.407472 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-11-27 09:45:40.407480 | controller |
2025-11-27 09:45:40.407486 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-11-27 09:45:40.407491 | controller | Thursday 27 November 2025  09:45:40 +0000 (0:00:00.120)       0:02:48.449 *****
2025-11-27 09:45:40.407519 | controller | skipping: [instance]
2025-11-27 09:45:40.449153 | controller |
2025-11-27 09:45:40.449171 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2025-11-27 09:45:40.449178 | controller | Thursday 27 November 2025  09:45:40 +0000 (0:00:00.024)       0:02:48.474 *****
2025-11-27 09:45:40.449187 | controller |
2025-11-27 09:45:40.529619 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-11-27 09:45:40.529638 | controller | Thursday 27 November 2025  09:45:40 +0000 (0:00:00.041)       0:02:48.516 *****
2025-11-27 09:45:40.529652 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2025-11-27 09:45:40.794435 | controller |
2025-11-27 09:45:40.794491 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-11-27 09:45:40.794500 | controller | Thursday 27 November 2025  09:45:40 +0000 (0:00:00.080)       0:02:48.596 *****
2025-11-27 09:45:40.794512 | controller | changed: [instance]
2025-11-27 09:45:41.026254 | controller |
2025-11-27 09:45:41.026308 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-11-27 09:45:41.026318 | controller | Thursday 27 November 2025  09:45:40 +0000 (0:00:00.263)       0:02:48.860 *****
2025-11-27 09:45:41.026330 | controller | changed: [instance]
2025-11-27 09:45:41.026368 | controller |
2025-11-27 09:45:41.026379 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2025-11-27 09:45:41.026517 | controller | Thursday 27 November 2025  09:45:41 +0000 (0:00:00.232)       0:02:49.092 *****
2025-11-27 09:45:41.422176 | controller | changed: [instance]
2025-11-27 09:45:41.451461 | controller |
2025-11-27 09:45:41.451483 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2025-11-27 09:45:41.451490 | controller | Thursday 27 November 2025  09:45:41 +0000 (0:00:00.395)       0:02:49.488 *****
2025-11-27 09:45:41.451499 | controller | skipping: [instance]
2025-11-27 09:45:41.483251 | controller |
2025-11-27 09:45:41.483269 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-11-27 09:45:41.483276 | controller | Thursday 27 November 2025  09:45:41 +0000 (0:00:00.029)       0:02:49.518 *****
2025-11-27 09:45:41.483284 | controller | skipping: [instance]
2025-11-27 09:45:41.539213 | controller |
2025-11-27 09:45:41.539231 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2025-11-27 09:45:41.539238 | controller | Thursday 27 November 2025  09:45:41 +0000 (0:00:00.031)       0:02:49.550 *****
2025-11-27 09:45:41.539246 | controller | skipping: [instance]
2025-11-27 09:45:41.592697 | controller |
2025-11-27 09:45:41.592715 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2025-11-27 09:45:41.592721 | controller | Thursday 27 November 2025  09:45:41 +0000 (0:00:00.055)       0:02:49.605 *****
2025-11-27 09:45:41.592729 | controller | skipping: [instance]
2025-11-27 09:45:41.620376 | controller |
2025-11-27 09:45:41.620408 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-11-27 09:45:41.620416 | controller | Thursday 27 November 2025  09:45:41 +0000 (0:00:00.053)       0:02:49.659 *****
2025-11-27 09:45:41.620425 | controller | skipping: [instance]
2025-11-27 09:45:41.620763 | controller |
2025-11-27 09:45:41.662286 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2025-11-27 09:45:41.662306 | controller | Thursday 27 November 2025  09:45:41 +0000 (0:00:00.027)       0:02:49.687 *****
2025-11-27 09:45:41.662318 | controller |
2025-11-27 09:45:41.743601 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-11-27 09:45:41.743667 | controller | Thursday 27 November 2025  09:45:41 +0000 (0:00:00.041)       0:02:49.729 *****
2025-11-27 09:45:41.743688 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2025-11-27 09:45:41.965650 | controller |
2025-11-27 09:45:41.965707 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-11-27 09:45:41.965716 | controller | Thursday 27 November 2025  09:45:41 +0000 (0:00:00.081)       0:02:49.810 *****
2025-11-27 09:45:41.965728 | controller | ok: [instance]
2025-11-27 09:45:41.965749 | controller |
2025-11-27 09:45:41.965807 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-11-27 09:45:41.965910 | controller | Thursday 27 November 2025  09:45:41 +0000 (0:00:00.222)       0:02:50.032 *****
2025-11-27 09:45:42.196137 | controller | ok: [instance]
2025-11-27 09:45:42.196198 | controller |
2025-11-27 09:45:42.196291 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2025-11-27 09:45:42.196413 | controller | Thursday 27 November 2025  09:45:42 +0000 (0:00:00.230)       0:02:50.262 *****
2025-11-27 09:45:42.608268 | controller | changed: [instance]
2025-11-27 09:45:42.608324 | controller |
2025-11-27 09:45:42.608434 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2025-11-27 09:45:42.608543 | controller | Thursday 27 November 2025  09:45:42 +0000 (0:00:00.412)       0:02:50.674 *****
2025-11-27 09:45:42.643478 | controller | skipping: [instance]
2025-11-27 09:45:42.677984 | controller |
2025-11-27 09:45:42.678014 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-11-27 09:45:42.678022 | controller | Thursday 27 November 2025  09:45:42 +0000 (0:00:00.035)       0:02:50.710 *****
2025-11-27 09:45:42.678033 | controller | skipping: [instance]
2025-11-27 09:45:44.458049 | controller |
2025-11-27 09:45:44.458116 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2025-11-27 09:45:44.458126 | controller | Thursday 27 November 2025  09:45:42 +0000 (0:00:00.034)       0:02:50.744 *****
2025-11-27 09:45:44.458143 | controller | changed: [instance -> controller-0.instance]
2025-11-27 09:45:45.828508 | controller |
2025-11-27 09:45:45.828578 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2025-11-27 09:45:45.828588 | controller | Thursday 27 November 2025  09:45:44 +0000 (0:00:01.779)       0:02:52.523 *****
2025-11-27 09:45:45.828603 | controller | changed: [instance -> controller-0.instance]
2025-11-27 09:45:45.884082 | controller |
2025-11-27 09:45:45.884131 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-11-27 09:45:45.884140 | controller | Thursday 27 November 2025  09:45:45 +0000 (0:00:01.370)       0:02:53.894 *****
2025-11-27 09:45:45.884153 | controller |
2025-11-27 09:45:46.142152 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2025-11-27 09:45:46.142203 | controller | Thursday 27 November 2025  09:45:45 +0000 (0:00:00.056)       0:02:53.950 *****
2025-11-27 09:45:46.142218 | controller | ok: [instance]
2025-11-27 09:45:46.142242 | controller |
2025-11-27 09:45:46.142290 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2025-11-27 09:45:46.142476 | controller | Thursday 27 November 2025  09:45:46 +0000 (0:00:00.257)       0:02:54.208 *****
2025-11-27 09:45:46.180865 | controller | ok: [instance]
2025-11-27 09:45:46.180931 | controller |
2025-11-27 09:45:46.181050 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2025-11-27 09:45:46.181164 | controller | Thursday 27 November 2025  09:45:46 +0000 (0:00:00.039)       0:02:54.247 *****
2025-11-27 09:45:46.226578 | controller | skipping: [instance]
2025-11-27 09:45:46.226664 | controller |
2025-11-27 09:45:46.226776 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2025-11-27 09:45:46.226880 | controller | Thursday 27 November 2025  09:45:46 +0000 (0:00:00.045)       0:02:54.293 *****
2025-11-27 09:45:46.282048 | controller |
2025-11-27 09:45:46.282153 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-11-27 09:45:46.282274 | controller | Thursday 27 November 2025  09:45:46 +0000 (0:00:00.055)       0:02:54.348 *****
2025-11-27 09:45:46.384974 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2025-11-27 09:45:46.622248 | controller |
2025-11-27 09:45:46.622317 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-11-27 09:45:46.622327 | controller | Thursday 27 November 2025  09:45:46 +0000 (0:00:00.102)       0:02:54.450 *****
2025-11-27 09:45:46.622359 | controller | ok: [instance]
2025-11-27 09:45:46.865885 | controller |
2025-11-27 09:45:46.865950 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-11-27 09:45:46.865959 | controller | Thursday 27 November 2025  09:45:46 +0000 (0:00:00.236)       0:02:54.687 *****
2025-11-27 09:45:46.865973 | controller | ok: [instance]
2025-11-27 09:45:47.326020 | controller |
2025-11-27 09:45:47.326082 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2025-11-27 09:45:47.326092 | controller | Thursday 27 November 2025  09:45:46 +0000 (0:00:00.243)       0:02:54.931 *****
2025-11-27 09:45:47.326106 | controller | changed: [instance]
2025-11-27 09:45:48.380904 | controller |
2025-11-27 09:45:48.380966 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2025-11-27 09:45:48.380976 | controller | Thursday 27 November 2025  09:45:47 +0000 (0:00:00.460)       0:02:55.391 *****
2025-11-27 09:45:48.381017 | controller | changed: [instance]
2025-11-27 09:45:48.420737 | controller |
2025-11-27 09:45:48.420757 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-11-27 09:45:48.420765 | controller | Thursday 27 November 2025  09:45:48 +0000 (0:00:01.050)       0:02:56.442 *****
2025-11-27 09:45:48.420775 | controller | skipping: [instance]
2025-11-27 09:45:48.486811 | controller |
2025-11-27 09:45:48.486879 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2025-11-27 09:45:48.486889 | controller | Thursday 27 November 2025  09:45:48 +0000 (0:00:00.045)       0:02:56.487 *****
2025-11-27 09:45:48.486914 | controller | skipping: [instance]
2025-11-27 09:45:48.486946 | controller |
2025-11-27 09:45:48.486954 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2025-11-27 09:45:48.486963 | controller | Thursday 27 November 2025  09:45:48 +0000 (0:00:00.065)       0:02:56.553 *****
2025-11-27 09:45:48.545291 | controller | skipping: [instance]
2025-11-27 09:45:48.600499 | controller |
2025-11-27 09:45:48.600526 | controller | TASK [Create VBMC entity] ******************************************************
2025-11-27 09:45:48.600534 | controller | Thursday 27 November 2025  09:45:48 +0000 (0:00:00.058)       0:02:56.611 *****
2025-11-27 09:45:48.600545 | controller | skipping: [instance] => (item=compute-0)
2025-11-27 09:45:48.858513 | controller | skipping: [instance] => (item=controller-0)
2025-11-27 09:45:48.858583 | controller | skipping: [instance] => (item=crc-0)
2025-11-27 09:45:48.858592 | controller | skipping: [instance]
2025-11-27 09:45:48.858599 | controller |
2025-11-27 09:45:48.858605 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2025-11-27 09:45:48.858611 | controller | Thursday 27 November 2025  09:45:48 +0000 (0:00:00.055)       0:02:56.667 *****
2025-11-27 09:45:48.858623 | controller | ok: [instance]
2025-11-27 09:45:49.253782 | controller |
2025-11-27 09:45:49.253830 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2025-11-27 09:45:49.253839 | controller | Thursday 27 November 2025  09:45:48 +0000 (0:00:00.257)       0:02:56.924 *****
2025-11-27 09:45:49.253852 | controller | changed: [instance]
2025-11-27 09:45:49.296498 | controller |
2025-11-27 09:45:49.296559 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2025-11-27 09:45:49.296568 | controller | Thursday 27 November 2025  09:45:49 +0000 (0:00:00.395)       0:02:57.320 *****
2025-11-27 09:45:49.296584 | controller | skipping: [instance]
2025-11-27 09:45:49.296674 | controller |
2025-11-27 09:45:49.296730 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2025-11-27 09:45:49.337947 | controller | Thursday 27 November 2025  09:45:49 +0000 (0:00:00.043)       0:02:57.363 *****
2025-11-27 09:45:49.338007 | controller | skipping: [instance]
2025-11-27 09:45:49.338042 | controller |
2025-11-27 09:45:49.338287 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2025-11-27 09:45:49.381532 | controller | Thursday 27 November 2025  09:45:49 +0000 (0:00:00.041)       0:02:57.404 *****
2025-11-27 09:45:49.381590 | controller | skipping: [instance]
2025-11-27 09:45:49.381816 | controller |
2025-11-27 09:45:49.381845 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2025-11-27 09:45:50.104554 | controller | Thursday 27 November 2025  09:45:49 +0000 (0:00:00.043)       0:02:57.448 *****
2025-11-27 09:45:50.104604 | controller | changed: [instance]
2025-11-27 09:45:50.104755 | controller |
2025-11-27 09:45:50.104774 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2025-11-27 09:45:50.859459 | controller | Thursday 27 November 2025  09:45:50 +0000 (0:00:00.722)       0:02:58.170 *****
2025-11-27 09:45:50.859537 | controller | changed: [instance]
2025-11-27 09:45:50.859566 | controller |
2025-11-27 09:45:50.859612 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2025-11-27 09:45:50.859721 | controller | Thursday 27 November 2025  09:45:50 +0000 (0:00:00.754)       0:02:58.925 *****
2025-11-27 09:45:50.916191 | controller | skipping: [instance]
2025-11-27 09:45:50.916284 | controller |
2025-11-27 09:45:50.916428 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2025-11-27 09:45:50.916552 | controller | Thursday 27 November 2025  09:45:50 +0000 (0:00:00.057)       0:02:58.982 *****
2025-11-27 09:45:50.991411 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2025-11-27 09:45:50.991560 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2025-11-27 09:45:50.991674 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2025-11-27 09:45:50.991794 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2025-11-27 09:45:50.991889 | controller |
2025-11-27 09:45:50.991975 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2025-11-27 09:45:50.992067 | controller | Thursday 27 November 2025  09:45:50 +0000 (0:00:00.075)       0:02:59.058 *****
2025-11-27 09:45:51.048590 | controller | skipping: [instance]
2025-11-27 09:45:51.048737 | controller |
2025-11-27 09:45:51.048772 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2025-11-27 09:45:51.048931 | controller | Thursday 27 November 2025  09:45:51 +0000 (0:00:00.057)       0:02:59.115 *****
2025-11-27 09:45:51.095017 | controller | skipping: [instance]
2025-11-27 09:45:51.095111 | controller |
2025-11-27 09:45:51.095218 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2025-11-27 09:45:51.095320 | controller | Thursday 27 November 2025  09:45:51 +0000 (0:00:00.046)       0:02:59.161 *****
2025-11-27 09:45:51.144162 | controller | skipping: [instance]
2025-11-27 09:45:51.144235 | controller |
2025-11-27 09:45:51.144366 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2025-11-27 09:45:51.144482 | controller | Thursday 27 November 2025  09:45:51 +0000 (0:00:00.049)       0:02:59.211 *****
2025-11-27 09:45:51.183690 | controller | skipping: [instance]
2025-11-27 09:45:51.183769 | controller |
2025-11-27 09:45:51.183873 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2025-11-27 09:45:51.184000 | controller | Thursday 27 November 2025  09:45:51 +0000 (0:00:00.039)       0:02:59.250 *****
2025-11-27 09:45:51.871513 | controller | changed: [instance]
2025-11-27 09:45:51.871576 | controller |
2025-11-27 09:45:51.871586 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2025-11-27 09:45:51.871596 | controller | Thursday 27 November 2025  09:45:51 +0000 (0:00:00.686)       0:02:59.937 *****
2025-11-27 09:45:51.918512 | controller | skipping: [instance]
2025-11-27 09:45:51.918562 | controller |
2025-11-27 09:45:51.918574 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2025-11-27 09:45:51.918699 | controller | Thursday 27 November 2025  09:45:51 +0000 (0:00:00.047)       0:02:59.985 *****
2025-11-27 09:45:51.961065 | controller | skipping: [instance]
2025-11-27 09:45:52.005910 | controller |
2025-11-27 09:45:52.005933 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2025-11-27 09:45:52.005941 | controller | Thursday 27 November 2025  09:45:51 +0000 (0:00:00.042)       0:03:00.027 *****
2025-11-27 09:45:52.005950 | controller | skipping: [instance]
2025-11-27 09:45:52.006006 | controller |
2025-11-27 09:45:52.006122 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2025-11-27 09:45:52.006226 | controller | Thursday 27 November 2025  09:45:52 +0000 (0:00:00.043)       0:03:00.071 *****
2025-11-27 09:45:52.045552 | controller | skipping: [instance]
2025-11-27 09:45:52.090788 | controller |
2025-11-27 09:45:52.090809 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2025-11-27 09:45:52.090818 | controller | Thursday 27 November 2025  09:45:52 +0000 (0:00:00.040)       0:03:00.112 *****
2025-11-27 09:45:52.090828 | controller | skipping: [instance]
2025-11-27 09:45:52.090959 | controller |
2025-11-27 09:45:52.091112 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2025-11-27 09:45:52.091258 | controller | Thursday 27 November 2025  09:45:52 +0000 (0:00:00.045)       0:03:00.157 *****
2025-11-27 09:45:52.133462 | controller | skipping: [instance]
2025-11-27 09:45:52.133621 | controller |
2025-11-27 09:45:52.133757 | controller | TASK [openshift_login : Assert files exist] ************************************
2025-11-27 09:45:52.133885 | controller | Thursday 27 November 2025  09:45:52 +0000 (0:00:00.042)       0:03:00.200 *****
2025-11-27 09:45:52.175715 | controller | skipping: [instance]
2025-11-27 09:45:52.219008 | controller |
2025-11-27 09:45:52.219033 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2025-11-27 09:45:52.219041 | controller | Thursday 27 November 2025  09:45:52 +0000 (0:00:00.042)       0:03:00.242 *****
2025-11-27 09:45:52.219049 | controller | skipping: [instance]
2025-11-27 09:45:52.268163 | controller |
2025-11-27 09:45:52.268186 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2025-11-27 09:45:52.268194 | controller | Thursday 27 November 2025  09:45:52 +0000 (0:00:00.042)       0:03:00.285 *****
2025-11-27 09:45:52.268203 | controller | skipping: [instance]
2025-11-27 09:45:52.321306 | controller |
2025-11-27 09:45:52.321374 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2025-11-27 09:45:52.321385 | controller | Thursday 27 November 2025  09:45:52 +0000 (0:00:00.049)       0:03:00.334 *****
2025-11-27 09:45:52.321405 | controller | skipping: [instance]
2025-11-27 09:45:52.321642 | controller |
2025-11-27 09:45:52.321657 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2025-11-27 09:45:52.360553 | controller | Thursday 27 November 2025  09:45:52 +0000 (0:00:00.053)       0:03:00.387 *****
2025-11-27 09:45:52.360628 | controller | skipping: [instance]
2025-11-27 09:45:52.605116 | controller |
2025-11-27 09:45:52.605154 | controller | TASK [reproducer : Configure Controller node] **********************************
2025-11-27 09:45:52.605162 | controller | Thursday 27 November 2025  09:45:52 +0000 (0:00:00.039)       0:03:00.427 *****
2025-11-27 09:45:52.605174 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2025-11-27 09:45:54.002326 | controller |
2025-11-27 09:45:54.002409 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2025-11-27 09:45:54.002418 | controller | Thursday 27 November 2025  09:45:52 +0000 (0:00:00.244)       0:03:00.671 *****
2025-11-27 09:45:54.002431 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2025-11-27 09:45:54.032551 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2025-11-27 09:45:54.032646 | controller |
2025-11-27 09:45:54.032662 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2025-11-27 09:45:54.032673 | controller | Thursday 27 November 2025  09:45:53 +0000 (0:00:01.396)       0:03:02.067 *****
2025-11-27 09:45:54.032704 | controller | skipping: [instance]
2025-11-27 09:45:54.715434 | controller |
2025-11-27 09:45:54.715525 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2025-11-27 09:45:54.715552 | controller | Thursday 27 November 2025  09:45:54 +0000 (0:00:00.030)       0:03:02.098 *****
2025-11-27 09:45:54.715570 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:45:54.715729 | controller |
2025-11-27 09:45:54.715799 | controller | TASK [install_ca : Install internal CA from url] *******************************
2025-11-27 09:45:54.754027 | controller | Thursday 27 November 2025  09:45:54 +0000 (0:00:00.682)       0:03:02.781 *****
2025-11-27 09:45:54.754081 | controller | skipping: [instance]
2025-11-27 09:45:54.795462 | controller |
2025-11-27 09:45:54.795495 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2025-11-27 09:45:54.795506 | controller | Thursday 27 November 2025  09:45:54 +0000 (0:00:00.039)       0:03:02.820 *****
2025-11-27 09:45:54.795519 | controller | skipping: [instance]
2025-11-27 09:45:54.795559 | controller |
2025-11-27 09:45:54.795845 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2025-11-27 09:45:54.831511 | controller | Thursday 27 November 2025  09:45:54 +0000 (0:00:00.041)       0:03:02.862 *****
2025-11-27 09:45:54.831563 | controller | skipping: [instance]
2025-11-27 09:45:54.831632 | controller |
2025-11-27 09:45:54.831664 | controller | TASK [install_ca : Update ca bundle] *******************************************
2025-11-27 09:45:54.831831 | controller | Thursday 27 November 2025  09:45:54 +0000 (0:00:00.036)       0:03:02.898 *****
2025-11-27 09:45:56.455371 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:45:56.496159 | controller |
2025-11-27 09:45:56.496240 | controller | TASK [reproducer : Get rhos-release] *******************************************
2025-11-27 09:45:56.496254 | controller | Thursday 27 November 2025  09:45:56 +0000 (0:00:01.622)       0:03:04.520 *****
2025-11-27 09:45:56.496269 | controller | skipping: [instance]
2025-11-27 09:45:56.535233 | controller |
2025-11-27 09:45:56.535277 | controller | TASK [reproducer : Install repos] **********************************************
2025-11-27 09:45:56.535290 | controller | Thursday 27 November 2025  09:45:56 +0000 (0:00:00.041)       0:03:04.562 *****
2025-11-27 09:45:56.535304 | controller | skipping: [instance]
2025-11-27 09:45:56.577408 | controller |
2025-11-27 09:45:56.577436 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2025-11-27 09:45:56.577443 | controller | Thursday 27 November 2025  09:45:56 +0000 (0:00:00.039)       0:03:04.601 *****
2025-11-27 09:45:56.577452 | controller | skipping: [instance]
2025-11-27 09:45:56.616487 | controller |
2025-11-27 09:45:56.616512 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2025-11-27 09:45:56.616519 | controller | Thursday 27 November 2025  09:45:56 +0000 (0:00:00.042)       0:03:04.643 *****
2025-11-27 09:45:56.616529 | controller | skipping: [instance]
2025-11-27 09:45:57.794786 | controller |
2025-11-27 09:45:57.794836 | controller | TASK [reproducer : Install some tools] *****************************************
2025-11-27 09:45:57.794844 | controller | Thursday 27 November 2025  09:45:56 +0000 (0:00:00.039)       0:03:04.683 *****
2025-11-27 09:45:57.794856 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:45:57.794876 | controller |
2025-11-27 09:45:57.794924 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2025-11-27 09:45:57.795054 | controller | Thursday 27 November 2025  09:45:57 +0000 (0:00:01.177)       0:03:05.861 *****
2025-11-27 09:45:58.945650 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:45:58.945705 | controller |
2025-11-27 09:45:58.945902 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2025-11-27 09:45:59.616610 | controller | Thursday 27 November 2025  09:45:58 +0000 (0:00:01.151)       0:03:07.012 *****
2025-11-27 09:45:59.616675 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:00.608533 | controller |
2025-11-27 09:46:00.608605 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2025-11-27 09:46:00.608615 | controller | Thursday 27 November 2025  09:45:59 +0000 (0:00:00.670)       0:03:07.682 *****
2025-11-27 09:46:00.608642 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:00.608705 | controller |
2025-11-27 09:46:00.608858 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2025-11-27 09:46:00.608923 | controller | Thursday 27 November 2025  09:46:00 +0000 (0:00:00.991)       0:03:08.674 *****
2025-11-27 09:46:01.820309 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2025-11-27 09:46:02.509649 | controller | skipping: [instance] => (item=compute-0)
2025-11-27 09:46:02.509712 | controller | skipping: [instance] => (item=controller-0)
2025-11-27 09:46:02.509719 | controller | skipping: [instance] => (item=crc-0)
2025-11-27 09:46:02.509725 | controller |
2025-11-27 09:46:02.509731 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2025-11-27 09:46:02.509738 | controller | Thursday 27 November 2025  09:46:01 +0000 (0:00:01.211)       0:03:09.885 *****
2025-11-27 09:46:02.509751 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2025-11-27 09:46:02.509903 | controller | skipping: [instance] => (item=compute-0)
2025-11-27 09:46:02.510037 | controller | skipping: [instance] => (item=controller-0)
2025-11-27 09:46:02.510169 | controller | skipping: [instance] => (item=crc-0)
2025-11-27 09:46:02.510292 | controller |
2025-11-27 09:46:02.510477 | controller | TASK [reproducer : Inject SSH configuration] ***********************************
2025-11-27 09:46:02.510616 | controller | Thursday 27 November 2025  09:46:02 +0000 (0:00:00.683)       0:03:10.569 *****
2025-11-27 09:46:04.312247 | controller | skipping: [instance] => (item=instance)
2025-11-27 09:46:04.312507 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
2025-11-27 09:46:04.312663 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2025-11-27 09:46:04.312796 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
2025-11-27 09:46:04.312915 | controller |
2025-11-27 09:46:04.313036 | controller | TASK [reproducer : Create kube directory] **************************************
2025-11-27 09:46:04.313156 | controller | Thursday 27 November 2025  09:46:04 +0000 (0:00:01.802)       0:03:12.372 *****
2025-11-27 09:46:04.942385 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:06.048503 | controller |
2025-11-27 09:46:06.048562 | controller | TASK [reproducer : Inject kubeconfig content] **********************************
2025-11-27 09:46:06.048571 | controller | Thursday 27 November 2025  09:46:04 +0000 (0:00:00.636)       0:03:13.008 *****
2025-11-27 09:46:06.048585 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:06.048842 | controller |
2025-11-27 09:46:06.048859 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************
2025-11-27 09:46:07.128659 | controller | Thursday 27 November 2025  09:46:06 +0000 (0:00:01.105)       0:03:14.113 *****
2025-11-27 09:46:07.128733 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:07.172137 | controller |
2025-11-27 09:46:07.172172 | controller | TASK [reproducer : Inject devscripts private key if set] ***********************
2025-11-27 09:46:07.172180 | controller | Thursday 27 November 2025  09:46:07 +0000 (0:00:01.080)       0:03:15.194 *****
2025-11-27 09:46:07.172190 | controller | skipping: [instance]
2025-11-27 09:46:07.815158 | controller |
2025-11-27 09:46:07.815205 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ******************************
2025-11-27 09:46:07.815214 | controller | Thursday 27 November 2025  09:46:07 +0000 (0:00:00.044)       0:03:15.238 *****
2025-11-27 09:46:07.815226 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:08.488228 | controller |
2025-11-27 09:46:08.488295 | controller | TASK [manage_secrets : Ensure directory tree exist] ****************************
2025-11-27 09:46:08.488304 | controller | Thursday 27 November 2025  09:46:07 +0000 (0:00:00.642)       0:03:15.881 *****
2025-11-27 09:46:08.488317 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:08.535711 | controller |
2025-11-27 09:46:08.535750 | controller | TASK [manage_secrets : Assert we get needed data] ******************************
2025-11-27 09:46:08.535760 | controller | Thursday 27 November 2025  09:46:08 +0000 (0:00:00.672)       0:03:16.553 *****
2025-11-27 09:46:08.535786 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:08.617703 | controller |
2025-11-27 09:46:08.617739 | controller | TASK [manage_secrets : Push reproducer secrets] ********************************
2025-11-27 09:46:08.617747 | controller | Thursday 27 November 2025  09:46:08 +0000 (0:00:00.048)       0:03:16.602 *****
2025-11-27 09:46:08.617759 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
2025-11-27 09:46:08.677436 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
2025-11-27 09:46:08.677466 | controller |
2025-11-27 09:46:08.677474 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2025-11-27 09:46:08.677480 | controller | Thursday 27 November 2025  09:46:08 +0000 (0:00:00.081)       0:03:16.684 *****
2025-11-27 09:46:08.677490 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 09:46:08.727305 | controller |   _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
2025-11-27 09:46:08.727360 | controller |
2025-11-27 09:46:08.727371 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2025-11-27 09:46:08.727377 | controller | Thursday 27 November 2025  09:46:08 +0000 (0:00:00.059)       0:03:16.744 *****
2025-11-27 09:46:08.727388 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 09:46:08.788368 | controller |   _secret_file: ''
2025-11-27 09:46:08.788391 | controller |
2025-11-27 09:46:08.788411 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2025-11-27 09:46:08.788418 | controller | Thursday 27 November 2025  09:46:08 +0000 (0:00:00.049)       0:03:16.793 *****
2025-11-27 09:46:08.788429 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 09:46:08.788579 | controller |   _secret_content: my-default-location-place
2025-11-27 09:46:08.788705 | controller |
2025-11-27 09:46:08.788843 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2025-11-27 09:46:08.788968 | controller | Thursday 27 November 2025  09:46:08 +0000 (0:00:00.061)       0:03:16.855 *****
2025-11-27 09:46:08.848048 | controller | skipping: [instance]
2025-11-27 09:46:08.848217 | controller |
2025-11-27 09:46:08.848431 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2025-11-27 09:46:08.848601 | controller | Thursday 27 November 2025  09:46:08 +0000 (0:00:00.059)       0:03:16.915 *****
2025-11-27 09:46:08.904045 | controller | skipping: [instance]
2025-11-27 09:46:08.904184 | controller |
2025-11-27 09:46:08.904313 | controller | TASK [manage_secrets : Copy file to location] **********************************
2025-11-27 09:46:08.904479 | controller | Thursday 27 November 2025  09:46:08 +0000 (0:00:00.056)       0:03:16.971 *****
2025-11-27 09:46:08.954162 | controller | skipping: [instance]
2025-11-27 09:46:08.954299 | controller |
2025-11-27 09:46:08.954466 | controller | TASK [manage_secrets : Create file from content] *******************************
2025-11-27 09:46:08.954598 | controller | Thursday 27 November 2025  09:46:08 +0000 (0:00:00.050)       0:03:17.021 *****
2025-11-27 09:46:10.036985 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:10.100032 | controller |
2025-11-27 09:46:10.100085 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2025-11-27 09:46:10.100094 | controller | Thursday 27 November 2025  09:46:10 +0000 (0:00:01.081)       0:03:18.102 *****
2025-11-27 09:46:10.100106 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 09:46:10.156823 | controller |   _secret_dest: /home/zuul/ipmi-things
2025-11-27 09:46:10.156869 | controller |
2025-11-27 09:46:10.156878 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2025-11-27 09:46:10.156885 | controller | Thursday 27 November 2025  09:46:10 +0000 (0:00:00.063)       0:03:18.166 *****
2025-11-27 09:46:10.156897 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 09:46:10.214253 | controller |   _secret_file: /tmp/ipmi-things
2025-11-27 09:46:10.214293 | controller |
2025-11-27 09:46:10.214307 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2025-11-27 09:46:10.214315 | controller | Thursday 27 November 2025  09:46:10 +0000 (0:00:00.056)       0:03:18.223 *****
2025-11-27 09:46:10.214328 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 09:46:10.281267 | controller |   _secret_content: ''
2025-11-27 09:46:10.281361 | controller |
2025-11-27 09:46:10.281374 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2025-11-27 09:46:10.281381 | controller | Thursday 27 November 2025  09:46:10 +0000 (0:00:00.057)       0:03:18.280 *****
2025-11-27 09:46:10.281404 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false
2025-11-27 09:46:10.281569 | controller |   msg: All assertions passed
2025-11-27 09:46:10.281701 | controller |
2025-11-27 09:46:10.281834 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2025-11-27 09:46:10.281961 | controller | Thursday 27 November 2025  09:46:10 +0000 (0:00:00.067)       0:03:18.348 *****
2025-11-27 09:46:10.977060 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:12.164690 | controller |
2025-11-27 09:46:12.164747 | controller | TASK [manage_secrets : Copy file to location] **********************************
2025-11-27 09:46:12.164757 | controller | Thursday 27 November 2025  09:46:10 +0000 (0:00:00.694)       0:03:19.042 *****
2025-11-27 09:46:12.164771 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:12.230988 | controller |
2025-11-27 09:46:12.231018 | controller | TASK [manage_secrets : Create file from content] *******************************
2025-11-27 09:46:12.231028 | controller | Thursday 27 November 2025  09:46:12 +0000 (0:00:01.187)       0:03:20.230 *****
2025-11-27 09:46:12.231038 | controller | skipping: [instance]
2025-11-27 09:46:12.891832 | controller |
2025-11-27 09:46:12.891874 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
2025-11-27 09:46:12.891882 | controller | Thursday 27 November 2025  09:46:12 +0000 (0:00:00.066)       0:03:20.297 *****
2025-11-27 09:46:12.891894 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:46:13.634282 | controller |
2025-11-27 09:46:13.634318 | controller | TASK [reproducer : Check if async file is still available] *********************
2025-11-27 09:46:13.634327 | controller | Thursday 27 November 2025  09:46:12 +0000 (0:00:00.660)       0:03:20.957 *****
2025-11-27 09:46:13.634361 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:20.932684 | controller |
2025-11-27 09:47:20.932735 | controller | TASK [reproducer : Check package install status] *******************************
2025-11-27 09:47:20.932743 | controller | Thursday 27 November 2025  09:46:13 +0000 (0:00:00.742)       0:03:21.700 *****
2025-11-27 09:47:20.932754 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
2025-11-27 09:47:20.932923 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
2025-11-27 09:47:20.933066 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
2025-11-27 09:47:20.933201 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
2025-11-27 09:47:20.933357 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
2025-11-27 09:47:20.933513 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
2025-11-27 09:47:20.933645 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
2025-11-27 09:47:20.933775 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left).
2025-11-27 09:47:20.933906 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left).
2025-11-27 09:47:20.934036 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left).
2025-11-27 09:47:20.934162 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left).
2025-11-27 09:47:20.934289 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (89 retries left).
2025-11-27 09:47:20.934473 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:20.934607 | controller |
2025-11-27 09:47:20.934739 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
2025-11-27 09:47:20.934871 | controller | Thursday 27 November 2025  09:47:20 +0000 (0:01:07.292)       0:04:28.992 *****
2025-11-27 09:47:21.517183 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:23.994077 | controller |
2025-11-27 09:47:23.994117 | controller | TASK [sushy_emulator : Install required packages] ******************************
2025-11-27 09:47:23.994124 | controller | Thursday 27 November 2025  09:47:21 +0000 (0:00:00.590)       0:04:29.583 *****
2025-11-27 09:47:23.994135 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:24.041386 | controller |
2025-11-27 09:47:24.041406 | controller | TASK [sushy_emulator : Get ingresses domain] ***********************************
2025-11-27 09:47:24.041413 | controller | Thursday 27 November 2025  09:47:23 +0000 (0:00:02.476)       0:04:32.060 *****
2025-11-27 09:47:24.041435 | controller | skipping: [instance]
2025-11-27 09:47:24.087556 | controller |
2025-11-27 09:47:24.087576 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] *********************
2025-11-27 09:47:24.087583 | controller | Thursday 27 November 2025  09:47:24 +0000 (0:00:00.047)       0:04:32.108 *****
2025-11-27 09:47:24.087591 | controller | skipping: [instance]
2025-11-27 09:47:24.834885 | controller |
2025-11-27 09:47:24.834935 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
2025-11-27 09:47:24.834944 | controller | Thursday 27 November 2025  09:47:24 +0000 (0:00:00.046)       0:04:32.154 *****
2025-11-27 09:47:24.834955 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:25.498249 | controller |
2025-11-27 09:47:25.498289 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ********************
2025-11-27 09:47:25.498297 | controller | Thursday 27 November 2025  09:47:24 +0000 (0:00:00.741)       0:04:32.896 *****
2025-11-27 09:47:25.498308 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:25.824887 | controller |
2025-11-27 09:47:25.824925 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
2025-11-27 09:47:25.824934 | controller | Thursday 27 November 2025  09:47:25 +0000 (0:00:00.668)       0:04:33.564 *****
2025-11-27 09:47:25.824945 | controller | changed: [instance]
2025-11-27 09:47:25.825299 | controller |
2025-11-27 09:47:26.582712 | controller | TASK [sushy_emulator : Run ssh-keyscan] ****************************************
2025-11-27 09:47:26.582756 | controller | Thursday 27 November 2025  09:47:25 +0000 (0:00:00.326)       0:04:33.891 *****
2025-11-27 09:47:26.582770 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:27.743531 | controller |
2025-11-27 09:47:27.743660 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************
2025-11-27 09:47:27.743871 | controller | Thursday 27 November 2025  09:47:26 +0000 (0:00:00.757)       0:04:34.648 *****
2025-11-27 09:47:27.743887 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:27.744284 | controller |
2025-11-27 09:47:27.788143 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2025-11-27 09:47:27.788161 | controller | Thursday 27 November 2025  09:47:27 +0000 (0:00:01.160)       0:04:35.809 *****
2025-11-27 09:47:27.788171 | controller | skipping: [instance]
2025-11-27 09:47:27.840309 | controller |
2025-11-27 09:47:27.840327 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2025-11-27 09:47:27.840360 | controller | Thursday 27 November 2025  09:47:27 +0000 (0:00:00.045)       0:04:35.855 *****
2025-11-27 09:47:27.840373 | controller | skipping: [instance]
2025-11-27 09:47:27.876587 | controller |
2025-11-27 09:47:27.876605 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2025-11-27 09:47:27.876612 | controller | Thursday 27 November 2025  09:47:27 +0000 (0:00:00.052)       0:04:35.907 *****
2025-11-27 09:47:27.876621 | controller | skipping: [instance]
2025-11-27 09:47:27.936602 | controller |
2025-11-27 09:47:27.936619 | controller | TASK [sushy_emulator : Generate list of filtered VMs] **************************
2025-11-27 09:47:27.936639 | controller | Thursday 27 November 2025  09:47:27 +0000 (0:00:00.036)       0:04:35.943 *****
2025-11-27 09:47:27.936648 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:27.976779 | controller |
2025-11-27 09:47:27.976804 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
2025-11-27 09:47:27.976812 | controller | Thursday 27 November 2025  09:47:27 +0000 (0:00:00.059)       0:04:36.003 *****
2025-11-27 09:47:27.976820 | controller | skipping: [instance]
2025-11-27 09:47:28.017092 | controller |
2025-11-27 09:47:28.017109 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
2025-11-27 09:47:28.017117 | controller | Thursday 27 November 2025  09:47:27 +0000 (0:00:00.040)       0:04:36.043 *****
2025-11-27 09:47:28.017125 | controller | skipping: [instance]
2025-11-27 09:47:28.060851 | controller |
2025-11-27 09:47:28.060869 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
2025-11-27 09:47:28.060876 | controller | Thursday 27 November 2025  09:47:28 +0000 (0:00:00.040)       0:04:36.084 *****
2025-11-27 09:47:28.060884 | controller | skipping: [instance]
2025-11-27 09:47:28.728416 | controller |
2025-11-27 09:47:28.728463 | controller | TASK [sushy_emulator : Generate htpasswd string] *******************************
2025-11-27 09:47:28.728471 | controller | Thursday 27 November 2025  09:47:28 +0000 (0:00:00.043)       0:04:36.127 *****
2025-11-27 09:47:28.728487 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:28.825839 | controller |
2025-11-27 09:47:28.825867 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] *********************
2025-11-27 09:47:28.825874 | controller | Thursday 27 November 2025  09:47:28 +0000 (0:00:00.667)       0:04:36.794 *****
2025-11-27 09:47:28.825885 | controller | skipping: [instance] => (item=secret)
2025-11-27 09:47:30.020537 | controller | skipping: [instance] => (item=configmap)
2025-11-27 09:47:30.020577 | controller | skipping: [instance] => (item=pod)
2025-11-27 09:47:30.020584 | controller | skipping: [instance] => (item=service)
2025-11-27 09:47:30.020591 | controller | skipping: [instance] => (item=route)
2025-11-27 09:47:30.020596 | controller | skipping: [instance]
2025-11-27 09:47:30.020602 | controller |
2025-11-27 09:47:30.020608 | controller | TASK [sushy_emulator : Write sushy emulator config] ****************************
2025-11-27 09:47:30.020614 | controller | Thursday 27 November 2025  09:47:28 +0000 (0:00:00.097)       0:04:36.892 *****
2025-11-27 09:47:30.020625 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:31.112686 | controller |
2025-11-27 09:47:31.112731 | controller | TASK [sushy_emulator : Write htpasswd string to file] **************************
2025-11-27 09:47:31.112740 | controller | Thursday 27 November 2025  09:47:30 +0000 (0:00:01.192)       0:04:38.084 *****
2025-11-27 09:47:31.112751 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:31.159436 | controller |
2025-11-27 09:47:31.159457 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
2025-11-27 09:47:31.159465 | controller | Thursday 27 November 2025  09:47:31 +0000 (0:00:01.093)       0:04:39.178 *****
2025-11-27 09:47:31.159473 | controller | skipping: [instance]
2025-11-27 09:47:31.205503 | controller |
2025-11-27 09:47:31.205521 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
2025-11-27 09:47:31.205529 | controller | Thursday 27 November 2025  09:47:31 +0000 (0:00:00.047)       0:04:39.226 *****
2025-11-27 09:47:31.205538 | controller | skipping: [instance]
2025-11-27 09:47:31.284382 | controller |
2025-11-27 09:47:31.284401 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
2025-11-27 09:47:31.284409 | controller | Thursday 27 November 2025  09:47:31 +0000 (0:00:00.045)       0:04:39.272 *****
2025-11-27 09:47:31.284418 | controller | skipping: [instance] => (item=secret)
2025-11-27 09:47:31.284819 | controller | skipping: [instance] => (item=configmap)
2025-11-27 09:47:31.284831 | controller | skipping: [instance] => (item=service)
2025-11-27 09:47:31.284838 | controller | skipping: [instance] => (item=route)
2025-11-27 09:47:31.284851 | controller | skipping: [instance]
2025-11-27 09:47:31.331899 | controller |
2025-11-27 09:47:31.331917 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
2025-11-27 09:47:31.331930 | controller | Thursday 27 November 2025  09:47:31 +0000 (0:00:00.079)       0:04:39.351 *****
2025-11-27 09:47:31.331938 | controller | skipping: [instance]
2025-11-27 09:47:32.941114 | controller |
2025-11-27 09:47:32.941155 | controller | TASK [podman : Ensure podman is installed] *************************************
2025-11-27 09:47:32.941163 | controller | Thursday 27 November 2025  09:47:31 +0000 (0:00:00.047)       0:04:39.398 *****
2025-11-27 09:47:32.941174 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:33.753698 | controller |
2025-11-27 09:47:33.753737 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] *********************
2025-11-27 09:47:33.753745 | controller | Thursday 27 November 2025  09:47:32 +0000 (0:00:01.608)       0:04:41.007 *****
2025-11-27 09:47:33.753756 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:33.888640 | controller |
2025-11-27 09:47:33.888676 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
2025-11-27 09:47:33.888684 | controller | Thursday 27 November 2025  09:47:33 +0000 (0:00:00.812)       0:04:41.819 *****
2025-11-27 09:47:33.888694 | controller | skipping: [instance]
2025-11-27 09:47:33.930860 | controller |
2025-11-27 09:47:33.930879 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
2025-11-27 09:47:33.930886 | controller | Thursday 27 November 2025  09:47:33 +0000 (0:00:00.135)       0:04:41.955 *****
2025-11-27 09:47:33.930895 | controller | skipping: [instance]
2025-11-27 09:47:33.986088 | controller |
2025-11-27 09:47:33.986108 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
2025-11-27 09:47:33.986115 | controller | Thursday 27 November 2025  09:47:33 +0000 (0:00:00.042)       0:04:41.997 *****
2025-11-27 09:47:33.986123 | controller | skipping: [instance]
2025-11-27 09:47:45.585421 | controller |
2025-11-27 09:47:45.585480 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
2025-11-27 09:47:45.585489 | controller | Thursday 27 November 2025  09:47:33 +0000 (0:00:00.055)       0:04:42.052 *****
2025-11-27 09:47:45.585501 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:47.292312 | controller |
2025-11-27 09:47:47.292383 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] **************
2025-11-27 09:47:47.292393 | controller | Thursday 27 November 2025  09:47:45 +0000 (0:00:11.598)       0:04:53.651 *****
2025-11-27 09:47:47.292405 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:48.547866 | controller |
2025-11-27 09:47:48.547913 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2025-11-27 09:47:48.547922 | controller | Thursday 27 November 2025  09:47:47 +0000 (0:00:01.706)       0:04:55.358 *****
2025-11-27 09:47:48.547934 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2025-11-27 09:47:48.593743 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2025-11-27 09:47:48.593761 | controller |
2025-11-27 09:47:48.593768 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] *************
2025-11-27 09:47:48.593774 | controller | Thursday 27 November 2025  09:47:48 +0000 (0:00:01.255)       0:04:56.613 *****
2025-11-27 09:47:48.593788 | controller | skipping: [instance]
2025-11-27 09:47:49.251248 | controller |
2025-11-27 09:47:49.251286 | controller | TASK [reproducer : Check if baremetal-info.yml exists] *************************
2025-11-27 09:47:49.251294 | controller | Thursday 27 November 2025  09:47:48 +0000 (0:00:00.047)       0:04:56.660 *****
2025-11-27 09:47:49.251305 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:49.295422 | controller |
2025-11-27 09:47:49.295448 | controller | TASK [reproducer : Get content of baremetal-info file] *************************
2025-11-27 09:47:49.295456 | controller | Thursday 27 November 2025  09:47:49 +0000 (0:00:00.656)       0:04:57.317 *****
2025-11-27 09:47:49.295464 | controller | skipping: [instance]
2025-11-27 09:47:49.354772 | controller |
2025-11-27 09:47:49.354789 | controller | TASK [reproducer : Interpret remote file content as yaml] **********************
2025-11-27 09:47:49.354796 | controller | Thursday 27 November 2025  09:47:49 +0000 (0:00:00.044)       0:04:57.362 *****
2025-11-27 09:47:49.354804 | controller | skipping: [instance]
2025-11-27 09:47:49.405123 | controller |
2025-11-27 09:47:49.405148 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2025-11-27 09:47:49.405159 | controller | Thursday 27 November 2025  09:47:49 +0000 (0:00:00.059)       0:04:57.421 *****
2025-11-27 09:47:49.405171 | controller | skipping: [instance]
2025-11-27 09:47:49.448165 | controller |
2025-11-27 09:47:49.448183 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2025-11-27 09:47:49.448190 | controller | Thursday 27 November 2025  09:47:49 +0000 (0:00:00.050)       0:04:57.471 *****
2025-11-27 09:47:49.448198 | controller | skipping: [instance]
2025-11-27 09:47:49.594188 | controller |
2025-11-27 09:47:49.594207 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
2025-11-27 09:47:49.594214 | controller | Thursday 27 November 2025  09:47:49 +0000 (0:00:00.042)       0:04:57.514 *****
2025-11-27 09:47:49.594222 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '5fed9f9c-75c8-420e-a0e6-7814265a94ad'})
2025-11-27 09:47:50.696510 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': 'c2007929-5f56-4238-af14-4e7b76ef2fb4'})
2025-11-27 09:47:50.696564 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '63273350-2384-4399-b74e-fd3bfe2b3b2a'})
2025-11-27 09:47:50.696572 | controller |
2025-11-27 09:47:50.696579 | controller | TASK [reproducer : Output baremetal info file] *********************************
2025-11-27 09:47:50.696585 | controller | Thursday 27 November 2025  09:47:49 +0000 (0:00:00.144)       0:04:57.659 *****
2025-11-27 09:47:50.696597 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:50.745553 | controller |
2025-11-27 09:47:50.745581 | controller | TASK [reproducer : Output ironic_nodes to file] ********************************
2025-11-27 09:47:50.745591 | controller | Thursday 27 November 2025  09:47:50 +0000 (0:00:01.100)       0:04:58.760 *****
2025-11-27 09:47:50.745604 | controller | skipping: [instance]
2025-11-27 09:47:50.900147 | controller |
2025-11-27 09:47:50.900170 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
2025-11-27 09:47:50.900180 | controller | Thursday 27 November 2025  09:47:50 +0000 (0:00:00.047)       0:04:58.807 *****
2025-11-27 09:47:50.900190 | controller |
2025-11-27 09:47:50.963491 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
2025-11-27 09:47:50.963510 | controller | Thursday 27 November 2025  09:47:50 +0000 (0:00:00.158)       0:04:58.966 *****
2025-11-27 09:47:50.963521 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:51.018557 | controller |
2025-11-27 09:47:51.018577 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2025-11-27 09:47:51.018586 | controller | Thursday 27 November 2025  09:47:50 +0000 (0:00:00.062)       0:04:59.029 *****
2025-11-27 09:47:51.018595 | controller | skipping: [instance]
2025-11-27 09:47:51.065953 | controller |
2025-11-27 09:47:51.065976 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2025-11-27 09:47:51.065985 | controller | Thursday 27 November 2025  09:47:51 +0000 (0:00:00.055)       0:04:59.085 *****
2025-11-27 09:47:51.065994 | controller | skipping: [instance]
2025-11-27 09:47:52.565694 | controller |
2025-11-27 09:47:52.565748 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
2025-11-27 09:47:52.565756 | controller | Thursday 27 November 2025  09:47:51 +0000 (0:00:00.047)       0:04:59.132 *****
2025-11-27 09:47:52.565769 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:47:57.722884 | controller |
2025-11-27 09:47:57.722935 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
2025-11-27 09:47:57.722944 | controller | Thursday 27 November 2025  09:47:52 +0000 (0:00:01.499)       0:05:00.631 *****
2025-11-27 09:47:57.722956 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=5fed9f9c-75c8-420e-a0e6-7814265a94ad)
2025-11-27 09:47:57.832839 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=c2007929-5f56-4238-af14-4e7b76ef2fb4)
2025-11-27 09:47:57.832893 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=63273350-2384-4399-b74e-fd3bfe2b3b2a)
2025-11-27 09:47:57.832901 | controller |
2025-11-27 09:47:57.832907 | controller | TASK [sushy_emulator : Verify baremetal VM power status] ***********************
2025-11-27 09:47:57.832913 | controller | Thursday 27 November 2025  09:47:57 +0000 (0:00:05.156)       0:05:05.788 *****
2025-11-27 09:47:57.832924 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
2025-11-27 09:47:58.081073 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
2025-11-27 09:47:58.081111 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
2025-11-27 09:47:58.081120 | controller |
2025-11-27 09:47:58.081126 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
2025-11-27 09:47:58.081131 | controller | Thursday 27 November 2025  09:47:57 +0000 (0:00:00.110)       0:05:05.899 *****
2025-11-27 09:47:58.081143 | controller | ok: [instance -> localhost]
2025-11-27 09:48:00.372457 | controller |
2025-11-27 09:48:00.372512 | controller | TASK [reproducer : Sync local repositories to other hosts if present] **********
2025-11-27 09:48:00.372528 | controller | Thursday 27 November 2025  09:47:58 +0000 (0:00:00.248)       0:05:06.147 *****
2025-11-27 09:48:00.372540 | controller | changed: [instance -> localhost] => (item=controller-0)
2025-11-27 09:48:01.084599 | controller |
2025-11-27 09:48:01.084654 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
2025-11-27 09:48:01.084662 | controller | Thursday 27 November 2025  09:48:00 +0000 (0:00:02.290)       0:05:08.438 *****
2025-11-27 09:48:01.084675 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:01.989167 | controller |
2025-11-27 09:48:01.989212 | controller | TASK [reproducer : Install ansible dependencies] *******************************
2025-11-27 09:48:01.989220 | controller | Thursday 27 November 2025  09:48:01 +0000 (0:00:00.711)       0:05:09.150 *****
2025-11-27 09:48:01.989232 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:03.213300 | controller |
2025-11-27 09:48:03.213365 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
2025-11-27 09:48:03.213376 | controller | Thursday 27 November 2025  09:48:01 +0000 (0:00:00.905)       0:05:10.055 *****
2025-11-27 09:48:03.213388 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:03.972050 | controller |
2025-11-27 09:48:03.972101 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
2025-11-27 09:48:03.972110 | controller | Thursday 27 November 2025  09:48:03 +0000 (0:00:01.220)       0:05:11.276 *****
2025-11-27 09:48:03.972122 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:05.132387 | controller |
2025-11-27 09:48:05.132455 | controller | TASK [reproducer : Inject local environment parameters] ************************
2025-11-27 09:48:05.132463 | controller | Thursday 27 November 2025  09:48:03 +0000 (0:00:00.761)       0:05:12.038 *****
2025-11-27 09:48:05.132475 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:05.841967 | controller |
2025-11-27 09:48:05.842026 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
2025-11-27 09:48:05.842035 | controller | Thursday 27 November 2025  09:48:05 +0000 (0:00:01.160)       0:05:13.198 *****
2025-11-27 09:48:05.842046 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:06.493789 | controller |
2025-11-27 09:48:06.493845 | controller | TASK [reproducer : Get interfaces-info content] ********************************
2025-11-27 09:48:06.493853 | controller | Thursday 27 November 2025  09:48:05 +0000 (0:00:00.707)       0:05:13.905 *****
2025-11-27 09:48:06.493865 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:07.976865 | controller |
2025-11-27 09:48:07.976923 | controller | TASK [reproducer : Wait for OCP nodes to be ready] *****************************
2025-11-27 09:48:07.976931 | controller | Thursday 27 November 2025  09:48:06 +0000 (0:00:00.653)       0:05:14.559 *****
2025-11-27 09:48:07.976944 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2025-11-27 09:48:07.977119 | controller |
2025-11-27 09:48:07.977264 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-11-27 09:48:07.977431 | controller | Thursday 27 November 2025  09:48:07 +0000 (0:00:01.479)       0:05:16.039 *****
2025-11-27 09:48:08.014164 | controller | skipping: [instance]
2025-11-27 09:48:08.053320 | controller |
2025-11-27 09:48:08.053377 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-11-27 09:48:08.053389 | controller | Thursday 27 November 2025  09:48:08 +0000 (0:00:00.041)       0:05:16.081 *****
2025-11-27 09:48:08.053402 | controller | skipping: [instance]
2025-11-27 09:48:08.098980 | controller |
2025-11-27 09:48:08.099004 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-11-27 09:48:08.099012 | controller | Thursday 27 November 2025  09:48:08 +0000 (0:00:00.038)       0:05:16.120 *****
2025-11-27 09:48:08.099021 | controller | skipping: [instance]
2025-11-27 09:48:08.147921 | controller |
2025-11-27 09:48:08.147947 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-11-27 09:48:08.147957 | controller | Thursday 27 November 2025  09:48:08 +0000 (0:00:00.045)       0:05:16.165 *****
2025-11-27 09:48:08.147969 | controller | skipping: [instance]
2025-11-27 09:48:08.193826 | controller |
2025-11-27 09:48:08.193850 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-11-27 09:48:08.193860 | controller | Thursday 27 November 2025  09:48:08 +0000 (0:00:00.048)       0:05:16.214 *****
2025-11-27 09:48:08.193871 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:08.309196 | controller |
2025-11-27 09:48:08.309241 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-11-27 09:48:08.309249 | controller | Thursday 27 November 2025  09:48:08 +0000 (0:00:00.045)       0:05:16.260 *****
2025-11-27 09:48:08.309264 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
2025-11-27 09:48:08.367980 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={})
2025-11-27 09:48:08.368006 | controller |
2025-11-27 09:48:08.368016 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-11-27 09:48:08.368024 | controller | Thursday 27 November 2025  09:48:08 +0000 (0:00:00.114)       0:05:16.375 *****
2025-11-27 09:48:08.368043 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
2025-11-27 09:48:12.064302 | controller |
2025-11-27 09:48:12.064372 | controller | TASK [networking_mapper : Gather the facts] ************************************
2025-11-27 09:48:12.064382 | controller | Thursday 27 November 2025  09:48:08 +0000 (0:00:00.059)       0:05:16.434 *****
2025-11-27 09:48:12.064395 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2025-11-27 09:48:13.216719 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
2025-11-27 09:48:13.216778 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2025-11-27 09:48:13.216786 | controller |
2025-11-27 09:48:13.216823 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
2025-11-27 09:48:13.216831 | controller | Thursday 27 November 2025  09:48:12 +0000 (0:00:03.693)       0:05:20.128 *****
2025-11-27 09:48:13.216843 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:13.727762 | controller |
2025-11-27 09:48:13.727811 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-11-27 09:48:13.727820 | controller | Thursday 27 November 2025  09:48:13 +0000 (0:00:01.154)       0:05:21.282 *****
2025-11-27 09:48:13.727832 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:13.728188 | controller |
2025-11-27 09:48:14.772957 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-11-27 09:48:14.773016 | controller | Thursday 27 November 2025  09:48:13 +0000 (0:00:00.511)       0:05:21.793 *****
2025-11-27 09:48:14.773030 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:14.867165 | controller |
2025-11-27 09:48:14.867217 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-11-27 09:48:14.867225 | controller | Thursday 27 November 2025  09:48:14 +0000 (0:00:01.043)       0:05:22.837 *****
2025-11-27 09:48:14.867236 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:14.931809 | controller |
2025-11-27 09:48:14.931828 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-11-27 09:48:14.931835 | controller | Thursday 27 November 2025  09:48:14 +0000 (0:00:00.095)       0:05:22.933 *****
2025-11-27 09:48:14.931843 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:15.988006 | controller |
2025-11-27 09:48:15.988057 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-11-27 09:48:15.988065 | controller | Thursday 27 November 2025  09:48:14 +0000 (0:00:00.065)       0:05:22.998 *****
2025-11-27 09:48:15.988079 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:16.937560 | controller |
2025-11-27 09:48:16.937612 | controller | TASK [reproducer : Inject CRC ssh key] *****************************************
2025-11-27 09:48:16.937620 | controller | Thursday 27 November 2025  09:48:15 +0000 (0:00:01.055)       0:05:24.054 *****
2025-11-27 09:48:16.937632 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:23.002353 | controller |
2025-11-27 09:48:23.002405 | controller | TASK [reproducer : Ensure we have all dependencies installed] ******************
2025-11-27 09:48:23.002414 | controller | Thursday 27 November 2025  09:48:16 +0000 (0:00:00.948)       0:05:25.002 *****
2025-11-27 09:48:23.002426 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
2025-11-27 09:48:23.207144 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:23.207189 | controller |
2025-11-27 09:48:23.207197 | controller | TASK [Configure ntp service] ***************************************************
2025-11-27 09:48:23.207213 | controller | Thursday 27 November 2025  09:48:22 +0000 (0:00:06.065)       0:05:31.068 *****
2025-11-27 09:48:23.207225 | controller |
2025-11-27 09:48:24.242659 | controller | TASK [cifmw_ntp : Install chrony] **********************************************
2025-11-27 09:48:24.242731 | controller | Thursday 27 November 2025  09:48:23 +0000 (0:00:00.205)       0:05:31.273 *****
2025-11-27 09:48:24.242745 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:25.352288 | controller |
2025-11-27 09:48:25.352364 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] *************************
2025-11-27 09:48:25.352378 | controller | Thursday 27 November 2025  09:48:24 +0000 (0:00:01.035)       0:05:32.308 *****
2025-11-27 09:48:25.352390 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
2025-11-27 09:48:26.352727 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
2025-11-27 09:48:26.352771 | controller |
2025-11-27 09:48:26.352779 | controller | TASK [cifmw_ntp : Render chrony extra config file] *****************************
2025-11-27 09:48:26.352785 | controller | Thursday 27 November 2025  09:48:25 +0000 (0:00:01.108)       0:05:33.417 *****
2025-11-27 09:48:26.352795 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:27.032027 | controller |
2025-11-27 09:48:27.032072 | controller | TASK [cifmw_ntp : Enable chrony service] ***************************************
2025-11-27 09:48:27.032080 | controller | Thursday 27 November 2025  09:48:26 +0000 (0:00:01.001)       0:05:34.419 *****
2025-11-27 09:48:27.032091 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:27.200188 | controller |
2025-11-27 09:48:27.200226 | controller | TASK [reproducer : Configure CRC node if available] ****************************
2025-11-27 09:48:27.200234 | controller | Thursday 27 November 2025  09:48:27 +0000 (0:00:00.678)       0:05:35.098 *****
2025-11-27 09:48:27.200246 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
2025-11-27 09:48:27.769528 | controller |
2025-11-27 09:48:27.769580 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] ***
2025-11-27 09:48:27.769596 | controller | Thursday 27 November 2025  09:48:27 +0000 (0:00:00.168)       0:05:35.266 *****
2025-11-27 09:48:27.769609 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:28.376835 | controller |
2025-11-27 09:48:28.376887 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ********************
2025-11-27 09:48:28.376896 | controller | Thursday 27 November 2025  09:48:27 +0000 (0:00:00.569)       0:05:35.835 *****
2025-11-27 09:48:28.376909 | controller | ok: [instance -> crc-0(crc-0.instance)]
2025-11-27 09:48:29.133258 | controller |
2025-11-27 09:48:29.133319 | controller | TASK [reproducer : Configure local DNS for CRC pod] ****************************
2025-11-27 09:48:29.133327 | controller | Thursday 27 November 2025  09:48:28 +0000 (0:00:00.606)       0:05:36.441 *****
2025-11-27 09:48:29.133356 | controller | changed: [instance -> crc-0(crc-0.instance)]
2025-11-27 09:48:29.692749 | controller |
2025-11-27 09:48:29.692807 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
2025-11-27 09:48:29.692817 | controller | Thursday 27 November 2025  09:48:29 +0000 (0:00:00.757)       0:05:37.199 *****
2025-11-27 09:48:29.692829 | controller | changed: [instance -> crc-0(crc-0.instance)]
2025-11-27 09:48:29.743903 | controller |
2025-11-27 09:48:29.743925 | controller | TASK [Restart DNS in CRC VM] ***************************************************
2025-11-27 09:48:29.743933 | controller | Thursday 27 November 2025  09:48:29 +0000 (0:00:00.559)       0:05:37.758 *****
2025-11-27 09:48:29.743943 | controller |
2025-11-27 09:48:30.293513 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
2025-11-27 09:48:30.293570 | controller | Thursday 27 November 2025  09:48:29 +0000 (0:00:00.051)       0:05:37.810 *****
2025-11-27 09:48:30.293583 | controller | ok: [instance -> crc-0(crc-0.instance)]
2025-11-27 09:48:31.058462 | controller |
2025-11-27 09:48:31.058522 | controller | TASK [openshift_setup : Restart dnsmasq service if used] ***********************
2025-11-27 09:48:31.058540 | controller | Thursday 27 November 2025  09:48:30 +0000 (0:00:00.549)       0:05:38.359 *****
2025-11-27 09:48:31.058553 | controller | changed: [instance -> crc-0(crc-0.instance)]
2025-11-27 09:48:31.097801 | controller |
2025-11-27 09:48:31.097827 | controller | TASK [openshift_setup : Stop dnsmasq] ******************************************
2025-11-27 09:48:31.097837 | controller | Thursday 27 November 2025  09:48:31 +0000 (0:00:00.764)       0:05:39.124 *****
2025-11-27 09:48:31.097850 | controller | skipping: [instance]
2025-11-27 09:48:31.141368 | controller |
2025-11-27 09:48:31.141393 | controller | TASK [openshift_setup : Start dnsmasq] *****************************************
2025-11-27 09:48:31.141403 | controller | Thursday 27 November 2025  09:48:31 +0000 (0:00:00.040)       0:05:39.164 *****
2025-11-27 09:48:31.141415 | controller | skipping: [instance]
2025-11-27 09:48:31.415697 | controller |
2025-11-27 09:48:31.415744 | controller | TASK [reproducer : Remove entry from /etc/hosts] *******************************
2025-11-27 09:48:31.415755 | controller | Thursday 27 November 2025  09:48:31 +0000 (0:00:00.043)       0:05:39.207 *****
2025-11-27 09:48:31.415769 | controller | changed: [instance]
2025-11-27 09:48:31.580683 | controller |
2025-11-27 09:48:31.580702 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
2025-11-27 09:48:31.580709 | controller | Thursday 27 November 2025  09:48:31 +0000 (0:00:00.273)       0:05:39.481 *****
2025-11-27 09:48:31.580718 | controller | skipping: [instance] => (item=)
2025-11-27 09:48:31.630662 | controller |
2025-11-27 09:48:31.630685 | controller | TASK [dnsmasq : Assert we have needed address data] ****************************
2025-11-27 09:48:31.630694 | controller | Thursday 27 November 2025  09:48:31 +0000 (0:00:00.165)       0:05:39.647 *****
2025-11-27 09:48:31.630705 | controller | ok: [instance]
2025-11-27 09:48:31.706914 | controller |
2025-11-27 09:48:31.706937 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-11-27 09:48:31.706946 | controller | Thursday 27 November 2025  09:48:31 +0000 (0:00:00.050)       0:05:39.697 *****
2025-11-27 09:48:31.706957 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2025-11-27 09:48:32.063171 | controller |
2025-11-27 09:48:32.063217 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-11-27 09:48:32.063225 | controller | Thursday 27 November 2025  09:48:31 +0000 (0:00:00.076)       0:05:39.773 *****
2025-11-27 09:48:32.063237 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2025-11-27 09:48:32.063439 | controller |
2025-11-27 09:48:32.063464 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
2025-11-27 09:48:32.113298 | controller | Thursday 27 November 2025  09:48:32 +0000 (0:00:00.355)       0:05:40.129 *****
2025-11-27 09:48:32.113320 | controller |
2025-11-27 09:48:32.193968 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-11-27 09:48:32.194023 | controller | Thursday 27 November 2025  09:48:32 +0000 (0:00:00.050)       0:05:40.180 *****
2025-11-27 09:48:32.194037 | controller | ok: [instance]
2025-11-27 09:48:32.194058 | controller |
2025-11-27 09:48:32.194067 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-11-27 09:48:32.276347 | controller | Thursday 27 November 2025  09:48:32 +0000 (0:00:00.080)       0:05:40.260 *****
2025-11-27 09:48:32.276397 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2025-11-27 09:48:32.276432 | controller |
2025-11-27 09:48:32.276538 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-11-27 09:48:32.276654 | controller | Thursday 27 November 2025  09:48:32 +0000 (0:00:00.080)       0:05:40.341 *****
2025-11-27 09:48:32.564786 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2025-11-27 09:48:33.017211 | controller |
2025-11-27 09:48:33.017261 | controller | TASK [reproducer : Ensure "testing" domain is "local"] *************************
2025-11-27 09:48:33.017269 | controller | Thursday 27 November 2025  09:48:32 +0000 (0:00:00.289)       0:05:40.630 *****
2025-11-27 09:48:33.017282 | controller | changed: [instance]
2025-11-27 09:48:33.822975 | controller |
2025-11-27 09:48:33.823032 | controller | TASK [reproducer : Flush handlers] *********************************************
2025-11-27 09:48:33.823040 | controller | Thursday 27 November 2025  09:48:33 +0000 (0:00:00.440)       0:05:41.071 *****
2025-11-27 09:48:33.823046 | controller |
2025-11-27 09:48:33.823051 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
2025-11-27 09:48:33.823056 | controller | Thursday 27 November 2025  09:48:33 +0000 (0:00:00.011)       0:05:41.083 *****
2025-11-27 09:48:33.823068 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:34.262071 | controller |
2025-11-27 09:48:34.262121 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-11-27 09:48:34.262130 | controller | Thursday 27 November 2025  09:48:33 +0000 (0:00:00.804)       0:05:41.887 *****
2025-11-27 09:48:34.262142 | controller | changed: [instance]
2025-11-27 09:48:34.447025 | controller |
2025-11-27 09:48:34.447053 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
2025-11-27 09:48:34.447061 | controller | Thursday 27 November 2025  09:48:34 +0000 (0:00:00.440)       0:05:42.328 *****
2025-11-27 09:48:34.447070 | controller | skipping: [instance] => (item=controller-0)
2025-11-27 09:48:36.006531 | controller | skipping: [instance] => (item=crc-0)
2025-11-27 09:48:36.006622 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
2025-11-27 09:48:36.006632 | controller |
2025-11-27 09:48:36.006638 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
2025-11-27 09:48:36.006645 | controller | Thursday 27 November 2025  09:48:34 +0000 (0:00:00.184)       0:05:42.512 *****
2025-11-27 09:48:36.006659 | controller | changed: [instance -> compute-0(compute-0.instance)]
2025-11-27 09:48:36.037062 | controller |
2025-11-27 09:48:36.037085 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2025-11-27 09:48:36.037092 | controller | Thursday 27 November 2025  09:48:36 +0000 (0:00:01.559)       0:05:44.072 *****
2025-11-27 09:48:36.037101 | controller | skipping: [instance]
2025-11-27 09:48:36.579557 | controller |
2025-11-27 09:48:36.579617 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2025-11-27 09:48:36.579626 | controller | Thursday 27 November 2025  09:48:36 +0000 (0:00:00.031)       0:05:44.103 *****
2025-11-27 09:48:36.579638 | controller | ok: [instance -> compute-0(compute-0.instance)]
2025-11-27 09:48:36.579756 | controller |
2025-11-27 09:48:36.579818 | controller | TASK [install_ca : Install internal CA from url] *******************************
2025-11-27 09:48:36.636603 | controller | Thursday 27 November 2025  09:48:36 +0000 (0:00:00.542)       0:05:44.645 *****
2025-11-27 09:48:36.636638 | controller | skipping: [instance]
2025-11-27 09:48:36.636714 | controller |
2025-11-27 09:48:36.636766 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2025-11-27 09:48:36.636778 | controller | Thursday 27 November 2025  09:48:36 +0000 (0:00:00.057)       0:05:44.703 *****
2025-11-27 09:48:36.672820 | controller | skipping: [instance]
2025-11-27 09:48:36.672857 | controller |
2025-11-27 09:48:36.672949 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2025-11-27 09:48:36.673058 | controller | Thursday 27 November 2025  09:48:36 +0000 (0:00:00.036)       0:05:44.739 *****
2025-11-27 09:48:36.709096 | controller | skipping: [instance]
2025-11-27 09:48:38.269506 | controller |
2025-11-27 09:48:38.269550 | controller | TASK [install_ca : Update ca bundle] *******************************************
2025-11-27 09:48:38.269559 | controller | Thursday 27 November 2025  09:48:36 +0000 (0:00:00.035)       0:05:44.775 *****
2025-11-27 09:48:38.269572 | controller | changed: [instance -> compute-0(compute-0.instance)]
2025-11-27 09:48:38.314863 | controller |
2025-11-27 09:48:38.314886 | controller | TASK [reproducer : Get rhos-release and setup repos] ***************************
2025-11-27 09:48:38.314894 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:01.559)       0:05:46.335 *****
2025-11-27 09:48:38.314910 | controller | skipping: [instance]
2025-11-27 09:48:38.315027 | controller |
2025-11-27 09:48:38.315103 | controller | TASK [reproducer : Create repositories on computes] ****************************
2025-11-27 09:48:38.341172 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:00.045)       0:05:46.381 *****
2025-11-27 09:48:38.341213 | controller | skipping: [instance]
2025-11-27 09:48:38.376016 | controller |
2025-11-27 09:48:38.376039 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
2025-11-27 09:48:38.376048 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:00.026)       0:05:46.407 *****
2025-11-27 09:48:38.376061 | controller | skipping: [instance]
2025-11-27 09:48:38.440099 | controller |
2025-11-27 09:48:38.440132 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2025-11-27 09:48:38.440141 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:00.035)       0:05:46.442 *****
2025-11-27 09:48:38.440152 | controller | ok: [instance]
2025-11-27 09:48:38.440173 | controller |
2025-11-27 09:48:38.440234 | controller | TASK [reproducer : Push local code] ********************************************
2025-11-27 09:48:38.440332 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:00.064)       0:05:46.507 *****
2025-11-27 09:48:38.551176 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
2025-11-27 09:48:38.601623 | controller |
2025-11-27 09:48:38.601676 | controller | TASK [reproducer : Check if repository directories already exist] **************
2025-11-27 09:48:38.601685 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:00.110)       0:05:46.617 *****
2025-11-27 09:48:38.601697 | controller | skipping: [instance]
2025-11-27 09:48:38.601729 | controller |
2025-11-27 09:48:38.601737 | controller | TASK [reproducer : Ensure we are not in the job_id branch] *********************
2025-11-27 09:48:38.654188 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:00.050)       0:05:46.668 *****
2025-11-27 09:48:38.654228 | controller | skipping: [instance]
2025-11-27 09:48:38.654558 | controller |
2025-11-27 09:48:38.654591 | controller | TASK [reproducer : Fetch zuul.items repositories] ******************************
2025-11-27 09:48:38.702506 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:00.052)       0:05:46.720 *****
2025-11-27 09:48:38.702567 | controller | skipping: [instance]
2025-11-27 09:48:38.702604 | controller |
2025-11-27 09:48:38.702734 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
2025-11-27 09:48:38.702763 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:00.048)       0:05:46.769 *****
2025-11-27 09:48:38.760941 | controller | skipping: [instance]
2025-11-27 09:48:38.797889 | controller |
2025-11-27 09:48:38.797906 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
2025-11-27 09:48:38.797920 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:00.057)       0:05:46.827 *****
2025-11-27 09:48:38.797929 | controller | skipping: [instance]
2025-11-27 09:48:39.295140 | controller |
2025-11-27 09:48:39.295180 | controller | TASK [reproducer : Create target directories beforehand] ***********************
2025-11-27 09:48:39.295189 | controller | Thursday 27 November 2025  09:48:38 +0000 (0:00:00.037)       0:05:46.864 *****
2025-11-27 09:48:39.295200 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
2025-11-27 09:48:39.914136 | controller |
2025-11-27 09:48:39.914186 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2025-11-27 09:48:39.914194 | controller | Thursday 27 November 2025  09:48:39 +0000 (0:00:00.496)       0:05:47.361 *****
2025-11-27 09:48:39.914206 | controller | ok: [instance -> localhost] => (item=ci-framework)
2025-11-27 09:48:39.962248 | controller |
2025-11-27 09:48:39.962279 | controller | TASK [reproducer : Sync remote repositories] ***********************************
2025-11-27 09:48:39.962287 | controller | Thursday 27 November 2025  09:48:39 +0000 (0:00:00.618)       0:05:47.980 *****
2025-11-27 09:48:39.962298 | controller | skipping: [instance] => (item=ci-framework)
2025-11-27 09:48:40.045501 | controller | skipping: [instance]
2025-11-27 09:48:40.045575 | controller |
2025-11-27 09:48:40.045585 | controller | TASK [reproducer : Ensure default repositories are present] ********************
2025-11-27 09:48:40.045592 | controller | Thursday 27 November 2025  09:48:39 +0000 (0:00:00.048)       0:05:48.028 *****
2025-11-27 09:48:40.045612 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework)
2025-11-27 09:48:40.045701 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls)
2025-11-27 09:48:40.045712 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture)
2025-11-27 09:48:40.045911 | controller |
2025-11-27 09:48:40.045960 | controller | TASK [reproducer : Check repository availability: ci-framework] ****************
2025-11-27 09:48:40.587372 | controller | Thursday 27 November 2025  09:48:40 +0000 (0:00:00.083)       0:05:48.112 *****
2025-11-27 09:48:40.587433 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:40.587542 | controller |
2025-11-27 09:48:40.587612 | controller | TASK [reproducer : Clone repository if needed: ci-framework] *******************
2025-11-27 09:48:40.587630 | controller | Thursday 27 November 2025  09:48:40 +0000 (0:00:00.541)       0:05:48.653 *****
2025-11-27 09:48:40.636393 | controller | skipping: [instance]
2025-11-27 09:48:41.176555 | controller |
2025-11-27 09:48:41.176680 | controller | TASK [reproducer : Check repository availability: install_yamls] ***************
2025-11-27 09:48:41.176691 | controller | Thursday 27 November 2025  09:48:40 +0000 (0:00:00.049)       0:05:48.703 *****
2025-11-27 09:48:41.176719 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:41.176748 | controller |
2025-11-27 09:48:41.176757 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ******************
2025-11-27 09:48:41.176767 | controller | Thursday 27 November 2025  09:48:41 +0000 (0:00:00.539)       0:05:49.242 *****
2025-11-27 09:48:41.224387 | controller | skipping: [instance]
2025-11-27 09:48:41.224450 | controller |
2025-11-27 09:48:41.224610 | controller | TASK [reproducer : Check repository availability: architecture] ****************
2025-11-27 09:48:41.224681 | controller | Thursday 27 November 2025  09:48:41 +0000 (0:00:00.048)       0:05:49.290 *****
2025-11-27 09:48:41.735950 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:48:44.044072 | controller |
2025-11-27 09:48:44.044145 | controller | TASK [reproducer : Clone repository if needed: architecture] *******************
2025-11-27 09:48:44.044154 | controller | Thursday 27 November 2025  09:48:41 +0000 (0:00:00.510)       0:05:49.801 *****
2025-11-27 09:48:44.044171 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:03.515160 | controller |
2025-11-27 09:49:03.515240 | controller | TASK [reproducer : Install collections on controller-0] ************************
2025-11-27 09:49:03.515249 | controller | Thursday 27 November 2025  09:48:44 +0000 (0:00:02.308)       0:05:52.110 *****
2025-11-27 09:49:03.515264 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:03.515405 | controller |
2025-11-27 09:49:03.515425 | controller | TASK [reproducer : Inject CI Framework motd] ***********************************
2025-11-27 09:49:03.515524 | controller | Thursday 27 November 2025  09:49:03 +0000 (0:00:19.463)       0:06:11.573 *****
2025-11-27 09:49:04.624212 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:04.746077 | controller |
2025-11-27 09:49:04.746117 | controller | TASK [reproducer : Rotate some logs] *******************************************
2025-11-27 09:49:04.746125 | controller | Thursday 27 November 2025  09:49:04 +0000 (0:00:01.115)       0:06:12.689 *****
2025-11-27 09:49:04.746136 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log)
2025-11-27 09:49:05.290594 | controller |
2025-11-27 09:49:05.290651 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] *********************
2025-11-27 09:49:05.290660 | controller | Thursday 27 November 2025  09:49:04 +0000 (0:00:00.122)       0:06:12.812 *****
2025-11-27 09:49:05.290673 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:05.331608 | controller |
2025-11-27 09:49:05.331656 | controller | TASK [reproducer : Rotate log if present] **************************************
2025-11-27 09:49:05.331665 | controller | Thursday 27 November 2025  09:49:05 +0000 (0:00:00.544)       0:06:13.356 *****
2025-11-27 09:49:05.331692 | controller | skipping: [instance]
2025-11-27 09:49:05.331727 | controller |
2025-11-27 09:49:05.331736 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] ***********************
2025-11-27 09:49:05.331878 | controller | Thursday 27 November 2025  09:49:05 +0000 (0:00:00.041)       0:06:13.398 *****
2025-11-27 09:49:05.379289 | controller | skipping: [instance]
2025-11-27 09:49:05.379421 | controller |
2025-11-27 09:49:05.379488 | controller | TASK [cifmw_setup : Get customized parameters] *********************************
2025-11-27 09:49:05.379503 | controller | Thursday 27 November 2025  09:49:05 +0000 (0:00:00.047)       0:06:13.445 *****
2025-11-27 09:49:05.529238 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:05.529468 | controller |
2025-11-27 09:49:05.529496 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2025-11-27 09:49:06.092192 | controller | Thursday 27 November 2025  09:49:05 +0000 (0:00:00.150)       0:06:13.596 *****
2025-11-27 09:49:06.092252 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:06.092276 | controller |
2025-11-27 09:49:06.092367 | controller | TASK [install_ca : Install internal CA from url] *******************************
2025-11-27 09:49:06.092514 | controller | Thursday 27 November 2025  09:49:06 +0000 (0:00:00.562)       0:06:14.158 *****
2025-11-27 09:49:06.133252 | controller | skipping: [instance]
2025-11-27 09:49:06.241281 | controller |
2025-11-27 09:49:06.241393 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2025-11-27 09:49:06.241404 | controller | Thursday 27 November 2025  09:49:06 +0000 (0:00:00.041)       0:06:14.199 *****
2025-11-27 09:49:06.241417 | controller | skipping: [instance]
2025-11-27 09:49:06.286226 | controller |
2025-11-27 09:49:06.286259 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2025-11-27 09:49:06.286267 | controller | Thursday 27 November 2025  09:49:06 +0000 (0:00:00.107)       0:06:14.307 *****
2025-11-27 09:49:06.286278 | controller | skipping: [instance]
2025-11-27 09:49:07.905149 | controller |
2025-11-27 09:49:07.905225 | controller | TASK [install_ca : Update ca bundle] *******************************************
2025-11-27 09:49:07.905234 | controller | Thursday 27 November 2025  09:49:06 +0000 (0:00:00.045)       0:06:14.352 *****
2025-11-27 09:49:07.905248 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:07.905419 | controller |
2025-11-27 09:49:07.905589 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2025-11-27 09:49:07.905759 | controller | Thursday 27 November 2025  09:49:07 +0000 (0:00:01.618)       0:06:15.971 *****
2025-11-27 09:49:09.476286 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-11-27 09:49:10.521064 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-11-27 09:49:10.521109 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-11-27 09:49:10.521117 | controller | changed: [instance -> controller-0]
2025-11-27 09:49:10.521123 | controller |
2025-11-27 09:49:10.521129 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2025-11-27 09:49:10.521135 | controller | Thursday 27 November 2025  09:49:09 +0000 (0:00:01.570)       0:06:17.541 *****
2025-11-27 09:49:10.521147 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:11.911257 | controller |
2025-11-27 09:49:11.911369 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2025-11-27 09:49:11.911381 | controller | Thursday 27 November 2025  09:49:10 +0000 (0:00:01.045)       0:06:18.587 *****
2025-11-27 09:49:11.911399 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:19.948396 | controller |
2025-11-27 09:49:19.948459 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2025-11-27 09:49:19.948468 | controller | Thursday 27 November 2025  09:49:11 +0000 (0:00:01.389)       0:06:19.976 *****
2025-11-27 09:49:19.948482 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:21.010948 | controller |
2025-11-27 09:49:21.011013 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2025-11-27 09:49:21.011021 | controller | Thursday 27 November 2025  09:49:19 +0000 (0:00:08.037)       0:06:28.014 *****
2025-11-27 09:49:21.011045 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:21.061211 | controller |
2025-11-27 09:49:21.061264 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2025-11-27 09:49:21.061274 | controller | Thursday 27 November 2025  09:49:21 +0000 (0:00:01.062)       0:06:29.076 *****
2025-11-27 09:49:21.061286 | controller | skipping: [instance]
2025-11-27 09:49:21.061429 | controller |
2025-11-27 09:49:21.061458 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2025-11-27 09:49:22.296638 | controller | Thursday 27 November 2025  09:49:21 +0000 (0:00:00.050)       0:06:29.127 *****
2025-11-27 09:49:22.296689 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:22.296711 | controller |
2025-11-27 09:49:22.296763 | controller | TASK [repo_setup : Get component repo] *****************************************
2025-11-27 09:49:22.296876 | controller | Thursday 27 November 2025  09:49:22 +0000 (0:00:01.235)       0:06:30.363 *****
2025-11-27 09:49:22.356846 | controller | skipping: [instance]
2025-11-27 09:49:22.356906 | controller |
2025-11-27 09:49:22.357019 | controller | TASK [repo_setup : Rename component repo] **************************************
2025-11-27 09:49:22.357130 | controller | Thursday 27 November 2025  09:49:22 +0000 (0:00:00.060)       0:06:30.423 *****
2025-11-27 09:49:22.424559 | controller | skipping: [instance]
2025-11-27 09:49:22.424638 | controller |
2025-11-27 09:49:22.424740 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2025-11-27 09:49:22.424837 | controller | Thursday 27 November 2025  09:49:22 +0000 (0:00:00.067)       0:06:30.491 *****
2025-11-27 09:49:22.490267 | controller | skipping: [instance]
2025-11-27 09:49:22.490374 | controller |
2025-11-27 09:49:22.490476 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2025-11-27 09:49:22.490578 | controller | Thursday 27 November 2025  09:49:22 +0000 (0:00:00.065)       0:06:30.557 *****
2025-11-27 09:49:23.532315 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:23.532550 | controller |
2025-11-27 09:49:23.532606 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2025-11-27 09:49:23.532616 | controller | Thursday 27 November 2025  09:49:23 +0000 (0:00:01.041)       0:06:31.598 *****
2025-11-27 09:49:24.532125 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:24.579510 | controller |
2025-11-27 09:49:24.579564 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2025-11-27 09:49:24.579573 | controller | Thursday 27 November 2025  09:49:24 +0000 (0:00:00.999)       0:06:32.597 *****
2025-11-27 09:49:24.579585 | controller | skipping: [instance]
2025-11-27 09:49:24.579615 | controller |
2025-11-27 09:49:24.579623 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2025-11-27 09:49:24.579770 | controller | Thursday 27 November 2025  09:49:24 +0000 (0:00:00.048)       0:06:32.646 *****
2025-11-27 09:49:24.626285 | controller | skipping: [instance]
2025-11-27 09:49:24.673253 | controller |
2025-11-27 09:49:24.673300 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2025-11-27 09:49:24.673310 | controller | Thursday 27 November 2025  09:49:24 +0000 (0:00:00.046)       0:06:32.692 *****
2025-11-27 09:49:24.673321 | controller | skipping: [instance]
2025-11-27 09:49:24.734213 | controller |
2025-11-27 09:49:24.734233 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2025-11-27 09:49:24.734241 | controller | Thursday 27 November 2025  09:49:24 +0000 (0:00:00.047)       0:06:32.739 *****
2025-11-27 09:49:24.734260 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:24.783493 | controller |
2025-11-27 09:49:24.783547 | controller | TASK [repo_setup : Create download directory] **********************************
2025-11-27 09:49:24.783556 | controller | Thursday 27 November 2025  09:49:24 +0000 (0:00:00.061)       0:06:32.800 *****
2025-11-27 09:49:24.783568 | controller | skipping: [instance]
2025-11-27 09:49:24.783608 | controller |
2025-11-27 09:49:24.783616 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2025-11-27 09:49:24.783719 | controller | Thursday 27 November 2025  09:49:24 +0000 (0:00:00.049)       0:06:32.850 *****
2025-11-27 09:49:24.832635 | controller | skipping: [instance]
2025-11-27 09:49:24.876017 | controller |
2025-11-27 09:49:24.876076 | controller | TASK [Download the RPM] ********************************************************
2025-11-27 09:49:24.876085 | controller | Thursday 27 November 2025  09:49:24 +0000 (0:00:00.049)       0:06:32.899 *****
2025-11-27 09:49:24.876099 | controller | skipping: [instance]
2025-11-27 09:49:24.876125 | controller |
2025-11-27 09:49:24.876133 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2025-11-27 09:49:24.919384 | controller | Thursday 27 November 2025  09:49:24 +0000 (0:00:00.043)       0:06:32.942 *****
2025-11-27 09:49:24.919413 | controller | skipping: [instance]
2025-11-27 09:49:24.966460 | controller |
2025-11-27 09:49:24.966489 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2025-11-27 09:49:24.966498 | controller | Thursday 27 November 2025  09:49:24 +0000 (0:00:00.043)       0:06:32.986 *****
2025-11-27 09:49:24.966507 | controller | skipping: [instance]
2025-11-27 09:49:24.966513 | controller |
2025-11-27 09:49:24.966519 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2025-11-27 09:49:24.966527 | controller | Thursday 27 November 2025  09:49:24 +0000 (0:00:00.047)       0:06:33.033 *****
2025-11-27 09:49:25.014495 | controller | skipping: [instance]
2025-11-27 09:49:25.014526 | controller |
2025-11-27 09:49:25.014537 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2025-11-27 09:49:25.014562 | controller | Thursday 27 November 2025  09:49:25 +0000 (0:00:00.047)       0:06:33.080 *****
2025-11-27 09:49:25.056229 | controller | skipping: [instance]
2025-11-27 09:49:25.056310 | controller |
2025-11-27 09:49:25.056486 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2025-11-27 09:49:25.056639 | controller | Thursday 27 November 2025  09:49:25 +0000 (0:00:00.042)       0:06:33.122 *****
2025-11-27 09:49:25.568976 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:25.569035 | controller |
2025-11-27 09:49:25.569100 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2025-11-27 09:49:25.569208 | controller | Thursday 27 November 2025  09:49:25 +0000 (0:00:00.512)       0:06:33.635 *****
2025-11-27 09:49:25.632375 | controller | skipping: [instance]
2025-11-27 09:49:25.632474 | controller |
2025-11-27 09:49:25.632584 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2025-11-27 09:49:25.632684 | controller | Thursday 27 November 2025  09:49:25 +0000 (0:00:00.064)       0:06:33.699 *****
2025-11-27 09:49:25.696397 | controller | skipping: [instance]
2025-11-27 09:49:25.696492 | controller |
2025-11-27 09:49:25.696608 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2025-11-27 09:49:25.696705 | controller | Thursday 27 November 2025  09:49:25 +0000 (0:00:00.063)       0:06:33.763 *****
2025-11-27 09:49:25.744972 | controller | skipping: [instance]
2025-11-27 09:49:25.745064 | controller |
2025-11-27 09:49:25.745172 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2025-11-27 09:49:25.745276 | controller | Thursday 27 November 2025  09:49:25 +0000 (0:00:00.048)       0:06:33.811 *****
2025-11-27 09:49:25.809922 | controller | skipping: [instance]
2025-11-27 09:49:25.810001 | controller |
2025-11-27 09:49:25.810127 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2025-11-27 09:49:25.810222 | controller | Thursday 27 November 2025  09:49:25 +0000 (0:00:00.065)       0:06:33.876 *****
2025-11-27 09:49:25.873147 | controller | skipping: [instance]
2025-11-27 09:49:25.873235 | controller |
2025-11-27 09:49:25.873244 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2025-11-27 09:49:25.873255 | controller | Thursday 27 November 2025  09:49:25 +0000 (0:00:00.062)       0:06:33.939 *****
2025-11-27 09:49:25.936370 | controller | skipping: [instance]
2025-11-27 09:49:25.936548 | controller |
2025-11-27 09:49:25.936643 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2025-11-27 09:49:25.936742 | controller | Thursday 27 November 2025  09:49:25 +0000 (0:00:00.063)       0:06:34.002 *****
2025-11-27 09:49:25.998765 | controller | skipping: [instance]
2025-11-27 09:49:25.998853 | controller |
2025-11-27 09:49:25.998981 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] ***
2025-11-27 09:49:25.999093 | controller | Thursday 27 November 2025  09:49:25 +0000 (0:00:00.062)       0:06:34.065 *****
2025-11-27 09:49:26.069196 | controller | skipping: [instance]
2025-11-27 09:49:26.069277 | controller |
2025-11-27 09:49:26.069415 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2025-11-27 09:49:26.069544 | controller | Thursday 27 November 2025  09:49:26 +0000 (0:00:00.070)       0:06:34.136 *****
2025-11-27 09:49:26.751615 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:26.751711 | controller |
2025-11-27 09:49:26.751757 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2025-11-27 09:49:26.751865 | controller | Thursday 27 November 2025  09:49:26 +0000 (0:00:00.681)       0:06:34.817 *****
2025-11-27 09:49:27.882693 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-11-27 09:49:27.883181 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-11-27 09:49:28.641082 | controller | changed: [instance -> controller-0]
2025-11-27 09:49:28.641142 | controller |
2025-11-27 09:49:28.641150 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2025-11-27 09:49:28.641156 | controller | Thursday 27 November 2025  09:49:27 +0000 (0:00:01.131)       0:06:35.949 *****
2025-11-27 09:49:28.641169 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:29.195531 | controller |
2025-11-27 09:49:29.195568 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2025-11-27 09:49:29.195577 | controller | Thursday 27 November 2025  09:49:28 +0000 (0:00:00.757)       0:06:36.707 *****
2025-11-27 09:49:29.195589 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:29.195623 | controller |
2025-11-27 09:49:29.195632 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2025-11-27 09:49:29.195838 | controller | Thursday 27 November 2025  09:49:29 +0000 (0:00:00.554)       0:06:37.261 *****
2025-11-27 09:49:29.268778 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-11-27 09:49:29.268861 | controller | ok: [instance -> controller-0]
2025-11-27 09:49:29.268882 | controller |
2025-11-27 09:49:29.268889 | controller | TASK [ci_setup : List packages to install] *************************************
2025-11-27 09:49:29.268898 | controller | Thursday 27 November 2025  09:49:29 +0000 (0:00:00.073)       0:06:37.334 *****
2025-11-27 09:49:29.316132 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 09:49:39.560828 | controller |
2025-11-27 09:49:39.560928 | controller | TASK [ci_setup : Install needed packages] **************************************
2025-11-27 09:49:39.560938 | controller | Thursday 27 November 2025  09:49:29 +0000 (0:00:00.047)       0:06:37.382 *****
2025-11-27 09:49:39.560953 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false
2025-11-27 09:49:39.568949 | controller |   censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result'
2025-11-27 09:49:39.569001 | controller |
2025-11-27 09:49:39.569052 | controller | TASK [Create dnsmasq dir] ******************************************************
2025-11-27 09:49:39.569166 | controller | Thursday 27 November 2025  09:49:39 +0000 (0:00:10.253)       0:06:47.635 *****
2025-11-27 09:49:39.798466 | controller | changed: [instance]
2025-11-27 09:49:39.798530 | controller |
2025-11-27 09:49:39.799132 | controller | TASK [Get journalctl in a file] ************************************************
2025-11-27 09:49:40.054556 | controller | Thursday 27 November 2025  09:49:39 +0000 (0:00:00.228)       0:06:47.864 *****
2025-11-27 09:49:40.054615 | controller | changed: [instance]
2025-11-27 09:49:40.054780 | controller |
2025-11-27 09:49:40.054894 | controller | TASK [Dump journalctl output] **************************************************
2025-11-27 09:49:40.054986 | controller | Thursday 27 November 2025  09:49:40 +0000 (0:00:00.256)       0:06:48.121 *****
2025-11-27 09:49:40.491348 | controller | changed: [instance]
2025-11-27 09:49:40.491458 | controller |
2025-11-27 09:49:40.491561 | controller | TASK [Copy all dnsmasq config] *************************************************
2025-11-27 09:49:40.491670 | controller | Thursday 27 November 2025  09:49:40 +0000 (0:00:00.436)       0:06:48.557 *****
2025-11-27 09:49:41.028711 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2025-11-27 09:49:41.028791 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2025-11-27 09:49:41.028875 | controller |
2025-11-27 09:49:41.028978 | controller | TASK [Create log directory] ****************************************************
2025-11-27 09:49:41.029079 | controller | Thursday 27 November 2025  09:49:41 +0000 (0:00:00.537)       0:06:49.095 *****
2025-11-27 09:49:41.262428 | controller | changed: [instance]
2025-11-27 09:49:41.262790 | controller |
2025-11-27 09:49:42.160610 | controller | TASK [Sync logs from controller-0] *********************************************
2025-11-27 09:49:42.160653 | controller | Thursday 27 November 2025  09:49:41 +0000 (0:00:00.233)       0:06:49.328 *****
2025-11-27 09:49:42.160666 | controller | changed: [instance]
2025-11-27 09:49:42.162474 | controller |
2025-11-27 09:49:42.163082 | controller | PLAY RECAP *********************************************************************
2025-11-27 09:49:42.163138 | controller | instance                   : ok=505  changed=190  unreachable=0    failed=1    skipped=205  rescued=0    ignored=0
2025-11-27 09:49:42.163148 | controller |
2025-11-27 09:49:42.163155 | controller | Thursday 27 November 2025  09:49:42 +0000 (0:00:00.896)       0:06:50.224 *****
2025-11-27 09:49:42.163162 | controller | ===============================================================================
2025-11-27 09:49:42.163167 | controller | reproducer : Check package install status ------------------------------ 67.29s
2025-11-27 09:49:42.163173 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.08s
2025-11-27 09:49:42.163179 | controller | libvirt_manager : Download base image ---------------------------------- 21.92s
2025-11-27 09:49:42.163185 | controller | reproducer : Install collections on controller-0 ----------------------- 19.46s
2025-11-27 09:49:42.163191 | controller | libvirt_manager : Install packages required for using KVM -------------- 12.32s
2025-11-27 09:49:42.163207 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.60s
2025-11-27 09:49:42.163213 | controller | ci_setup : Install needed packages ------------------------------------- 10.25s
2025-11-27 09:49:42.163218 | controller | repo_setup : Initialize python venv and install requirements ------------ 8.04s
2025-11-27 09:49:42.163224 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.07s
2025-11-27 09:49:42.163229 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.16s
2025-11-27 09:49:42.163235 | controller | ci_nmstate : Install required packages on localhost --------------------- 4.92s
2025-11-27 09:49:42.163240 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.72s
2025-11-27 09:49:42.163246 | controller | networking_mapper : Gather the facts ------------------------------------ 3.69s
2025-11-27 09:49:42.163251 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.42s
2025-11-27 09:49:42.163264 | controller | sushy_emulator : Install required packages ------------------------------ 2.48s
2025-11-27 09:49:42.366050 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.31s
2025-11-27 09:49:42.366114 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.29s
2025-11-27 09:49:42.366123 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.24s
2025-11-27 09:49:42.366129 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.08s
2025-11-27 09:49:42.366134 | controller | discover_latest_image : Get latest image -------------------------------- 1.87s
2025-11-27 09:49:42.366149 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml']
2025-11-27 09:49:42.366625 | controller | WARNING  An error occurred during the test sequence action: 'converge'. Cleaning up.
2025-11-27 09:49:42.375879 | controller | INFO     Running crc_layout > cleanup
2025-11-27 09:49:42.376370 | controller | WARNING  Skipping, cleanup playbook not configured.
2025-11-27 09:49:42.383832 | controller | INFO     Running crc_layout > destroy
2025-11-27 09:49:42.384164 | controller | WARNING  Skipping, instances are delegated.
2025-11-27 09:49:42.384524 | controller | INFO     Pruning extra files from scenario ephemeral directory
2025-11-27 09:49:42.386118 | controller | INFO     Writing /tmp/report.html report.
2025-11-27 09:49:42.632115 | [controller] Waiting on logger
2025-11-27 09:49:47.809113 | [controller] Waiting on logger
2025-11-27 09:49:58.241009 | [controller] Waiting on logger
2025-11-27 09:50:08.673064 | [controller] Waiting on logger
2025-11-27 09:50:12.499587 | [Zuul] Log Stream did not terminate
2025-11-27 09:50:12.499936 | controller | ERROR
2025-11-27 09:50:12.500027 | controller | {
2025-11-27 09:50:12.500057 | controller |   "delta": "0:08:19.682506",
2025-11-27 09:50:12.500078 | controller |   "end": "2025-11-27 09:49:42.454572",
2025-11-27 09:50:12.500095 | controller |   "msg": "non-zero return code",
2025-11-27 09:50:12.500110 | controller |   "rc": 1,
2025-11-27 09:50:12.500125 | controller |   "start": "2025-11-27 09:41:22.772066"
2025-11-27 09:50:12.500139 | controller | }
failure
2025-11-27 09:50:12.547672 | 
2025-11-27 09:50:12.547729 | PLAY RECAP
2025-11-27 09:50:12.547779 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0
2025-11-27 09:50:12.547800 | 
2025-11-27 09:50:12.606472 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2025-11-27 09:50:12.607244 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2025-11-27 09:50:13.081651 | 
2025-11-27 09:50:13.081754 | PLAY [Run ci/playbooks/collect-logs.yml]
2025-11-27 09:50:13.100197 | 
2025-11-27 09:50:13.100262 | TASK [Filter out host if needed]
2025-11-27 09:50:13.107956 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2025-11-27 09:50:13.112012 | 
2025-11-27 09:50:13.112075 | TASK [Ensure file is present]
2025-11-27 09:50:13.484180 | controller | ok
2025-11-27 09:50:13.490203 | 
2025-11-27 09:50:13.490270 | TASK [Manage molecule report file]
2025-11-27 09:50:13.509071 | [controller] Waiting on logger
2025-11-27 09:50:22.817444 | [controller] Waiting on logger
2025-11-27 09:50:33.249202 | [controller] Waiting on logger
2025-11-27 09:50:43.681177 | [controller] Waiting on logger
2025-11-27 09:50:43.891159 | [Zuul] Log Stream did not terminate
2025-11-27 09:50:43.891336 | controller | changed
2025-11-27 09:50:43.896238 | 
2025-11-27 09:50:43.896300 | TASK [Check if we get ci-framework-data basedir]
2025-11-27 09:50:44.342273 | controller | ok
2025-11-27 09:50:44.347171 | 
2025-11-27 09:50:44.347234 | TASK [Create ci-framework-data log directory for zuul]
2025-11-27 09:50:44.864507 | controller | changed
2025-11-27 09:50:44.869890 | 
2025-11-27 09:50:44.869955 | TASK [Copy ci-framework interesting files]
2025-11-27 09:50:44.889983 | [controller] Waiting on logger
2025-11-27 09:50:51.155322 | controller | changed
2025-11-27 09:50:51.160299 | 
2025-11-27 09:50:51.160369 | TASK [Get SELinux listing]
2025-11-27 09:50:51.180309 | [controller] Waiting on logger
2025-11-27 09:51:01.600797 | [controller] Waiting on logger
2025-11-27 09:51:10.944704 | [controller] Waiting on logger
2025-11-27 09:51:21.377076 | [controller] Waiting on logger
2025-11-27 09:51:21.543355 | [Zuul] Log Stream did not terminate
2025-11-27 09:51:21.543606 | controller | changed
2025-11-27 09:51:21.549180 | 
2025-11-27 09:51:21.549303 | TASK [Generate log index]
2025-11-27 09:51:23.710241 | controller | changed
2025-11-27 09:51:23.715291 | 
2025-11-27 09:51:23.715356 | TASK [Get some env related data]
2025-11-27 09:51:23.737015 | [controller] Waiting on logger
2025-11-27 09:51:41.408903 | [controller] Waiting on logger
2025-11-27 09:51:50.752972 | [controller] Waiting on logger
2025-11-27 09:51:55.593377 | [Zuul] Log Stream did not terminate
2025-11-27 09:51:55.593652 | controller | changed
2025-11-27 09:51:55.599251 | 
2025-11-27 09:51:55.599333 | TASK [Generate list of logs to collect in home directory]
2025-11-27 09:51:56.107073 | controller | ok: All paths examined
2025-11-27 09:51:56.112354 | 
2025-11-27 09:51:56.112450 | LOOP [Copy logs from home directory]
2025-11-27 09:51:57.113082 | controller | changed:
2025-11-27 09:51:57.113284 | controller | {
2025-11-27 09:51:57.113313 | controller |   "atime": 1763989167.9348345,
2025-11-27 09:51:57.113366 | controller |   "ctime": 1763990251.6129293,
2025-11-27 09:51:57.113409 | controller |   "dev": 64513,
2025-11-27 09:51:57.113431 | controller |   "gid": 1000,
2025-11-27 09:51:57.113447 | controller |   "gr_name": "zuul",
2025-11-27 09:51:57.113463 | controller |   "inode": 5131423,
2025-11-27 09:51:57.113482 | controller |   "isblk": false,
2025-11-27 09:51:57.113498 | controller |   "ischr": false,
2025-11-27 09:51:57.113512 | controller |   "isdir": false,
2025-11-27 09:51:57.113526 | controller |   "isfifo": false,
2025-11-27 09:51:57.113540 | controller |   "isgid": false,
2025-11-27 09:51:57.113554 | controller |   "islnk": false,
2025-11-27 09:51:57.113567 | controller |   "isreg": true,
2025-11-27 09:51:57.113582 | controller |   "issock": false,
2025-11-27 09:51:57.113599 | controller |   "isuid": false,
2025-11-27 09:51:57.113615 | controller |   "mode": "0644",
2025-11-27 09:51:57.113630 | controller |   "mtime": 1763990251.6129293,
2025-11-27 09:51:57.113645 | controller |   "nlink": 1,
2025-11-27 09:51:57.113659 | controller |   "path": "/home/zuul/crc-setup.log",
2025-11-27 09:51:57.113673 | controller |   "pw_name": "zuul",
2025-11-27 09:51:57.113687 | controller |   "rgrp": true,
2025-11-27 09:51:57.113700 | controller |   "roth": true,
2025-11-27 09:51:57.113714 | controller |   "rusr": true,
2025-11-27 09:51:57.113727 | controller |   "size": 4108,
2025-11-27 09:51:57.113750 | controller |   "uid": 1000,
2025-11-27 09:51:57.113765 | controller |   "wgrp": false,
2025-11-27 09:51:57.113778 | controller |   "woth": false,
2025-11-27 09:51:57.113791 | controller |   "wusr": true,
2025-11-27 09:51:57.113804 | controller |   "xgrp": false,
2025-11-27 09:51:57.113817 | controller |   "xoth": false,
2025-11-27 09:51:57.113830 | controller |   "xusr": false
2025-11-27 09:51:57.113843 | controller | }
2025-11-27 09:51:57.941524 | controller | changed:
2025-11-27 09:51:57.941615 | controller | {
2025-11-27 09:51:57.941639 | controller |   "atime": 1763990253.7119775,
2025-11-27 09:51:57.941656 | controller |   "ctime": 1763991032.5164254,
2025-11-27 09:51:57.941672 | controller |   "dev": 64513,
2025-11-27 09:51:57.941687 | controller |   "gid": 1000,
2025-11-27 09:51:57.941701 | controller |   "gr_name": "zuul",
2025-11-27 09:51:57.941716 | controller |   "inode": 5131425,
2025-11-27 09:51:57.941741 | controller |   "isblk": false,
2025-11-27 09:51:57.941758 | controller |   "ischr": false,
2025-11-27 09:51:57.941772 | controller |   "isdir": false,
2025-11-27 09:51:57.941785 | controller |   "isfifo": false,
2025-11-27 09:51:57.941798 | controller |   "isgid": false,
2025-11-27 09:51:57.941810 | controller |   "islnk": false,
2025-11-27 09:51:57.941823 | controller |   "isreg": true,
2025-11-27 09:51:57.941835 | controller |   "issock": false,
2025-11-27 09:51:57.941848 | controller |   "isuid": false,
2025-11-27 09:51:57.941861 | controller |   "mode": "0644",
2025-11-27 09:51:57.941873 | controller |   "mtime": 1763991032.5164254,
2025-11-27 09:51:57.941885 | controller |   "nlink": 1,
2025-11-27 09:51:57.941898 | controller |   "path": "/home/zuul/crc-start.log",
2025-11-27 09:51:57.941910 | controller |   "pw_name": "zuul",
2025-11-27 09:51:57.941928 | controller |   "rgrp": true,
2025-11-27 09:51:57.941942 | controller |   "roth": true,
2025-11-27 09:51:57.941954 | controller |   "rusr": true,
2025-11-27 09:51:57.941967 | controller |   "size": 4428,
2025-11-27 09:51:57.941979 | controller |   "uid": 1000,
2025-11-27 09:51:57.941991 | controller |   "wgrp": false,
2025-11-27 09:51:57.942004 | controller |   "woth": false,
2025-11-27 09:51:57.942016 | controller |   "wusr": true,
2025-11-27 09:51:57.942028 | controller |   "xgrp": false,
2025-11-27 09:51:57.942040 | controller |   "xoth": false,
2025-11-27 09:51:57.942061 | controller |   "xusr": false
2025-11-27 09:51:57.942076 | controller | }
2025-11-27 09:51:58.866301 | controller | changed:
2025-11-27 09:51:58.866429 | controller | {
2025-11-27 09:51:58.866461 | controller |   "atime": 1764236464.848647,
2025-11-27 09:51:58.866482 | controller |   "ctime": 1764236480.4605806,
2025-11-27 09:51:58.866499 | controller |   "dev": 64513,
2025-11-27 09:51:58.866515 | controller |   "gid": 1000,
2025-11-27 09:51:58.866530 | controller |   "gr_name": "zuul",
2025-11-27 09:51:58.866545 | controller |   "inode": 4751296,
2025-11-27 09:51:58.866560 | controller |   "isblk": false,
2025-11-27 09:51:58.866575 | controller |   "ischr": false,
2025-11-27 09:51:58.866592 | controller |   "isdir": false,
2025-11-27 09:51:58.866609 | controller |   "isfifo": false,
2025-11-27 09:51:58.866625 | controller |   "isgid": false,
2025-11-27 09:51:58.866639 | controller |   "islnk": false,
2025-11-27 09:51:58.866653 | controller |   "isreg": true,
2025-11-27 09:51:58.866667 | controller |   "issock": false,
2025-11-27 09:51:58.866681 | controller |   "isuid": false,
2025-11-27 09:51:58.866694 | controller |   "mode": "0644",
2025-11-27 09:51:58.866707 | controller |   "mtime": 1764236480.4605806,
2025-11-27 09:51:58.866721 | controller |   "nlink": 1,
2025-11-27 09:51:58.866745 | controller |   "path": "/home/zuul/ansible.log",
2025-11-27 09:51:58.866760 | controller |   "pw_name": "zuul",
2025-11-27 09:51:58.866774 | controller |   "rgrp": true,
2025-11-27 09:51:58.866787 | controller |   "roth": true,
2025-11-27 09:51:58.866800 | controller |   "rusr": true,
2025-11-27 09:51:58.866813 | controller |   "size": 6749,
2025-11-27 09:51:58.866827 | controller |   "uid": 1000,
2025-11-27 09:51:58.866840 | controller |   "wgrp": false,
2025-11-27 09:51:58.866854 | controller |   "woth": false,
2025-11-27 09:51:58.866867 | controller |   "wusr": true,
2025-11-27 09:51:58.866881 | controller |   "xgrp": false,
2025-11-27 09:51:58.866894 | controller |   "xoth": false,
2025-11-27 09:51:58.866907 | controller |   "xusr": false
2025-11-27 09:51:58.866920 | controller | }
2025-11-27 09:51:58.875329 | 
2025-11-27 09:51:58.875415 | TASK [Copy crio stats log file]
2025-11-27 09:51:58.888306 | controller | skipping: Conditional result was False
2025-11-27 09:51:58.893353 | 
2025-11-27 09:51:58.893430 | TASK [Get SELinux related data]
2025-11-27 09:51:59.968924 | [controller] Waiting on logger
2025-11-27 09:52:03.232989 | [controller] Waiting on logger
2025-11-27 09:52:20.769179 | [controller] Waiting on logger
2025-11-27 09:52:21.729000 | [controller] Waiting on logger
2025-11-27 09:52:29.356813 | [Zuul] Log Stream did not terminate
2025-11-27 09:52:29.356992 | controller | ERROR
2025-11-27 09:52:29.357082 | controller | {
2025-11-27 09:52:29.357107 | controller |   "delta": "0:00:00.015130",
2025-11-27 09:52:29.357125 | controller |   "end": "2025-11-27 09:51:59.314126",
2025-11-27 09:52:29.357141 | controller |   "msg": "non-zero return code",
2025-11-27 09:52:29.357156 | controller |   "rc": 1,
2025-11-27 09:52:29.357170 | controller |   "start": "2025-11-27 09:51:59.298996"
2025-11-27 09:52:29.357184 | controller | }
2025-11-27 09:52:29.357206 | controller | ERROR: Ignoring Errors
2025-11-27 09:52:29.361845 | 
2025-11-27 09:52:29.361902 | TASK [Create system configuration directory]
2025-11-27 09:52:29.980812 | controller | changed
2025-11-27 09:52:29.985647 | 
2025-11-27 09:52:29.985709 | TASK [Get some of the system configurations]
2025-11-27 09:52:30.005369 | [controller] Waiting on logger
2025-11-27 09:52:37.395817 | controller | changed
2025-11-27 09:52:37.401208 | 
2025-11-27 09:52:37.401273 | TASK [Copy generated documentation if available]
2025-11-27 09:52:37.415121 | controller | skipping: Conditional result was False
2025-11-27 09:52:37.420951 | 
2025-11-27 09:52:37.421018 | TASK [Copy generated AsciiDoc documentation if available]
2025-11-27 09:52:37.434319 | controller | skipping: Conditional result was False
2025-11-27 09:52:37.439277 | 
2025-11-27 09:52:37.439339 | TASK [Compress logs bigger than 2MB]
2025-11-27 09:52:38.433109 | [controller] Waiting on logger
2025-11-27 09:52:42.466487 | controller | changed
2025-11-27 09:52:42.471318 | 
2025-11-27 09:52:42.471405 | TASK [Copy files from workspace on node]
2025-11-27 09:52:42.488901 | controller | ok
2025-11-27 09:52:42.509180 | 
2025-11-27 09:52:42.509245 | TASK [fetch-output : Set log path for multiple nodes]
2025-11-27 09:52:42.522273 | controller | skipping: Conditional result was False
2025-11-27 09:52:42.527446 | 
2025-11-27 09:52:42.527509 | TASK [fetch-output : Set log path for single node]
2025-11-27 09:52:42.555204 | controller | ok
2025-11-27 09:52:42.559959 | 
2025-11-27 09:52:42.560024 | LOOP [fetch-output : Ensure local output dirs]
2025-11-27 09:52:42.740851 | controller -> localhost | ok: "/var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/logs"
2025-11-27 09:52:42.741027 | controller -> localhost | changed: All items complete
2025-11-27 09:52:42.741057 | 
2025-11-27 09:52:42.902788 | controller -> localhost | changed: "/var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/artifacts"
2025-11-27 09:52:43.073057 | controller -> localhost | changed: "/var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/docs"
2025-11-27 09:52:43.085722 | 
2025-11-27 09:52:43.085805 | LOOP [fetch-output : Collect logs, artifacts and docs]
2025-11-27 09:52:43.764570 | controller | changed:
2025-11-27 09:52:43.764752 | controller | .d..t...... ./
2025-11-27 09:52:43.764786 | controller | >f+++++++++ README.html
2025-11-27 09:52:43.764808 | controller | >f+++++++++ ansible-execution.log
2025-11-27 09:52:43.764830 | controller | >f+++++++++ ansible.log
2025-11-27 09:52:43.764851 | controller | >f+++++++++ crc-setup.log
2025-11-27 09:52:43.764869 | controller | >f+++++++++ crc-start.log
2025-11-27 09:52:43.764886 | controller | >f+++++++++ dmesg.log
2025-11-27 09:52:43.764903 | controller | >f+++++++++ installed-pkgs.log
2025-11-27 09:52:43.764920 | controller | >f+++++++++ python.log
2025-11-27 09:52:43.764936 | controller | >f+++++++++ registries.conf
2025-11-27 09:52:43.764952 | controller | >f+++++++++ report.html
2025-11-27 09:52:43.764968 | controller | >f+++++++++ selinux-denials.log
2025-11-27 09:52:43.764984 | controller | >f+++++++++ selinux-listing.log
2025-11-27 09:52:43.764999 | controller | cd+++++++++ ci-framework-data/
2025-11-27 09:52:43.765015 | controller | cd+++++++++ ci-framework-data/artifacts/
2025-11-27 09:52:43.765032 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2025-11-27 09:52:43.765049 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2025-11-27 09:52:43.765066 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf
2025-11-27 09:52:43.765082 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2025-11-27 09:52:43.765097 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf
2025-11-27 09:52:43.765114 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2025-11-27 09:52:43.765130 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2025-11-27 09:52:43.765146 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2025-11-27 09:52:43.765162 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2025-11-27 09:52:43.765177 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2025-11-27 09:52:43.765193 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2025-11-27 09:52:43.765214 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2025-11-27 09:52:43.765231 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2025-11-27 09:52:43.765247 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:35:68:6a
2025-11-27 09:52:43.765264 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:66:67:87
2025-11-27 09:52:43.765280 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:3f:7f:18
2025-11-27 09:52:43.765297 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:7a:68:be
2025-11-27 09:52:43.765313 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:c9:1a:5a
2025-11-27 09:52:43.765330 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:c8:6a:65
2025-11-27 09:52:43.765347 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2025-11-27 09:52:43.765363 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2025-11-27 09:52:43.765394 | controller | cd+++++++++ ci-framework-data/logs/
2025-11-27 09:52:43.765421 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2025-11-27 09:52:43.765439 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2025-11-27 09:52:43.765456 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log
2025-11-27 09:52:43.765472 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2025-11-27 09:52:43.765488 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2025-11-27 09:52:43.765504 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml
2025-11-27 09:52:43.765520 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2025-11-27 09:52:43.765536 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/
2025-11-27 09:52:43.765552 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo
2025-11-27 09:52:43.765568 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo
2025-11-27 09:52:43.765584 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5
2025-11-27 09:52:43.765599 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo
2025-11-27 09:52:43.765618 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo
2025-11-27 09:52:43.765636 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo
2025-11-27 09:52:43.765653 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo
2025-11-27 09:52:43.765669 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/
2025-11-27 09:52:43.765685 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd
2025-11-27 09:52:43.765701 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf
2025-11-27 09:52:43.765717 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts
2025-11-27 09:52:43.765741 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2025-11-27 09:52:43.765764 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml
2025-11-27 09:52:43.765783 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2025-11-27 09:52:43.765799 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml
2025-11-27 09:52:43.765816 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml
2025-11-27 09:52:43.765833 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/
2025-11-27 09:52:43.765849 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt
2025-11-27 09:52:43.765865 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2025-11-27 09:52:43.765881 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd
2025-11-27 09:52:43.765896 | controller | cd+++++++++ registries.conf.d/
2025-11-27 09:52:43.765912 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2025-11-27 09:52:43.765928 | controller | cd+++++++++ system-config/
2025-11-27 09:52:43.765943 | controller | cd+++++++++ system-config/libvirt/
2025-11-27 09:52:43.765958 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2025-11-27 09:52:43.765974 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2025-11-27 09:52:43.765989 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2025-11-27 09:52:43.766004 | controller | >f+++++++++ system-config/libvirt/network.conf
2025-11-27 09:52:43.766020 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2025-11-27 09:52:43.766036 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2025-11-27 09:52:43.766052 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2025-11-27 09:52:43.766068 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2025-11-27 09:52:43.766083 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2025-11-27 09:52:43.766099 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2025-11-27 09:52:43.766115 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2025-11-27 09:52:43.766131 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2025-11-27 09:52:43.766147 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2025-11-27 09:52:43.766162 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2025-11-27 09:52:43.766177 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2025-11-27 09:52:43.766192 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2025-11-27 09:52:44.234940 | controller | changed: .d..t...... ./
2025-11-27 09:52:44.725633 | controller | changed: .d..t...... ./
2025-11-27 09:52:44.742741 | 
2025-11-27 09:52:44.742877 | TASK [Return artifact to Zuul]
2025-11-27 09:52:44.771230 | controller | ok
2025-11-27 09:52:44.789039 | 
2025-11-27 09:52:44.789096 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2025-11-27 09:52:44.789183 | 
2025-11-27 09:52:44.789209 | PLAY RECAP
2025-11-27 09:52:44.789246 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2025-11-27 09:52:44.789266 | 
2025-11-27 09:52:44.860327 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2025-11-27 09:52:44.861037 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2025-11-27 09:52:45.319918 | 
2025-11-27 09:52:45.319998 | PLAY [all]
2025-11-27 09:52:45.336284 | 
2025-11-27 09:52:45.336348 | TASK [include_role : fetch-output]
2025-11-27 09:52:45.364017 | controller | ok
2025-11-27 09:52:45.378791 | 
2025-11-27 09:52:45.378860 | TASK [fetch-output : Set log path for multiple nodes]
2025-11-27 09:52:45.412331 | controller | skipping: Conditional result was False
2025-11-27 09:52:45.417690 | 
2025-11-27 09:52:45.417766 | TASK [fetch-output : Set log path for single node]
2025-11-27 09:52:45.445200 | controller | ok
2025-11-27 09:52:45.449569 | 
2025-11-27 09:52:45.449631 | LOOP [fetch-output : Ensure local output dirs]
2025-11-27 09:52:45.745602 | controller -> localhost | ok: "/var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/logs"
2025-11-27 09:52:45.913160 | controller -> localhost | ok: "/var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/artifacts"
2025-11-27 09:52:46.085436 | controller -> localhost | ok: "/var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/docs"
2025-11-27 09:52:46.099539 | 
2025-11-27 09:52:46.099609 | LOOP [fetch-output : Collect logs, artifacts and docs]
2025-11-27 09:52:46.775374 | controller | ok
2025-11-27 09:52:46.775571 | controller | ok: All items complete
2025-11-27 09:52:46.775601 | 
2025-11-27 09:52:47.311057 | controller | ok
2025-11-27 09:52:47.915246 | controller | ok
2025-11-27 09:52:47.931325 | 
2025-11-27 09:52:47.931446 | TASK [include_role : fetch-output-openshift]
2025-11-27 09:52:47.944209 | controller | skipping: Conditional result was False
2025-11-27 09:52:47.949301 | 
2025-11-27 09:52:47.949363 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2025-11-27 09:52:48.250700 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.005444
2025-11-27 09:52:48.424978 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.005923
2025-11-27 09:52:48.451660 | 
2025-11-27 09:52:48.451746 | PLAY [all]
2025-11-27 09:52:48.464505 | 
2025-11-27 09:52:48.464566 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2025-11-27 09:52:49.114213 | controller | changed
2025-11-27 09:52:49.134364 | 
2025-11-27 09:52:49.134440 | PLAY RECAP
2025-11-27 09:52:49.134513 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2025-11-27 09:52:49.134542 | 
2025-11-27 09:52:49.198868 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2025-11-27 09:52:49.199551 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2025-11-27 09:52:49.721331 | 
2025-11-27 09:52:49.721454 | PLAY [localhost]
2025-11-27 09:52:49.738284 | 
2025-11-27 09:52:49.738357 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2025-11-27 09:52:50.028757 | localhost | changed
2025-11-27 09:52:50.033157 | 
2025-11-27 09:52:50.033233 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2025-11-27 09:52:50.050148 | localhost | ok
2025-11-27 09:52:50.057521 | 
2025-11-27 09:52:50.057586 | TASK [add-fileserver : Create SSH private key tempfile]
2025-11-27 09:52:50.338128 | localhost | changed
2025-11-27 09:52:50.343317 | 
2025-11-27 09:52:50.343415 | TASK [add-fileserver : Create SSH private key from secret]
2025-11-27 09:52:50.857291 | localhost | changed
2025-11-27 09:52:50.862170 | 
2025-11-27 09:52:50.862236 | TASK [add-fileserver : Add fileserver ssh key]
2025-11-27 09:52:51.162487 | localhost | Identity added: /var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/tmp/ansible.2y9cl_dv (/var/lib/zuul/builds/a93b4cbdecfb434f8e5d42900d3b1332/work/tmp/ansible.2y9cl_dv)
2025-11-27 09:52:51.162658 | localhost | ok: Runtime: 0:00:00.006033
2025-11-27 09:52:51.166609 | 
2025-11-27 09:52:51.166671 | TASK [add-fileserver : Remove SSH private key from disk]
2025-11-27 09:52:51.365472 | localhost | ok: Runtime: 0:00:00.003508
2025-11-27 09:52:51.370107 | 
2025-11-27 09:52:51.370176 | TASK [add-fileserver : Add fileserver to inventory]
2025-11-27 09:52:51.417636 | localhost | changed
2025-11-27 09:52:51.422427 | 
2025-11-27 09:52:51.422490 | TASK [add-fileserver : Add fileserver server to known hosts]
2025-11-27 09:52:51.722743 | localhost | changed
2025-11-27 09:52:51.741678 | 
2025-11-27 09:52:51.741765 | PLAY [localhost]
2025-11-27 09:52:51.752415 | 
2025-11-27 09:52:51.752474 | TASK [Generate bulk log download script]
2025-11-27 09:52:51.769912 | localhost | ok
2025-11-27 09:52:51.779943 | 
2025-11-27 09:52:51.780000 | TASK [local-log-download : Check API endpoint is defined]
2025-11-27 09:52:51.806965 | localhost | ok: All assertions passed
2025-11-27 09:52:51.811216 | 
2025-11-27 09:52:51.811279 | TASK [local-log-download : Create download script]
2025-11-27 09:52:52.138476 | localhost -> localhost | changed
2025-11-27 09:52:52.146997 | 
2025-11-27 09:52:52.147066 | TASK [Register quick-download link]
2025-11-27 09:52:52.163965 | localhost | ok
2025-11-27 09:52:52.196238 | 
2025-11-27 09:52:52.196309 | PLAY [logserver.rdoproject.org]
2025-11-27 09:52:52.205767 | 
2025-11-27 09:52:52.205826 | TASK [Set zuul-log-path fact]
2025-11-27 09:52:52.221185 | logserver.rdoproject.org | ok
2025-11-27 09:52:52.229650 | 
2025-11-27 09:52:52.229712 | TASK [set-zuul-log-path-fact : Set log path for a build]
2025-11-27 09:52:52.255427 | logserver.rdoproject.org | ok
2025-11-27 09:52:52.260498 | 
2025-11-27 09:52:52.260561 | TASK [upload-logs : Create log directories]
2025-11-27 09:52:53.893917 | logserver.rdoproject.org | changed
2025-11-27 09:52:53.897002 | 
2025-11-27 09:52:53.897063 | TASK [upload-logs : Ensure logs are readable before uploading]
2025-11-27 09:52:54.102560 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004643
2025-11-27 09:52:54.106872 | 
2025-11-27 09:52:54.106932 | TASK [upload-logs : Upload logs to log server]
2025-11-27 09:52:55.644566 | logserver.rdoproject.org | Output suppressed because no_log was given
2025-11-27 09:52:55.647250 | 
2025-11-27 09:52:55.647312 | LOOP [upload-logs : Compress console log and json output]
2025-11-27 09:52:55.683502 | logserver.rdoproject.org | skipping: Conditional result was False
2025-11-27 09:52:55.691438 | logserver.rdoproject.org | skipping: Conditional result was False
2025-11-27 09:52:55.704840 | 
2025-11-27 09:52:55.704909 | LOOP [upload-logs : Upload compressed console log and json output]
2025-11-27 09:52:55.737182 | logserver.rdoproject.org | skipping: Conditional result was False
2025-11-27 09:52:55.737345 | 
2025-11-27 09:52:55.740712 | logserver.rdoproject.org | skipping: Conditional result was False
2025-11-27 09:52:55.751278 | 
2025-11-27 09:52:55.751348 | LOOP [upload-logs : Upload console log and json output]