2025-09-29 12:31:18.747108 | Job console starting...
2025-09-29 12:31:18.984412 | Updating repositories
2025-09-29 12:31:19.703359 | Preparing job workspace
2025-09-29 12:31:27.324258 | Running Ansible setup...
2025-09-29 12:31:30.706334 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2025-09-29 12:31:31.181043 | 
2025-09-29 12:31:31.181153 | PLAY [localhost]
2025-09-29 12:31:31.188647 | 
2025-09-29 12:31:31.188710 | TASK [Gathering Facts]
2025-09-29 12:31:31.933245 | localhost | ok
2025-09-29 12:31:31.945800 | 
2025-09-29 12:31:31.945875 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2025-09-29 12:31:32.232545 | localhost -> localhost | changed
2025-09-29 12:31:32.237607 | 
2025-09-29 12:31:32.237689 | TASK [log-inventory : Copy ansible inventory to logs dir]
2025-09-29 12:31:32.879780 | localhost -> localhost | changed
2025-09-29 12:31:32.887367 | 
2025-09-29 12:31:32.887431 | TASK [Setup log path fact]
2025-09-29 12:31:32.904165 | localhost | ok
2025-09-29 12:31:32.914790 | 
2025-09-29 12:31:32.914858 | TASK [set-zuul-log-path-fact : Set log path for a build]
2025-09-29 12:31:32.932156 | localhost | ok
2025-09-29 12:31:32.939283 | 
2025-09-29 12:31:32.939349 | TASK [emit-job-header : Print job information]
2025-09-29 12:31:32.965998 | # Job Information
2025-09-29 12:31:32.966113 | Ansible Version: 2.15.12
2025-09-29 12:31:32.966142 | Job: cifmw-molecule-reproducer
2025-09-29 12:31:32.966163 | Pipeline: github-check
2025-09-29 12:31:32.966182 | Executor: ibm-bm4-ze.softwarefactory-project.io
2025-09-29 12:31:32.966213 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3350
2025-09-29 12:31:32.966234 | Log URL (when completed): https://logserver.rdoproject.org/78e/rdoproject.org/78eeea42ec294a03aafb1a14dfbf04fe/
2025-09-29 12:31:32.966254 | Event ID: 11c883b0-9d30-11f0-9e9c-20fe782843a0
2025-09-29 12:31:32.969841 | 
2025-09-29 12:31:32.969906 | LOOP [emit-job-header : Print node information]
2025-09-29 12:31:33.052748 | localhost | ok:
2025-09-29 12:31:33.052895 | localhost | # Node Information
2025-09-29 12:31:33.052959 | localhost | Inventory Hostname: controller
2025-09-29 12:31:33.052988 | localhost | Hostname: np0005459448
2025-09-29 12:31:33.053008 | localhost | Username: zuul
2025-09-29 12:31:33.053028 | localhost | Distro: CentOS 9
2025-09-29 12:31:33.053045 | localhost | Provider: ibm-bm4-nodepool
2025-09-29 12:31:33.053062 | localhost | Region: regionOne
2025-09-29 12:31:33.053079 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2025-09-29 12:31:33.053095 | localhost | Product Name: OpenStack Compute
2025-09-29 12:31:33.053111 | localhost | Interface IP: 192.168.26.244
2025-09-29 12:31:33.071811 | 
2025-09-29 12:31:33.071881 | PLAY [all]
2025-09-29 12:31:33.077959 | 
2025-09-29 12:31:33.078022 | TASK [Gather network facts]
2025-09-29 12:31:33.533686 | controller | ok
2025-09-29 12:31:33.547237 | 
2025-09-29 12:31:33.547298 | TASK [include_role : start-zuul-console]
2025-09-29 12:31:33.564493 | controller | ok
2025-09-29 12:31:33.575242 | 
2025-09-29 12:31:33.575306 | TASK [start-zuul-console : Start zuul_console daemon.]
2025-09-29 12:31:33.928001 | controller | ok
2025-09-29 12:31:33.936206 | 
2025-09-29 12:31:33.936268 | TASK [include_role : add-build-sshkey]
2025-09-29 12:31:33.952959 | controller | ok
2025-09-29 12:31:33.964946 | 
2025-09-29 12:31:33.965012 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2025-09-29 12:31:34.149618 | controller -> localhost | ok
2025-09-29 12:31:34.154892 | 
2025-09-29 12:31:34.154977 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2025-09-29 12:31:34.172663 | controller | ok
2025-09-29 12:31:34.184588 | controller | included: /var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2025-09-29 12:31:34.189956 | 
2025-09-29 12:31:34.190019 | TASK [add-build-sshkey : Create Temp SSH key]
2025-09-29 12:31:34.799680 | controller -> localhost | Generating public/private rsa key pair.
2025-09-29 12:31:34.799839 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/78eeea42ec294a03aafb1a14dfbf04fe_id_rsa.
2025-09-29 12:31:34.799871 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/78eeea42ec294a03aafb1a14dfbf04fe_id_rsa.pub.
2025-09-29 12:31:34.799896 | controller -> localhost | The key fingerprint is:
2025-09-29 12:31:34.799938 | controller -> localhost | SHA256:fOX0ZNkgtf/vYEkHZOOvJduMqzxRn3o2koCkxpXCH24 zuul-build-sshkey
2025-09-29 12:31:34.799962 | controller -> localhost | The key's randomart image is:
2025-09-29 12:31:34.799982 | controller -> localhost | +---[RSA 3072]----+
2025-09-29 12:31:34.800000 | controller -> localhost | |            ..*  |
2025-09-29 12:31:34.800017 | controller -> localhost | |             = * |
2025-09-29 12:31:34.800035 | controller -> localhost | |      .   . o B .|
2025-09-29 12:31:34.800051 | controller -> localhost | |       + = + +.+ |
2025-09-29 12:31:34.800068 | controller -> localhost | |      . S + ..+.*|
2025-09-29 12:31:34.800085 | controller -> localhost | |       + E ... %o|
2025-09-29 12:31:34.800101 | controller -> localhost | |      . .   ..X +|
2025-09-29 12:31:34.800121 | controller -> localhost | |           ..= *.|
2025-09-29 12:31:34.800139 | controller -> localhost | |            oo=.+|
2025-09-29 12:31:34.800155 | controller -> localhost | +----[SHA256]-----+
2025-09-29 12:31:34.800205 | controller -> localhost | ok: Runtime: 0:00:00.312130
2025-09-29 12:31:34.805211 | 
2025-09-29 12:31:34.805270 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2025-09-29 12:31:34.822374 | controller | ok
2025-09-29 12:31:34.830888 | controller | included: /var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2025-09-29 12:31:34.837799 | 
2025-09-29 12:31:34.837857 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2025-09-29 12:31:34.850377 | controller | skipping: Conditional result was False
2025-09-29 12:31:34.854856 | 
2025-09-29 12:31:34.854928 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2025-09-29 12:31:35.277490 | controller | changed
2025-09-29 12:31:35.281841 | 
2025-09-29 12:31:35.281919 | TASK [add-build-sshkey : Make sure user has a .ssh]
2025-09-29 12:31:35.543690 | controller | ok
2025-09-29 12:31:35.548138 | 
2025-09-29 12:31:35.548205 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2025-09-29 12:31:36.681071 | controller | changed
2025-09-29 12:31:36.685969 | 
2025-09-29 12:31:36.686034 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2025-09-29 12:31:37.759321 | controller | changed
2025-09-29 12:31:37.764038 | 
2025-09-29 12:31:37.764105 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2025-09-29 12:31:37.777392 | controller | skipping: Conditional result was False
2025-09-29 12:31:37.782605 | 
2025-09-29 12:31:37.782667 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2025-09-29 12:31:38.048932 | controller -> localhost | changed
2025-09-29 12:31:38.057904 | 
2025-09-29 12:31:38.057980 | TASK [add-build-sshkey : Add back temp key]
2025-09-29 12:31:38.263406 | controller -> localhost | Identity added: /var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/78eeea42ec294a03aafb1a14dfbf04fe_id_rsa (zuul-build-sshkey)
2025-09-29 12:31:38.263631 | controller -> localhost | ok: Runtime: 0:00:00.006336
2025-09-29 12:31:38.269110 | 
2025-09-29 12:31:38.269171 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2025-09-29 12:31:38.623374 | controller | ok
2025-09-29 12:31:38.628210 | 
2025-09-29 12:31:38.628280 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2025-09-29 12:31:38.652471 | controller | skipping: Conditional result was False
2025-09-29 12:31:38.661527 | 
2025-09-29 12:31:38.661598 | TASK [include_role : validate-host]
2025-09-29 12:31:38.680503 | controller | ok
2025-09-29 12:31:38.698527 | 
2025-09-29 12:31:38.698615 | TASK [validate-host : Define zuul_info_dir fact]
2025-09-29 12:31:38.726962 | controller | ok
2025-09-29 12:31:38.731397 | 
2025-09-29 12:31:38.731461 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2025-09-29 12:31:38.927373 | controller -> localhost | ok
2025-09-29 12:31:38.932803 | 
2025-09-29 12:31:38.932870 | TASK [validate-host : Collect information about the host]
2025-09-29 12:31:39.572901 | controller | ok
2025-09-29 12:31:39.579958 | 
2025-09-29 12:31:39.580024 | TASK [validate-host : Sanitize hostname]
2025-09-29 12:31:39.617765 | controller | ok
2025-09-29 12:31:39.622299 | 
2025-09-29 12:31:39.622359 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2025-09-29 12:31:39.960428 | controller -> localhost | changed
2025-09-29 12:31:39.969904 | 
2025-09-29 12:31:39.970020 | TASK [validate-host : Collect information about zuul worker]
2025-09-29 12:31:40.330241 | controller | ok
2025-09-29 12:31:40.335472 | 
2025-09-29 12:31:40.335588 | TASK [validate-host : Write out all zuul information for each host]
2025-09-29 12:31:40.687688 | controller -> localhost | changed
2025-09-29 12:31:40.698431 | 
2025-09-29 12:31:40.698524 | TASK [include_role : prepare-workspace-openshift]
2025-09-29 12:31:40.714345 | controller | skipping: Conditional result was False
2025-09-29 12:31:40.721239 | 
2025-09-29 12:31:40.721311 | TASK [include_role : remove-zuul-sshkey]
2025-09-29 12:31:40.736724 | controller | skipping: Conditional result was False
2025-09-29 12:31:40.743421 | 
2025-09-29 12:31:40.743499 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2025-09-29 12:31:41.014647 | controller | ok: "logs"
2025-09-29 12:31:41.014975 | controller | ok: All items complete
2025-09-29 12:31:41.015008 | 
2025-09-29 12:31:41.230936 | controller | ok: "artifacts"
2025-09-29 12:31:41.446976 | controller | ok: "docs"
2025-09-29 12:31:41.459881 | 
2025-09-29 12:31:41.460087 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2025-09-29 12:31:41.700598 | controller | changed: "logs"
2025-09-29 12:31:41.920810 | controller | changed: "artifacts"
2025-09-29 12:31:42.135310 | controller | changed: "docs"
2025-09-29 12:31:42.156074 | 
2025-09-29 12:31:42.156124 | PLAY RECAP
2025-09-29 12:31:42.156163 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2025-09-29 12:31:42.156189 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2025-09-29 12:31:42.156221 | 
2025-09-29 12:31:42.223408 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2025-09-29 12:31:42.224136 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2025-09-29 12:31:42.717779 | 
2025-09-29 12:31:42.717890 | PLAY [all]
2025-09-29 12:31:42.735537 | 
2025-09-29 12:31:42.735606 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2025-09-29 12:31:42.783790 | controller | ok
2025-09-29 12:31:42.788310 | 
2025-09-29 12:31:42.788383 | TASK [mirror-info-fork : Create /etc/ci]
2025-09-29 12:31:43.212269 | controller | changed
2025-09-29 12:31:43.217384 | 
2025-09-29 12:31:43.217456 | TASK [mirror-info-fork : Install ci_mirror script]
2025-09-29 12:31:44.396424 | controller | changed
2025-09-29 12:31:44.405676 | 
2025-09-29 12:31:44.405748 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2025-09-29 12:31:44.812558 | controller | changed:
2025-09-29 12:31:44.812734 | controller | {
2025-09-29 12:31:44.812767 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2025-09-29 12:31:44.812810 | controller | }
2025-09-29 12:31:45.086339 | controller | changed:
2025-09-29 12:31:45.086431 | controller | {
2025-09-29 12:31:45.086460 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2025-09-29 12:31:45.086482 | controller | }
2025-09-29 12:31:45.363126 | controller | changed:
2025-09-29 12:31:45.363242 | controller | {
2025-09-29 12:31:45.363274 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2025-09-29 12:31:45.363297 | controller | }
2025-09-29 12:31:45.639797 | controller | changed:
2025-09-29 12:31:45.639900 | controller | {
2025-09-29 12:31:45.640037 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2025-09-29 12:31:45.640064 | controller | }
2025-09-29 12:31:45.906226 | controller | changed:
2025-09-29 12:31:45.906328 | controller | {
2025-09-29 12:31:45.906352 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2025-09-29 12:31:45.906369 | controller | }
2025-09-29 12:31:46.181325 | controller | changed:
2025-09-29 12:31:46.181427 | controller | {
2025-09-29 12:31:46.181455 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2025-09-29 12:31:46.181475 | controller | }
2025-09-29 12:31:46.473476 | controller | changed:
2025-09-29 12:31:46.473536 | controller | {
2025-09-29 12:31:46.473563 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2025-09-29 12:31:46.473584 | controller | }
2025-09-29 12:31:46.765672 | controller | changed:
2025-09-29 12:31:46.765791 | controller | {
2025-09-29 12:31:46.765818 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2025-09-29 12:31:46.765839 | controller | }
2025-09-29 12:31:47.035193 | controller | changed:
2025-09-29 12:31:47.035286 | controller | {
2025-09-29 12:31:47.035311 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2025-09-29 12:31:47.035329 | controller | }
2025-09-29 12:31:47.324113 | controller | changed:
2025-09-29 12:31:47.324229 | controller | {
2025-09-29 12:31:47.324257 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2025-09-29 12:31:47.324277 | controller | }
2025-09-29 12:31:47.587544 | controller | changed:
2025-09-29 12:31:47.587649 | controller | {
2025-09-29 12:31:47.587673 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2025-09-29 12:31:47.587690 | controller | }
2025-09-29 12:31:47.860306 | controller | changed:
2025-09-29 12:31:47.860383 | controller | {
2025-09-29 12:31:47.860409 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2025-09-29 12:31:47.860428 | controller | }
2025-09-29 12:31:48.163008 | controller | changed:
2025-09-29 12:31:48.163162 | controller | {
2025-09-29 12:31:48.163205 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith"
2025-09-29 12:31:48.163229 | controller | }
2025-09-29 12:31:48.440903 | controller | changed:
2025-09-29 12:31:48.440994 | controller | {
2025-09-29 12:31:48.441021 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2025-09-29 12:31:48.441041 | controller | }
2025-09-29 12:31:48.717644 | controller | changed:
2025-09-29 12:31:48.717757 | controller | {
2025-09-29 12:31:48.717781 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2025-09-29 12:31:48.717801 | controller | }
2025-09-29 12:31:48.990118 | controller | changed:
2025-09-29 12:31:48.990178 | controller | {
2025-09-29 12:31:48.990211 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2025-09-29 12:31:48.990230 | controller | }
2025-09-29 12:31:49.280487 | controller | changed:
2025-09-29 12:31:49.280607 | controller | {
2025-09-29 12:31:49.280636 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2025-09-29 12:31:49.280657 | controller | }
2025-09-29 12:31:49.589950 | controller | changed:
2025-09-29 12:31:49.590024 | controller | {
2025-09-29 12:31:49.590050 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2025-09-29 12:31:49.590079 | controller | }
2025-09-29 12:31:49.863901 | controller | changed:
2025-09-29 12:31:49.863973 | controller | {
2025-09-29 12:31:49.864000 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2025-09-29 12:31:49.864020 | controller | }
2025-09-29 12:31:50.137681 | controller | changed:
2025-09-29 12:31:50.137738 | controller | {
2025-09-29 12:31:50.137761 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2025-09-29 12:31:50.137780 | controller | }
2025-09-29 12:31:50.407127 | controller | changed:
2025-09-29 12:31:50.407179 | controller | {
2025-09-29 12:31:50.407214 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2025-09-29 12:31:50.407234 | controller | }
2025-09-29 12:31:50.672847 | controller | changed:
2025-09-29 12:31:50.672934 | controller | {
2025-09-29 12:31:50.672969 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2025-09-29 12:31:50.672994 | controller | }
2025-09-29 12:31:50.946217 | controller | changed:
2025-09-29 12:31:50.946304 | controller | {
2025-09-29 12:31:50.946333 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2025-09-29 12:31:50.946355 | controller | }
2025-09-29 12:31:51.218971 | controller | changed:
2025-09-29 12:31:51.219022 | controller | {
2025-09-29 12:31:51.219048 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2025-09-29 12:31:51.219067 | controller | }
2025-09-29 12:31:51.497585 | controller | changed:
2025-09-29 12:31:51.497687 | controller | {
2025-09-29 12:31:51.497714 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2025-09-29 12:31:51.497734 | controller | }
2025-09-29 12:31:51.768575 | controller | changed:
2025-09-29 12:31:51.768661 | controller | {
2025-09-29 12:31:51.768688 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2025-09-29 12:31:51.768709 | controller | }
2025-09-29 12:31:51.784745 | 
2025-09-29 12:31:51.784842 | TASK [Set timezone to UTC]
2025-09-29 12:31:52.250848 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2025-09-29 12:31:52.256052 | 
2025-09-29 12:31:52.256126 | TASK [Create nodepool directory]
2025-09-29 12:31:52.509156 | controller | changed
2025-09-29 12:31:52.515339 | 
2025-09-29 12:31:52.515409 | TASK [Create nodepool sub_nodes file]
2025-09-29 12:31:53.404983 | controller | changed
2025-09-29 12:31:53.409822 | 
2025-09-29 12:31:53.409890 | TASK [Create nodepool sub_nodes_private file]
2025-09-29 12:31:54.300360 | controller | changed
2025-09-29 12:31:54.316001 | 
2025-09-29 12:31:54.316071 | LOOP [Populate nodepool sub_nodes file]
2025-09-29 12:31:54.344766 | 
2025-09-29 12:31:54.344891 | LOOP [Populate nodepool sub_nodes_private file]
2025-09-29 12:31:54.373043 | 
2025-09-29 12:31:54.373163 | TASK [Create nodepool primary file]
2025-09-29 12:31:54.396175 | controller | skipping: Conditional result was False
2025-09-29 12:31:54.401031 | 
2025-09-29 12:31:54.401097 | TASK [Create nodepool node_private for this node]
2025-09-29 12:31:55.319023 | controller | changed
2025-09-29 12:31:55.325781 | 
2025-09-29 12:31:55.325850 | LOOP [Copy ssh keys to nodepool directory]
2025-09-29 12:31:55.678501 | controller | ok: Item: id_rsa Runtime: 0:00:00.003372
2025-09-29 12:31:55.678661 | 
2025-09-29 12:31:55.891275 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004696
2025-09-29 12:31:55.898023 | 
2025-09-29 12:31:55.898138 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2025-09-29 12:31:56.797722 | controller | changed
2025-09-29 12:31:56.802717 | 
2025-09-29 12:31:56.802791 | TASK [Validate sudoers config after edits]
2025-09-29 12:31:57.068969 | controller | /etc/sudoers: parsed OK
2025-09-29 12:31:57.069038 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2025-09-29 12:31:57.069049 | controller | /etc/sudoers.d/zuul: parsed OK
2025-09-29 12:31:57.069055 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2025-09-29 12:31:57.329889 | controller | ok: Runtime: 0:00:00.004571
2025-09-29 12:31:57.335006 | 
2025-09-29 12:31:57.335070 | TASK [Show the environment passed in to job shell scripts]
2025-09-29 12:31:57.599646 | controller | SHELL=/bin/bash
2025-09-29 12:31:57.599681 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2025-09-29 12:31:57.599691 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2025-09-29 12:31:57.599699 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/50/3350/747e495ee0f363784243f616037c2e314a8d13cb
2025-09-29 12:31:57.599704 | controller | PWD=/home/zuul
2025-09-29 12:31:57.599710 | controller | ZUUL_PIPELINE=github-check
2025-09-29 12:31:57.599715 | controller | LOGNAME=zuul
2025-09-29 12:31:57.599720 | controller | XDG_SESSION_TYPE=tty
2025-09-29 12:31:57.599725 | controller | _=/usr/bin/env
2025-09-29 12:31:57.599730 | controller | MOTD_SHOWN=pam
2025-09-29 12:31:57.599736 | controller | HOME=/home/zuul
2025-09-29 12:31:57.599773 | controller | LANG=en_US.UTF-8
2025-09-29 12:31:57.599782 | controller | SSH_CONNECTION=192.168.26.12 44524 192.168.26.244 22
2025-09-29 12:31:57.599787 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2025-09-29 12:31:57.599795 | controller | ZUUL_CHANGE_IDS=3350,747e495ee0f363784243f616037c2e314a8d13cb
2025-09-29 12:31:57.599801 | controller | WORKSPACE=/home/zuul/workspace
2025-09-29 12:31:57.599806 | controller | XDG_SESSION_CLASS=user
2025-09-29 12:31:57.599811 | controller | SELINUX_ROLE_REQUESTED=
2025-09-29 12:31:57.599816 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2025-09-29 12:31:57.599821 | controller | USER=zuul
2025-09-29 12:31:57.599827 | controller | ZUUL_VOTING=True
2025-09-29 12:31:57.599832 | controller | BUILD_TIMEOUT=5400000
2025-09-29 12:31:57.599837 | controller | SELINUX_USE_CURRENT_RANGE=
2025-09-29 12:31:57.599842 | controller | SHLVL=1
2025-09-29 12:31:57.599847 | controller | ZUUL_PATCHSET=747e495ee0f363784243f616037c2e314a8d13cb
2025-09-29 12:31:57.599852 | controller | XDG_SESSION_ID=1
2025-09-29 12:31:57.599858 | controller | ZUUL_BRANCH=main
2025-09-29 12:31:57.599863 | controller | XDG_RUNTIME_DIR=/run/user/1000
2025-09-29 12:31:57.599868 | controller | SSH_CLIENT=192.168.26.12 44524 22
2025-09-29 12:31:57.599874 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2025-09-29 12:31:57.599879 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2025-09-29 12:31:57.599884 | controller | which_declare=declare -f
2025-09-29 12:31:57.599890 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2025-09-29 12:31:57.599895 | controller | SELINUX_LEVEL_REQUESTED=
2025-09-29 12:31:57.599900 | controller | ZUUL_CHANGE=3350
2025-09-29 12:31:57.599905 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2025-09-29 12:31:57.599910 | controller | ZUUL_UUID=78eeea42ec294a03aafb1a14dfbf04fe
2025-09-29 12:31:57.599915 | controller | BASH_FUNC_which%%=() {  ( alias;
2025-09-29 12:31:57.599921 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2025-09-29 12:31:57.599926 | controller | }
2025-09-29 12:31:57.860476 | controller | ok: Runtime: 0:00:00.008137
2025-09-29 12:31:57.865565 | 
2025-09-29 12:31:57.865630 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2025-09-29 12:31:57.879620 | controller | skipping: Conditional result was False
2025-09-29 12:31:57.884875 | 
2025-09-29 12:31:57.884953 | TASK [Symlink /home/zuul-worker/workspace]
2025-09-29 12:31:58.436498 | controller | skipping: Conditional result was False
2025-09-29 12:31:58.442722 | 
2025-09-29 12:31:58.442789 | TASK [Ensure legacy workspace directory]
2025-09-29 12:31:58.703767 | controller | changed
2025-09-29 12:31:58.722004 | 
2025-09-29 12:31:58.722069 | PLAY RECAP
2025-09-29 12:31:58.722121 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2025-09-29 12:31:58.722152 | 
2025-09-29 12:31:58.789899 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2025-09-29 12:31:58.790662 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/read_global_vars.yml@main]
2025-09-29 12:31:59.285302 | 
2025-09-29 12:31:59.285401 | PLAY [Load global variables]
2025-09-29 12:31:59.305105 | 
2025-09-29 12:31:59.305179 | TASK [Read group_vars all file]
2025-09-29 12:31:59.333602 | controller | ok
2025-09-29 12:31:59.348444 | 
2025-09-29 12:31:59.348526 | TASK [cifmw_helpers : Check if file is available]
2025-09-29 12:31:59.670794 | controller | ok
2025-09-29 12:31:59.676087 | 
2025-09-29 12:31:59.676164 | TASK [cifmw_helpers : Read vars]
2025-09-29 12:31:59.698702 | 
2025-09-29 12:31:59.698827 | LOOP [cifmw_helpers : Set vars as fact]
2025-09-29 12:31:59.755951 | 
2025-09-29 12:31:59.756055 | PLAY RECAP
2025-09-29 12:31:59.756107 | controller | ok: 1 changed: 0 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2025-09-29 12:31:59.756138 | 
2025-09-29 12:31:59.821112 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/read_global_vars.yml@main]
2025-09-29 12:31:59.821799 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2025-09-29 12:32:00.318267 | 
2025-09-29 12:32:00.318368 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2025-09-29 12:32:00.338322 | 
2025-09-29 12:32:00.338402 | TASK [Create zuul-output directory]
2025-09-29 12:32:00.712390 | controller | changed
2025-09-29 12:32:00.717332 | 
2025-09-29 12:32:00.717407 | TASK [Slurp Zuul inventory test]
2025-09-29 12:32:00.983885 | controller -> localhost | ok
2025-09-29 12:32:00.989291 | 
2025-09-29 12:32:00.989352 | TASK [Save zuul inventory]
2025-09-29 12:32:02.181981 | controller | changed
2025-09-29 12:32:02.187494 | 
2025-09-29 12:32:02.187564 | TASK [Save zuul vars without the change_message]
2025-09-29 12:32:03.333822 | controller | changed
2025-09-29 12:32:03.354289 | 
2025-09-29 12:32:03.354354 | PLAY RECAP
2025-09-29 12:32:03.354407 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2025-09-29 12:32:03.354430 | 
2025-09-29 12:32:03.455558 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2025-09-29 12:32:03.456251 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2025-09-29 12:32:04.064385 | 
2025-09-29 12:32:04.064514 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2025-09-29 12:32:04.083513 | 
2025-09-29 12:32:04.083588 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2025-09-29 12:32:04.102727 | controller | ok
2025-09-29 12:32:04.119740 | 
2025-09-29 12:32:04.120047 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2025-09-29 12:32:04.144181 | controller | skipping: Conditional result was False
2025-09-29 12:32:04.150159 | 
2025-09-29 12:32:04.150245 | TASK [mirror-info-fork : Create /etc/ci]
2025-09-29 12:32:04.553743 | controller | ok
2025-09-29 12:32:04.559844 | 
2025-09-29 12:32:04.559955 | TASK [mirror-info-fork : Install ci_mirror script]
2025-09-29 12:32:05.593123 | controller | ok
2025-09-29 12:32:05.602435 | 
2025-09-29 12:32:05.602504 | TASK [Prepare workspace]
2025-09-29 12:32:05.620238 | controller | ok
2025-09-29 12:32:05.636456 | 
2025-09-29 12:32:05.636522 | TASK [prepare-workspace : Start zuul_console daemon.]
2025-09-29 12:32:06.000217 | controller | ok
2025-09-29 12:32:06.005777 | 
2025-09-29 12:32:06.005842 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2025-09-29 12:32:08.013067 | controller | Output suppressed because no_log was given
2025-09-29 12:32:08.021666 | 
2025-09-29 12:32:08.021743 | LOOP [Create zuul-output directory]
2025-09-29 12:32:08.272935 | controller | changed: "/home/zuul/ci-framework-data/logs"
2025-09-29 12:32:08.495545 | controller | ok: "/home/zuul/zuul-output/logs"
2025-09-29 12:32:08.507499 | 
2025-09-29 12:32:08.507602 | TASK [Install required packages]
2025-09-29 12:32:44.353373 | controller | ok: Nothing to do
2025-09-29 12:32:44.358245 | 
2025-09-29 12:32:44.358304 | TASK [Install venv]
2025-09-29 12:33:41.984434 | controller | changed
2025-09-29 12:33:42.008281 | 
2025-09-29 12:33:42.008348 | PLAY RECAP
2025-09-29 12:33:42.008393 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2025-09-29 12:33:42.008416 | 
2025-09-29 12:33:42.072067 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2025-09-29 12:33:42.072874 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2025-09-29 12:33:42.557960 | 
2025-09-29 12:33:42.558110 | PLAY [Run ci/playbooks/molecule-test.yml]
2025-09-29 12:33:42.576714 | 
2025-09-29 12:33:42.576782 | TASK [Gather required facts]
2025-09-29 12:33:43.081615 | controller | ok
2025-09-29 12:33:43.086945 | 
2025-09-29 12:33:43.087019 | TASK [Load environment var if instructed to]
2025-09-29 12:33:43.110318 | controller | skipping: Conditional result was False
2025-09-29 12:33:43.115717 | 
2025-09-29 12:33:43.115782 | TASK [Run molecule]
2025-09-29 12:33:44.062613 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2025-09-29 12:33:44.318221 | controller | INFO     Performing prerun with role_name_check=0...
2025-09-29 12:34:00.430469 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.430849 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.430874 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.431318 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.431805 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+747e495e was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+747e495e (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.432284 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.432723 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.433169 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.433569 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.433967 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.434378 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.434805 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.435278 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.435709 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.436162 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2025-09-29 12:34:00.445333 | controller | INFO     Running crc_layout > prepare
2025-09-29 12:34:01.083504 | controller |
2025-09-29 12:34:01.083563 | controller | PLAY [Prepare] *****************************************************************
2025-09-29 12:34:01.083702 | controller |
2025-09-29 12:34:01.083819 | controller | TASK [Gathering Facts] *********************************************************
2025-09-29 12:34:01.083942 | controller | Monday 29 September 2025  12:34:01 +0000 (0:00:00.018)       0:00:00.018 ******
2025-09-29 12:34:01.881291 | controller | ok: [instance]
2025-09-29 12:34:01.881383 | controller |
2025-09-29 12:34:01.881507 | controller | TASK [Create custom basedir] ***************************************************
2025-09-29 12:34:01.881632 | controller | Monday 29 September 2025  12:34:01 +0000 (0:00:00.798)       0:00:00.817 ******
2025-09-29 12:34:02.175692 | controller | changed: [instance]
2025-09-29 12:34:02.175829 | controller |
2025-09-29 12:34:02.175846 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2025-09-29 12:34:02.175926 | controller | Monday 29 September 2025  12:34:02 +0000 (0:00:00.294)       0:00:01.111 ******
2025-09-29 12:34:02.192888 | controller | skipping: [instance]
2025-09-29 12:34:02.192963 | controller |
2025-09-29 12:34:02.193070 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2025-09-29 12:34:02.193217 | controller | Monday 29 September 2025  12:34:02 +0000 (0:00:00.017)       0:00:01.129 ******
2025-09-29 12:34:02.234511 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2025-09-29 12:34:02.234602 | controller |
2025-09-29 12:34:02.234737 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2025-09-29 12:34:02.234918 | controller | Monday 29 September 2025  12:34:02 +0000 (0:00:00.041)       0:00:01.170 ******
2025-09-29 12:34:02.504625 | controller | ok: [instance]
2025-09-29 12:34:02.504713 | controller |
2025-09-29 12:34:02.504822 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2025-09-29 12:34:02.504928 | controller | Monday 29 September 2025  12:34:02 +0000 (0:00:00.270)       0:00:01.440 ******
2025-09-29 12:34:02.708916 | controller | ok: [instance]
2025-09-29 12:34:03.377247 | controller |
2025-09-29 12:34:03.377283 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2025-09-29 12:34:03.377291 | controller | Monday 29 September 2025  12:34:02 +0000 (0:00:00.203)       0:00:01.644 ******
2025-09-29 12:34:03.377302 | controller | ok: [instance] => (item=ubi-9-appstream)
2025-09-29 12:34:03.377416 | controller | ok: [instance] => (item=ubi-9-baseos)
2025-09-29 12:34:03.377431 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2025-09-29 12:34:03.377516 | controller |
2025-09-29 12:34:03.377613 | controller | TASK [Deploy repo-setup] *******************************************************
2025-09-29 12:34:03.377697 | controller | Monday 29 September 2025  12:34:03 +0000 (0:00:00.668)       0:00:02.313 ******
2025-09-29 12:34:03.436260 | controller |
2025-09-29 12:34:03.957335 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2025-09-29 12:34:03.957372 | controller | Monday 29 September 2025  12:34:03 +0000 (0:00:00.058)       0:00:02.371 ******
2025-09-29 12:34:03.957385 | controller | changed: [instance] => (item=tmp)
2025-09-29 12:34:03.957412 | controller | changed: [instance] => (item=artifacts/repositories)
2025-09-29 12:34:03.957523 | controller | changed: [instance] => (item=venv/repo_setup)
2025-09-29 12:34:03.957615 | controller |
2025-09-29 12:34:03.957725 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2025-09-29 12:34:03.957823 | controller | Monday 29 September 2025  12:34:03 +0000 (0:00:00.521)       0:00:02.893 ******
2025-09-29 12:34:04.753324 | controller | ok: [instance]
2025-09-29 12:34:04.753650 | controller |
2025-09-29 12:34:05.965304 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2025-09-29 12:34:05.965347 | controller | Monday 29 September 2025  12:34:04 +0000 (0:00:00.795)       0:00:03.689 ******
2025-09-29 12:34:05.965363 | controller | changed: [instance]
2025-09-29 12:34:13.614827 | controller |
2025-09-29 12:34:13.614867 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2025-09-29 12:34:13.614875 | controller | Monday 29 September 2025  12:34:05 +0000 (0:00:01.211)       0:00:04.900 ******
2025-09-29 12:34:13.614885 | controller | changed: [instance]
2025-09-29 12:34:14.317295 | controller |
2025-09-29 12:34:14.317334 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2025-09-29 12:34:14.317344 | controller | Monday 29 September 2025  12:34:13 +0000 (0:00:07.649)       0:00:12.550 ******
2025-09-29 12:34:14.317356 | controller | changed: [instance]
2025-09-29 12:34:14.317386 | controller |
2025-09-29 12:34:14.317583 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2025-09-29 12:34:14.338210 | controller | Monday 29 September 2025  12:34:14 +0000 (0:00:00.702)       0:00:13.253 ******
2025-09-29 12:34:14.338237 | controller | skipping: [instance]
2025-09-29 12:34:14.338570 | controller |
2025-09-29 12:34:15.161225 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2025-09-29 12:34:15.161255 | controller | Monday 29 September 2025  12:34:14 +0000 (0:00:00.021)       0:00:13.274 ******
2025-09-29 12:34:15.161267 | controller | changed: [instance]
2025-09-29 12:34:15.161294 | controller |
2025-09-29 12:34:15.161568 | controller | TASK [repo_setup : Get component repo] *****************************************
2025-09-29 12:34:15.196011 | controller | Monday 29 September 2025  12:34:15 +0000 (0:00:00.822)       0:00:14.097 ******
2025-09-29 12:34:15.196040 | controller | skipping: [instance]
2025-09-29 12:34:15.230267 | controller |
2025-09-29 12:34:15.230307 | controller | TASK [repo_setup : Rename component repo] **************************************
2025-09-29 12:34:15.230318 | controller | Monday 29 September 2025  12:34:15 +0000 (0:00:00.034)       0:00:14.131 ******
2025-09-29 12:34:15.230331 | controller | skipping: [instance]
2025-09-29 12:34:15.264744 | controller |
2025-09-29 12:34:15.264776 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2025-09-29 12:34:15.264785 | controller | Monday 29 September 2025  12:34:15 +0000 (0:00:00.034)       0:00:14.165 ******
2025-09-29 12:34:15.264797 | controller | skipping: [instance]
2025-09-29 12:34:15.815256 | controller |
2025-09-29 12:34:15.815288 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2025-09-29 12:34:15.815296 | controller | Monday 29 September 2025  12:34:15 +0000 (0:00:00.034)       0:00:14.200 ******
2025-09-29 12:34:15.815306 | controller | changed: [instance]
2025-09-29 12:34:15.815332 | controller |
2025-09-29 12:34:15.815528 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2025-09-29 12:34:16.260369 | controller | Monday 29 September 2025  12:34:15 +0000 (0:00:00.550)       0:00:14.750 ******
2025-09-29 12:34:16.260424 | controller | changed: [instance]
2025-09-29 12:34:16.260459 | controller |
2025-09-29 12:34:16.260468 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2025-09-29 12:34:16.260477 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.444)       0:00:15.195 ******
2025-09-29 12:34:16.294774 | controller | skipping: [instance]
2025-09-29 12:34:16.328226 | controller |
2025-09-29 12:34:16.328247 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2025-09-29 12:34:16.328256 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.034)       0:00:15.230 ******
2025-09-29 12:34:16.328272 | controller | skipping: [instance]
2025-09-29 12:34:16.328298 | controller |
2025-09-29 12:34:16.328308 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2025-09-29 12:34:16.328421 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.033)       0:00:15.264 ******
2025-09-29 12:34:16.362218 | controller | skipping: [instance]
2025-09-29 12:34:16.362504 | controller |
2025-09-29 12:34:16.403314 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2025-09-29 12:34:16.403355 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.034)       0:00:15.298 ******
2025-09-29 12:34:16.403370 | controller | ok: [instance]
2025-09-29 12:34:16.433592 | controller |
2025-09-29 12:34:16.433626 | controller | TASK [repo_setup : Create download directory] **********************************
2025-09-29 12:34:16.433636 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.040)       0:00:15.338 ******
2025-09-29 12:34:16.433663 | controller | skipping: [instance]
2025-09-29 12:34:16.462021 | controller |
2025-09-29 12:34:16.462049 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2025-09-29 12:34:16.462058 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.029)       0:00:15.368 ******
2025-09-29 12:34:16.462070 | controller | skipping: [instance]
2025-09-29 12:34:16.462174 | controller |
2025-09-29 12:34:16.462194 | controller | TASK [Download the RPM] ********************************************************
2025-09-29 12:34:16.462304 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.029)       0:00:15.397 ******
2025-09-29 12:34:16.503690 | controller | skipping: [instance]
2025-09-29 12:34:16.503923 | controller |
2025-09-29 12:34:16.504176 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2025-09-29 12:34:16.504368 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.031)       0:00:15.429 ******
2025-09-29 12:34:16.532973 | controller | skipping: [instance]
2025-09-29 12:34:16.533244 | controller |
2025-09-29 12:34:16.533384 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2025-09-29 12:34:16.533536 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.039)       0:00:15.468 ******
2025-09-29 12:34:16.562360 | controller | skipping: [instance]
2025-09-29 12:34:16.562504 | controller |
2025-09-29 12:34:16.562593 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2025-09-29 12:34:16.562705 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.029)       0:00:15.498 ******
2025-09-29 12:34:16.591398 | controller | skipping: [instance]
2025-09-29 12:34:16.591776 | controller |
2025-09-29 12:34:16.591841 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2025-09-29 12:34:16.592112 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.029)       0:00:15.527 ******
2025-09-29 12:34:16.620617 | controller | skipping: [instance]
2025-09-29 12:34:16.620748 | controller |
2025-09-29 12:34:16.620931 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2025-09-29 12:34:16.621067 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.029)       0:00:15.556 ******
2025-09-29 12:34:16.820282 | controller | ok: [instance]
2025-09-29 12:34:16.820336 | controller |
2025-09-29 12:34:16.820347 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2025-09-29 12:34:16.820432 | controller | Monday 29 September 2025  12:34:16 +0000 (0:00:00.199)       0:00:15.756 ******
2025-09-29 12:34:17.043657 | controller | changed: [instance]
2025-09-29 12:34:17.325223 | controller |
2025-09-29 12:34:17.325259 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2025-09-29 12:34:17.325268 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.223)       0:00:15.979 ******
2025-09-29 12:34:17.325279 | controller | changed: [instance]
2025-09-29 12:34:17.355255 | controller |
2025-09-29 12:34:17.355290 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2025-09-29 12:34:17.355300 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.281)       0:00:16.260 ******
2025-09-29 12:34:17.355312 | controller | skipping: [instance]
2025-09-29 12:34:17.382276 | controller |
2025-09-29 12:34:17.382316 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2025-09-29 12:34:17.382326 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.030)       0:00:16.290 ******
2025-09-29 12:34:17.382347 | controller | skipping: [instance]
2025-09-29 12:34:17.382384 | controller |
2025-09-29 12:34:17.382393 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2025-09-29 12:34:17.382403 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.027)       0:00:16.318 ******
2025-09-29 12:34:17.414306 | controller | skipping: [instance]
2025-09-29 12:34:17.439336 | controller |
2025-09-29 12:34:17.439370 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2025-09-29 12:34:17.439383 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.031)       0:00:16.350 ******
2025-09-29 12:34:17.439399 | controller | skipping: [instance]
2025-09-29 12:34:17.439457 | controller |
2025-09-29 12:34:17.439470 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2025-09-29 12:34:17.439495 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.025)       0:00:16.375 ******
2025-09-29 12:34:17.466961 | controller | skipping: [instance]
2025-09-29 12:34:17.493209 | controller |
2025-09-29 12:34:17.493229 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] ***
2025-09-29 12:34:17.493237 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.027)       0:00:16.402 ******
2025-09-29 12:34:17.493251 | controller | skipping: [instance]
2025-09-29 12:34:17.511683 | controller |
2025-09-29 12:34:17.511705 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2025-09-29 12:34:17.511714 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.026)       0:00:16.428 ******
2025-09-29 12:34:17.511725 | controller | skipping: [instance]
2025-09-29 12:34:17.511914 | controller |
2025-09-29 12:34:17.512121 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2025-09-29 12:34:17.512291 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.018)       0:00:16.447 ******
2025-09-29 12:34:17.542688 | controller | skipping: [instance]
2025-09-29 12:34:17.542874 | controller |
2025-09-29 12:34:17.543068 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2025-09-29 12:34:17.543284 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.030)       0:00:16.478 ******
2025-09-29 12:34:17.559664 | controller | skipping: [instance]
2025-09-29 12:34:17.559815 | controller |
2025-09-29 12:34:17.559971 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2025-09-29 12:34:17.560108 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.017)       0:00:16.495 ******
2025-09-29 12:34:17.584197 | controller | skipping: [instance]
2025-09-29 12:34:17.584399 | controller |
2025-09-29 12:34:17.584576 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2025-09-29 12:34:17.584747 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.024)       0:00:16.520 ******
2025-09-29 12:34:17.615998 | controller | skipping: [instance]
2025-09-29 12:34:17.616212 | controller |
2025-09-29 12:34:17.616370 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2025-09-29 12:34:17.616514 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.031)       0:00:16.551 ******
2025-09-29 12:34:17.648435 | controller | skipping: [instance]
2025-09-29 12:34:17.648621 | controller |
2025-09-29 12:34:17.648814 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2025-09-29 12:34:17.649003 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.032)       0:00:16.584 ******
2025-09-29 12:34:17.681859 | controller | skipping: [instance]
2025-09-29 12:34:17.682046 | controller |
2025-09-29 12:34:17.682237 | controller | TASK [test_deps : Install additional packages] *********************************
2025-09-29 12:34:17.682398 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.033)       0:00:16.618 ******
2025-09-29 12:34:17.712307 | controller | skipping: [instance]
2025-09-29 12:34:17.712482 | controller |
2025-09-29 12:34:17.712623 | controller | TASK [test_deps : Install selinux python libs] *********************************
2025-09-29 12:34:17.712760 | controller | Monday 29 September 2025  12:34:17 +0000 (0:00:00.030)       0:00:16.648 ******
2025-09-29 12:35:11.218058 | controller | ok: [instance]
2025-09-29 12:35:12.552269 | controller |
2025-09-29 12:35:12.552307 | controller | TASK [test_deps : Install python yaml libs] ************************************
2025-09-29 12:35:12.552315 | controller | Monday 29 September 2025  12:35:11 +0000 (0:00:53.505)       0:01:10.153 ******
2025-09-29 12:35:12.552326 | controller | ok: [instance]
2025-09-29 12:35:12.552354 | controller |
2025-09-29 12:35:12.552620 | controller | TASK [test_deps : Install extra packages] **************************************
2025-09-29 12:35:12.584365 | controller | Monday 29 September 2025  12:35:12 +0000 (0:00:01.334)       0:01:11.487 ******
2025-09-29 12:35:12.584647 | controller | skipping: [instance]
2025-09-29 12:35:12.584723 | controller |
2025-09-29 12:35:12.584769 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2025-09-29 12:35:12.584938 | controller | Monday 29 September 2025  12:35:12 +0000 (0:00:00.032)       0:01:11.520 ******
2025-09-29 12:35:12.631077 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2025-09-29 12:35:12.653393 | controller |
2025-09-29 12:35:12.653438 | controller | TASK [ci_setup : List packages to install] *************************************
2025-09-29 12:35:12.653458 | controller | Monday 29 September 2025  12:35:12 +0000 (0:00:00.046)       0:01:11.566 ******
2025-09-29 12:35:12.653472 | controller | ok: [instance] =>
2025-09-29 12:35:12.653508 | controller |   cifmw_ci_setup_packages:
2025-09-29 12:35:12.653516 | controller |   - bash-completion
2025-09-29 12:35:12.653523 | controller |   - ca-certificates
2025-09-29 12:35:12.653530 | controller |   - git-core
2025-09-29 12:35:12.653539 | controller |   - make
2025-09-29 12:35:12.653570 | controller |   - tar
2025-09-29 12:35:12.654113 | controller |   - tmux
2025-09-29 12:35:18.592293 | controller |   - python3-pip
2025-09-29 12:35:18.592446 | controller |
2025-09-29 12:35:18.592455 | controller | TASK [ci_setup : Install needed packages] **************************************
2025-09-29 12:35:18.592462 | controller | Monday 29 September 2025  12:35:12 +0000 (0:00:00.022)       0:01:11.589 ******
2025-09-29 12:35:18.592490 | controller | changed: [instance]
2025-09-29 12:35:19.205287 | controller |
2025-09-29 12:35:19.205324 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2025-09-29 12:35:19.205333 | controller | Monday 29 September 2025  12:35:18 +0000 (0:00:05.938)       0:01:17.527 ******
2025-09-29 12:35:19.205344 | controller | ok: [instance]
2025-09-29 12:35:19.205373 | controller |
2025-09-29 12:35:19.205389 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2025-09-29 12:35:19.205415 | controller | Monday 29 September 2025  12:35:19 +0000 (0:00:00.613)       0:01:18.140 ******
2025-09-29 12:35:19.439259 | controller | changed: [instance]
2025-09-29 12:35:19.439298 | controller |
2025-09-29 12:35:19.439306 | controller | TASK [ci_setup : Install openshift client] *************************************
2025-09-29 12:35:19.439315 | controller | Monday 29 September 2025  12:35:19 +0000 (0:00:00.234)       0:01:18.374 ******
2025-09-29 12:35:26.512299 | controller | changed: [instance]
2025-09-29 12:35:26.512355 | controller |
2025-09-29 12:35:26.512367 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2025-09-29 12:35:26.512445 | controller | Monday 29 September 2025  12:35:26 +0000 (0:00:07.072)       0:01:25.447 ******
2025-09-29 12:35:26.550644 | controller | ok: [instance]
2025-09-29 12:35:26.814757 | controller |
2025-09-29 12:35:26.814791 | controller | TASK [ci_setup : Create completion file] ***************************************
2025-09-29 12:35:26.814800 | controller | Monday 29 September 2025  12:35:26 +0000 (0:00:00.038)       0:01:25.486 ******
2025-09-29 12:35:26.814811 | controller | changed: [instance]
2025-09-29 12:35:27.090299 | controller |
2025-09-29 12:35:27.090336 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2025-09-29 12:35:27.090345 | controller | Monday 29 September 2025  12:35:26 +0000 (0:00:00.263)       0:01:25.750 ******
2025-09-29 12:35:27.090357 | controller | changed: [instance]
2025-09-29 12:35:27.108769 | controller |
2025-09-29 12:35:27.108790 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2025-09-29 12:35:27.108797 | controller | Monday 29 September 2025  12:35:27 +0000 (0:00:00.275)       0:01:26.025 ******
2025-09-29 12:35:27.108806 | controller | skipping: [instance]
2025-09-29 12:35:27.126882 | controller |
2025-09-29 12:35:27.126901 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2025-09-29 12:35:27.126910 | controller | Monday 29 September 2025  12:35:27 +0000 (0:00:00.018)       0:01:26.044 ******
2025-09-29 12:35:27.126920 | controller | skipping: [instance]
2025-09-29 12:35:27.144667 | controller |
2025-09-29 12:35:27.144690 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2025-09-29 12:35:27.144699 | controller | Monday 29 September 2025  12:35:27 +0000 (0:00:00.018)       0:01:26.062 ******
2025-09-29 12:35:27.144709 | controller | skipping: [instance]
2025-09-29 12:35:27.160405 | controller |
2025-09-29 12:35:27.160429 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2025-09-29 12:35:27.160438 | controller | Monday 29 September 2025  12:35:27 +0000 (0:00:00.017)       0:01:26.080 ******
2025-09-29 12:35:27.160450 | controller | skipping: [instance]
2025-09-29 12:35:27.160478 | controller |
2025-09-29 12:35:27.160488 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2025-09-29 12:35:27.160587 | controller | Monday 29 September 2025  12:35:27 +0000 (0:00:00.015)       0:01:26.096 ******
2025-09-29 12:35:27.177328 | controller | skipping: [instance]
2025-09-29 12:35:27.198722 | controller |
2025-09-29 12:35:27.198757 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2025-09-29 12:35:27.198767 | controller | Monday 29 September 2025  12:35:27 +0000 (0:00:00.016)       0:01:26.113 ******
2025-09-29 12:35:27.198779 | controller | skipping: [instance]
2025-09-29 12:35:28.168332 | controller |
2025-09-29 12:35:28.168373 | controller | TASK [ci_setup : Manage directories] *******************************************
2025-09-29 12:35:28.168383 | controller | Monday 29 September 2025  12:35:27 +0000 (0:00:00.021)       0:01:26.134 ******
2025-09-29 12:35:28.168397 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2025-09-29 12:35:28.168427 | controller | changed: [instance] => (item=/opt/basedir/logs)
2025-09-29 12:35:28.168437 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2025-09-29 12:35:28.168462 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2025-09-29 12:35:28.168937 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2025-09-29 12:35:28.513789 | controller |
2025-09-29 12:35:28.513834 | controller | TASK [Create secret file] ******************************************************
2025-09-29 12:35:28.513844 | controller | Monday 29 September 2025  12:35:28 +0000 (0:00:00.969)       0:01:27.103 ******
2025-09-29 12:35:28.513861 | controller | changed: [instance]
2025-09-29 12:35:28.513882 | controller |
2025-09-29 12:35:28.514213 | controller | PLAY RECAP *********************************************************************
2025-09-29 12:35:28.515199 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2025-09-29 12:35:28.515213 | controller |
2025-09-29 12:35:28.515222 | controller | Monday 29 September 2025  12:35:28 +0000 (0:00:00.345)       0:01:27.449 ******
2025-09-29 12:35:28.515245 | controller | ===============================================================================
2025-09-29 12:35:28.515251 | controller | test_deps : Install selinux python libs -------------------------------- 53.51s
2025-09-29 12:35:28.515257 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.65s
2025-09-29 12:35:28.515262 | controller | ci_setup : Install openshift client ------------------------------------- 7.07s
2025-09-29 12:35:28.515267 | controller | ci_setup : Install needed packages -------------------------------------- 5.94s
2025-09-29 12:35:28.515273 | controller | test_deps : Install python yaml libs ------------------------------------ 1.33s
2025-09-29 12:35:28.515278 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.21s
2025-09-29 12:35:28.515283 | controller | ci_setup : Manage directories ------------------------------------------- 0.97s
2025-09-29 12:35:28.515288 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.82s
2025-09-29 12:35:28.515296 | controller | Gathering Facts --------------------------------------------------------- 0.80s
2025-09-29 12:35:28.516275 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.80s
2025-09-29 12:35:28.585764 | controller | repo_setup : Install repo-setup package --------------------------------- 0.70s
2025-09-29 12:35:28.585786 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.67s
2025-09-29 12:35:28.585793 | controller | ci_setup : Gather version of openshift client --------------------------- 0.61s
2025-09-29 12:35:28.585799 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.55s
2025-09-29 12:35:28.585805 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s
2025-09-29 12:35:28.585810 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.44s
2025-09-29 12:35:28.585815 | controller | Create secret file ------------------------------------------------------ 0.35s
2025-09-29 12:35:28.585821 | controller | Create custom basedir --------------------------------------------------- 0.29s
2025-09-29 12:35:28.585826 | controller | repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist) --- 0.28s
2025-09-29 12:35:28.585838 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.28s
2025-09-29 12:35:28.585847 | controller | INFO     Running crc_layout > converge
2025-09-29 12:35:29.147840 | controller |
2025-09-29 12:35:29.148024 | controller | PLAY [Converge] ****************************************************************
2025-09-29 12:35:29.148181 | controller |
2025-09-29 12:35:29.148338 | controller | TASK [Gathering Facts] *********************************************************
2025-09-29 12:35:29.148478 | controller | Monday 29 September 2025  12:35:29 +0000 (0:00:00.023)       0:00:00.023 ******
2025-09-29 12:35:29.956317 | controller | ok: [instance]
2025-09-29 12:35:29.956382 | controller |
2025-09-29 12:35:29.956395 | controller | TASK [Load networking definition from scenario file] ***************************
2025-09-29 12:35:29.956423 | controller | Monday 29 September 2025  12:35:29 +0000 (0:00:00.809)       0:00:00.833 ******
2025-09-29 12:35:30.006014 | controller | ok: [instance]
2025-09-29 12:35:31.581339 | controller |
2025-09-29 12:35:31.581382 | controller | TASK [discover_latest_image : Get latest image] ********************************
2025-09-29 12:35:31.581392 | controller | Monday 29 September 2025  12:35:30 +0000 (0:00:00.049)       0:00:00.882 ******
2025-09-29 12:35:31.581406 | controller | changed: [instance]
2025-09-29 12:35:31.581437 | controller |
2025-09-29 12:35:31.581447 | controller | TASK [discover_latest_image : Export facts accordingly] ************************
2025-09-29 12:35:31.581574 | controller | Monday 29 September 2025  12:35:31 +0000 (0:00:01.575)       0:00:02.457 ******
2025-09-29 12:35:31.610336 | controller | ok: [instance]
2025-09-29 12:35:31.632309 | controller |
2025-09-29 12:35:31.632346 | controller | TASK [reproducer : Load CI job environment] ************************************
2025-09-29 12:35:31.632357 | controller | Monday 29 September 2025  12:35:31 +0000 (0:00:00.028)       0:00:02.486 ******
2025-09-29 12:35:31.632368 | controller | skipping: [instance]
2025-09-29 12:35:31.632398 | controller |
2025-09-29 12:35:31.632409 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2025-09-29 12:35:31.632507 | controller | Monday 29 September 2025  12:35:31 +0000 (0:00:00.022)       0:00:02.509 ******
2025-09-29 12:35:31.678202 | controller | ok: [instance]
2025-09-29 12:35:31.728928 | controller |
2025-09-29 12:35:31.728961 | controller | TASK [Build final libvirt layout] **********************************************
2025-09-29 12:35:31.728975 | controller | Monday 29 September 2025  12:35:31 +0000 (0:00:00.045)       0:00:02.554 ******
2025-09-29 12:35:31.728991 | controller |
2025-09-29 12:35:31.729329 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2025-09-29 12:35:31.729599 | controller | Monday 29 September 2025  12:35:31 +0000 (0:00:00.050)       0:00:02.605 ******
2025-09-29 12:35:31.809880 | controller | ok: [instance]
2025-09-29 12:35:31.810199 | controller |
2025-09-29 12:35:31.810494 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2025-09-29 12:35:31.810698 | controller | Monday 29 September 2025  12:35:31 +0000 (0:00:00.081)       0:00:02.686 ******
2025-09-29 12:35:31.870818 | controller | skipping: [instance]
2025-09-29 12:35:31.870974 | controller |
2025-09-29 12:35:31.871130 | controller | TASK [reproducer : Set controller-0 user and basedir facts] ********************
2025-09-29 12:35:31.871306 | controller | Monday 29 September 2025  12:35:31 +0000 (0:00:00.060)       0:00:02.747 ******
2025-09-29 12:35:31.910697 | controller | ok: [instance]
2025-09-29 12:35:31.910896 | controller |
2025-09-29 12:35:31.911041 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2025-09-29 12:35:31.911204 | controller | Monday 29 September 2025  12:35:31 +0000 (0:00:00.039)       0:00:02.787 ******
2025-09-29 12:35:31.939483 | controller | ok: [instance]
2025-09-29 12:35:31.939666 | controller |
2025-09-29 12:35:31.939821 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2025-09-29 12:35:31.939959 | controller | Monday 29 September 2025  12:35:31 +0000 (0:00:00.028)       0:00:02.816 ******
2025-09-29 12:35:31.964348 | controller | ok: [instance] => changed=false
2025-09-29 12:35:31.964659 | controller |   msg: All assertions passed
2025-09-29 12:35:31.964905 | controller |
2025-09-29 12:35:31.965052 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2025-09-29 12:35:31.965216 | controller | Monday 29 September 2025  12:35:31 +0000 (0:00:00.024)       0:00:02.841 ******
2025-09-29 12:35:32.008015 | controller | ok: [instance]
2025-09-29 12:35:32.008191 | controller |
2025-09-29 12:35:32.008345 | controller | TASK [reproducer : Ensure directories are present] *****************************
2025-09-29 12:35:32.008485 | controller | Monday 29 September 2025  12:35:32 +0000 (0:00:00.043)       0:00:02.884 ******
2025-09-29 12:35:32.479964 | controller | ok: [instance] => (item=artifacts)
2025-09-29 12:35:32.557334 | controller | ok: [instance] => (item=logs)
2025-09-29 12:35:32.557378 | controller |
2025-09-29 12:35:32.557397 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2025-09-29 12:35:32.557408 | controller | Monday 29 September 2025  12:35:32 +0000 (0:00:00.471)       0:00:03.356 ******
2025-09-29 12:35:32.557424 | controller |
2025-09-29 12:35:32.759024 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2025-09-29 12:35:32.759062 | controller | Monday 29 September 2025  12:35:32 +0000 (0:00:00.077)       0:00:03.434 ******
2025-09-29 12:35:32.759081 | controller | ok: [instance]
2025-09-29 12:35:33.051802 | controller |
2025-09-29 12:35:33.051829 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2025-09-29 12:35:33.051838 | controller | Monday 29 September 2025  12:35:32 +0000 (0:00:00.201)       0:00:03.635 ******
2025-09-29 12:35:33.051849 | controller | changed: [instance]
2025-09-29 12:35:33.339143 | controller |
2025-09-29 12:35:33.339195 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2025-09-29 12:35:33.339206 | controller | Monday 29 September 2025  12:35:33 +0000 (0:00:00.292)       0:00:03.928 ******
2025-09-29 12:35:33.339219 | controller | ok: [instance]
2025-09-29 12:35:33.370010 | controller |
2025-09-29 12:35:33.370033 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2025-09-29 12:35:33.370042 | controller | Monday 29 September 2025  12:35:33 +0000 (0:00:00.287)       0:00:04.215 ******
2025-09-29 12:35:33.370053 | controller | skipping: [instance]
2025-09-29 12:35:33.389364 | controller |
2025-09-29 12:35:33.389406 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2025-09-29 12:35:33.389417 | controller | Monday 29 September 2025  12:35:33 +0000 (0:00:00.031)       0:00:04.246 ******
2025-09-29 12:35:33.389430 | controller | skipping: [instance]
2025-09-29 12:35:33.411264 | controller |
2025-09-29 12:35:33.411292 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2025-09-29 12:35:33.411311 | controller | Monday 29 September 2025  12:35:33 +0000 (0:00:00.019)       0:00:04.266 ******
2025-09-29 12:35:33.411324 | controller | ok: [instance]
2025-09-29 12:35:33.411360 | controller |
2025-09-29 12:35:33.411371 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2025-09-29 12:35:33.411419 | controller | Monday 29 September 2025  12:35:33 +0000 (0:00:00.021)       0:00:04.288 ******
2025-09-29 12:35:33.439817 | controller | skipping: [instance]
2025-09-29 12:35:43.448798 | controller |
2025-09-29 12:35:43.448835 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2025-09-29 12:35:43.448844 | controller | Monday 29 September 2025  12:35:33 +0000 (0:00:00.028)       0:00:04.316 ******
2025-09-29 12:35:43.448855 | controller | changed: [instance]
2025-09-29 12:35:43.666234 | controller |
2025-09-29 12:35:43.666272 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2025-09-29 12:35:43.666280 | controller | Monday 29 September 2025  12:35:43 +0000 (0:00:10.008)       0:00:14.325 ******
2025-09-29 12:35:43.666291 | controller | changed: [instance]
2025-09-29 12:35:44.158831 | controller |
2025-09-29 12:35:44.158862 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2025-09-29 12:35:44.158871 | controller | Monday 29 September 2025  12:35:43 +0000 (0:00:00.214)       0:00:14.540 ******
2025-09-29 12:35:44.158881 | controller | changed: [instance]
2025-09-29 12:35:44.750247 | controller |
2025-09-29 12:35:44.750281 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2025-09-29 12:35:44.750290 | controller | Monday 29 September 2025  12:35:44 +0000 (0:00:00.495)       0:00:15.035 ******
2025-09-29 12:35:44.750301 | controller | changed: [instance]
2025-09-29 12:35:44.945106 | controller |
2025-09-29 12:35:44.945138 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2025-09-29 12:35:44.945170 | controller | Monday 29 September 2025  12:35:44 +0000 (0:00:00.591)       0:00:15.626 ******
2025-09-29 12:35:44.945185 | controller | ok: [instance]
2025-09-29 12:35:45.599268 | controller |
2025-09-29 12:35:45.599307 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2025-09-29 12:35:45.599318 | controller | Monday 29 September 2025  12:35:44 +0000 (0:00:00.194)       0:00:15.821 ******
2025-09-29 12:35:45.599331 | controller | ok: [instance]
2025-09-29 12:35:45.599369 | controller |
2025-09-29 12:35:45.599381 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2025-09-29 12:35:45.599527 | controller | Monday 29 September 2025  12:35:45 +0000 (0:00:00.654)       0:00:16.476 ******
2025-09-29 12:35:46.541655 | controller | changed: [instance]
2025-09-29 12:35:46.627701 | controller |
2025-09-29 12:35:46.627725 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2025-09-29 12:35:46.627735 | controller | Monday 29 September 2025  12:35:46 +0000 (0:00:00.941)       0:00:17.417 ******
2025-09-29 12:35:46.627746 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2025-09-29 12:35:46.627793 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2025-09-29 12:35:46.627802 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2025-09-29 12:35:46.627809 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2025-09-29 12:35:46.627816 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2025-09-29 12:35:46.627825 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2025-09-29 12:35:46.627938 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2025-09-29 12:35:46.628100 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2025-09-29 12:35:46.628141 | controller |
2025-09-29 12:35:46.628277 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2025-09-29 12:35:46.628357 | controller | Monday 29 September 2025  12:35:46 +0000 (0:00:00.086)       0:00:17.504 ******
2025-09-29 12:35:46.944449 | controller | ok: [instance]
2025-09-29 12:35:47.264389 | controller |
2025-09-29 12:35:47.264432 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2025-09-29 12:35:47.264443 | controller | Monday 29 September 2025  12:35:46 +0000 (0:00:00.316)       0:00:17.820 ******
2025-09-29 12:35:47.264457 | controller | ok: [instance]
2025-09-29 12:35:47.582144 | controller |
2025-09-29 12:35:47.582205 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2025-09-29 12:35:47.582216 | controller | Monday 29 September 2025  12:35:47 +0000 (0:00:00.319)       0:00:18.140 ******
2025-09-29 12:35:47.582229 | controller | ok: [instance]
2025-09-29 12:35:47.899885 | controller |
2025-09-29 12:35:47.899923 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2025-09-29 12:35:47.899933 | controller | Monday 29 September 2025  12:35:47 +0000 (0:00:00.317)       0:00:18.458 ******
2025-09-29 12:35:47.899946 | controller | ok: [instance]
2025-09-29 12:35:48.220940 | controller |
2025-09-29 12:35:48.220977 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2025-09-29 12:35:48.220986 | controller | Monday 29 September 2025  12:35:47 +0000 (0:00:00.317)       0:00:18.776 ******
2025-09-29 12:35:48.220996 | controller | ok: [instance]
2025-09-29 12:35:48.533590 | controller |
2025-09-29 12:35:48.533639 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2025-09-29 12:35:48.533648 | controller | Monday 29 September 2025  12:35:48 +0000 (0:00:00.321)       0:00:19.097 ******
2025-09-29 12:35:48.533677 | controller | ok: [instance]
2025-09-29 12:35:48.853289 | controller |
2025-09-29 12:35:48.853327 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2025-09-29 12:35:48.853337 | controller | Monday 29 September 2025  12:35:48 +0000 (0:00:00.312)       0:00:19.410 ******
2025-09-29 12:35:48.853351 | controller | ok: [instance]
2025-09-29 12:35:48.853381 | controller |
2025-09-29 12:35:48.853389 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2025-09-29 12:35:48.853398 | controller | Monday 29 September 2025  12:35:48 +0000 (0:00:00.319)       0:00:19.729 ******
2025-09-29 12:35:49.181585 | controller | ok: [instance]
2025-09-29 12:35:49.508283 | controller |
2025-09-29 12:35:49.508322 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2025-09-29 12:35:49.508333 | controller | Monday 29 September 2025  12:35:49 +0000 (0:00:00.328)       0:00:20.058 ******
2025-09-29 12:35:49.508345 | controller | ok: [instance]
2025-09-29 12:35:49.508538 | controller |
2025-09-29 12:35:49.508578 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2025-09-29 12:35:49.828875 | controller | Monday 29 September 2025  12:35:49 +0000 (0:00:00.326)       0:00:20.385 ******
2025-09-29 12:35:49.828915 | controller | ok: [instance]
2025-09-29 12:35:50.146417 | controller |
2025-09-29 12:35:50.146450 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2025-09-29 12:35:50.146459 | controller | Monday 29 September 2025  12:35:49 +0000 (0:00:00.320)       0:00:20.705 ******
2025-09-29 12:35:50.146469 | controller | ok: [instance]
2025-09-29 12:35:50.465622 | controller |
2025-09-29 12:35:50.465672 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2025-09-29 12:35:50.465681 | controller | Monday 29 September 2025  12:35:50 +0000 (0:00:00.317)       0:00:21.022 ******
2025-09-29 12:35:50.465692 | controller | ok: [instance]
2025-09-29 12:35:50.767101 | controller |
2025-09-29 12:35:50.767136 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2025-09-29 12:35:50.767145 | controller | Monday 29 September 2025  12:35:50 +0000 (0:00:00.319)       0:00:21.342 ******
2025-09-29 12:35:50.767173 | controller | ok: [instance]
2025-09-29 12:35:51.082844 | controller |
2025-09-29 12:35:51.082878 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2025-09-29 12:35:51.082886 | controller | Monday 29 September 2025  12:35:50 +0000 (0:00:00.301)       0:00:21.643 ******
2025-09-29 12:35:51.082897 | controller | ok: [instance]
2025-09-29 12:35:51.404293 | controller |
2025-09-29 12:35:51.404337 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2025-09-29 12:35:51.404348 | controller | Monday 29 September 2025  12:35:51 +0000 (0:00:00.315)       0:00:21.959 ******
2025-09-29 12:35:51.404362 | controller | ok: [instance]
2025-09-29 12:35:51.715939 | controller |
2025-09-29 12:35:51.715965 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2025-09-29 12:35:51.715973 | controller | Monday 29 September 2025  12:35:51 +0000 (0:00:00.321)       0:00:22.280 ******
2025-09-29 12:35:51.715983 | controller | ok: [instance]
2025-09-29 12:35:52.036104 | controller |
2025-09-29 12:35:52.036138 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2025-09-29 12:35:52.036146 | controller | Monday 29 September 2025  12:35:51 +0000 (0:00:00.311)       0:00:22.592 ******
2025-09-29 12:35:52.036172 | controller | ok: [instance]
2025-09-29 12:35:52.359737 | controller |
2025-09-29 12:35:52.359772 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2025-09-29 12:35:52.359780 | controller | Monday 29 September 2025  12:35:52 +0000 (0:00:00.319)       0:00:22.912 ******
2025-09-29 12:35:52.359791 | controller | ok: [instance]
2025-09-29 12:35:52.668725 | controller |
2025-09-29 12:35:52.668757 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2025-09-29 12:35:52.668766 | controller | Monday 29 September 2025  12:35:52 +0000 (0:00:00.323)       0:00:23.236 ******
2025-09-29 12:35:52.668777 | controller | ok: [instance]
2025-09-29 12:35:52.981322 | controller |
2025-09-29 12:35:52.981369 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2025-09-29 12:35:52.981382 | controller | Monday 29 September 2025  12:35:52 +0000 (0:00:00.309)       0:00:23.545 ******
2025-09-29 12:35:52.981409 | controller | ok: [instance]
2025-09-29 12:35:53.290575 | controller |
2025-09-29 12:35:53.290609 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2025-09-29 12:35:53.290618 | controller | Monday 29 September 2025  12:35:52 +0000 (0:00:00.312)       0:00:23.857 ******
2025-09-29 12:35:53.290642 | controller | ok: [instance]
2025-09-29 12:35:53.598300 | controller |
2025-09-29 12:35:53.598337 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2025-09-29 12:35:53.598356 | controller | Monday 29 September 2025  12:35:53 +0000 (0:00:00.309)       0:00:24.167 ******
2025-09-29 12:35:53.598369 | controller | ok: [instance]
2025-09-29 12:35:53.598392 | controller |
2025-09-29 12:35:53.598422 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2025-09-29 12:35:53.598587 | controller | Monday 29 September 2025  12:35:53 +0000 (0:00:00.307)       0:00:24.475 ******
2025-09-29 12:35:53.921239 | controller | ok: [instance]
2025-09-29 12:35:54.225095 | controller |
2025-09-29 12:35:54.225129 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2025-09-29 12:35:54.225138 | controller | Monday 29 September 2025  12:35:53 +0000 (0:00:00.321)       0:00:24.796 ******
2025-09-29 12:35:54.225149 | controller | ok: [instance]
2025-09-29 12:35:54.246172 | controller |
2025-09-29 12:35:54.246195 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2025-09-29 12:35:54.246203 | controller | Monday 29 September 2025  12:35:54 +0000 (0:00:00.305)       0:00:25.101 ******
2025-09-29 12:35:54.246212 | controller | skipping: [instance]
2025-09-29 12:35:54.531089 | controller |
2025-09-29 12:35:54.531120 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2025-09-29 12:35:54.531128 | controller | Monday 29 September 2025  12:35:54 +0000 (0:00:00.021)       0:00:25.122 ******
2025-09-29 12:35:54.531139 | controller | ok: [instance]
2025-09-29 12:35:54.901675 | controller |
2025-09-29 12:35:54.901708 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2025-09-29 12:35:54.901716 | controller | Monday 29 September 2025  12:35:54 +0000 (0:00:00.284)       0:00:25.407 ******
2025-09-29 12:35:54.901728 | controller | ok: [instance]
2025-09-29 12:35:55.207959 | controller |
2025-09-29 12:35:55.207993 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2025-09-29 12:35:55.208001 | controller | Monday 29 September 2025  12:35:54 +0000 (0:00:00.369)       0:00:25.777 ******
2025-09-29 12:35:55.208012 | controller | changed: [instance]
2025-09-29 12:35:55.497884 | controller |
2025-09-29 12:35:55.497921 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2025-09-29 12:35:55.497932 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.306)       0:00:26.084 ******
2025-09-29 12:35:55.497945 | controller | [WARNING]: Reset is not implemented for this connection
2025-09-29 12:35:55.507630 | controller | changed: [instance]
2025-09-29 12:35:55.598851 | controller |
2025-09-29 12:35:55.598867 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2025-09-29 12:35:55.598874 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.284)       0:00:26.368 ******
2025-09-29 12:35:55.598880 | controller |
2025-09-29 12:35:55.598886 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2025-09-29 12:35:55.598891 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.015)       0:00:26.384 ******
2025-09-29 12:35:55.598899 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2025-09-29 12:35:55.640324 | controller |
2025-09-29 12:35:55.640367 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2025-09-29 12:35:55.640378 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.091)       0:00:26.475 ******
2025-09-29 12:35:55.640396 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2025-09-29 12:35:55.640430 | controller |
2025-09-29 12:35:55.640657 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2025-09-29 12:35:55.688067 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.041)       0:00:26.517 ******
2025-09-29 12:35:55.688093 | controller | ok: [instance] => (item=compute)
2025-09-29 12:35:55.729211 | controller | ok: [instance] => (item=controller)
2025-09-29 12:35:55.729230 | controller | ok: [instance] => (item=crc)
2025-09-29 12:35:55.729238 | controller |
2025-09-29 12:35:55.729244 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2025-09-29 12:35:55.729250 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.047)       0:00:26.564 ******
2025-09-29 12:35:55.729259 | controller | ok: [instance]
2025-09-29 12:35:55.729446 | controller |
2025-09-29 12:35:55.729468 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2025-09-29 12:35:55.773339 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.041)       0:00:26.606 ******
2025-09-29 12:35:55.773366 | controller | ok: [instance] => changed=false
2025-09-29 12:35:55.773550 | controller |   msg: All assertions passed
2025-09-29 12:35:55.773725 | controller |
2025-09-29 12:35:55.773892 | controller | TASK [Ensure we get latest OCP config] *****************************************
2025-09-29 12:35:55.774046 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.044)       0:00:26.650 ******
2025-09-29 12:35:55.816751 | controller |
2025-09-29 12:35:55.816951 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2025-09-29 12:35:55.817121 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.043)       0:00:26.694 ******
2025-09-29 12:35:55.888012 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2025-09-29 12:35:55.888237 | controller | ok: [instance] => (item={})
2025-09-29 12:35:55.888379 | controller |
2025-09-29 12:35:55.888516 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2025-09-29 12:35:55.888663 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.071)       0:00:26.765 ******
2025-09-29 12:35:55.905714 | controller | skipping: [instance]
2025-09-29 12:35:55.905899 | controller |
2025-09-29 12:35:55.906071 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2025-09-29 12:35:55.906265 | controller | Monday 29 September 2025  12:35:55 +0000 (0:00:00.017)       0:00:26.782 ******
2025-09-29 12:35:56.118584 | controller | ok: [instance]
2025-09-29 12:35:56.482261 | controller |
2025-09-29 12:35:56.482295 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2025-09-29 12:35:56.482304 | controller | Monday 29 September 2025  12:35:56 +0000 (0:00:00.212)       0:00:26.995 ******
2025-09-29 12:35:56.482316 | controller | changed: [instance]
2025-09-29 12:35:56.482339 | controller |
2025-09-29 12:35:56.482348 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2025-09-29 12:35:56.482481 | controller | Monday 29 September 2025  12:35:56 +0000 (0:00:00.362)       0:00:27.357 ******
2025-09-29 12:35:57.241038 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2025-09-29 12:35:57.268281 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2025-09-29 12:35:57.268321 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2025-09-29 12:35:57.268331 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2025-09-29 12:35:57.268339 | controller |
2025-09-29 12:35:57.268346 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2025-09-29 12:35:57.268353 | controller | Monday 29 September 2025  12:35:57 +0000 (0:00:00.759)       0:00:28.117 ******
2025-09-29 12:35:57.268365 | controller | skipping: [instance]
2025-09-29 12:35:57.677317 | controller |
2025-09-29 12:35:57.677382 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2025-09-29 12:35:57.677411 | controller | Monday 29 September 2025  12:35:57 +0000 (0:00:00.027)       0:00:28.145 ******
2025-09-29 12:35:57.677435 | controller | changed: [instance]
2025-09-29 12:35:58.112235 | controller |
2025-09-29 12:35:58.112268 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2025-09-29 12:35:58.112275 | controller | Monday 29 September 2025  12:35:57 +0000 (0:00:00.399)       0:00:28.544 ******
2025-09-29 12:35:58.112281 | controller |
2025-09-29 12:35:58.112287 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-09-29 12:35:58.112292 | controller | Monday 29 September 2025  12:35:57 +0000 (0:00:00.008)       0:00:28.552 ******
2025-09-29 12:35:58.112302 | controller | changed: [instance]
2025-09-29 12:35:58.112328 | controller |
2025-09-29 12:35:58.112524 | controller | TASK [Ensure no default networks exists] ***************************************
2025-09-29 12:35:58.191687 | controller | Monday 29 September 2025  12:35:58 +0000 (0:00:00.436)       0:00:28.989 ******
2025-09-29 12:35:58.191719 | controller |
2025-09-29 12:35:59.375192 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2025-09-29 12:35:59.375223 | controller | Monday 29 September 2025  12:35:58 +0000 (0:00:00.079)       0:00:29.068 ******
2025-09-29 12:35:59.375235 | controller | ok: [instance]
2025-09-29 12:35:59.602236 | controller |
2025-09-29 12:35:59.602278 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2025-09-29 12:35:59.602289 | controller | Monday 29 September 2025  12:35:59 +0000 (0:00:01.183)       0:00:30.251 ******
2025-09-29 12:35:59.602302 | controller | ok: [instance]
2025-09-29 12:36:00.118249 | controller |
2025-09-29 12:36:00.118286 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2025-09-29 12:36:00.118296 | controller | Monday 29 September 2025  12:35:59 +0000 (0:00:00.227)       0:00:30.478 ******
2025-09-29 12:36:00.118308 | controller | ok: [instance]
2025-09-29 12:36:00.118336 | controller |
2025-09-29 12:36:00.118347 | controller | TASK [libvirt_manager : Removing default] **************************************
2025-09-29 12:36:00.118431 | controller | Monday 29 September 2025  12:36:00 +0000 (0:00:00.516)       0:00:30.995 ******
2025-09-29 12:36:00.337293 | controller | ok: [instance]
2025-09-29 12:36:00.337494 | controller |
2025-09-29 12:36:00.337513 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2025-09-29 12:36:01.486076 | controller | Monday 29 September 2025  12:36:00 +0000 (0:00:00.219)       0:00:31.214 ******
2025-09-29 12:36:01.486112 | controller | ok: [instance]
2025-09-29 12:36:01.799617 | controller |
2025-09-29 12:36:01.799663 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2025-09-29 12:36:01.799673 | controller | Monday 29 September 2025  12:36:01 +0000 (0:00:01.148)       0:00:32.362 ******
2025-09-29 12:36:01.799683 | controller | ok: [instance]
2025-09-29 12:36:02.099233 | controller |
2025-09-29 12:36:02.099278 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2025-09-29 12:36:02.099289 | controller | Monday 29 September 2025  12:36:01 +0000 (0:00:00.313)       0:00:32.676 ******
2025-09-29 12:36:02.099303 | controller | changed: [instance]
2025-09-29 12:36:02.394885 | controller |
2025-09-29 12:36:02.394914 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2025-09-29 12:36:02.394922 | controller | Monday 29 September 2025  12:36:02 +0000 (0:00:00.299)       0:00:32.975 ******
2025-09-29 12:36:02.394932 | controller | changed: [instance]
2025-09-29 12:36:02.959174 | controller |
2025-09-29 12:36:02.959204 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2025-09-29 12:36:02.959212 | controller | Monday 29 September 2025  12:36:02 +0000 (0:00:00.295)       0:00:33.271 ******
2025-09-29 12:36:02.959222 | controller | changed: [instance] => (item=arptables)
2025-09-29 12:36:03.270242 | controller | changed: [instance] => (item=iptables)
2025-09-29 12:36:03.270275 | controller | changed: [instance] => (item=ip6tables)
2025-09-29 12:36:03.270283 | controller |
2025-09-29 12:36:03.270289 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2025-09-29 12:36:03.270295 | controller | Monday 29 September 2025  12:36:02 +0000 (0:00:00.564)       0:00:33.835 ******
2025-09-29 12:36:03.270306 | controller | ok: [instance]
2025-09-29 12:36:03.270331 | controller |
2025-09-29 12:36:03.270551 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2025-09-29 12:36:03.362963 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.311)       0:00:34.147 ******
2025-09-29 12:36:03.362997 | controller | ok: [instance]
2025-09-29 12:36:03.404118 | controller |
2025-09-29 12:36:03.404137 | controller | TASK [Ensure the required network configurations are applied] ******************
2025-09-29 12:36:03.404145 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.092)       0:00:34.239 ******
2025-09-29 12:36:03.404178 | controller |
2025-09-29 12:36:03.425754 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2025-09-29 12:36:03.425770 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.041)       0:00:34.281 ******
2025-09-29 12:36:03.425781 | controller | skipping: [instance]
2025-09-29 12:36:03.448052 | controller |
2025-09-29 12:36:03.448070 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2025-09-29 12:36:03.448078 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.021)       0:00:34.302 ******
2025-09-29 12:36:03.448087 | controller | skipping: [instance]
2025-09-29 12:36:03.471593 | controller |
2025-09-29 12:36:03.471614 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-09-29 12:36:03.471622 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.022)       0:00:34.324 ******
2025-09-29 12:36:03.471632 | controller | skipping: [instance]
2025-09-29 12:36:03.471882 | controller |
2025-09-29 12:36:03.471941 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2025-09-29 12:36:03.471960 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.023)       0:00:34.348 ******
2025-09-29 12:36:03.498998 | controller | skipping: [instance]
2025-09-29 12:36:03.536800 | controller |
2025-09-29 12:36:03.536821 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2025-09-29 12:36:03.536828 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.027)       0:00:34.375 ******
2025-09-29 12:36:03.536837 | controller | ok: [instance]
2025-09-29 12:36:03.569299 | controller |
2025-09-29 12:36:03.569319 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2025-09-29 12:36:03.569327 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.037)       0:00:34.413 ******
2025-09-29 12:36:03.569337 | controller | skipping: [instance]
2025-09-29 12:36:03.569503 | controller |
2025-09-29 12:36:03.569687 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2025-09-29 12:36:03.569865 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.032)       0:00:34.446 ******
2025-09-29 12:36:03.594740 | controller | skipping: [instance]
2025-09-29 12:36:03.594928 | controller |
2025-09-29 12:36:03.595080 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2025-09-29 12:36:03.595251 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.025)       0:00:34.471 ******
2025-09-29 12:36:03.648412 | controller | ok: [instance]
2025-09-29 12:36:03.648585 | controller |
2025-09-29 12:36:03.648760 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2025-09-29 12:36:03.648914 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.053)       0:00:34.525 ******
2025-09-29 12:36:03.669068 | controller | skipping: [instance]
2025-09-29 12:36:03.669268 | controller |
2025-09-29 12:36:03.669435 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2025-09-29 12:36:03.669590 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.020)       0:00:34.546 ******
2025-09-29 12:36:03.712450 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2025-09-29 12:36:03.712625 | controller |
2025-09-29 12:36:03.712809 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2025-09-29 12:36:03.712965 | controller | Monday 29 September 2025  12:36:03 +0000 (0:00:00.043)       0:00:34.589 ******
2025-09-29 12:36:04.031234 | controller | ok: [instance -> localhost]
2025-09-29 12:36:04.031285 | controller |
2025-09-29 12:36:04.031484 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2025-09-29 12:36:11.687836 | controller | Monday 29 September 2025  12:36:04 +0000 (0:00:00.318)       0:00:34.908 ******
2025-09-29 12:36:11.687902 | controller | changed: [instance -> localhost]
2025-09-29 12:36:11.892829 | controller |
2025-09-29 12:36:11.892876 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2025-09-29 12:36:11.892885 | controller | Monday 29 September 2025  12:36:11 +0000 (0:00:07.655)       0:00:42.563 ******
2025-09-29 12:36:11.892898 | controller | changed: [instance]
2025-09-29 12:36:12.222084 | controller |
2025-09-29 12:36:12.222120 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2025-09-29 12:36:12.222128 | controller | Monday 29 September 2025  12:36:11 +0000 (0:00:00.205)       0:00:42.769 ******
2025-09-29 12:36:12.222139 | controller | changed: [instance]
2025-09-29 12:36:13.843197 | controller |
2025-09-29 12:36:13.843250 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2025-09-29 12:36:13.843259 | controller | Monday 29 September 2025  12:36:12 +0000 (0:00:00.329)       0:00:43.098 ******
2025-09-29 12:36:13.843272 | controller | changed: [instance -> localhost]
2025-09-29 12:36:14.177832 | controller |
2025-09-29 12:36:14.177854 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2025-09-29 12:36:14.177861 | controller | Monday 29 September 2025  12:36:13 +0000 (0:00:01.620)       0:00:44.719 ******
2025-09-29 12:36:14.177870 | controller | changed: [instance]
2025-09-29 12:36:14.208935 | controller |
2025-09-29 12:36:14.208953 | controller | TASK [reproducer : Select right domain] ****************************************
2025-09-29 12:36:14.208960 | controller | Monday 29 September 2025  12:36:14 +0000 (0:00:00.335)       0:00:45.054 ******
2025-09-29 12:36:14.208969 | controller | ok: [instance]
2025-09-29 12:36:14.319281 | controller |
2025-09-29 12:36:14.319303 | controller | TASK [Create the virtual networks] *********************************************
2025-09-29 12:36:14.319312 | controller | Monday 29 September 2025  12:36:14 +0000 (0:00:00.030)       0:00:45.085 ******
2025-09-29 12:36:14.319323 | controller |
2025-09-29 12:36:14.339374 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2025-09-29 12:36:14.339426 | controller | Monday 29 September 2025  12:36:14 +0000 (0:00:00.110)       0:00:45.196 ******
2025-09-29 12:36:14.339440 | controller | ok: [instance]
2025-09-29 12:36:14.527365 | controller |
2025-09-29 12:36:14.527412 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2025-09-29 12:36:14.527421 | controller | Monday 29 September 2025  12:36:14 +0000 (0:00:00.019)       0:00:45.215 ******
2025-09-29 12:36:14.527432 | controller | ok: [instance]
2025-09-29 12:36:14.554689 | controller |
2025-09-29 12:36:14.554710 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2025-09-29 12:36:14.554718 | controller | Monday 29 September 2025  12:36:14 +0000 (0:00:00.188)       0:00:45.403 ******
2025-09-29 12:36:14.554728 | controller | skipping: [instance]
2025-09-29 12:36:14.554892 | controller |
2025-09-29 12:36:14.555072 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2025-09-29 12:36:14.555260 | controller | Monday 29 September 2025  12:36:14 +0000 (0:00:00.028)       0:00:45.431 ******
2025-09-29 12:36:14.582078 | controller | skipping: [instance]
2025-09-29 12:36:14.582262 | controller |
2025-09-29 12:36:14.582421 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2025-09-29 12:36:14.582569 | controller | Monday 29 September 2025  12:36:14 +0000 (0:00:00.027)       0:00:45.459 ******
2025-09-29 12:36:14.636613 | controller | ok: [instance]
2025-09-29 12:36:14.762483 | controller |
2025-09-29 12:36:14.762518 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2025-09-29 12:36:14.762534 | controller | Monday 29 September 2025  12:36:14 +0000 (0:00:00.053)       0:00:45.513 ******
2025-09-29 12:36:14.762545 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2025-09-29 12:36:14.834198 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2025-09-29 12:36:14.834221 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2025-09-29 12:36:14.834229 | controller |
2025-09-29 12:36:14.834234 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2025-09-29 12:36:14.834239 | controller | Monday 29 September 2025  12:36:14 +0000 (0:00:00.125)       0:00:45.638 ******
2025-09-29 12:36:14.834260 | controller | skipping: [instance]
2025-09-29 12:36:15.183062 | controller |
2025-09-29 12:36:15.183092 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2025-09-29 12:36:15.183100 | controller | Monday 29 September 2025  12:36:14 +0000 (0:00:00.072)       0:00:45.710 ******
2025-09-29 12:36:15.183110 | controller | changed: [instance]
2025-09-29 12:36:15.303000 | controller |
2025-09-29 12:36:15.303027 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2025-09-29 12:36:15.303034 | controller | Monday 29 September 2025  12:36:15 +0000 (0:00:00.348)       0:00:46.059 ******
2025-09-29 12:36:15.303044 | controller | changed: [instance] => (item=Adding compute-0 to computes)
2025-09-29 12:36:15.326311 | controller | changed: [instance] => (item=Adding controller-0 to controllers)
2025-09-29 12:36:15.326347 | controller | changed: [instance] => (item=Adding crc-0 to ocps)
2025-09-29 12:36:15.326356 | controller |
2025-09-29 12:36:15.326363 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-09-29 12:36:15.326371 | controller | Monday 29 September 2025  12:36:15 +0000 (0:00:00.119)       0:00:46.179 ******
2025-09-29 12:36:15.326382 | controller | skipping: [instance]
2025-09-29 12:36:15.349646 | controller |
2025-09-29 12:36:15.349687 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-09-29 12:36:15.349696 | controller | Monday 29 September 2025  12:36:15 +0000 (0:00:00.023)       0:00:46.203 ******
2025-09-29 12:36:15.349708 | controller | skipping: [instance]
2025-09-29 12:36:15.373027 | controller |
2025-09-29 12:36:15.373049 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-09-29 12:36:15.373058 | controller | Monday 29 September 2025  12:36:15 +0000 (0:00:00.023)       0:00:46.226 ******
2025-09-29 12:36:15.373068 | controller | skipping: [instance]
2025-09-29 12:36:15.398284 | controller |
2025-09-29 12:36:15.398315 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-09-29 12:36:15.398324 | controller | Monday 29 September 2025  12:36:15 +0000 (0:00:00.023)       0:00:46.249 ******
2025-09-29 12:36:15.398333 | controller | skipping: [instance]
2025-09-29 12:36:15.398361 | controller |
2025-09-29 12:36:15.398368 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-09-29 12:36:15.398375 | controller | Monday 29 September 2025  12:36:15 +0000 (0:00:00.025)       0:00:46.275 ******
2025-09-29 12:36:15.416870 | controller | ok: [instance]
2025-09-29 12:36:15.417018 | controller |
2025-09-29 12:36:15.417175 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-09-29 12:36:15.417339 | controller | Monday 29 September 2025  12:36:15 +0000 (0:00:00.018)       0:00:46.294 ******
2025-09-29 12:36:15.492402 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2025-09-29 12:36:15.492557 | controller |
2025-09-29 12:36:15.492699 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-09-29 12:36:15.492813 | controller | Monday 29 September 2025  12:36:15 +0000 (0:00:00.075)       0:00:46.369 ******
2025-09-29 12:36:15.509741 | controller | skipping: [instance]
2025-09-29 12:36:15.509933 | controller |
2025-09-29 12:36:15.510131 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-09-29 12:36:15.510376 | controller | Monday 29 September 2025  12:36:15 +0000 (0:00:00.017)       0:00:46.386 ******
2025-09-29 12:36:15.708284 | controller | changed: [instance]
2025-09-29 12:36:15.708318 | controller |
2025-09-29 12:36:15.708326 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-09-29 12:36:15.708335 | controller | Monday 29 September 2025  12:36:15 +0000 (0:00:00.198)       0:00:46.585 ******
2025-09-29 12:36:16.095300 | controller | changed: [instance]
2025-09-29 12:36:16.095522 | controller |
2025-09-29 12:36:16.095553 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-09-29 12:36:16.153258 | controller | Monday 29 September 2025  12:36:16 +0000 (0:00:00.387)       0:00:46.972 ******
2025-09-29 12:36:16.153288 | controller | ok: [instance]
2025-09-29 12:36:16.153322 | controller |
2025-09-29 12:36:16.153554 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-09-29 12:36:16.184308 | controller | Monday 29 September 2025  12:36:16 +0000 (0:00:00.058)       0:00:47.030 ******
2025-09-29 12:36:16.184347 | controller | ok: [instance]
2025-09-29 12:36:16.184622 | controller |
2025-09-29 12:36:16.184655 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-09-29 12:36:16.559291 | controller | Monday 29 September 2025  12:36:16 +0000 (0:00:00.030)       0:00:47.061 ******
2025-09-29 12:36:16.559337 | controller | changed: [instance]
2025-09-29 12:36:16.559370 | controller |
2025-09-29 12:36:16.559575 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2025-09-29 12:36:16.632959 | controller | Monday 29 September 2025  12:36:16 +0000 (0:00:00.375)       0:00:47.436 ******
2025-09-29 12:36:16.632980 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2025-09-29 12:36:16.678291 | controller |
2025-09-29 12:36:16.678323 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2025-09-29 12:36:16.678333 | controller | Monday 29 September 2025  12:36:16 +0000 (0:00:00.073)       0:00:47.509 ******
2025-09-29 12:36:16.678344 | controller | ok: [instance] => (item=public)
2025-09-29 12:36:16.678372 | controller | ok: [instance] => (item=osp_trunk)
2025-09-29 12:36:16.678380 | controller |
2025-09-29 12:36:16.678389 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2025-09-29 12:36:16.678475 | controller | Monday 29 September 2025  12:36:16 +0000 (0:00:00.045)       0:00:47.555 ******
2025-09-29 12:36:17.108274 | controller | changed: [instance] => (item=cifmw-public)
2025-09-29 12:36:17.711246 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:36:17.711286 | controller |
2025-09-29 12:36:17.711294 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2025-09-29 12:36:17.711300 | controller | Monday 29 September 2025  12:36:17 +0000 (0:00:00.428)       0:00:47.984 ******
2025-09-29 12:36:17.711312 | controller | ok: [instance] => (item=cifmw-public)
2025-09-29 12:36:17.711347 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:36:17.711355 | controller |
2025-09-29 12:36:17.711381 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2025-09-29 12:36:17.711611 | controller | Monday 29 September 2025  12:36:17 +0000 (0:00:00.602)       0:00:48.586 ******
2025-09-29 12:36:18.144301 | controller | ok: [instance] => (item=cifmw-public)
2025-09-29 12:36:18.144375 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:36:18.144387 | controller |
2025-09-29 12:36:18.144415 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2025-09-29 12:36:18.144630 | controller | Monday 29 September 2025  12:36:18 +0000 (0:00:00.433)       0:00:49.020 ******
2025-09-29 12:36:18.581073 | controller | changed: [instance] => (item=cifmw-public)
2025-09-29 12:36:18.637036 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:36:18.637077 | controller |
2025-09-29 12:36:18.637087 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2025-09-29 12:36:18.637096 | controller | Monday 29 September 2025  12:36:18 +0000 (0:00:00.436)       0:00:49.457 ******
2025-09-29 12:36:18.637109 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2025-09-29 12:36:18.820829 | controller |
2025-09-29 12:36:18.820856 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2025-09-29 12:36:18.820864 | controller | Monday 29 September 2025  12:36:18 +0000 (0:00:00.056)       0:00:49.513 ******
2025-09-29 12:36:18.820874 | controller | ok: [instance]
2025-09-29 12:36:19.224023 | controller |
2025-09-29 12:36:19.224056 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2025-09-29 12:36:19.224063 | controller | Monday 29 September 2025  12:36:18 +0000 (0:00:00.183)       0:00:49.697 ******
2025-09-29 12:36:19.224074 | controller | ok: [instance] => (item=cifmw-public)
2025-09-29 12:36:19.296072 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:36:19.296094 | controller |
2025-09-29 12:36:19.296102 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2025-09-29 12:36:19.296109 | controller | Monday 29 September 2025  12:36:19 +0000 (0:00:00.402)       0:00:50.100 ******
2025-09-29 12:36:19.296119 | controller |
2025-09-29 12:36:19.337886 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2025-09-29 12:36:19.337905 | controller | Monday 29 September 2025  12:36:19 +0000 (0:00:00.072)       0:00:50.172 ******
2025-09-29 12:36:19.337916 | controller | skipping: [instance]
2025-09-29 12:36:20.550239 | controller |
2025-09-29 12:36:20.550296 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2025-09-29 12:36:20.550305 | controller | Monday 29 September 2025  12:36:19 +0000 (0:00:00.041)       0:00:50.214 ******
2025-09-29 12:36:20.550315 | controller | ok: [instance]
2025-09-29 12:36:20.550661 | controller |
2025-09-29 12:36:20.758239 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2025-09-29 12:36:20.758265 | controller | Monday 29 September 2025  12:36:20 +0000 (0:00:01.212)       0:00:51.426 ******
2025-09-29 12:36:20.758278 | controller | ok: [instance]
2025-09-29 12:36:20.758349 | controller |
2025-09-29 12:36:20.758364 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2025-09-29 12:36:20.758374 | controller | Monday 29 September 2025  12:36:20 +0000 (0:00:00.208)       0:00:51.634 ******
2025-09-29 12:36:21.165245 | controller | changed: [instance]
2025-09-29 12:36:22.817685 | controller |
2025-09-29 12:36:22.817716 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2025-09-29 12:36:22.817724 | controller | Monday 29 September 2025  12:36:21 +0000 (0:00:00.406)       0:00:52.041 ******
2025-09-29 12:36:22.817735 | controller | changed: [instance]
2025-09-29 12:36:23.203073 | controller |
2025-09-29 12:36:23.203104 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2025-09-29 12:36:23.203122 | controller | Monday 29 September 2025  12:36:22 +0000 (0:00:01.652)       0:00:53.694 ******
2025-09-29 12:36:23.203133 | controller | changed: [instance]
2025-09-29 12:36:23.241802 | controller |
2025-09-29 12:36:23.241821 | controller | TASK [Create extra network configuration] **************************************
2025-09-29 12:36:23.241835 | controller | Monday 29 September 2025  12:36:23 +0000 (0:00:00.385)       0:00:54.079 ******
2025-09-29 12:36:23.241846 | controller | skipping: [instance]
2025-09-29 12:36:23.271332 | controller |
2025-09-29 12:36:23.271368 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2025-09-29 12:36:23.271378 | controller | Monday 29 September 2025  12:36:23 +0000 (0:00:00.038)       0:00:54.118 ******
2025-09-29 12:36:23.271391 | controller | skipping: [instance]
2025-09-29 12:36:23.271421 | controller |
2025-09-29 12:36:23.271431 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2025-09-29 12:36:23.271514 | controller | Monday 29 September 2025  12:36:23 +0000 (0:00:00.029)       0:00:54.148 ******
2025-09-29 12:36:23.733856 | controller | ok: [instance]
2025-09-29 12:36:23.882258 | controller |
2025-09-29 12:36:23.882281 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2025-09-29 12:36:23.882290 | controller | Monday 29 September 2025  12:36:23 +0000 (0:00:00.461)       0:00:54.610 ******
2025-09-29 12:36:23.882301 | controller | ok: [instance] => (item=cifmw-public)
2025-09-29 12:36:25.038776 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:36:25.038809 | controller |
2025-09-29 12:36:25.038816 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2025-09-29 12:36:25.038823 | controller | Monday 29 September 2025  12:36:23 +0000 (0:00:00.148)       0:00:54.758 ******
2025-09-29 12:36:25.038833 | controller | ok: [instance]
2025-09-29 12:36:28.831629 | controller |
2025-09-29 12:36:28.831662 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2025-09-29 12:36:28.831671 | controller | Monday 29 September 2025  12:36:25 +0000 (0:00:01.156)       0:00:55.915 ******
2025-09-29 12:36:28.831693 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2025-09-29 12:36:29.064929 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2025-09-29 12:36:29.064960 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2025-09-29 12:36:29.064968 | controller |
2025-09-29 12:36:29.064974 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2025-09-29 12:36:29.064980 | controller | Monday 29 September 2025  12:36:28 +0000 (0:00:03.792)       0:00:59.707 ******
2025-09-29 12:36:29.064990 | controller | changed: [instance]
2025-09-29 12:36:29.445462 | controller |
2025-09-29 12:36:29.445492 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2025-09-29 12:36:29.445501 | controller | Monday 29 September 2025  12:36:29 +0000 (0:00:00.233)       0:00:59.941 ******
2025-09-29 12:36:29.445511 | controller | changed: [instance]
2025-09-29 12:36:29.867310 | controller |
2025-09-29 12:36:29.867362 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2025-09-29 12:36:29.867372 | controller | Monday 29 September 2025  12:36:29 +0000 (0:00:00.380)       0:01:00.322 ******
2025-09-29 12:36:29.867388 | controller | changed: [instance]
2025-09-29 12:36:29.867417 | controller |
2025-09-29 12:36:29.867427 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2025-09-29 12:36:29.900341 | controller | Monday 29 September 2025  12:36:29 +0000 (0:00:00.421)       0:01:00.744 ******
2025-09-29 12:36:29.900383 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2025-09-29 12:36:30.320746 | controller |
2025-09-29 12:36:30.320780 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2025-09-29 12:36:30.320788 | controller | Monday 29 September 2025  12:36:29 +0000 (0:00:00.032)       0:01:00.776 ******
2025-09-29 12:36:30.320798 | controller | changed: [instance]
2025-09-29 12:36:30.340950 | controller |
2025-09-29 12:36:30.340971 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2025-09-29 12:36:30.340981 | controller | Monday 29 September 2025  12:36:30 +0000 (0:00:00.420)       0:01:01.197 ******
2025-09-29 12:36:30.340992 | controller | skipping: [instance]
2025-09-29 12:36:30.375371 | controller |
2025-09-29 12:36:30.375437 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2025-09-29 12:36:30.375456 | controller | Monday 29 September 2025  12:36:30 +0000 (0:00:00.020)       0:01:01.217 ******
2025-09-29 12:36:30.375475 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2025-09-29 12:36:30.760281 | controller |
2025-09-29 12:36:30.760330 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2025-09-29 12:36:30.760341 | controller | Monday 29 September 2025  12:36:30 +0000 (0:00:00.034)       0:01:01.252 ******
2025-09-29 12:36:30.760356 | controller | changed: [instance]
2025-09-29 12:36:30.760386 | controller |
2025-09-29 12:36:30.760408 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2025-09-29 12:36:30.760472 | controller | Monday 29 September 2025  12:36:30 +0000 (0:00:00.384)       0:01:01.637 ******
2025-09-29 12:36:30.779796 | controller | skipping: [instance]
2025-09-29 12:36:30.995067 | controller |
2025-09-29 12:36:30.995107 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2025-09-29 12:36:30.995116 | controller | Monday 29 September 2025  12:36:30 +0000 (0:00:00.019)       0:01:01.656 ******
2025-09-29 12:36:30.995128 | controller | ok: [instance] => (item=127.0.0.2)
2025-09-29 12:36:31.691007 | controller |
2025-09-29 12:36:31.691051 | controller | TASK [dnsmasq : Enable and start service] **************************************
2025-09-29 12:36:31.691061 | controller | Monday 29 September 2025  12:36:30 +0000 (0:00:00.214)       0:01:01.871 ******
2025-09-29 12:36:31.691074 | controller | changed: [instance]
2025-09-29 12:36:31.709860 | controller |
2025-09-29 12:36:31.709896 | controller | TASK [dnsmasq : Stop service] **************************************************
2025-09-29 12:36:31.709906 | controller | Monday 29 September 2025  12:36:31 +0000 (0:00:00.695)       0:01:02.567 ******
2025-09-29 12:36:31.709918 | controller | skipping: [instance]
2025-09-29 12:36:31.728030 | controller |
2025-09-29 12:36:31.728063 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2025-09-29 12:36:31.728073 | controller | Monday 29 September 2025  12:36:31 +0000 (0:00:00.019)       0:01:02.586 ******
2025-09-29 12:36:31.728084 | controller | skipping: [instance]
2025-09-29 12:36:31.758256 | controller |
2025-09-29 12:36:31.758311 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2025-09-29 12:36:31.758322 | controller | Monday 29 September 2025  12:36:31 +0000 (0:00:00.018)       0:01:02.604 ******
2025-09-29 12:36:31.758338 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2025-09-29 12:36:31.758385 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2025-09-29 12:36:31.758414 | controller | skipping: [instance]
2025-09-29 12:36:31.758778 | controller |
2025-09-29 12:36:31.875483 | controller | TASK [Create dnsmasq networks] *************************************************
2025-09-29 12:36:31.875526 | controller | Monday 29 September 2025  12:36:31 +0000 (0:00:00.030)       0:01:02.634 ******
2025-09-29 12:36:31.875540 | controller |
2025-09-29 12:36:31.910592 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2025-09-29 12:36:31.910619 | controller | Monday 29 September 2025  12:36:31 +0000 (0:00:00.117)       0:01:02.752 ******
2025-09-29 12:36:31.910632 | controller | ok: [instance] => changed=false
2025-09-29 12:36:31.910836 | controller |   msg: All assertions passed
2025-09-29 12:36:31.911001 | controller |
2025-09-29 12:36:31.911206 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2025-09-29 12:36:31.911429 | controller | Monday 29 September 2025  12:36:31 +0000 (0:00:00.035)       0:01:02.787 ******
2025-09-29 12:36:31.959278 | controller | ok: [instance] => changed=false
2025-09-29 12:36:31.959465 | controller |   msg: All assertions passed
2025-09-29 12:36:31.959616 | controller |
2025-09-29 12:36:31.959769 | controller | TASK [dnsmasq : Create network] ************************************************
2025-09-29 12:36:31.959896 | controller | Monday 29 September 2025  12:36:31 +0000 (0:00:00.048)       0:01:02.836 ******
2025-09-29 12:36:32.436982 | controller | changed: [instance]
2025-09-29 12:36:32.458063 | controller |
2025-09-29 12:36:32.458084 | controller | TASK [dnsmasq : Remove network] ************************************************
2025-09-29 12:36:32.458094 | controller | Monday 29 September 2025  12:36:32 +0000 (0:00:00.477)       0:01:03.313 ******
2025-09-29 12:36:32.458110 | controller | skipping: [instance]
2025-09-29 12:36:32.481833 | controller |
2025-09-29 12:36:32.481850 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2025-09-29 12:36:32.481856 | controller | Monday 29 September 2025  12:36:32 +0000 (0:00:00.021)       0:01:03.334 ******
2025-09-29 12:36:32.481865 | controller | skipping: [instance]
2025-09-29 12:36:32.510327 | controller |
2025-09-29 12:36:32.510372 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2025-09-29 12:36:32.510382 | controller | Monday 29 September 2025  12:36:32 +0000 (0:00:00.023)       0:01:03.358 ******
2025-09-29 12:36:32.510395 | controller | ok: [instance] => changed=false
2025-09-29 12:36:32.510575 | controller |   msg: All assertions passed
2025-09-29 12:36:32.510596 | controller |
2025-09-29 12:36:32.510609 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2025-09-29 12:36:32.548263 | controller | Monday 29 September 2025  12:36:32 +0000 (0:00:00.028)       0:01:03.387 ******
2025-09-29 12:36:32.548303 | controller | ok: [instance] => changed=false
2025-09-29 12:36:32.548477 | controller |   msg: All assertions passed
2025-09-29 12:36:32.548498 | controller |
2025-09-29 12:36:32.548510 | controller | TASK [dnsmasq : Create network] ************************************************
2025-09-29 12:36:33.022629 | controller | Monday 29 September 2025  12:36:32 +0000 (0:00:00.037)       0:01:03.425 ******
2025-09-29 12:36:33.022653 | controller | changed: [instance]
2025-09-29 12:36:33.042407 | controller |
2025-09-29 12:36:33.042482 | controller | TASK [dnsmasq : Remove network] ************************************************
2025-09-29 12:36:33.042491 | controller | Monday 29 September 2025  12:36:33 +0000 (0:00:00.474)       0:01:03.899 ******
2025-09-29 12:36:33.042510 | controller | skipping: [instance]
2025-09-29 12:36:33.066306 | controller |
2025-09-29 12:36:33.066361 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2025-09-29 12:36:33.066381 | controller | Monday 29 September 2025  12:36:33 +0000 (0:00:00.019)       0:01:03.919 ******
2025-09-29 12:36:33.066395 | controller | skipping: [instance]
2025-09-29 12:36:33.603247 | controller |
2025-09-29 12:36:33.603293 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2025-09-29 12:36:33.603302 | controller | Monday 29 September 2025  12:36:33 +0000 (0:00:00.024)       0:01:03.943 ******
2025-09-29 12:36:33.603315 | controller | changed: [instance] => (item=cifmw-public)
2025-09-29 12:36:33.654939 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:36:33.654974 | controller |
2025-09-29 12:36:33.654982 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-09-29 12:36:33.654990 | controller | Monday 29 September 2025  12:36:33 +0000 (0:00:00.536)       0:01:04.479 ******
2025-09-29 12:36:33.655001 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2025-09-29 12:36:33.968330 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2025-09-29 12:36:33.968364 | controller |
2025-09-29 12:36:33.968372 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-09-29 12:36:33.968379 | controller | Monday 29 September 2025  12:36:33 +0000 (0:00:00.051)       0:01:04.531 ******
2025-09-29 12:36:33.968389 | controller | ok: [instance]
2025-09-29 12:36:34.011280 | controller |
2025-09-29 12:36:34.011318 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2025-09-29 12:36:34.011328 | controller | Monday 29 September 2025  12:36:33 +0000 (0:00:00.313)       0:01:04.844 ******
2025-09-29 12:36:34.011343 | controller | ok: [instance]
2025-09-29 12:36:34.218132 | controller |
2025-09-29 12:36:34.218185 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-09-29 12:36:34.218197 | controller | Monday 29 September 2025  12:36:34 +0000 (0:00:00.042)       0:01:04.887 ******
2025-09-29 12:36:34.218208 | controller | ok: [instance]
2025-09-29 12:36:34.260110 | controller |
2025-09-29 12:36:34.260136 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2025-09-29 12:36:34.260144 | controller | Monday 29 September 2025  12:36:34 +0000 (0:00:00.207)       0:01:05.094 ******
2025-09-29 12:36:34.260204 | controller | ok: [instance]
2025-09-29 12:36:34.602244 | controller |
2025-09-29 12:36:34.602280 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2025-09-29 12:36:34.602290 | controller | Monday 29 September 2025  12:36:34 +0000 (0:00:00.042)       0:01:05.136 ******
2025-09-29 12:36:34.602302 | controller | changed: [instance]
2025-09-29 12:36:34.602730 | controller |
2025-09-29 12:36:34.939129 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2025-09-29 12:36:34.939178 | controller | Monday 29 September 2025  12:36:34 +0000 (0:00:00.342)       0:01:05.479 ******
2025-09-29 12:36:34.939193 | controller | changed: [instance]
2025-09-29 12:36:35.282054 | controller |
2025-09-29 12:36:35.282090 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2025-09-29 12:36:35.282098 | controller | Monday 29 September 2025  12:36:34 +0000 (0:00:00.336)       0:01:05.815 ******
2025-09-29 12:36:35.282109 | controller | changed: [instance]
2025-09-29 12:36:35.380180 | controller |
2025-09-29 12:36:35.380204 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2025-09-29 12:36:35.380212 | controller | Monday 29 September 2025  12:36:35 +0000 (0:00:00.342)       0:01:06.158 ******
2025-09-29 12:36:35.380222 | controller | ok: [instance]
2025-09-29 12:36:35.720351 | controller |
2025-09-29 12:36:35.720391 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2025-09-29 12:36:35.720402 | controller | Monday 29 September 2025  12:36:35 +0000 (0:00:00.098)       0:01:06.256 ******
2025-09-29 12:36:35.720415 | controller | changed: [instance]
2025-09-29 12:36:35.720444 | controller |
2025-09-29 12:36:35.720454 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-09-29 12:36:35.748108 | controller | Monday 29 September 2025  12:36:35 +0000 (0:00:00.340)       0:01:06.597 ******
2025-09-29 12:36:35.748137 | controller | skipping: [instance]
2025-09-29 12:36:35.774390 | controller |
2025-09-29 12:36:35.774441 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-09-29 12:36:35.774456 | controller | Monday 29 September 2025  12:36:35 +0000 (0:00:00.027)       0:01:06.624 ******
2025-09-29 12:36:35.774473 | controller | skipping: [instance]
2025-09-29 12:36:35.774485 | controller |
2025-09-29 12:36:35.774495 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-09-29 12:36:35.774508 | controller | Monday 29 September 2025  12:36:35 +0000 (0:00:00.026)       0:01:06.651 ******
2025-09-29 12:36:35.799818 | controller | skipping: [instance]
2025-09-29 12:36:35.826299 | controller |
2025-09-29 12:36:35.826323 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-09-29 12:36:35.826332 | controller | Monday 29 September 2025  12:36:35 +0000 (0:00:00.025)       0:01:06.676 ******
2025-09-29 12:36:35.826350 | controller | skipping: [instance]
2025-09-29 12:36:35.845702 | controller |
2025-09-29 12:36:35.845728 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-09-29 12:36:35.845738 | controller | Monday 29 September 2025  12:36:35 +0000 (0:00:00.026)       0:01:06.703 ******
2025-09-29 12:36:35.845748 | controller | ok: [instance]
2025-09-29 12:36:35.930337 | controller |
2025-09-29 12:36:35.930380 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-09-29 12:36:35.930390 | controller | Monday 29 September 2025  12:36:35 +0000 (0:00:00.019)       0:01:06.722 ******
2025-09-29 12:36:35.930407 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2025-09-29 12:36:35.930440 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2025-09-29 12:36:35.930454 | controller |
2025-09-29 12:36:35.930526 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-09-29 12:36:35.930554 | controller | Monday 29 September 2025  12:36:35 +0000 (0:00:00.084)       0:01:06.807 ******
2025-09-29 12:36:35.949372 | controller | skipping: [instance]
2025-09-29 12:36:35.949542 | controller |
2025-09-29 12:36:35.949712 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-09-29 12:36:35.949869 | controller | Monday 29 September 2025  12:36:35 +0000 (0:00:00.019)       0:01:06.826 ******
2025-09-29 12:36:36.148174 | controller | ok: [instance]
2025-09-29 12:36:36.548119 | controller |
2025-09-29 12:36:36.548172 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-09-29 12:36:36.548184 | controller | Monday 29 September 2025  12:36:36 +0000 (0:00:00.198)       0:01:07.024 ******
2025-09-29 12:36:36.548195 | controller | changed: [instance]
2025-09-29 12:36:36.609605 | controller |
2025-09-29 12:36:36.609632 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-09-29 12:36:36.609640 | controller | Monday 29 September 2025  12:36:36 +0000 (0:00:00.399)       0:01:07.424 ******
2025-09-29 12:36:36.609650 | controller | ok: [instance]
2025-09-29 12:36:36.651054 | controller |
2025-09-29 12:36:36.651075 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-09-29 12:36:36.651083 | controller | Monday 29 September 2025  12:36:36 +0000 (0:00:00.061)       0:01:07.486 ******
2025-09-29 12:36:36.651091 | controller | ok: [instance]
2025-09-29 12:36:37.069354 | controller |
2025-09-29 12:36:37.069418 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-09-29 12:36:37.069428 | controller | Monday 29 September 2025  12:36:36 +0000 (0:00:00.041)       0:01:07.527 ******
2025-09-29 12:36:37.069446 | controller | changed: [instance]
2025-09-29 12:36:37.102275 | controller |
2025-09-29 12:36:37.102298 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2025-09-29 12:36:37.102308 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.418)       0:01:07.945 ******
2025-09-29 12:36:37.102320 | controller | ok: [instance]
2025-09-29 12:36:37.102345 | controller |
2025-09-29 12:36:37.102593 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2025-09-29 12:36:37.123007 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.033)       0:01:07.979 ******
2025-09-29 12:36:37.123044 | controller | ok: [instance]
2025-09-29 12:36:37.144299 | controller |
2025-09-29 12:36:37.144345 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2025-09-29 12:36:37.144356 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.020)       0:01:07.999 ******
2025-09-29 12:36:37.144370 | controller | ok: [instance]
2025-09-29 12:36:37.219338 | controller |
2025-09-29 12:36:37.219379 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2025-09-29 12:36:37.219393 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.021)       0:01:08.021 ******
2025-09-29 12:36:37.219409 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2025-09-29 12:36:37.338906 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2025-09-29 12:36:37.338941 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2025-09-29 12:36:37.338948 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2025-09-29 12:36:37.338954 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2025-09-29 12:36:37.338959 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2025-09-29 12:36:37.338965 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2025-09-29 12:36:37.338970 | controller |
2025-09-29 12:36:37.338977 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-09-29 12:36:37.338983 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.074)       0:01:08.095 ******
2025-09-29 12:36:37.338994 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2025-09-29 12:36:37.436650 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2025-09-29 12:36:37.436673 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2025-09-29 12:36:37.436683 | controller |
2025-09-29 12:36:37.436702 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-09-29 12:36:37.436709 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.119)       0:01:08.215 ******
2025-09-29 12:36:37.436720 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2025-09-29 12:36:37.436892 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2025-09-29 12:36:37.437049 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2025-09-29 12:36:37.437198 | controller | skipping: [instance]
2025-09-29 12:36:37.437329 | controller |
2025-09-29 12:36:37.437449 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-09-29 12:36:37.437566 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.098)       0:01:08.313 ******
2025-09-29 12:36:37.517402 | controller | skipping: [instance] => (item=compute-0 - storage)
2025-09-29 12:36:37.517583 | controller | skipping: [instance] => (item=controller-0 - storage)
2025-09-29 12:36:37.517752 | controller | skipping: [instance] => (item=crc-0 - storage)
2025-09-29 12:36:37.517902 | controller | skipping: [instance]
2025-09-29 12:36:37.518040 | controller |
2025-09-29 12:36:37.518210 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-09-29 12:36:37.518347 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.080)       0:01:08.394 ******
2025-09-29 12:36:37.671458 | controller | skipping: [instance] => (item=compute-0 - tenant)
2025-09-29 12:36:37.671639 | controller | skipping: [instance] => (item=controller-0 - tenant)
2025-09-29 12:36:37.671780 | controller | skipping: [instance] => (item=crc-0 - tenant)
2025-09-29 12:36:37.671904 | controller | skipping: [instance]
2025-09-29 12:36:37.672016 | controller |
2025-09-29 12:36:37.672137 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-09-29 12:36:37.672302 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.153)       0:01:08.548 ******
2025-09-29 12:36:37.751901 | controller | skipping: [instance] => (item=compute-0 - external)
2025-09-29 12:36:37.752083 | controller | skipping: [instance] => (item=controller-0 - external)
2025-09-29 12:36:37.752265 | controller | skipping: [instance] => (item=crc-0 - external)
2025-09-29 12:36:37.752422 | controller | skipping: [instance]
2025-09-29 12:36:37.752561 | controller |
2025-09-29 12:36:37.752709 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-09-29 12:36:37.752831 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.080)       0:01:08.629 ******
2025-09-29 12:36:37.837140 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2025-09-29 12:36:37.837370 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2025-09-29 12:36:37.837530 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2025-09-29 12:36:37.837678 | controller | skipping: [instance]
2025-09-29 12:36:37.837831 | controller |
2025-09-29 12:36:37.837959 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-09-29 12:36:37.838080 | controller | Monday 29 September 2025  12:36:37 +0000 (0:00:00.085)       0:01:08.714 ******
2025-09-29 12:36:38.013317 | controller | ok: [instance] => (item=compute-0 - public)
2025-09-29 12:36:38.013498 | controller | ok: [instance] => (item=controller-0 - public)
2025-09-29 12:36:38.013654 | controller | ok: [instance] => (item=crc-0 - public)
2025-09-29 12:36:38.013811 | controller |
2025-09-29 12:36:38.013961 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2025-09-29 12:36:38.014108 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.176)       0:01:08.890 ******
2025-09-29 12:36:38.173471 | controller |
2025-09-29 12:36:38.217343 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2025-09-29 12:36:38.217400 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.159)       0:01:09.050 ******
2025-09-29 12:36:38.217417 | controller | ok: [instance]
2025-09-29 12:36:38.217439 | controller |
2025-09-29 12:36:38.217447 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2025-09-29 12:36:38.217456 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.043)       0:01:09.094 ******
2025-09-29 12:36:38.315580 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6f:5f:c5', 'ips': ['192.168.140.100', '']})
2025-09-29 12:36:38.315681 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:5c:a5:4a', 'ips': ['192.168.140.9', '']})
2025-09-29 12:36:38.315811 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:bb:d7:df', 'ips': ['192.168.140.10', '']})
2025-09-29 12:36:38.316246 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:90:39:f1', 'ips': ['192.168.101.100', '']})
2025-09-29 12:36:38.316447 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a4:32:19', 'ips': ['192.168.101.9', '']})
2025-09-29 12:36:38.316476 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:43:b1:b6', 'ips': ['192.168.101.10', '']})
2025-09-29 12:36:38.316484 | controller |
2025-09-29 12:36:38.316495 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2025-09-29 12:36:38.372269 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.098)       0:01:09.192 ******
2025-09-29 12:36:38.372297 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2025-09-29 12:36:38.372632 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2025-09-29 12:36:38.372662 | controller |
2025-09-29 12:36:38.557957 | controller | TASK [dnsmasq : Check network file status] *************************************
2025-09-29 12:36:38.557991 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.056)       0:01:09.249 ******
2025-09-29 12:36:38.558007 | controller | ok: [instance]
2025-09-29 12:36:38.585425 | controller |
2025-09-29 12:36:38.585447 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2025-09-29 12:36:38.585454 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.185)       0:01:09.434 ******
2025-09-29 12:36:38.585463 | controller | ok: [instance]
2025-09-29 12:36:38.769930 | controller |
2025-09-29 12:36:38.769966 | controller | TASK [dnsmasq : Check network file status] *************************************
2025-09-29 12:36:38.769975 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.027)       0:01:09.462 ******
2025-09-29 12:36:38.769986 | controller | ok: [instance]
2025-09-29 12:36:38.796630 | controller |
2025-09-29 12:36:38.796648 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2025-09-29 12:36:38.796656 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.184)       0:01:09.646 ******
2025-09-29 12:36:38.796665 | controller | ok: [instance]
2025-09-29 12:36:38.818646 | controller |
2025-09-29 12:36:38.818664 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2025-09-29 12:36:38.818671 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.027)       0:01:09.673 ******
2025-09-29 12:36:38.818680 | controller | ok: [instance]
2025-09-29 12:36:38.986292 | controller |
2025-09-29 12:36:38.986345 | controller | TASK [dnsmasq : Compute entry] *************************************************
2025-09-29 12:36:38.986354 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.022)       0:01:09.695 ******
2025-09-29 12:36:38.986367 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6f:5f:c5', 'ips': ['192.168.140.100', '']})
2025-09-29 12:36:39.025334 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:5c:a5:4a', 'ips': ['192.168.140.9', '']})
2025-09-29 12:36:39.025389 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:bb:d7:df', 'ips': ['192.168.140.10', '']})
2025-09-29 12:36:39.025409 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:90:39:f1', 'ips': ['192.168.101.100', '']})
2025-09-29 12:36:39.025416 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a4:32:19', 'ips': ['192.168.101.9', '']})
2025-09-29 12:36:39.025423 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:43:b1:b6', 'ips': ['192.168.101.10', '']})
2025-09-29 12:36:39.025430 | controller |
2025-09-29 12:36:39.025437 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2025-09-29 12:36:39.025444 | controller | Monday 29 September 2025  12:36:38 +0000 (0:00:00.167)       0:01:09.862 ******
2025-09-29 12:36:39.025458 | controller | ok: [instance]
2025-09-29 12:36:41.047278 | controller |
2025-09-29 12:36:41.047350 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2025-09-29 12:36:41.047365 | controller | Monday 29 September 2025  12:36:39 +0000 (0:00:00.039)       0:01:09.902 ******
2025-09-29 12:36:41.047401 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:6f:5f:c5', 'entry': '52:54:00:6f:5f:c5,192.168.140.100,compute-0', 'state': 'present'})
2025-09-29 12:36:41.047977 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:5c:a5:4a', 'entry': '52:54:01:5c:a5:4a,192.168.140.9,controller-0', 'state': 'present'})
2025-09-29 12:36:41.048016 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:bb:d7:df', 'entry': '52:54:02:bb:d7:df,192.168.140.10,crc-0', 'state': 'present'})
2025-09-29 12:36:41.070804 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:90:39:f1', 'entry': '52:54:00:90:39:f1,192.168.101.100,compute-0', 'state': 'present'})
2025-09-29 12:36:41.070833 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:a4:32:19', 'entry': '52:54:01:a4:32:19,192.168.101.9,controller-0', 'state': 'present'})
2025-09-29 12:36:41.070841 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:43:b1:b6', 'entry': '52:54:02:43:b1:b6,192.168.101.10,crc-0', 'state': 'present'})
2025-09-29 12:36:41.070853 | controller |
2025-09-29 12:36:41.070860 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2025-09-29 12:36:41.070868 | controller | Monday 29 September 2025  12:36:41 +0000 (0:00:02.021)       0:01:11.923 ******
2025-09-29 12:36:41.070878 | controller | skipping: [instance]
2025-09-29 12:36:41.274379 | controller |
2025-09-29 12:36:41.274406 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2025-09-29 12:36:41.274415 | controller | Monday 29 September 2025  12:36:41 +0000 (0:00:00.023)       0:01:11.947 ******
2025-09-29 12:36:41.274426 | controller | ok: [instance] => (item=compute-0)
2025-09-29 12:36:41.392964 | controller | ok: [instance] => (item=controller-0)
2025-09-29 12:36:41.393005 | controller | ok: [instance] => (item=crc-0)
2025-09-29 12:36:41.393015 | controller |
2025-09-29 12:36:41.393023 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2025-09-29 12:36:41.393031 | controller | Monday 29 September 2025  12:36:41 +0000 (0:00:00.203)       0:01:12.150 ******
2025-09-29 12:36:41.393043 | controller |
2025-09-29 12:36:41.434283 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-09-29 12:36:41.434325 | controller | Monday 29 September 2025  12:36:41 +0000 (0:00:00.118)       0:01:12.269 ******
2025-09-29 12:36:41.434340 | controller | ok: [instance]
2025-09-29 12:36:41.434373 | controller |
2025-09-29 12:36:41.434517 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-09-29 12:36:41.635339 | controller | Monday 29 September 2025  12:36:41 +0000 (0:00:00.041)       0:01:12.311 ******
2025-09-29 12:36:41.635364 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-09-29 12:36:41.635393 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-09-29 12:36:41.635407 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2025-09-29 12:36:41.635414 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2025-09-29 12:36:41.635423 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2025-09-29 12:36:41.636794 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2025-09-29 12:36:44.778324 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2025-09-29 12:36:44.778370 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-09-29 12:36:44.778380 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-09-29 12:36:44.778388 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2025-09-29 12:36:44.778395 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-09-29 12:36:44.778402 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-09-29 12:36:44.778409 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2025-09-29 12:36:44.778419 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2025-09-29 12:36:44.778427 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2025-09-29 12:36:44.778434 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2025-09-29 12:36:44.778440 | controller |
2025-09-29 12:36:44.778448 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-09-29 12:36:44.778455 | controller | Monday 29 September 2025  12:36:41 +0000 (0:00:00.200)       0:01:12.512 ******
2025-09-29 12:36:44.778469 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-09-29 12:36:44.778504 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-09-29 12:36:44.778512 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2025-09-29 12:36:44.778519 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2025-09-29 12:36:44.778528 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2025-09-29 12:36:44.779900 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2025-09-29 12:36:44.779939 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2025-09-29 12:36:45.154829 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-09-29 12:36:45.154866 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-09-29 12:36:45.154876 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2025-09-29 12:36:45.154884 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-09-29 12:36:45.154891 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-09-29 12:36:45.154898 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2025-09-29 12:36:45.154912 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2025-09-29 12:36:45.154919 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2025-09-29 12:36:45.154926 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2025-09-29 12:36:45.154933 | controller |
2025-09-29 12:36:45.154940 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2025-09-29 12:36:45.154948 | controller | Monday 29 September 2025  12:36:44 +0000 (0:00:03.142)       0:01:15.654 ******
2025-09-29 12:36:45.154961 | controller | changed: [instance]
2025-09-29 12:36:45.951720 | controller |
2025-09-29 12:36:45.951754 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2025-09-29 12:36:45.951762 | controller | Monday 29 September 2025  12:36:45 +0000 (0:00:00.365)       0:01:16.020 ******
2025-09-29 12:36:45.951768 | controller |
2025-09-29 12:36:45.951774 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2025-09-29 12:36:45.951779 | controller | Monday 29 September 2025  12:36:45 +0000 (0:00:00.010)       0:01:16.031 ******
2025-09-29 12:36:45.951789 | controller | changed: [instance]
2025-09-29 12:36:46.298906 | controller |
2025-09-29 12:36:46.298939 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-09-29 12:36:46.298951 | controller | Monday 29 September 2025  12:36:45 +0000 (0:00:00.796)       0:01:16.828 ******
2025-09-29 12:36:46.298961 | controller | changed: [instance]
2025-09-29 12:36:46.646310 | controller |
2025-09-29 12:36:46.646367 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2025-09-29 12:36:46.646377 | controller | Monday 29 September 2025  12:36:46 +0000 (0:00:00.347)       0:01:17.175 ******
2025-09-29 12:36:46.646393 | controller | changed: [instance]
2025-09-29 12:36:46.646433 | controller |
2025-09-29 12:36:46.646444 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2025-09-29 12:36:46.646556 | controller | Monday 29 September 2025  12:36:46 +0000 (0:00:00.347)       0:01:17.523 ******
2025-09-29 12:36:47.022758 | controller | changed: [instance]
2025-09-29 12:36:47.407602 | controller |
2025-09-29 12:36:47.407638 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2025-09-29 12:36:47.407646 | controller | Monday 29 September 2025  12:36:47 +0000 (0:00:00.376)       0:01:17.899 ******
2025-09-29 12:36:47.407657 | controller | changed: [instance]
2025-09-29 12:36:47.439899 | controller |
2025-09-29 12:36:47.439920 | controller | TASK [Build utility records dataset] *******************************************
2025-09-29 12:36:47.439927 | controller | Monday 29 September 2025  12:36:47 +0000 (0:00:00.384)       0:01:18.284 ******
2025-09-29 12:36:47.439936 | controller |
2025-09-29 12:36:47.535109 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-09-29 12:36:47.535128 | controller | Monday 29 September 2025  12:36:47 +0000 (0:00:00.032)       0:01:18.316 ******
2025-09-29 12:36:47.535139 | controller | ok: [instance]
2025-09-29 12:36:47.634751 | controller |
2025-09-29 12:36:47.634770 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-09-29 12:36:47.634785 | controller | Monday 29 September 2025  12:36:47 +0000 (0:00:00.095)       0:01:18.412 ******
2025-09-29 12:36:47.634795 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2025-09-29 12:36:48.106320 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-09-29 12:36:48.106368 | controller |
2025-09-29 12:36:48.106382 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-09-29 12:36:48.106393 | controller | Monday 29 September 2025  12:36:47 +0000 (0:00:00.099)       0:01:18.511 ******
2025-09-29 12:36:48.106411 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2025-09-29 12:36:48.585026 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-09-29 12:36:48.585060 | controller |
2025-09-29 12:36:48.585069 | controller | TASK [reproducer : Flush handlers] *********************************************
2025-09-29 12:36:48.585075 | controller | Monday 29 September 2025  12:36:48 +0000 (0:00:00.460)       0:01:18.972 ******
2025-09-29 12:36:48.585081 | controller |
2025-09-29 12:36:48.585087 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-09-29 12:36:48.585092 | controller | Monday 29 September 2025  12:36:48 +0000 (0:00:00.010)       0:01:18.982 ******
2025-09-29 12:36:48.585102 | controller | changed: [instance]
2025-09-29 12:36:48.928268 | controller |
2025-09-29 12:36:48.928304 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-09-29 12:36:48.928317 | controller | Monday 29 September 2025  12:36:48 +0000 (0:00:00.478)       0:01:19.461 ******
2025-09-29 12:36:48.928329 | controller | changed: [instance]
2025-09-29 12:36:48.928356 | controller |
2025-09-29 12:36:48.928362 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2025-09-29 12:36:48.928370 | controller | Monday 29 September 2025  12:36:48 +0000 (0:00:00.343)       0:01:19.805 ******
2025-09-29 12:36:48.959344 | controller | skipping: [instance]
2025-09-29 12:36:48.959408 | controller |
2025-09-29 12:36:48.959420 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2025-09-29 12:36:48.959547 | controller | Monday 29 September 2025  12:36:48 +0000 (0:00:00.031)       0:01:19.836 ******
2025-09-29 12:36:49.031851 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2025-09-29 12:36:49.215537 | controller |
2025-09-29 12:36:49.215557 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2025-09-29 12:36:49.215564 | controller | Monday 29 September 2025  12:36:49 +0000 (0:00:00.072)       0:01:19.908 ******
2025-09-29 12:36:49.215573 | controller | ok: [instance]
2025-09-29 12:36:49.235935 | controller |
2025-09-29 12:36:49.235956 | controller | TASK [Deploy CRC if needed] ****************************************************
2025-09-29 12:36:49.235964 | controller | Monday 29 September 2025  12:36:49 +0000 (0:00:00.183)       0:01:20.092 ******
2025-09-29 12:36:49.235975 | controller | skipping: [instance]
2025-09-29 12:36:49.573263 | controller |
2025-09-29 12:36:49.573297 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2025-09-29 12:36:49.573306 | controller | Monday 29 September 2025  12:36:49 +0000 (0:00:00.020)       0:01:20.112 ******
2025-09-29 12:36:49.573317 | controller | ok: [instance]
2025-09-29 12:36:49.811118 | controller |
2025-09-29 12:36:49.811188 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2025-09-29 12:36:49.811202 | controller | Monday 29 September 2025  12:36:49 +0000 (0:00:00.337)       0:01:20.449 ******
2025-09-29 12:36:49.811214 | controller | ok: [instance]
2025-09-29 12:36:50.029689 | controller |
2025-09-29 12:36:50.029723 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2025-09-29 12:36:50.029730 | controller | Monday 29 September 2025  12:36:49 +0000 (0:00:00.237)       0:01:20.687 ******
2025-09-29 12:36:50.029739 | controller | ok: [instance]
2025-09-29 12:36:50.254970 | controller |
2025-09-29 12:36:50.255010 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2025-09-29 12:36:50.255019 | controller | Monday 29 September 2025  12:36:50 +0000 (0:00:00.218)       0:01:20.906 ******
2025-09-29 12:36:50.255030 | controller | ok: [instance]
2025-09-29 12:36:50.479313 | controller |
2025-09-29 12:36:50.479342 | controller | TASK [rhol_crc : Destroy default network] **************************************
2025-09-29 12:36:50.479351 | controller | Monday 29 September 2025  12:36:50 +0000 (0:00:00.224)       0:01:21.131 ******
2025-09-29 12:36:50.479362 | controller | ok: [instance]
2025-09-29 12:36:50.518336 | controller |
2025-09-29 12:36:50.518379 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-09-29 12:36:50.518388 | controller | Monday 29 September 2025  12:36:50 +0000 (0:00:00.224)       0:01:21.356 ******
2025-09-29 12:36:50.518401 | controller |
2025-09-29 12:36:50.710238 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2025-09-29 12:36:50.710267 | controller | Monday 29 September 2025  12:36:50 +0000 (0:00:00.039)       0:01:21.395 ******
2025-09-29 12:36:50.710286 | controller | ok: [instance]
2025-09-29 12:36:50.710313 | controller |
2025-09-29 12:36:50.710322 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2025-09-29 12:36:50.710421 | controller | Monday 29 September 2025  12:36:50 +0000 (0:00:00.191)       0:01:21.586 ******
2025-09-29 12:36:50.733694 | controller | ok: [instance]
2025-09-29 12:36:50.758047 | controller |
2025-09-29 12:36:50.758062 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2025-09-29 12:36:50.758069 | controller | Monday 29 September 2025  12:36:50 +0000 (0:00:00.023)       0:01:21.610 ******
2025-09-29 12:36:50.758076 | controller | skipping: [instance]
2025-09-29 12:36:51.032230 | controller |
2025-09-29 12:36:51.032265 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2025-09-29 12:36:51.032278 | controller | Monday 29 September 2025  12:36:50 +0000 (0:00:00.024)       0:01:21.635 ******
2025-09-29 12:36:51.032290 | controller | ok: [instance]
2025-09-29 12:36:51.032316 | controller |
2025-09-29 12:36:51.032559 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2025-09-29 12:36:51.246397 | controller | Monday 29 September 2025  12:36:51 +0000 (0:00:00.274)       0:01:21.909 ******
2025-09-29 12:36:51.246434 | controller | ok: [instance]
2025-09-29 12:36:51.419983 | controller |
2025-09-29 12:36:51.420006 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2025-09-29 12:36:51.420014 | controller | Monday 29 September 2025  12:36:51 +0000 (0:00:00.213)       0:01:22.123 ******
2025-09-29 12:36:51.420024 | controller | ok: [instance]
2025-09-29 12:36:51.475649 | controller |
2025-09-29 12:36:51.475669 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2025-09-29 12:36:51.475676 | controller | Monday 29 September 2025  12:36:51 +0000 (0:00:00.173)       0:01:22.296 ******
2025-09-29 12:36:51.475685 | controller |
2025-09-29 12:36:51.518806 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2025-09-29 12:36:51.518832 | controller | Monday 29 September 2025  12:36:51 +0000 (0:00:00.055)       0:01:22.352 ******
2025-09-29 12:36:51.518845 | controller | ok: [instance] => changed=false
2025-09-29 12:36:51.692303 | controller |   msg: All assertions passed
2025-09-29 12:36:51.692332 | controller |
2025-09-29 12:36:51.692342 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2025-09-29 12:36:51.692350 | controller | Monday 29 September 2025  12:36:51 +0000 (0:00:00.042)       0:01:22.395 ******
2025-09-29 12:36:51.692361 | controller | ok: [instance]
2025-09-29 12:36:51.692381 | controller |
2025-09-29 12:36:51.692391 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2025-09-29 12:36:51.692447 | controller | Monday 29 September 2025  12:36:51 +0000 (0:00:00.173)       0:01:22.569 ******
2025-09-29 12:36:51.882945 | controller | ok: [instance]
2025-09-29 12:36:51.906970 | controller |
2025-09-29 12:36:51.906993 | controller | TASK [openshift_login : Assert files exist] ************************************
2025-09-29 12:36:51.907001 | controller | Monday 29 September 2025  12:36:51 +0000 (0:00:00.190)       0:01:22.759 ******
2025-09-29 12:36:51.907011 | controller | ok: [instance] => changed=false
2025-09-29 12:36:52.092458 | controller |   msg: All assertions passed
2025-09-29 12:36:52.092495 | controller |
2025-09-29 12:36:52.092505 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2025-09-29 12:36:52.092513 | controller | Monday 29 September 2025  12:36:51 +0000 (0:00:00.024)       0:01:22.783 ******
2025-09-29 12:36:52.092525 | controller | ok: [instance]
2025-09-29 12:36:52.265200 | controller |
2025-09-29 12:36:52.265230 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2025-09-29 12:36:52.265239 | controller | Monday 29 September 2025  12:36:52 +0000 (0:00:00.185)       0:01:22.968 ******
2025-09-29 12:36:52.265249 | controller | ok: [instance]
2025-09-29 12:36:52.310797 | controller |
2025-09-29 12:36:52.310818 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2025-09-29 12:36:52.310827 | controller | Monday 29 September 2025  12:36:52 +0000 (0:00:00.172)       0:01:23.141 ******
2025-09-29 12:36:52.310837 | controller | ok: [instance]
2025-09-29 12:36:52.693411 | controller |
2025-09-29 12:36:52.693445 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2025-09-29 12:36:52.693453 | controller | Monday 29 September 2025  12:36:52 +0000 (0:00:00.045)       0:01:23.187 ******
2025-09-29 12:36:52.693465 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2025-09-29 12:36:52.712312 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2025-09-29 12:36:52.712362 | controller |
2025-09-29 12:36:52.712376 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2025-09-29 12:36:52.712387 | controller | Monday 29 September 2025  12:36:52 +0000 (0:00:00.382)       0:01:23.569 ******
2025-09-29 12:36:52.712404 | controller | skipping: [instance]
2025-09-29 12:36:52.735833 | controller |
2025-09-29 12:36:52.735861 | controller | TASK [Load the architecture local kustomize patches] ***************************
2025-09-29 12:36:52.735883 | controller | Monday 29 September 2025  12:36:52 +0000 (0:00:00.019)       0:01:23.589 ******
2025-09-29 12:36:52.735895 | controller | skipping: [instance]
2025-09-29 12:36:52.888781 | controller |
2025-09-29 12:36:52.888800 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2025-09-29 12:36:52.888807 | controller | Monday 29 September 2025  12:36:52 +0000 (0:00:00.023)       0:01:23.612 ******
2025-09-29 12:36:52.888818 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2025-09-29 12:36:52.913681 | controller |
2025-09-29 12:36:52.913716 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2025-09-29 12:36:52.913726 | controller | Monday 29 September 2025  12:36:52 +0000 (0:00:00.152)       0:01:23.765 ******
2025-09-29 12:36:52.913737 | controller | skipping: [instance]
2025-09-29 12:36:53.312270 | controller |
2025-09-29 12:36:53.312305 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2025-09-29 12:36:53.312314 | controller | Monday 29 September 2025  12:36:52 +0000 (0:00:00.025)       0:01:23.790 ******
2025-09-29 12:36:53.312325 | controller | changed: [instance]
2025-09-29 12:36:53.799144 | controller |
2025-09-29 12:36:53.799196 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2025-09-29 12:36:53.799205 | controller | Monday 29 September 2025  12:36:53 +0000 (0:00:00.398)       0:01:24.188 ******
2025-09-29 12:36:53.799216 | controller | changed: [instance]
2025-09-29 12:36:54.219256 | controller |
2025-09-29 12:36:54.219293 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2025-09-29 12:36:54.219303 | controller | Monday 29 September 2025  12:36:53 +0000 (0:00:00.475)       0:01:24.663 ******
2025-09-29 12:36:54.219318 | controller |
2025-09-29 12:36:54.219325 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-09-29 12:36:54.219332 | controller | Monday 29 September 2025  12:36:53 +0000 (0:00:00.011)       0:01:24.675 ******
2025-09-29 12:36:54.219344 | controller | changed: [instance]
2025-09-29 12:36:54.219364 | controller |
2025-09-29 12:36:54.219374 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2025-09-29 12:36:54.219478 | controller | Monday 29 September 2025  12:36:54 +0000 (0:00:00.420)       0:01:25.096 ******
2025-09-29 12:36:55.042764 | controller | changed: [instance]
2025-09-29 12:36:55.075214 | controller |
2025-09-29 12:36:55.075233 | controller | TASK [Deploy virtualbmc] *******************************************************
2025-09-29 12:36:55.075241 | controller | Monday 29 September 2025  12:36:55 +0000 (0:00:00.823)       0:01:25.919 ******
2025-09-29 12:36:55.075250 | controller | skipping: [instance]
2025-09-29 12:36:55.107859 | controller |
2025-09-29 12:36:55.107883 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2025-09-29 12:36:55.107892 | controller | Monday 29 September 2025  12:36:55 +0000 (0:00:00.032)       0:01:25.952 ******
2025-09-29 12:36:55.107904 | controller | skipping: [instance]
2025-09-29 12:36:55.664037 | controller |
2025-09-29 12:36:55.664071 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2025-09-29 12:36:55.664079 | controller | Monday 29 September 2025  12:36:55 +0000 (0:00:00.032)       0:01:25.984 ******
2025-09-29 12:36:55.664090 | controller | changed: [instance] => (item=workload)
2025-09-29 12:36:56.084020 | controller | changed: [instance] => (item=reproducer-inventory)
2025-09-29 12:36:56.084047 | controller | ok: [instance] => (item=volumes)
2025-09-29 12:36:56.084054 | controller |
2025-09-29 12:36:56.084060 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2025-09-29 12:36:56.084066 | controller | Monday 29 September 2025  12:36:55 +0000 (0:00:00.555)       0:01:26.540 ******
2025-09-29 12:36:56.084076 | controller | changed: [instance] => (item=workload)
2025-09-29 12:36:56.110020 | controller | changed: [instance] => (item=volumes)
2025-09-29 12:36:56.110039 | controller |
2025-09-29 12:36:56.110046 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2025-09-29 12:36:56.110052 | controller | Monday 29 September 2025  12:36:56 +0000 (0:00:00.420)       0:01:26.960 ******
2025-09-29 12:36:56.110061 | controller | skipping: [instance]
2025-09-29 12:36:57.159329 | controller |
2025-09-29 12:36:57.159377 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2025-09-29 12:36:57.159387 | controller | Monday 29 September 2025  12:36:56 +0000 (0:00:00.026)       0:01:26.986 ******
2025-09-29 12:36:57.159404 | controller | changed: [instance] => (item=compute)
2025-09-29 12:36:57.159445 | controller | changed: [instance] => (item=controller)
2025-09-29 12:36:57.159456 | controller | changed: [instance] => (item=crc)
2025-09-29 12:36:57.159465 | controller |
2025-09-29 12:36:57.159478 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2025-09-29 12:36:57.159552 | controller | Monday 29 September 2025  12:36:57 +0000 (0:00:01.049)       0:01:28.036 ******
2025-09-29 12:36:57.533328 | controller | changed: [instance]
2025-09-29 12:36:57.533392 | controller |
2025-09-29 12:36:57.533403 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2025-09-29 12:36:57.533414 | controller | Monday 29 September 2025  12:36:57 +0000 (0:00:00.373)       0:01:28.410 ******
2025-09-29 12:36:57.572803 | controller | skipping: [instance]
2025-09-29 12:36:57.636271 | controller |
2025-09-29 12:36:57.636325 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2025-09-29 12:36:57.636336 | controller | Monday 29 September 2025  12:36:57 +0000 (0:00:00.039)       0:01:28.449 ******
2025-09-29 12:36:57.636351 | controller | skipping: [instance] => (item=crc)
2025-09-29 12:36:57.636452 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2025-09-29 12:36:57.636471 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2025-09-29 12:36:57.636480 | controller |
2025-09-29 12:36:57.636490 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2025-09-29 12:36:57.841230 | controller | Monday 29 September 2025  12:36:57 +0000 (0:00:00.063)       0:01:28.513 ******
2025-09-29 12:36:57.841266 | controller | changed: [instance]
2025-09-29 12:36:57.841341 | controller |
2025-09-29 12:36:57.841360 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2025-09-29 12:36:57.841370 | controller | Monday 29 September 2025  12:36:57 +0000 (0:00:00.205)       0:01:28.718 ******
2025-09-29 12:36:58.017682 | controller | ok: [instance]
2025-09-29 12:37:17.995296 | controller |
2025-09-29 12:37:17.995332 | controller | TASK [libvirt_manager : Download base image] ***********************************
2025-09-29 12:37:17.995340 | controller | Monday 29 September 2025  12:36:58 +0000 (0:00:00.176)       0:01:28.894 ******
2025-09-29 12:37:17.995351 | controller | changed: [instance]
2025-09-29 12:37:17.995357 | controller |
2025-09-29 12:37:17.995362 | controller | TASK [libvirt_manager : Check image] *******************************************
2025-09-29 12:37:17.995369 | controller | Monday 29 September 2025  12:37:17 +0000 (0:00:19.977)       0:01:48.871 ******
2025-09-29 12:37:18.184706 | controller | ok: [instance]
2025-09-29 12:37:18.224856 | controller |
2025-09-29 12:37:18.224885 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2025-09-29 12:37:18.224894 | controller | Monday 29 September 2025  12:37:18 +0000 (0:00:00.189)       0:01:49.061 ******
2025-09-29 12:37:18.224905 | controller | ok: [instance] => changed=false
2025-09-29 12:37:18.430709 | controller |   msg: All assertions passed
2025-09-29 12:37:18.430744 | controller |
2025-09-29 12:37:18.430752 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2025-09-29 12:37:18.430758 | controller | Monday 29 September 2025  12:37:18 +0000 (0:00:00.040)       0:01:49.101 ******
2025-09-29 12:37:18.430767 | controller | changed: [instance]
2025-09-29 12:37:18.634228 | controller |
2025-09-29 12:37:18.634264 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2025-09-29 12:37:18.634272 | controller | Monday 29 September 2025  12:37:18 +0000 (0:00:00.205)       0:01:49.307 ******
2025-09-29 12:37:18.634283 | controller | ok: [instance]
2025-09-29 12:37:18.634307 | controller |
2025-09-29 12:37:18.634315 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2025-09-29 12:37:18.634398 | controller | Monday 29 September 2025  12:37:18 +0000 (0:00:00.203)       0:01:49.511 ******
2025-09-29 12:37:18.827708 | controller | ok: [instance]
2025-09-29 12:37:18.850262 | controller |
2025-09-29 12:37:18.850295 | controller | TASK [libvirt_manager : Download base image] ***********************************
2025-09-29 12:37:18.850303 | controller | Monday 29 September 2025  12:37:18 +0000 (0:00:00.193)       0:01:49.704 ******
2025-09-29 12:37:18.850315 | controller | skipping: [instance]
2025-09-29 12:37:18.850518 | controller |
2025-09-29 12:37:18.850540 | controller | TASK [libvirt_manager : Check image] *******************************************
2025-09-29 12:37:19.045553 | controller | Monday 29 September 2025  12:37:18 +0000 (0:00:00.022)       0:01:49.727 ******
2025-09-29 12:37:19.045587 | controller | ok: [instance]
2025-09-29 12:37:19.085132 | controller |
2025-09-29 12:37:19.085165 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2025-09-29 12:37:19.085176 | controller | Monday 29 September 2025  12:37:19 +0000 (0:00:00.195)       0:01:49.922 ******
2025-09-29 12:37:19.085185 | controller | ok: [instance] => changed=false
2025-09-29 12:37:19.288219 | controller |   msg: All assertions passed
2025-09-29 12:37:19.288247 | controller |
2025-09-29 12:37:19.288256 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2025-09-29 12:37:19.288263 | controller | Monday 29 September 2025  12:37:19 +0000 (0:00:00.039)       0:01:49.961 ******
2025-09-29 12:37:19.288274 | controller | ok: [instance]
2025-09-29 12:37:19.458252 | controller |
2025-09-29 12:37:19.458292 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2025-09-29 12:37:19.458303 | controller | Monday 29 September 2025  12:37:19 +0000 (0:00:00.202)       0:01:50.164 ******
2025-09-29 12:37:19.458318 | controller | ok: [instance]
2025-09-29 12:37:19.836247 | controller |
2025-09-29 12:37:19.836286 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2025-09-29 12:37:19.836295 | controller | Monday 29 September 2025  12:37:19 +0000 (0:00:00.170)       0:01:50.335 ******
2025-09-29 12:37:19.836307 | controller | changed: [instance]
2025-09-29 12:37:19.836347 | controller |
2025-09-29 12:37:19.836481 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2025-09-29 12:37:19.836509 | controller | Monday 29 September 2025  12:37:19 +0000 (0:00:00.378)       0:01:50.713 ******
2025-09-29 12:37:20.011014 | controller | ok: [instance]
2025-09-29 12:37:20.186297 | controller |
2025-09-29 12:37:20.186357 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2025-09-29 12:37:20.186368 | controller | Monday 29 September 2025  12:37:20 +0000 (0:00:00.174)       0:01:50.887 ******
2025-09-29 12:37:20.186385 | controller | ok: [instance]
2025-09-29 12:37:20.598329 | controller |
2025-09-29 12:37:20.598388 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2025-09-29 12:37:20.598397 | controller | Monday 29 September 2025  12:37:20 +0000 (0:00:00.175)       0:01:51.063 ******
2025-09-29 12:37:20.598415 | controller | changed: [instance]
2025-09-29 12:37:20.598447 | controller |
2025-09-29 12:37:20.598457 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2025-09-29 12:37:20.619281 | controller | Monday 29 September 2025  12:37:20 +0000 (0:00:00.412)       0:01:51.475 ******
2025-09-29 12:37:20.619314 | controller | ok: [instance]
2025-09-29 12:37:20.619556 | controller |
2025-09-29 12:37:20.619598 | controller | TASK [libvirt_manager : List existing networks] ********************************
2025-09-29 12:37:20.888211 | controller | Monday 29 September 2025  12:37:20 +0000 (0:00:00.021)       0:01:51.496 ******
2025-09-29 12:37:20.888263 | controller | ok: [instance]
2025-09-29 12:37:21.330225 | controller |
2025-09-29 12:37:21.330258 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2025-09-29 12:37:21.330266 | controller | Monday 29 September 2025  12:37:20 +0000 (0:00:00.268)       0:01:51.764 ******
2025-09-29 12:37:21.330277 | controller | ok: [instance]
2025-09-29 12:37:21.330353 | controller |
2025-09-29 12:37:21.330369 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2025-09-29 12:37:21.330378 | controller | Monday 29 September 2025  12:37:21 +0000 (0:00:00.442)       0:01:52.207 ******
2025-09-29 12:37:21.449322 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-09-29 12:37:21.449469 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-09-29 12:37:21.449491 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-09-29 12:37:21.449499 | controller |
2025-09-29 12:37:21.449505 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2025-09-29 12:37:21.449514 | controller | Monday 29 September 2025  12:37:21 +0000 (0:00:00.118)       0:01:52.325 ******
2025-09-29 12:37:21.708605 | controller | changed: [instance]
2025-09-29 12:37:21.935107 | controller |
2025-09-29 12:37:21.935138 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2025-09-29 12:37:21.935146 | controller | Monday 29 September 2025  12:37:21 +0000 (0:00:00.259)       0:01:52.585 ******
2025-09-29 12:37:21.935174 | controller | changed: [instance]
2025-09-29 12:37:22.228067 | controller |
2025-09-29 12:37:22.228103 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2025-09-29 12:37:22.228111 | controller | Monday 29 September 2025  12:37:21 +0000 (0:00:00.226)       0:01:52.811 ******
2025-09-29 12:37:22.228121 | controller | changed: [instance]
2025-09-29 12:37:22.256996 | controller |
2025-09-29 12:37:22.257018 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2025-09-29 12:37:22.257028 | controller | Monday 29 September 2025  12:37:22 +0000 (0:00:00.292)       0:01:53.104 ******
2025-09-29 12:37:22.257039 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-09-29 12:37:22.301094 | controller |
2025-09-29 12:37:22.301128 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-09-29 12:37:22.301139 | controller | Monday 29 September 2025  12:37:22 +0000 (0:00:00.029)       0:01:53.133 ******
2025-09-29 12:37:22.301148 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-09-29 12:37:22.531785 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-09-29 12:37:22.531821 | controller |
2025-09-29 12:37:22.531829 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-09-29 12:37:22.531835 | controller | Monday 29 September 2025  12:37:22 +0000 (0:00:00.043)       0:01:53.177 ******
2025-09-29 12:37:22.531845 | controller | ok: [instance]
2025-09-29 12:37:22.575824 | controller |
2025-09-29 12:37:22.575845 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-09-29 12:37:22.575852 | controller | Monday 29 September 2025  12:37:22 +0000 (0:00:00.231)       0:01:53.408 ******
2025-09-29 12:37:22.575862 | controller | ok: [instance] => (item=cifmw-public)
2025-09-29 12:37:22.803802 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:37:22.803839 | controller |
2025-09-29 12:37:22.803849 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-09-29 12:37:22.803857 | controller | Monday 29 September 2025  12:37:22 +0000 (0:00:00.044)       0:01:53.452 ******
2025-09-29 12:37:22.803869 | controller | ok: [instance]
2025-09-29 12:37:23.002131 | controller |
2025-09-29 12:37:23.002177 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-09-29 12:37:23.002186 | controller | Monday 29 September 2025  12:37:22 +0000 (0:00:00.227)       0:01:53.680 ******
2025-09-29 12:37:23.002202 | controller | ok: [instance]
2025-09-29 12:37:24.293277 | controller |
2025-09-29 12:37:24.293314 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2025-09-29 12:37:24.293324 | controller | Monday 29 September 2025  12:37:22 +0000 (0:00:00.198)       0:01:53.878 ******
2025-09-29 12:37:24.293337 | controller | changed: [instance]
2025-09-29 12:37:24.293366 | controller |
2025-09-29 12:37:24.293376 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-09-29 12:37:24.293400 | controller | Monday 29 September 2025  12:37:24 +0000 (0:00:01.291)       0:01:55.169 ******
2025-09-29 12:37:24.529298 | controller | ok: [instance]
2025-09-29 12:37:24.529536 | controller |
2025-09-29 12:37:24.573046 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-09-29 12:37:24.573066 | controller | Monday 29 September 2025  12:37:24 +0000 (0:00:00.236)       0:01:55.406 ******
2025-09-29 12:37:24.573076 | controller | ok: [instance] => (item=cifmw-public)
2025-09-29 12:37:24.801251 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:37:24.801287 | controller |
2025-09-29 12:37:24.801295 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-09-29 12:37:24.801301 | controller | Monday 29 September 2025  12:37:24 +0000 (0:00:00.043)       0:01:55.449 ******
2025-09-29 12:37:24.801313 | controller | ok: [instance]
2025-09-29 12:37:24.801338 | controller |
2025-09-29 12:37:24.801347 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-09-29 12:37:24.801440 | controller | Monday 29 September 2025  12:37:24 +0000 (0:00:00.228)       0:01:55.678 ******
2025-09-29 12:37:25.007593 | controller | ok: [instance]
2025-09-29 12:37:25.301917 | controller |
2025-09-29 12:37:25.301943 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2025-09-29 12:37:25.301951 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.206)       0:01:55.884 ******
2025-09-29 12:37:25.301961 | controller | changed: [instance]
2025-09-29 12:37:25.323065 | controller |
2025-09-29 12:37:25.323086 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2025-09-29 12:37:25.323094 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.294)       0:01:56.178 ******
2025-09-29 12:37:25.323103 | controller | skipping: [instance]
2025-09-29 12:37:25.352121 | controller |
2025-09-29 12:37:25.352139 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2025-09-29 12:37:25.352146 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.021)       0:01:56.199 ******
2025-09-29 12:37:25.352171 | controller | skipping: [instance]
2025-09-29 12:37:25.380197 | controller |
2025-09-29 12:37:25.380219 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2025-09-29 12:37:25.380228 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.028)       0:01:56.228 ******
2025-09-29 12:37:25.380239 | controller | skipping: [instance]
2025-09-29 12:37:25.407715 | controller |
2025-09-29 12:37:25.407751 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2025-09-29 12:37:25.407761 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.028)       0:01:56.257 ******
2025-09-29 12:37:25.407771 | controller | skipping: [instance]
2025-09-29 12:37:25.628197 | controller |
2025-09-29 12:37:25.628229 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-09-29 12:37:25.628238 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.027)       0:01:56.284 ******
2025-09-29 12:37:25.628248 | controller | changed: [instance]
2025-09-29 12:37:25.664995 | controller |
2025-09-29 12:37:25.665017 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-09-29 12:37:25.665026 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.219)       0:01:56.504 ******
2025-09-29 12:37:25.665037 | controller | ok: [instance]
2025-09-29 12:37:25.719833 | controller |
2025-09-29 12:37:25.719856 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-09-29 12:37:25.719865 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.037)       0:01:56.541 ******
2025-09-29 12:37:25.719877 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2025-09-29 12:37:25.919309 | controller |
2025-09-29 12:37:25.919348 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2025-09-29 12:37:25.919358 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.054)       0:01:56.596 ******
2025-09-29 12:37:25.919370 | controller | ok: [instance]
2025-09-29 12:37:25.919399 | controller |
2025-09-29 12:37:25.919409 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2025-09-29 12:37:25.919509 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.199)       0:01:56.796 ******
2025-09-29 12:37:25.981694 | controller | ok: [instance]
2025-09-29 12:37:26.026262 | controller |
2025-09-29 12:37:26.026282 | controller | TASK [libvirt_manager : Define the user data] **********************************
2025-09-29 12:37:26.026294 | controller | Monday 29 September 2025  12:37:25 +0000 (0:00:00.062)       0:01:56.858 ******
2025-09-29 12:37:26.026302 | controller | ok: [instance]
2025-09-29 12:37:26.068091 | controller |
2025-09-29 12:37:26.068113 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2025-09-29 12:37:26.068123 | controller | Monday 29 September 2025  12:37:26 +0000 (0:00:00.044)       0:01:56.903 ******
2025-09-29 12:37:26.068133 | controller | skipping: [instance]
2025-09-29 12:37:26.112297 | controller |
2025-09-29 12:37:26.112359 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2025-09-29 12:37:26.112370 | controller | Monday 29 September 2025  12:37:26 +0000 (0:00:00.041)       0:01:56.944 ******
2025-09-29 12:37:26.112386 | controller | skipping: [instance]
2025-09-29 12:37:26.171313 | controller |
2025-09-29 12:37:26.171359 | controller | TASK [Call the config_drive role] **********************************************
2025-09-29 12:37:26.171369 | controller | Monday 29 September 2025  12:37:26 +0000 (0:00:00.044)       0:01:56.989 ******
2025-09-29 12:37:26.171381 | controller |
2025-09-29 12:37:26.577284 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2025-09-29 12:37:26.577326 | controller | Monday 29 September 2025  12:37:26 +0000 (0:00:00.059)       0:01:57.048 ******
2025-09-29 12:37:26.577343 | controller | ok: [instance] => (item=artifacts)
2025-09-29 12:37:26.577384 | controller | ok: [instance] => (item=logs)
2025-09-29 12:37:26.577395 | controller |
2025-09-29 12:37:26.577557 | controller | TASK [config_drive : Install required RPM packages] ****************************
2025-09-29 12:37:27.792228 | controller | Monday 29 September 2025  12:37:26 +0000 (0:00:00.405)       0:01:57.454 ******
2025-09-29 12:37:27.792268 | controller | ok: [instance]
2025-09-29 12:37:28.011250 | controller |
2025-09-29 12:37:28.011293 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2025-09-29 12:37:28.011304 | controller | Monday 29 September 2025  12:37:27 +0000 (0:00:01.214)       0:01:58.668 ******
2025-09-29 12:37:28.011316 | controller | changed: [instance]
2025-09-29 12:37:28.011344 | controller |
2025-09-29 12:37:28.011355 | controller | TASK [config_drive : Generate meta-data] ***************************************
2025-09-29 12:37:28.011431 | controller | Monday 29 September 2025  12:37:28 +0000 (0:00:00.219)       0:01:58.888 ******
2025-09-29 12:37:28.377247 | controller | changed: [instance]
2025-09-29 12:37:28.377465 | controller |
2025-09-29 12:37:28.377491 | controller | TASK [config_drive : Generate user-data] ***************************************
2025-09-29 12:37:28.751829 | controller | Monday 29 September 2025  12:37:28 +0000 (0:00:00.366)       0:01:59.254 ******
2025-09-29 12:37:28.751870 | controller | changed: [instance]
2025-09-29 12:37:28.794886 | controller |
2025-09-29 12:37:28.794927 | controller | TASK [config_drive : Generate network-data] ************************************
2025-09-29 12:37:28.794935 | controller | Monday 29 September 2025  12:37:28 +0000 (0:00:00.374)       0:01:59.628 ******
2025-09-29 12:37:28.794946 | controller | skipping: [instance]
2025-09-29 12:37:28.999317 | controller |
2025-09-29 12:37:28.999353 | controller | TASK [config_drive : Check ISO availability] ***********************************
2025-09-29 12:37:28.999363 | controller | Monday 29 September 2025  12:37:28 +0000 (0:00:00.042)       0:01:59.671 ******
2025-09-29 12:37:28.999376 | controller | ok: [instance]
2025-09-29 12:37:28.999405 | controller |
2025-09-29 12:37:28.999413 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2025-09-29 12:37:28.999422 | controller | Monday 29 September 2025  12:37:28 +0000 (0:00:00.204)       0:01:59.876 ******
2025-09-29 12:37:29.041928 | controller | skipping: [instance]
2025-09-29 12:37:29.276037 | controller |
2025-09-29 12:37:29.276070 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2025-09-29 12:37:29.276081 | controller | Monday 29 September 2025  12:37:29 +0000 (0:00:00.042)       0:01:59.918 ******
2025-09-29 12:37:29.276093 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2025-09-29 12:37:29.550649 | controller | changed: [instance]
2025-09-29 12:37:29.550688 | controller |
2025-09-29 12:37:29.550705 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-09-29 12:37:29.550713 | controller | Monday 29 September 2025  12:37:29 +0000 (0:00:00.234)       0:02:00.152 ******
2025-09-29 12:37:29.550726 | controller | changed: [instance]
2025-09-29 12:37:29.648145 | controller |
2025-09-29 12:37:29.648227 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-09-29 12:37:29.648237 | controller | Monday 29 September 2025  12:37:29 +0000 (0:00:00.274)       0:02:00.427 ******
2025-09-29 12:37:29.648251 | controller | skipping: [instance]
2025-09-29 12:37:29.892662 | controller |
2025-09-29 12:37:29.892691 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2025-09-29 12:37:29.892703 | controller | Monday 29 September 2025  12:37:29 +0000 (0:00:00.097)       0:02:00.524 ******
2025-09-29 12:37:29.892713 | controller | changed: [instance]
2025-09-29 12:37:30.128624 | controller |
2025-09-29 12:37:30.128652 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2025-09-29 12:37:30.128659 | controller | Monday 29 September 2025  12:37:29 +0000 (0:00:00.244)       0:02:00.769 ******
2025-09-29 12:37:30.128669 | controller | changed: [instance]
2025-09-29 12:37:30.420850 | controller |
2025-09-29 12:37:30.420881 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2025-09-29 12:37:30.420890 | controller | Monday 29 September 2025  12:37:30 +0000 (0:00:00.236)       0:02:01.005 ******
2025-09-29 12:37:30.420900 | controller | changed: [instance]
2025-09-29 12:37:30.450848 | controller |
2025-09-29 12:37:30.450869 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2025-09-29 12:37:30.450876 | controller | Monday 29 September 2025  12:37:30 +0000 (0:00:00.292)       0:02:01.297 ******
2025-09-29 12:37:30.450886 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-09-29 12:37:30.505277 | controller |
2025-09-29 12:37:30.505303 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-09-29 12:37:30.505312 | controller | Monday 29 September 2025  12:37:30 +0000 (0:00:00.030)       0:02:01.327 ******
2025-09-29 12:37:30.505324 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-09-29 12:37:30.505353 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-09-29 12:37:30.505720 | controller |
2025-09-29 12:37:30.772841 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-09-29 12:37:30.772878 | controller | Monday 29 September 2025  12:37:30 +0000 (0:00:00.054)       0:02:01.382 ******
2025-09-29 12:37:30.772893 | controller | ok: [instance]
2025-09-29 12:37:30.820301 | controller |
2025-09-29 12:37:30.820338 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-09-29 12:37:30.820348 | controller | Monday 29 September 2025  12:37:30 +0000 (0:00:00.267)       0:02:01.649 ******
2025-09-29 12:37:30.820361 | controller | ok: [instance] => (item=cifmw-public)
2025-09-29 12:37:31.063720 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:37:31.063770 | controller |
2025-09-29 12:37:31.063778 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-09-29 12:37:31.063785 | controller | Monday 29 September 2025  12:37:30 +0000 (0:00:00.047)       0:02:01.696 ******
2025-09-29 12:37:31.063795 | controller | ok: [instance]
2025-09-29 12:37:31.269981 | controller |
2025-09-29 12:37:31.270016 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-09-29 12:37:31.270025 | controller | Monday 29 September 2025  12:37:31 +0000 (0:00:00.243)       0:02:01.940 ******
2025-09-29 12:37:31.270035 | controller | ok: [instance]
2025-09-29 12:37:31.565320 | controller |
2025-09-29 12:37:31.565364 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2025-09-29 12:37:31.565377 | controller | Monday 29 September 2025  12:37:31 +0000 (0:00:00.206)       0:02:02.146 ******
2025-09-29 12:37:31.565393 | controller | changed: [instance]
2025-09-29 12:37:31.803968 | controller |
2025-09-29 12:37:31.804014 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-09-29 12:37:31.804025 | controller | Monday 29 September 2025  12:37:31 +0000 (0:00:00.295)       0:02:02.441 ******
2025-09-29 12:37:31.804038 | controller | ok: [instance]
2025-09-29 12:37:31.848328 | controller |
2025-09-29 12:37:31.848366 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-09-29 12:37:31.848376 | controller | Monday 29 September 2025  12:37:31 +0000 (0:00:00.238)       0:02:02.680 ******
2025-09-29 12:37:31.848388 | controller | ok: [instance] => (item=cifmw-public)
2025-09-29 12:37:31.848420 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:37:31.848427 | controller |
2025-09-29 12:37:31.848436 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-09-29 12:37:31.848463 | controller | Monday 29 September 2025  12:37:31 +0000 (0:00:00.044)       0:02:02.725 ******
2025-09-29 12:37:32.079964 | controller | ok: [instance]
2025-09-29 12:37:32.080011 | controller |
2025-09-29 12:37:32.080256 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-09-29 12:37:32.293331 | controller | Monday 29 September 2025  12:37:32 +0000 (0:00:00.231)       0:02:02.956 ******
2025-09-29 12:37:32.293381 | controller | ok: [instance]
2025-09-29 12:37:32.293416 | controller |
2025-09-29 12:37:32.293634 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2025-09-29 12:37:32.585268 | controller | Monday 29 September 2025  12:37:32 +0000 (0:00:00.213)       0:02:03.170 ******
2025-09-29 12:37:32.585305 | controller | changed: [instance]
2025-09-29 12:37:32.606991 | controller |
2025-09-29 12:37:32.607024 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2025-09-29 12:37:32.607033 | controller | Monday 29 September 2025  12:37:32 +0000 (0:00:00.291)       0:02:03.461 ******
2025-09-29 12:37:32.607047 | controller | skipping: [instance]
2025-09-29 12:37:32.636225 | controller |
2025-09-29 12:37:32.636254 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2025-09-29 12:37:32.636263 | controller | Monday 29 September 2025  12:37:32 +0000 (0:00:00.021)       0:02:03.483 ******
2025-09-29 12:37:32.636275 | controller | skipping: [instance]
2025-09-29 12:37:32.666655 | controller |
2025-09-29 12:37:32.666674 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2025-09-29 12:37:32.666681 | controller | Monday 29 September 2025  12:37:32 +0000 (0:00:00.029)       0:02:03.513 ******
2025-09-29 12:37:32.666690 | controller | skipping: [instance]
2025-09-29 12:37:32.694377 | controller |
2025-09-29 12:37:32.694408 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2025-09-29 12:37:32.694417 | controller | Monday 29 September 2025  12:37:32 +0000 (0:00:00.030)       0:02:03.543 ******
2025-09-29 12:37:32.694427 | controller | skipping: [instance]
2025-09-29 12:37:32.913720 | controller |
2025-09-29 12:37:32.913767 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-09-29 12:37:32.913776 | controller | Monday 29 September 2025  12:37:32 +0000 (0:00:00.027)       0:02:03.571 ******
2025-09-29 12:37:32.913787 | controller | changed: [instance]
2025-09-29 12:37:32.954326 | controller |
2025-09-29 12:37:32.954370 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-09-29 12:37:32.954384 | controller | Monday 29 September 2025  12:37:32 +0000 (0:00:00.219)       0:02:03.790 ******
2025-09-29 12:37:32.954400 | controller | ok: [instance]
2025-09-29 12:37:33.009291 | controller |
2025-09-29 12:37:33.009314 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-09-29 12:37:33.009324 | controller | Monday 29 September 2025  12:37:32 +0000 (0:00:00.040)       0:02:03.831 ******
2025-09-29 12:37:33.009336 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2025-09-29 12:37:33.009368 | controller |
2025-09-29 12:37:33.009376 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2025-09-29 12:37:33.009385 | controller | Monday 29 September 2025  12:37:33 +0000 (0:00:00.055)       0:02:03.886 ******
2025-09-29 12:37:33.206274 | controller | ok: [instance]
2025-09-29 12:37:33.206323 | controller |
2025-09-29 12:37:33.206335 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2025-09-29 12:37:33.206434 | controller | Monday 29 September 2025  12:37:33 +0000 (0:00:00.196)       0:02:04.083 ******
2025-09-29 12:37:33.269632 | controller | ok: [instance]
2025-09-29 12:37:33.313393 | controller |
2025-09-29 12:37:33.313442 | controller | TASK [libvirt_manager : Define the user data] **********************************
2025-09-29 12:37:33.313456 | controller | Monday 29 September 2025  12:37:33 +0000 (0:00:00.062)       0:02:04.145 ******
2025-09-29 12:37:33.313474 | controller | ok: [instance]
2025-09-29 12:37:33.355109 | controller |
2025-09-29 12:37:33.355139 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2025-09-29 12:37:33.355147 | controller | Monday 29 September 2025  12:37:33 +0000 (0:00:00.044)       0:02:04.190 ******
2025-09-29 12:37:33.355171 | controller | skipping: [instance]
2025-09-29 12:37:33.397598 | controller |
2025-09-29 12:37:33.397627 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2025-09-29 12:37:33.397635 | controller | Monday 29 September 2025  12:37:33 +0000 (0:00:00.041)       0:02:04.231 ******
2025-09-29 12:37:33.397645 | controller | skipping: [instance]
2025-09-29 12:37:33.460285 | controller |
2025-09-29 12:37:33.460321 | controller | TASK [Call the config_drive role] **********************************************
2025-09-29 12:37:33.460331 | controller | Monday 29 September 2025  12:37:33 +0000 (0:00:00.042)       0:02:04.274 ******
2025-09-29 12:37:33.460343 | controller |
2025-09-29 12:37:33.460374 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2025-09-29 12:37:33.460392 | controller | Monday 29 September 2025  12:37:33 +0000 (0:00:00.062)       0:02:04.337 ******
2025-09-29 12:37:33.852966 | controller | ok: [instance] => (item=artifacts)
2025-09-29 12:37:35.034608 | controller | ok: [instance] => (item=logs)
2025-09-29 12:37:35.034644 | controller |
2025-09-29 12:37:35.034653 | controller | TASK [config_drive : Install required RPM packages] ****************************
2025-09-29 12:37:35.034659 | controller | Monday 29 September 2025  12:37:33 +0000 (0:00:00.392)       0:02:04.729 ******
2025-09-29 12:37:35.034670 | controller | ok: [instance]
2025-09-29 12:37:35.250645 | controller |
2025-09-29 12:37:35.250678 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2025-09-29 12:37:35.250686 | controller | Monday 29 September 2025  12:37:35 +0000 (0:00:01.181)       0:02:05.911 ******
2025-09-29 12:37:35.250696 | controller | changed: [instance]
2025-09-29 12:37:35.623978 | controller |
2025-09-29 12:37:35.624010 | controller | TASK [config_drive : Generate meta-data] ***************************************
2025-09-29 12:37:35.624024 | controller | Monday 29 September 2025  12:37:35 +0000 (0:00:00.216)       0:02:06.127 ******
2025-09-29 12:37:35.624034 | controller | changed: [instance]
2025-09-29 12:37:36.003912 | controller |
2025-09-29 12:37:36.003945 | controller | TASK [config_drive : Generate user-data] ***************************************
2025-09-29 12:37:36.003954 | controller | Monday 29 September 2025  12:37:35 +0000 (0:00:00.373)       0:02:06.500 ******
2025-09-29 12:37:36.003963 | controller | changed: [instance]
2025-09-29 12:37:36.049252 | controller |
2025-09-29 12:37:36.049275 | controller | TASK [config_drive : Generate network-data] ************************************
2025-09-29 12:37:36.049283 | controller | Monday 29 September 2025  12:37:36 +0000 (0:00:00.379)       0:02:06.880 ******
2025-09-29 12:37:36.049292 | controller | skipping: [instance]
2025-09-29 12:37:36.253064 | controller |
2025-09-29 12:37:36.253096 | controller | TASK [config_drive : Check ISO availability] ***********************************
2025-09-29 12:37:36.253104 | controller | Monday 29 September 2025  12:37:36 +0000 (0:00:00.045)       0:02:06.926 ******
2025-09-29 12:37:36.253113 | controller | ok: [instance]
2025-09-29 12:37:36.295056 | controller |
2025-09-29 12:37:36.295084 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2025-09-29 12:37:36.295092 | controller | Monday 29 September 2025  12:37:36 +0000 (0:00:00.203)       0:02:07.129 ******
2025-09-29 12:37:36.295101 | controller | skipping: [instance]
2025-09-29 12:37:36.538146 | controller |
2025-09-29 12:37:36.538200 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2025-09-29 12:37:36.538208 | controller | Monday 29 September 2025  12:37:36 +0000 (0:00:00.042)       0:02:07.171 ******
2025-09-29 12:37:36.538218 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2025-09-29 12:37:36.808006 | controller | changed: [instance]
2025-09-29 12:37:36.808036 | controller |
2025-09-29 12:37:36.808044 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-09-29 12:37:36.808050 | controller | Monday 29 September 2025  12:37:36 +0000 (0:00:00.242)       0:02:07.414 ******
2025-09-29 12:37:36.808059 | controller | changed: [instance]
2025-09-29 12:37:36.852956 | controller |
2025-09-29 12:37:36.852974 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-09-29 12:37:36.852981 | controller | Monday 29 September 2025  12:37:36 +0000 (0:00:00.269)       0:02:07.684 ******
2025-09-29 12:37:36.852989 | controller | skipping: [instance]
2025-09-29 12:37:37.140360 | controller |
2025-09-29 12:37:37.140427 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2025-09-29 12:37:37.140439 | controller | Monday 29 September 2025  12:37:36 +0000 (0:00:00.045)       0:02:07.729 ******
2025-09-29 12:37:37.140459 | controller | changed: [instance]
2025-09-29 12:37:37.405349 | controller |
2025-09-29 12:37:37.405419 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2025-09-29 12:37:37.405428 | controller | Monday 29 September 2025  12:37:37 +0000 (0:00:00.286)       0:02:08.016 ******
2025-09-29 12:37:37.405443 | controller | changed: [instance]
2025-09-29 12:37:37.405535 | controller |
2025-09-29 12:37:37.405596 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2025-09-29 12:37:37.767106 | controller | Monday 29 September 2025  12:37:37 +0000 (0:00:00.265)       0:02:08.281 ******
2025-09-29 12:37:37.767147 | controller | changed: [instance]
2025-09-29 12:37:37.799402 | controller |
2025-09-29 12:37:37.799454 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2025-09-29 12:37:37.799467 | controller | Monday 29 September 2025  12:37:37 +0000 (0:00:00.361)       0:02:08.643 ******
2025-09-29 12:37:37.799486 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-09-29 12:37:37.848334 | controller |
2025-09-29 12:37:37.848365 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-09-29 12:37:37.848377 | controller | Monday 29 September 2025  12:37:37 +0000 (0:00:00.032)       0:02:08.675 ******
2025-09-29 12:37:37.848393 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-09-29 12:37:37.848783 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-09-29 12:37:37.848805 | controller |
2025-09-29 12:37:38.095986 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-09-29 12:37:38.096009 | controller | Monday 29 September 2025  12:37:37 +0000 (0:00:00.049)       0:02:08.725 ******
2025-09-29 12:37:38.096020 | controller | ok: [instance]
2025-09-29 12:37:38.157048 | controller |
2025-09-29 12:37:38.157081 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-09-29 12:37:38.157094 | controller | Monday 29 September 2025  12:37:38 +0000 (0:00:00.247)       0:02:08.972 ******
2025-09-29 12:37:38.157110 | controller | ok: [instance] => (item=cifmw-public)
2025-09-29 12:37:38.426228 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:37:38.426261 | controller |
2025-09-29 12:37:38.426269 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-09-29 12:37:38.426281 | controller | Monday 29 September 2025  12:37:38 +0000 (0:00:00.060)       0:02:09.033 ******
2025-09-29 12:37:38.426292 | controller | ok: [instance]
2025-09-29 12:37:38.426318 | controller |
2025-09-29 12:37:38.426326 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-09-29 12:37:38.426540 | controller | Monday 29 September 2025  12:37:38 +0000 (0:00:00.269)       0:02:09.302 ******
2025-09-29 12:37:38.638271 | controller | ok: [instance]
2025-09-29 12:37:38.954135 | controller |
2025-09-29 12:37:38.954184 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2025-09-29 12:37:38.954195 | controller | Monday 29 September 2025  12:37:38 +0000 (0:00:00.211)       0:02:09.514 ******
2025-09-29 12:37:38.954211 | controller | changed: [instance]
2025-09-29 12:37:39.203263 | controller |
2025-09-29 12:37:39.203561 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-09-29 12:37:39.203572 | controller | Monday 29 September 2025  12:37:38 +0000 (0:00:00.315)       0:02:09.830 ******
2025-09-29 12:37:39.203586 | controller | ok: [instance]
2025-09-29 12:37:39.252363 | controller |
2025-09-29 12:37:39.252413 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-09-29 12:37:39.252423 | controller | Monday 29 September 2025  12:37:39 +0000 (0:00:00.249)       0:02:10.079 ******
2025-09-29 12:37:39.252438 | controller | ok: [instance] => (item=cifmw-public)
2025-09-29 12:37:39.252473 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-09-29 12:37:39.252481 | controller |
2025-09-29 12:37:39.252490 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-09-29 12:37:39.503883 | controller | Monday 29 September 2025  12:37:39 +0000 (0:00:00.049)       0:02:10.128 ******
2025-09-29 12:37:39.503912 | controller | ok: [instance]
2025-09-29 12:37:39.717979 | controller |
2025-09-29 12:37:39.718001 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-09-29 12:37:39.718010 | controller | Monday 29 September 2025  12:37:39 +0000 (0:00:00.251)       0:02:10.380 ******
2025-09-29 12:37:39.718020 | controller | ok: [instance]
2025-09-29 12:37:40.018067 | controller |
2025-09-29 12:37:40.018094 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2025-09-29 12:37:40.018102 | controller | Monday 29 September 2025  12:37:39 +0000 (0:00:00.214)       0:02:10.594 ******
2025-09-29 12:37:40.018112 | controller | changed: [instance]
2025-09-29 12:37:40.041027 | controller |
2025-09-29 12:37:40.041043 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2025-09-29 12:37:40.041050 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.300)       0:02:10.894 ******
2025-09-29 12:37:40.041058 | controller | skipping: [instance]
2025-09-29 12:37:40.069669 | controller |
2025-09-29 12:37:40.069688 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2025-09-29 12:37:40.069696 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.023)       0:02:10.917 ******
2025-09-29 12:37:40.069706 | controller | skipping: [instance]
2025-09-29 12:37:40.098311 | controller |
2025-09-29 12:37:40.098349 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2025-09-29 12:37:40.098360 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.028)       0:02:10.946 ******
2025-09-29 12:37:40.098373 | controller | skipping: [instance]
2025-09-29 12:37:40.098418 | controller |
2025-09-29 12:37:40.098720 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2025-09-29 12:37:40.127044 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.028)       0:02:10.975 ******
2025-09-29 12:37:40.127070 | controller | skipping: [instance]
2025-09-29 12:37:40.367302 | controller |
2025-09-29 12:37:40.367368 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-09-29 12:37:40.367378 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.028)       0:02:11.003 ******
2025-09-29 12:37:40.367393 | controller | changed: [instance]
2025-09-29 12:37:40.367432 | controller |
2025-09-29 12:37:40.367441 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-09-29 12:37:40.407097 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.240)       0:02:11.244 ******
2025-09-29 12:37:40.407130 | controller | ok: [instance]
2025-09-29 12:37:40.438329 | controller |
2025-09-29 12:37:40.438379 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-09-29 12:37:40.438390 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.039)       0:02:11.283 ******
2025-09-29 12:37:40.438404 | controller | skipping: [instance]
2025-09-29 12:37:40.438438 | controller |
2025-09-29 12:37:40.438448 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-09-29 12:37:40.438490 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.031)       0:02:11.315 ******
2025-09-29 12:37:40.466325 | controller | skipping: [instance]
2025-09-29 12:37:40.466389 | controller |
2025-09-29 12:37:40.466401 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-09-29 12:37:40.466447 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.028)       0:02:11.343 ******
2025-09-29 12:37:40.513883 | controller | skipping: [instance]
2025-09-29 12:37:40.576609 | controller |
2025-09-29 12:37:40.576631 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2025-09-29 12:37:40.576641 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.047)       0:02:11.390 ******
2025-09-29 12:37:40.576652 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2025-09-29 12:37:40.848261 | controller |
2025-09-29 12:37:40.848310 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2025-09-29 12:37:40.848319 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.062)       0:02:11.453 ******
2025-09-29 12:37:40.848332 | controller | ok: [instance] => (item=crc)
2025-09-29 12:37:40.848370 | controller |
2025-09-29 12:37:40.848532 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2025-09-29 12:37:42.921333 | controller | Monday 29 September 2025  12:37:40 +0000 (0:00:00.271)       0:02:11.725 ******
2025-09-29 12:37:42.921387 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-09-29 12:37:42.921418 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-09-29 12:37:42.921426 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-09-29 12:37:42.921436 | controller |
2025-09-29 12:37:42.921521 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-09-29 12:37:42.921544 | controller | Monday 29 September 2025  12:37:42 +0000 (0:00:02.072)       0:02:13.797 ******
2025-09-29 12:37:43.840263 | controller | changed: [instance]
2025-09-29 12:37:43.840318 | controller |
2025-09-29 12:37:43.840330 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-09-29 12:37:43.840460 | controller | Monday 29 September 2025  12:37:43 +0000 (0:00:00.919)       0:02:14.716 ******
2025-09-29 12:37:44.702803 | controller | changed: [instance]
2025-09-29 12:37:45.623127 | controller |
2025-09-29 12:37:45.623173 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-09-29 12:37:45.623184 | controller | Monday 29 September 2025  12:37:44 +0000 (0:00:00.862)       0:02:15.579 ******
2025-09-29 12:37:45.623201 | controller | changed: [instance]
2025-09-29 12:37:45.623222 | controller |
2025-09-29 12:37:45.623235 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2025-09-29 12:37:45.623330 | controller | Monday 29 September 2025  12:37:45 +0000 (0:00:00.920)       0:02:16.499 ******
2025-09-29 12:37:46.388434 | controller | changed: [instance] => (item=compute-0.utility)
2025-09-29 12:37:46.388506 | controller | changed: [instance] => (item=controller-0.utility)
2025-09-29 12:37:46.388845 | controller | changed: [instance] => (item=crc-0.utility)
2025-09-29 12:37:46.388892 | controller |
2025-09-29 12:38:06.250480 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2025-09-29 12:38:06.250522 | controller | Monday 29 September 2025  12:37:46 +0000 (0:00:00.765)       0:02:17.264 ******
2025-09-29 12:38:06.250535 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2025-09-29 12:38:06.250759 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2025-09-29 12:38:06.250802 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2025-09-29 12:38:06.250810 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2025-09-29 12:38:06.250816 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2025-09-29 12:38:06.250822 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j85283086744.23736', 'results_file': '/home/zuul/.ansible_async/j85283086744.23736', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2025-09-29 12:38:06.250841 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2025-09-29 12:38:06.250847 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j688059441888.23753', 'results_file': '/home/zuul/.ansible_async/j688059441888.23753', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2025-09-29 12:38:06.250853 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j559997012107.23769', 'results_file': '/home/zuul/.ansible_async/j559997012107.23769', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2025-09-29 12:38:06.250864 | controller |
2025-09-29 12:38:06.364666 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2025-09-29 12:38:06.364689 | controller | Monday 29 September 2025  12:38:06 +0000 (0:00:19.861)       0:02:37.126 ******
2025-09-29 12:38:06.364718 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-09-29 12:38:06.397381 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-09-29 12:38:06.397401 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-09-29 12:38:06.397409 | controller |
2025-09-29 12:38:06.397416 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-09-29 12:38:06.397422 | controller | Monday 29 September 2025  12:38:06 +0000 (0:00:00.113)       0:02:37.240 ******
2025-09-29 12:38:06.397432 | controller | skipping: [instance]
2025-09-29 12:38:06.439297 | controller |
2025-09-29 12:38:06.439321 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2025-09-29 12:38:06.439330 | controller | Monday 29 September 2025  12:38:06 +0000 (0:00:00.034)       0:02:37.274 ******
2025-09-29 12:38:06.439343 | controller |
2025-09-29 12:38:06.439557 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-09-29 12:38:06.439699 | controller | Monday 29 September 2025  12:38:06 +0000 (0:00:00.042)       0:02:37.316 ******
2025-09-29 12:38:06.524387 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2025-09-29 12:38:06.524540 | controller |
2025-09-29 12:38:06.524679 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-09-29 12:38:06.524845 | controller | Monday 29 September 2025  12:38:06 +0000 (0:00:00.085)       0:02:37.401 ******
2025-09-29 12:38:06.772502 | controller | changed: [instance]
2025-09-29 12:38:07.009933 | controller |
2025-09-29 12:38:07.009965 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-09-29 12:38:07.009974 | controller | Monday 29 September 2025  12:38:06 +0000 (0:00:00.247)       0:02:37.648 ******
2025-09-29 12:38:07.009985 | controller | changed: [instance]
2025-09-29 12:38:07.010014 | controller |
2025-09-29 12:38:07.010022 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2025-09-29 12:38:07.010212 | controller | Monday 29 September 2025  12:38:07 +0000 (0:00:00.237)       0:02:37.886 ******
2025-09-29 12:38:07.433349 | controller | changed: [instance]
2025-09-29 12:38:07.460622 | controller |
2025-09-29 12:38:07.460641 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2025-09-29 12:38:07.460650 | controller | Monday 29 September 2025  12:38:07 +0000 (0:00:00.423)       0:02:38.309 ******
2025-09-29 12:38:07.460668 | controller | skipping: [instance]
2025-09-29 12:38:07.460884 | controller |
2025-09-29 12:38:07.461021 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-09-29 12:38:07.461205 | controller | Monday 29 September 2025  12:38:07 +0000 (0:00:00.028)       0:02:38.337 ******
2025-09-29 12:38:07.491620 | controller | skipping: [instance]
2025-09-29 12:38:07.549139 | controller |
2025-09-29 12:38:07.549186 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2025-09-29 12:38:07.549196 | controller | Monday 29 September 2025  12:38:07 +0000 (0:00:00.030)       0:02:38.368 ******
2025-09-29 12:38:07.549207 | controller | skipping: [instance]
2025-09-29 12:38:07.606857 | controller |
2025-09-29 12:38:07.606886 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2025-09-29 12:38:07.606896 | controller | Monday 29 September 2025  12:38:07 +0000 (0:00:00.056)       0:02:38.425 ******
2025-09-29 12:38:07.606907 | controller | skipping: [instance]
2025-09-29 12:38:07.640436 | controller |
2025-09-29 12:38:07.640467 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-09-29 12:38:07.640476 | controller | Monday 29 September 2025  12:38:07 +0000 (0:00:00.058)       0:02:38.483 ******
2025-09-29 12:38:07.640488 | controller | skipping: [instance]
2025-09-29 12:38:07.689684 | controller |
2025-09-29 12:38:07.689727 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2025-09-29 12:38:07.689738 | controller | Monday 29 September 2025  12:38:07 +0000 (0:00:00.033)       0:02:38.516 ******
2025-09-29 12:38:07.689753 | controller |
2025-09-29 12:38:07.790511 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-09-29 12:38:07.790545 | controller | Monday 29 September 2025  12:38:07 +0000 (0:00:00.049)       0:02:38.566 ******
2025-09-29 12:38:07.790560 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2025-09-29 12:38:08.031649 | controller |
2025-09-29 12:38:08.031714 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-09-29 12:38:08.031724 | controller | Monday 29 September 2025  12:38:07 +0000 (0:00:00.100)       0:02:38.666 ******
2025-09-29 12:38:08.031737 | controller | ok: [instance]
2025-09-29 12:38:08.031757 | controller |
2025-09-29 12:38:08.031844 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-09-29 12:38:08.031952 | controller | Monday 29 September 2025  12:38:08 +0000 (0:00:00.241)       0:02:38.908 ******
2025-09-29 12:38:08.271469 | controller | ok: [instance]
2025-09-29 12:38:08.271542 | controller |
2025-09-29 12:38:08.271740 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2025-09-29 12:38:08.271849 | controller | Monday 29 September 2025  12:38:08 +0000 (0:00:00.239)       0:02:39.147 ******
2025-09-29 12:38:08.664448 | controller | changed: [instance]
2025-09-29 12:38:08.704455 | controller |
2025-09-29 12:38:08.704565 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2025-09-29 12:38:08.704575 | controller | Monday 29 September 2025  12:38:08 +0000 (0:00:00.393)       0:02:39.540 ******
2025-09-29 12:38:08.704594 | controller | skipping: [instance]
2025-09-29 12:38:08.743226 | controller |
2025-09-29 12:38:08.743288 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-09-29 12:38:08.743300 | controller | Monday 29 September 2025  12:38:08 +0000 (0:00:00.040)       0:02:39.580 ******
2025-09-29 12:38:08.743317 | controller | skipping: [instance]
2025-09-29 12:38:10.400281 | controller |
2025-09-29 12:38:10.400329 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2025-09-29 12:38:10.400338 | controller | Monday 29 September 2025  12:38:08 +0000 (0:00:00.038)       0:02:39.619 ******
2025-09-29 12:38:10.400351 | controller | changed: [instance -> controller-0.instance]
2025-09-29 12:38:10.400378 | controller |
2025-09-29 12:38:10.400458 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2025-09-29 12:38:10.400563 | controller | Monday 29 September 2025  12:38:10 +0000 (0:00:01.657)       0:02:41.276 ******
2025-09-29 12:38:11.559933 | controller | changed: [instance -> controller-0.instance]
2025-09-29 12:38:11.560116 | controller |
2025-09-29 12:38:11.560167 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-09-29 12:38:11.612125 | controller | Monday 29 September 2025  12:38:11 +0000 (0:00:01.159)       0:02:42.436 ******
2025-09-29 12:38:11.612193 | controller |
2025-09-29 12:38:11.612249 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2025-09-29 12:38:11.612263 | controller | Monday 29 September 2025  12:38:11 +0000 (0:00:00.052)       0:02:42.488 ******
2025-09-29 12:38:11.841216 | controller | ok: [instance]
2025-09-29 12:38:11.841300 | controller |
2025-09-29 12:38:11.841408 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2025-09-29 12:38:11.841509 | controller | Monday 29 September 2025  12:38:11 +0000 (0:00:00.229)       0:02:42.717 ******
2025-09-29 12:38:11.867653 | controller | ok: [instance]
2025-09-29 12:38:11.867764 | controller |
2025-09-29 12:38:11.867889 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2025-09-29 12:38:11.867990 | controller | Monday 29 September 2025  12:38:11 +0000 (0:00:00.026)       0:02:42.744 ******
2025-09-29 12:38:11.901561 | controller | skipping: [instance]
2025-09-29 12:38:11.901647 | controller |
2025-09-29 12:38:11.901765 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2025-09-29 12:38:11.901893 | controller | Monday 29 September 2025  12:38:11 +0000 (0:00:00.033)       0:02:42.778 ******
2025-09-29 12:38:11.955752 | controller |
2025-09-29 12:38:11.955884 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-09-29 12:38:11.956000 | controller | Monday 29 September 2025  12:38:11 +0000 (0:00:00.054)       0:02:42.832 ******
2025-09-29 12:38:12.040426 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2025-09-29 12:38:12.040518 | controller |
2025-09-29 12:38:12.040626 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-09-29 12:38:12.040743 | controller | Monday 29 September 2025  12:38:12 +0000 (0:00:00.084)       0:02:42.916 ******
2025-09-29 12:38:12.284169 | controller | ok: [instance]
2025-09-29 12:38:12.284235 | controller |
2025-09-29 12:38:12.284336 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-09-29 12:38:12.284439 | controller | Monday 29 September 2025  12:38:12 +0000 (0:00:00.243)       0:02:43.160 ******
2025-09-29 12:38:12.536562 | controller | ok: [instance]
2025-09-29 12:38:12.536602 | controller |
2025-09-29 12:38:12.536738 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2025-09-29 12:38:12.536845 | controller | Monday 29 September 2025  12:38:12 +0000 (0:00:00.252)       0:02:43.412 ******
2025-09-29 12:38:12.979410 | controller | changed: [instance]
2025-09-29 12:38:12.979471 | controller |
2025-09-29 12:38:12.979525 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2025-09-29 12:38:12.979650 | controller | Monday 29 September 2025  12:38:12 +0000 (0:00:00.443)       0:02:43.855 ******
2025-09-29 12:38:13.753232 | controller | changed: [instance]
2025-09-29 12:38:13.753320 | controller |
2025-09-29 12:38:13.753343 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-09-29 12:38:13.753482 | controller | Monday 29 September 2025  12:38:13 +0000 (0:00:00.773)       0:02:44.629 ******
2025-09-29 12:38:13.781484 | controller | skipping: [instance]
2025-09-29 12:38:13.781566 | controller |
2025-09-29 12:38:13.781665 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2025-09-29 12:38:13.781778 | controller | Monday 29 September 2025  12:38:13 +0000 (0:00:00.029)       0:02:44.658 ******
2025-09-29 12:38:13.830820 | controller | skipping: [instance]
2025-09-29 12:38:13.830925 | controller |
2025-09-29 12:38:13.831046 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2025-09-29 12:38:13.831167 | controller | Monday 29 September 2025  12:38:13 +0000 (0:00:00.048)       0:02:44.707 ******
2025-09-29 12:38:13.877487 | controller | skipping: [instance]
2025-09-29 12:38:13.877601 | controller |
2025-09-29 12:38:13.877736 | controller | TASK [Create VBMC entity] ******************************************************
2025-09-29 12:38:13.877945 | controller | Monday 29 September 2025  12:38:13 +0000 (0:00:00.046)       0:02:44.754 ******
2025-09-29 12:38:13.942177 | controller | skipping: [instance] => (item=compute-0)
2025-09-29 12:38:13.942246 | controller | skipping: [instance] => (item=controller-0)
2025-09-29 12:38:13.942351 | controller | skipping: [instance] => (item=crc-0)
2025-09-29 12:38:13.942449 | controller | skipping: [instance]
2025-09-29 12:38:13.942544 | controller |
2025-09-29 12:38:13.942657 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2025-09-29 12:38:13.942769 | controller | Monday 29 September 2025  12:38:13 +0000 (0:00:00.064)       0:02:44.819 ******
2025-09-29 12:38:14.203226 | controller | ok: [instance]
2025-09-29 12:38:14.203315 | controller |
2025-09-29 12:38:14.203436 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2025-09-29 12:38:14.203521 | controller | Monday 29 September 2025  12:38:14 +0000 (0:00:00.260)       0:02:45.079 ******
2025-09-29 12:38:14.620524 | controller | changed: [instance]
2025-09-29 12:38:14.620704 | controller |
2025-09-29 12:38:14.620799 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2025-09-29 12:38:14.620922 | controller | Monday 29 September 2025  12:38:14 +0000 (0:00:00.417)       0:02:45.496 ******
2025-09-29 12:38:14.656898 | controller | skipping: [instance]
2025-09-29 12:38:14.657067 | controller |
2025-09-29 12:38:14.657134 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2025-09-29 12:38:14.657179 | controller | Monday 29 September 2025  12:38:14 +0000 (0:00:00.037)       0:02:45.533 ******
2025-09-29 12:38:14.699359 | controller | skipping: [instance]
2025-09-29 12:38:14.699541 | controller |
2025-09-29 12:38:14.699722 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2025-09-29 12:38:14.699871 | controller | Monday 29 September 2025  12:38:14 +0000 (0:00:00.042)       0:02:45.576 ******
2025-09-29 12:38:14.741959 | controller | skipping: [instance]
2025-09-29 12:38:15.507438 | controller |
2025-09-29 12:38:15.507504 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2025-09-29 12:38:15.507541 | controller | Monday 29 September 2025  12:38:14 +0000 (0:00:00.042)       0:02:45.618 ******
2025-09-29 12:38:15.507556 | controller | changed: [instance]
2025-09-29 12:38:15.507577 | controller |
2025-09-29 12:38:15.507583 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2025-09-29 12:38:15.507590 | controller | Monday 29 September 2025  12:38:15 +0000 (0:00:00.764)       0:02:46.383 ******
2025-09-29 12:38:16.219313 | controller | changed: [instance]
2025-09-29 12:38:16.219522 | controller |
2025-09-29 12:38:16.219671 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2025-09-29 12:38:16.219761 | controller | Monday 29 September 2025  12:38:16 +0000 (0:00:00.711)       0:02:47.095 ******
2025-09-29 12:38:16.259804 | controller | skipping: [instance]
2025-09-29 12:38:16.327028 | controller |
2025-09-29 12:38:16.327048 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2025-09-29 12:38:16.327057 | controller | Monday 29 September 2025  12:38:16 +0000 (0:00:00.041)       0:02:47.136 ******
2025-09-29 12:38:16.327068 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2025-09-29 12:38:16.375207 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2025-09-29 12:38:16.375272 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2025-09-29 12:38:16.375298 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2025-09-29 12:38:16.375307 | controller |
2025-09-29 12:38:16.375315 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2025-09-29 12:38:16.375323 | controller | Monday 29 September 2025  12:38:16 +0000 (0:00:00.066)       0:02:47.203 ******
2025-09-29 12:38:16.375341 | controller | skipping: [instance]
2025-09-29 12:38:16.418105 | controller |
2025-09-29 12:38:16.418133 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2025-09-29 12:38:16.418142 | controller | Monday 29 September 2025  12:38:16 +0000 (0:00:00.046)       0:02:47.249 ******
2025-09-29 12:38:16.418167 | controller | skipping: [instance]
2025-09-29 12:38:16.475472 | controller |
2025-09-29 12:38:16.475553 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2025-09-29 12:38:16.475562 | controller | Monday 29 September 2025  12:38:16 +0000 (0:00:00.044)       0:02:47.294 ******
2025-09-29 12:38:16.475577 | controller | skipping: [instance]
2025-09-29 12:38:16.524879 | controller |
2025-09-29 12:38:16.524941 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2025-09-29 12:38:16.524959 | controller | Monday 29 September 2025  12:38:16 +0000 (0:00:00.057)       0:02:47.352 ******
2025-09-29 12:38:16.524974 | controller | skipping: [instance]
2025-09-29 12:38:16.525143 | controller |
2025-09-29 12:38:16.525183 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2025-09-29 12:38:16.525322 | controller | Monday 29 September 2025  12:38:16 +0000 (0:00:00.049)       0:02:47.401 ******
2025-09-29 12:38:17.187459 | controller | changed: [instance]
2025-09-29 12:38:17.187540 | controller |
2025-09-29 12:38:17.187550 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2025-09-29 12:38:17.187561 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.662)       0:02:48.063 ******
2025-09-29 12:38:17.219389 | controller | skipping: [instance]
2025-09-29 12:38:17.219459 | controller |
2025-09-29 12:38:17.219470 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2025-09-29 12:38:17.219483 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.032)       0:02:48.095 ******
2025-09-29 12:38:17.252398 | controller | skipping: [instance]
2025-09-29 12:38:17.252495 | controller |
2025-09-29 12:38:17.252506 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2025-09-29 12:38:17.252713 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.033)       0:02:48.129 ******
2025-09-29 12:38:17.283840 | controller | skipping: [instance]
2025-09-29 12:38:17.317928 | controller |
2025-09-29 12:38:17.317970 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2025-09-29 12:38:17.317979 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.030)       0:02:48.160 ******
2025-09-29 12:38:17.317996 | controller | skipping: [instance]
2025-09-29 12:38:17.349483 | controller |
2025-09-29 12:38:17.349506 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2025-09-29 12:38:17.349515 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.034)       0:02:48.194 ******
2025-09-29 12:38:17.349526 | controller | skipping: [instance]
2025-09-29 12:38:17.349703 | controller |
2025-09-29 12:38:17.349877 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2025-09-29 12:38:17.350041 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.032)       0:02:48.226 ******
2025-09-29 12:38:17.381828 | controller | skipping: [instance]
2025-09-29 12:38:17.382025 | controller |
2025-09-29 12:38:17.382218 | controller | TASK [openshift_login : Assert files exist] ************************************
2025-09-29 12:38:17.382359 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.032)       0:02:48.258 ******
2025-09-29 12:38:17.417201 | controller | skipping: [instance]
2025-09-29 12:38:17.417365 | controller |
2025-09-29 12:38:17.417509 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2025-09-29 12:38:17.417650 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.035)       0:02:48.294 ******
2025-09-29 12:38:17.449830 | controller | skipping: [instance]
2025-09-29 12:38:17.449993 | controller |
2025-09-29 12:38:17.450852 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2025-09-29 12:38:17.451006 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.032)       0:02:48.326 ******
2025-09-29 12:38:17.487744 | controller | skipping: [instance]
2025-09-29 12:38:17.487926 | controller |
2025-09-29 12:38:17.488070 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2025-09-29 12:38:17.488230 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.037)       0:02:48.364 ******
2025-09-29 12:38:17.534629 | controller | skipping: [instance]
2025-09-29 12:38:17.534804 | controller |
2025-09-29 12:38:17.534944 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2025-09-29 12:38:17.535077 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.047)       0:02:48.411 ******
2025-09-29 12:38:17.569814 | controller | skipping: [instance]
2025-09-29 12:38:17.569981 | controller |
2025-09-29 12:38:17.570121 | controller | TASK [reproducer : Configure Controller node] **********************************
2025-09-29 12:38:17.570295 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.035)       0:02:48.446 ******
2025-09-29 12:38:17.774141 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2025-09-29 12:38:17.804137 | controller |
2025-09-29 12:38:17.804186 | controller | TASK [reproducer : Set facts related to the reproducer] ************************
2025-09-29 12:38:17.804195 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.202)       0:02:48.649 ******
2025-09-29 12:38:17.804206 | controller | ok: [instance]
2025-09-29 12:38:19.090832 | controller |
2025-09-29 12:38:19.090887 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2025-09-29 12:38:19.090897 | controller | Monday 29 September 2025  12:38:17 +0000 (0:00:00.031)       0:02:48.680 ******
2025-09-29 12:38:19.090910 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2025-09-29 12:38:19.090979 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2025-09-29 12:38:19.090989 | controller |
2025-09-29 12:38:19.090994 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2025-09-29 12:38:19.091003 | controller | Monday 29 September 2025  12:38:19 +0000 (0:00:01.285)       0:02:49.966 ******
2025-09-29 12:38:19.116594 | controller | skipping: [instance]
2025-09-29 12:38:19.740057 | controller |
2025-09-29 12:38:19.740126 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2025-09-29 12:38:19.740136 | controller | Monday 29 September 2025  12:38:19 +0000 (0:00:00.026)       0:02:49.993 ******
2025-09-29 12:38:19.740230 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-09-29 12:38:19.784109 | controller |
2025-09-29 12:38:19.784130 | controller | TASK [install_ca : Install internal CA from url] *******************************
2025-09-29 12:38:19.784137 | controller | Monday 29 September 2025  12:38:19 +0000 (0:00:00.622)       0:02:50.615 ******
2025-09-29 12:38:19.784167 | controller | skipping: [instance]
2025-09-29 12:38:19.824972 | controller |
2025-09-29 12:38:19.824991 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2025-09-29 12:38:19.824998 | controller | Monday 29 September 2025  12:38:19 +0000 (0:00:00.044)       0:02:50.660 ******
2025-09-29 12:38:19.825006 | controller | skipping: [instance]
2025-09-29 12:38:19.865650 | controller |
2025-09-29 12:38:19.865668 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2025-09-29 12:38:19.865675 | controller | Monday 29 September 2025  12:38:19 +0000 (0:00:00.041)       0:02:50.701 ******
2025-09-29 12:38:19.865703 | controller | skipping: [instance]
2025-09-29 12:38:21.408314 | controller |
2025-09-29 12:38:21.408358 | controller | TASK [install_ca : Update ca bundle] *******************************************
2025-09-29 12:38:21.408366 | controller | Monday 29 September 2025  12:38:19 +0000 (0:00:00.040)       0:02:50.742 ******
2025-09-29 12:38:21.408378 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-09-29 12:38:21.408412 | controller |
2025-09-29 12:38:21.408421 | controller | TASK [reproducer : Get rhos-release] *******************************************
2025-09-29 12:38:21.408447 | controller | Monday 29 September 2025  12:38:21 +0000 (0:00:01.541)       0:02:52.284 ******
2025-09-29 12:38:21.456511 | controller | skipping: [instance]
2025-09-29 12:38:21.498636 | controller |
2025-09-29 12:38:21.498660 | controller | TASK [reproducer : Install repos] **********************************************
2025-09-29 12:38:21.498671 | controller | Monday 29 September 2025  12:38:21 +0000 (0:00:00.048)       0:02:52.332 ******
2025-09-29 12:38:21.498694 | controller | skipping: [instance]
2025-09-29 12:38:21.539614 | controller |
2025-09-29 12:38:21.539633 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2025-09-29 12:38:21.539642 | controller | Monday 29 September 2025  12:38:21 +0000 (0:00:00.043)       0:02:52.375 ******
2025-09-29 12:38:21.539652 | controller | skipping: [instance]
2025-09-29 12:38:21.582463 | controller |
2025-09-29 12:38:21.582482 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2025-09-29 12:38:21.582489 | controller | Monday 29 September 2025  12:38:21 +0000 (0:00:00.040)       0:02:52.416 ******
2025-09-29 12:38:21.582498 | controller | skipping: [instance]
2025-09-29 12:38:22.827819 | controller |
2025-09-29 12:38:22.827883 | controller | TASK [reproducer : Install some tools] *****************************************
2025-09-29 12:38:22.827892 | controller | Monday 29 September 2025  12:38:21 +0000 (0:00:00.042)       0:02:52.459 ******
2025-09-29 12:38:22.827907 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-09-29 12:38:23.958117 | controller |
2025-09-29 12:38:23.958169 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2025-09-29 12:38:23.958181 | controller | Monday 29 September 2025  12:38:22 +0000 (0:00:01.244)       0:02:53.703 ******
2025-09-29 12:38:23.958192 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-09-29 12:38:24.625848 | controller |
2025-09-29 12:38:24.625882 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2025-09-29 12:38:24.625889 | controller | Monday 29 September 2025  12:38:23 +0000 (0:00:01.131)       0:02:54.834 ******
2025-09-29 12:38:24.625900 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-09-29 12:38:25.653009 | controller |
2025-09-29 12:38:25.653049 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2025-09-29 12:38:25.653059 | controller | Monday 29 September 2025  12:38:24 +0000 (0:00:00.667)       0:02:55.502 ******
2025-09-29 12:38:25.653072 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-09-29 12:38:26.942602 | controller |
2025-09-29 12:38:26.942692 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2025-09-29 12:38:26.942702 | controller | Monday 29 September 2025  12:38:25 +0000 (0:00:01.027)       0:02:56.529 ******
2025-09-29 12:38:26.942713 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2025-09-29 12:38:26.943064 | controller | skipping: [instance] => (item=compute-0)
2025-09-29 12:38:26.943650 | controller | skipping: [instance] => (item=controller-0)
2025-09-29 12:38:26.943852 | controller | skipping: [instance] => (item=crc-0)
2025-09-29 12:38:26.944144 | controller |
2025-09-29 12:38:26.944505 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2025-09-29 12:38:27.029957 | controller | Monday 29 September 2025  12:38:26 +0000 (0:00:01.289)       0:02:57.818 ******
2025-09-29 12:38:27.029981 | controller | fatal: [instance -> controller-0]: FAILED! =>
2025-09-29 12:38:27.040891 | controller |   msg: |-
2025-09-29 12:38:27.040914 | controller |     The task includes an option with an undefined variable. The error was: 'anisble_user_id' is undefined. 'anisble_user_id' is undefined
2025-09-29 12:38:27.040922 | controller |
2025-09-29 12:38:27.040928 | controller |     The error appears to be in '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml': line 160, column 7, but may
2025-09-29 12:38:27.040934 | controller |     be elsewhere in the file depending on the exact syntax problem.
2025-09-29 12:38:27.040939 | controller |
2025-09-29 12:38:27.040944 | controller |     The offending line appears to be:
2025-09-29 12:38:27.040950 | controller |
2025-09-29 12:38:27.040956 | controller |         # options set in the ansible inventory.
2025-09-29 12:38:27.040961 | controller |         - name: Inject remote hypervisor SSH configuration
2025-09-29 12:38:27.040972 | controller |           ^ here
2025-09-29 12:38:27.040981 | controller |
2025-09-29 12:38:27.271715 | controller | TASK [Create dnsmasq dir] ******************************************************
2025-09-29 12:38:27.271741 | controller | Monday 29 September 2025  12:38:27 +0000 (0:00:00.098)       0:02:57.917 ******
2025-09-29 12:38:27.271753 | controller | changed: [instance]
2025-09-29 12:38:27.516873 | controller |
2025-09-29 12:38:27.516897 | controller | TASK [Get journalctl in a file] ************************************************
2025-09-29 12:38:27.516904 | controller | Monday 29 September 2025  12:38:27 +0000 (0:00:00.230)       0:02:58.148 ******
2025-09-29 12:38:27.516915 | controller | changed: [instance]
2025-09-29 12:38:27.950620 | controller |
2025-09-29 12:38:27.950652 | controller | TASK [Dump journalctl output] **************************************************
2025-09-29 12:38:27.950660 | controller | Monday 29 September 2025  12:38:27 +0000 (0:00:00.241)       0:02:58.389 ******
2025-09-29 12:38:27.950670 | controller | changed: [instance]
2025-09-29 12:38:28.677248 | controller |
2025-09-29 12:38:28.677281 | controller | TASK [Copy all dnsmasq config] *************************************************
2025-09-29 12:38:28.677289 | controller | Monday 29 September 2025  12:38:27 +0000 (0:00:00.437)       0:02:58.826 ******
2025-09-29 12:38:28.677299 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2025-09-29 12:38:28.891637 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2025-09-29 12:38:28.891669 | controller |
2025-09-29 12:38:28.891689 | controller | TASK [Create log directory] ****************************************************
2025-09-29 12:38:28.891701 | controller | Monday 29 September 2025  12:38:28 +0000 (0:00:00.726)       0:02:59.553 ******
2025-09-29 12:38:28.891711 | controller | changed: [instance]
2025-09-29 12:38:29.899269 | controller |
2025-09-29 12:38:29.899304 | controller | TASK [Sync logs from controller-0] *********************************************
2025-09-29 12:38:29.899313 | controller | Monday 29 September 2025  12:38:28 +0000 (0:00:00.214)       0:02:59.768 ******
2025-09-29 12:38:29.899323 | controller | changed: [instance]
2025-09-29 12:38:29.899771 | controller |
2025-09-29 12:38:29.899783 | controller | PLAY RECAP *********************************************************************
2025-09-29 12:38:29.899796 | controller | instance                   : ok=380  changed=128  unreachable=0    failed=1    skipped=122  rescued=0    ignored=0
2025-09-29 12:38:29.899803 | controller |
2025-09-29 12:38:29.899808 | controller | Monday 29 September 2025  12:38:29 +0000 (0:00:01.005)       0:03:00.773 ******
2025-09-29 12:38:29.899814 | controller | ===============================================================================
2025-09-29 12:38:29.899819 | controller | libvirt_manager : Download base image ---------------------------------- 19.98s
2025-09-29 12:38:29.899824 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.86s
2025-09-29 12:38:29.899830 | controller | libvirt_manager : Install packages required for using KVM -------------- 10.01s
2025-09-29 12:38:29.899835 | controller | ci_nmstate : Install required packages on localhost --------------------- 7.66s
2025-09-29 12:38:29.899840 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.79s
2025-09-29 12:38:29.899846 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.14s
2025-09-29 12:38:29.899851 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s
2025-09-29 12:38:29.899856 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.02s
2025-09-29 12:38:29.899862 | controller | libvirt_manager : Inject private key on hosts controller-0 -------------- 1.66s
2025-09-29 12:38:29.899867 | controller | ci_nmstate : Apply the desidered state on instance ---------------------- 1.65s
2025-09-29 12:38:29.899872 | controller | ci_nmstate : Apply the desidered state on localhost --------------------- 1.62s
2025-09-29 12:38:29.899877 | controller | discover_latest_image : Get latest image -------------------------------- 1.58s
2025-09-29 12:38:29.899883 | controller | install_ca : Update ca bundle ------------------------------------------- 1.54s
2025-09-29 12:38:29.899888 | controller | reproducer : Restart NetworkManager ------------------------------------- 1.34s
2025-09-29 12:38:29.899893 | controller | libvirt_manager : Attach interface public on cifmw-compute-0 ------------ 1.29s
2025-09-29 12:38:29.899906 | controller | reproducer : Inject other Hypervisor SSH keys --------------------------- 1.29s
2025-09-29 12:38:29.998418 | controller | reproducer : Ensure directories exist ----------------------------------- 1.29s
2025-09-29 12:38:29.998450 | controller | reproducer : Install some tools ----------------------------------------- 1.24s
2025-09-29 12:38:29.998458 | controller | config_drive : Install required RPM packages ---------------------------- 1.21s
2025-09-29 12:38:29.998464 | controller | ci_nmstate : Install required packages on instance ---------------------- 1.21s
2025-09-29 12:38:29.998475 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml']
2025-09-29 12:38:30.001327 | controller | WARNING  An error occurred during the test sequence action: 'converge'. Cleaning up.
2025-09-29 12:38:30.007139 | controller | INFO     Running crc_layout > cleanup
2025-09-29 12:38:30.007622 | controller | WARNING  Skipping, cleanup playbook not configured.
2025-09-29 12:38:30.014799 | controller | INFO     Running crc_layout > destroy
2025-09-29 12:38:30.015134 | controller | WARNING  Skipping, instances are delegated.
2025-09-29 12:38:30.015496 | controller | INFO     Pruning extra files from scenario ephemeral directory
2025-09-29 12:38:30.016915 | controller | INFO     Writing /tmp/report.html report.
2025-09-29 12:38:30.494740 | [controller] Waiting on logger
2025-09-29 12:38:35.634550 | [controller] Waiting on logger
2025-09-29 12:38:46.066507 | [controller] Waiting on logger
2025-09-29 12:38:56.498451 | [controller] Waiting on logger
2025-09-29 12:39:00.100650 | [Zuul] Log Stream did not terminate
2025-09-29 12:39:00.100844 | controller | ERROR
2025-09-29 12:39:00.100962 | controller | {
2025-09-29 12:39:00.101005 | controller |   "delta": "0:04:46.594045",
2025-09-29 12:39:00.101034 | controller |   "end": "2025-09-29 12:38:30.064934",
2025-09-29 12:39:00.101057 | controller |   "msg": "non-zero return code",
2025-09-29 12:39:00.101078 | controller |   "rc": 1,
2025-09-29 12:39:00.101101 | controller |   "start": "2025-09-29 12:33:43.470889"
2025-09-29 12:39:00.101129 | controller | }
failure
2025-09-29 12:39:00.153655 | 
2025-09-29 12:39:00.153707 | PLAY RECAP
2025-09-29 12:39:00.153746 | controller | ok: 1 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0
2025-09-29 12:39:00.153769 | 
2025-09-29 12:39:00.211870 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2025-09-29 12:39:00.212690 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2025-09-29 12:39:00.730005 | 
2025-09-29 12:39:00.730099 | PLAY [Run ci/playbooks/collect-logs.yml]
2025-09-29 12:39:00.749869 | 
2025-09-29 12:39:00.749959 | TASK [Filter out host if needed]
2025-09-29 12:39:00.758294 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2025-09-29 12:39:00.762751 | 
2025-09-29 12:39:00.762882 | TASK [Ensure file is present]
2025-09-29 12:39:01.165479 | controller | ok
2025-09-29 12:39:01.172281 | 
2025-09-29 12:39:01.172350 | TASK [Manage molecule report file]
2025-09-29 12:39:01.195148 | [controller] Waiting on logger
2025-09-29 12:39:10.550932 | [controller] Waiting on logger
2025-09-29 12:39:20.946544 | [controller] Waiting on logger
2025-09-29 12:39:31.378456 | [controller] Waiting on logger
2025-09-29 12:39:31.565961 | [Zuul] Log Stream did not terminate
2025-09-29 12:39:31.566272 | controller | changed
2025-09-29 12:39:31.571538 | 
2025-09-29 12:39:31.571602 | TASK [Check if we get ci-framework-data basedir]
2025-09-29 12:39:31.863766 | controller | ok
2025-09-29 12:39:31.868758 | 
2025-09-29 12:39:31.868821 | TASK [Create ci-framework-data log directory for zuul]
2025-09-29 12:39:32.271407 | controller | changed
2025-09-29 12:39:32.276977 | 
2025-09-29 12:39:32.277042 | TASK [Copy ci-framework interesting files]
2025-09-29 12:39:32.299931 | [controller] Waiting on logger
2025-09-29 12:39:37.403234 | controller | changed
2025-09-29 12:39:37.408414 | 
2025-09-29 12:39:37.408479 | TASK [Get SELinux listing]
2025-09-29 12:39:40.530502 | [controller] Waiting on logger
2025-09-29 12:39:43.858471 | [controller] Waiting on logger
2025-09-29 12:40:02.290408 | [controller] Waiting on logger
2025-09-29 12:40:04.530380 | [controller] Waiting on logger
2025-09-29 12:40:07.688611 | [Zuul] Log Stream did not terminate
2025-09-29 12:40:07.688875 | controller | changed
2025-09-29 12:40:07.694821 | 
2025-09-29 12:40:07.694890 | TASK [Generate log index]
2025-09-29 12:40:08.799540 | controller | changed
2025-09-29 12:40:08.804303 | 
2025-09-29 12:40:08.804367 | TASK [Get some env related data]
2025-09-29 12:40:08.826948 | [controller] Waiting on logger
2025-09-29 12:40:24.434352 | [controller] Waiting on logger
2025-09-29 12:40:33.778435 | [controller] Waiting on logger
2025-09-29 12:40:40.033618 | [Zuul] Log Stream did not terminate
2025-09-29 12:40:40.033821 | controller | changed
2025-09-29 12:40:40.038955 | 
2025-09-29 12:40:40.039017 | TASK [Generate list of logs to collect in home directory]
2025-09-29 12:40:40.400389 | controller | ok: All paths examined
2025-09-29 12:40:40.405448 | 
2025-09-29 12:40:40.405534 | LOOP [Copy logs from home directory]
2025-09-29 12:40:40.929011 | controller | changed:
2025-09-29 12:40:40.929227 | controller | {
2025-09-29 12:40:40.929258 | controller |   "atime": 1743544925.4788878,
2025-09-29 12:40:40.929279 | controller |   "ctime": 1743545329.1409318,
2025-09-29 12:40:40.929297 | controller |   "dev": 64513,
2025-09-29 12:40:40.929315 | controller |   "gid": 1000,
2025-09-29 12:40:40.929331 | controller |   "gr_name": "zuul",
2025-09-29 12:40:40.929347 | controller |   "inode": 4518807,
2025-09-29 12:40:40.929366 | controller |   "isblk": false,
2025-09-29 12:40:40.929382 | controller |   "ischr": false,
2025-09-29 12:40:40.929397 | controller |   "isdir": false,
2025-09-29 12:40:40.929412 | controller |   "isfifo": false,
2025-09-29 12:40:40.929426 | controller |   "isgid": false,
2025-09-29 12:40:40.929440 | controller |   "islnk": false,
2025-09-29 12:40:40.929454 | controller |   "isreg": true,
2025-09-29 12:40:40.929475 | controller |   "issock": false,
2025-09-29 12:40:40.929492 | controller |   "isuid": false,
2025-09-29 12:40:40.929507 | controller |   "mode": "0644",
2025-09-29 12:40:40.929521 | controller |   "mtime": 1743545329.1409318,
2025-09-29 12:40:40.929536 | controller |   "nlink": 1,
2025-09-29 12:40:40.929550 | controller |   "path": "/home/zuul/crc-setup.log",
2025-09-29 12:40:40.929564 | controller |   "pw_name": "zuul",
2025-09-29 12:40:40.929578 | controller |   "rgrp": true,
2025-09-29 12:40:40.929592 | controller |   "roth": true,
2025-09-29 12:40:40.929606 | controller |   "rusr": true,
2025-09-29 12:40:40.929620 | controller |   "size": 4108,
2025-09-29 12:40:40.929634 | controller |   "uid": 1000,
2025-09-29 12:40:40.929647 | controller |   "wgrp": false,
2025-09-29 12:40:40.929660 | controller |   "woth": false,
2025-09-29 12:40:40.929674 | controller |   "wusr": true,
2025-09-29 12:40:40.929687 | controller |   "xgrp": false,
2025-09-29 12:40:40.929700 | controller |   "xoth": false,
2025-09-29 12:40:40.929712 | controller |   "xusr": false
2025-09-29 12:40:40.929725 | controller | }
2025-09-29 12:40:41.466620 | controller | changed:
2025-09-29 12:40:41.466693 | controller | {
2025-09-29 12:40:41.466728 | controller |   "atime": 1743545331.0429637,
2025-09-29 12:40:41.466753 | controller |   "ctime": 1743545842.0111232,
2025-09-29 12:40:41.466776 | controller |   "dev": 64513,
2025-09-29 12:40:41.466798 | controller |   "gid": 1000,
2025-09-29 12:40:41.466819 | controller |   "gr_name": "zuul",
2025-09-29 12:40:41.466839 | controller |   "inode": 4194437,
2025-09-29 12:40:41.466860 | controller |   "isblk": false,
2025-09-29 12:40:41.466883 | controller |   "ischr": false,
2025-09-29 12:40:41.466904 | controller |   "isdir": false,
2025-09-29 12:40:41.466949 | controller |   "isfifo": false,
2025-09-29 12:40:41.466973 | controller |   "isgid": false,
2025-09-29 12:40:41.466993 | controller |   "islnk": false,
2025-09-29 12:40:41.467013 | controller |   "isreg": true,
2025-09-29 12:40:41.467032 | controller |   "issock": false,
2025-09-29 12:40:41.467051 | controller |   "isuid": false,
2025-09-29 12:40:41.467069 | controller |   "mode": "0644",
2025-09-29 12:40:41.467088 | controller |   "mtime": 1743545842.0111232,
2025-09-29 12:40:41.467107 | controller |   "nlink": 1,
2025-09-29 12:40:41.467126 | controller |   "path": "/home/zuul/crc-start.log",
2025-09-29 12:40:41.467144 | controller |   "pw_name": "zuul",
2025-09-29 12:40:41.467170 | controller |   "rgrp": true,
2025-09-29 12:40:41.467191 | controller |   "roth": true,
2025-09-29 12:40:41.467210 | controller |   "rusr": true,
2025-09-29 12:40:41.467230 | controller |   "size": 4023,
2025-09-29 12:40:41.467250 | controller |   "uid": 1000,
2025-09-29 12:40:41.467270 | controller |   "wgrp": false,
2025-09-29 12:40:41.467290 | controller |   "woth": false,
2025-09-29 12:40:41.467309 | controller |   "wusr": true,
2025-09-29 12:40:41.467328 | controller |   "xgrp": false,
2025-09-29 12:40:41.467346 | controller |   "xoth": false,
2025-09-29 12:40:41.467365 | controller |   "xusr": false
2025-09-29 12:40:41.467384 | controller | }
2025-09-29 12:40:41.977302 | controller | changed:
2025-09-29 12:40:41.977376 | controller | {
2025-09-29 12:40:41.977402 | controller |   "atime": 1759149206.186588,
2025-09-29 12:40:41.977422 | controller |   "ctime": 1759149221.5715952,
2025-09-29 12:40:41.977440 | controller |   "dev": 64513,
2025-09-29 12:40:41.977457 | controller |   "gid": 1000,
2025-09-29 12:40:41.977472 | controller |   "gr_name": "zuul",
2025-09-29 12:40:41.977487 | controller |   "inode": 4638648,
2025-09-29 12:40:41.977502 | controller |   "isblk": false,
2025-09-29 12:40:41.977518 | controller |   "ischr": false,
2025-09-29 12:40:41.977534 | controller |   "isdir": false,
2025-09-29 12:40:41.977552 | controller |   "isfifo": false,
2025-09-29 12:40:41.977567 | controller |   "isgid": false,
2025-09-29 12:40:41.977581 | controller |   "islnk": false,
2025-09-29 12:40:41.977595 | controller |   "isreg": true,
2025-09-29 12:40:41.977614 | controller |   "issock": false,
2025-09-29 12:40:41.977629 | controller |   "isuid": false,
2025-09-29 12:40:41.977643 | controller |   "mode": "0644",
2025-09-29 12:40:41.977656 | controller |   "mtime": 1759149221.5715952,
2025-09-29 12:40:41.977670 | controller |   "nlink": 1,
2025-09-29 12:40:41.977684 | controller |   "path": "/home/zuul/ansible.log",
2025-09-29 12:40:41.977698 | controller |   "pw_name": "zuul",
2025-09-29 12:40:41.977712 | controller |   "rgrp": true,
2025-09-29 12:40:41.977726 | controller |   "roth": true,
2025-09-29 12:40:41.977740 | controller |   "rusr": true,
2025-09-29 12:40:41.977753 | controller |   "size": 6749,
2025-09-29 12:40:41.977767 | controller |   "uid": 1000,
2025-09-29 12:40:41.977781 | controller |   "wgrp": false,
2025-09-29 12:40:41.977795 | controller |   "woth": false,
2025-09-29 12:40:41.977808 | controller |   "wusr": true,
2025-09-29 12:40:41.977820 | controller |   "xgrp": false,
2025-09-29 12:40:41.977833 | controller |   "xoth": false,
2025-09-29 12:40:41.977846 | controller |   "xusr": false
2025-09-29 12:40:41.977859 | controller | }
2025-09-29 12:40:41.992971 | 
2025-09-29 12:40:41.993078 | TASK [Copy crio stats log file]
2025-09-29 12:40:42.006929 | controller | skipping: Conditional result was False
2025-09-29 12:40:42.012123 | 
2025-09-29 12:40:42.012203 | TASK [Get SELinux related data]
2025-09-29 12:40:43.058504 | [controller] Waiting on logger
2025-09-29 12:40:46.258345 | [controller] Waiting on logger
2025-09-29 12:40:49.315355 | controller | ERROR
2025-09-29 12:40:49.315557 | controller | {
2025-09-29 12:40:49.315596 | controller |   "delta": "0:00:00.008319",
2025-09-29 12:40:49.315622 | controller |   "end": "2025-09-29 12:40:42.275408",
2025-09-29 12:40:49.315643 | controller |   "msg": "non-zero return code",
2025-09-29 12:40:49.315665 | controller |   "rc": 1,
2025-09-29 12:40:49.315688 | controller |   "start": "2025-09-29 12:40:42.267089"
2025-09-29 12:40:49.315708 | controller | }
2025-09-29 12:40:49.315735 | controller | ERROR: Ignoring Errors
2025-09-29 12:40:49.320812 | 
2025-09-29 12:40:49.320887 | TASK [Create system configuration directory]
2025-09-29 12:40:49.572671 | controller | changed
2025-09-29 12:40:49.577500 | 
2025-09-29 12:40:49.577578 | TASK [Get some of the system configurations]
2025-09-29 12:40:49.598620 | [controller] Waiting on logger
2025-09-29 12:41:04.882553 | [controller] Waiting on logger
2025-09-29 12:41:08.210514 | [controller] Waiting on logger
2025-09-29 12:41:19.870790 | [Zuul] Log Stream did not terminate
2025-09-29 12:41:19.871032 | controller | changed
2025-09-29 12:41:19.876345 | 
2025-09-29 12:41:19.876412 | TASK [Copy generated documentation if available]
2025-09-29 12:41:19.889490 | controller | skipping: Conditional result was False
2025-09-29 12:41:19.894585 | 
2025-09-29 12:41:19.894647 | TASK [Copy generated AsciiDoc documentation if available]
2025-09-29 12:41:19.907718 | controller | skipping: Conditional result was False
2025-09-29 12:41:19.912811 | 
2025-09-29 12:41:19.912877 | TASK [Compress logs bigger than 2MB]
2025-09-29 12:41:19.933518 | [controller] Waiting on logger
2025-09-29 12:41:30.354476 | [controller] Waiting on logger
2025-09-29 12:41:39.698519 | [controller] Waiting on logger
2025-09-29 12:41:50.130537 | [controller] Waiting on logger
2025-09-29 12:41:50.194560 | [Zuul] Log Stream did not terminate
2025-09-29 12:41:50.194733 | controller | changed
2025-09-29 12:41:50.199922 | 
2025-09-29 12:41:50.199990 | TASK [Copy files from workspace on node]
2025-09-29 12:41:50.218084 | controller | ok
2025-09-29 12:41:50.239758 | 
2025-09-29 12:41:50.239826 | TASK [fetch-output : Set log path for multiple nodes]
2025-09-29 12:41:50.263458 | controller | skipping: Conditional result was False
2025-09-29 12:41:50.269465 | 
2025-09-29 12:41:50.269533 | TASK [fetch-output : Set log path for single node]
2025-09-29 12:41:50.297360 | controller | ok
2025-09-29 12:41:50.302316 | 
2025-09-29 12:41:50.302382 | LOOP [fetch-output : Ensure local output dirs]
2025-09-29 12:41:50.494699 | controller -> localhost | ok: "/var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/logs"
2025-09-29 12:41:50.494941 | controller -> localhost | changed: All items complete
2025-09-29 12:41:50.494986 | 
2025-09-29 12:41:50.668643 | controller -> localhost | changed: "/var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/artifacts"
2025-09-29 12:41:50.843868 | controller -> localhost | changed: "/var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/docs"
2025-09-29 12:41:50.858726 | 
2025-09-29 12:41:50.858799 | LOOP [fetch-output : Collect logs, artifacts and docs]
2025-09-29 12:41:51.489448 | controller | changed:
2025-09-29 12:41:51.489683 | controller | .d..t...... ./
2025-09-29 12:41:51.489719 | controller | >f+++++++++ README.html
2025-09-29 12:41:51.489743 | controller | >f+++++++++ ansible-execution.log
2025-09-29 12:41:51.489765 | controller | >f+++++++++ ansible.log
2025-09-29 12:41:51.489786 | controller | >f+++++++++ crc-setup.log
2025-09-29 12:41:51.489805 | controller | >f+++++++++ crc-start.log
2025-09-29 12:41:51.489824 | controller | >f+++++++++ dmesg.log
2025-09-29 12:41:51.489842 | controller | >f+++++++++ installed-pkgs.log
2025-09-29 12:41:51.489861 | controller | >f+++++++++ python.log
2025-09-29 12:41:51.489878 | controller | >f+++++++++ registries.conf
2025-09-29 12:41:51.489895 | controller | >f+++++++++ report.html
2025-09-29 12:41:51.490009 | controller | >f+++++++++ selinux-denials.log
2025-09-29 12:41:51.490036 | controller | >f+++++++++ selinux-listing.log
2025-09-29 12:41:51.490056 | controller | cd+++++++++ ci-framework-data/
2025-09-29 12:41:51.490076 | controller | cd+++++++++ ci-framework-data/artifacts/
2025-09-29 12:41:51.490095 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2025-09-29 12:41:51.490113 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2025-09-29 12:41:51.490130 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2025-09-29 12:41:51.490148 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2025-09-29 12:41:51.490177 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2025-09-29 12:41:51.490197 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2025-09-29 12:41:51.490214 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2025-09-29 12:41:51.490230 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2025-09-29 12:41:51.490246 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2025-09-29 12:41:51.490263 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2025-09-29 12:41:51.490279 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2025-09-29 12:41:51.490295 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:6f:5f:c5
2025-09-29 12:41:51.490311 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:5c:a5:4a
2025-09-29 12:41:51.490328 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:bb:d7:df
2025-09-29 12:41:51.490344 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:90:39:f1
2025-09-29 12:41:51.490361 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:a4:32:19
2025-09-29 12:41:51.490377 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:43:b1:b6
2025-09-29 12:41:51.490394 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2025-09-29 12:41:51.490410 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2025-09-29 12:41:51.490426 | controller | cd+++++++++ ci-framework-data/logs/
2025-09-29 12:41:51.490443 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2025-09-29 12:41:51.490460 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2025-09-29 12:41:51.490482 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2025-09-29 12:41:51.490500 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2025-09-29 12:41:51.490516 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2025-09-29 12:41:51.490531 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2025-09-29 12:41:51.490547 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2025-09-29 12:41:51.490562 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2025-09-29 12:41:51.490579 | controller | cd+++++++++ registries.conf.d/
2025-09-29 12:41:51.490595 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2025-09-29 12:41:51.490614 | controller | cd+++++++++ system-config/
2025-09-29 12:41:51.490631 | controller | cd+++++++++ system-config/libvirt/
2025-09-29 12:41:51.490647 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2025-09-29 12:41:51.490662 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2025-09-29 12:41:51.490677 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2025-09-29 12:41:51.490693 | controller | >f+++++++++ system-config/libvirt/network.conf
2025-09-29 12:41:51.490709 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2025-09-29 12:41:51.490726 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2025-09-29 12:41:51.490742 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2025-09-29 12:41:51.490758 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2025-09-29 12:41:51.490774 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2025-09-29 12:41:51.490789 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2025-09-29 12:41:51.490805 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2025-09-29 12:41:51.490820 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2025-09-29 12:41:51.490836 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2025-09-29 12:41:51.490851 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2025-09-29 12:41:51.490867 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2025-09-29 12:41:51.490882 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2025-09-29 12:41:51.929589 | controller | changed: .d..t...... ./
2025-09-29 12:41:52.356819 | controller | changed: .d..t...... ./
2025-09-29 12:41:52.374761 | 
2025-09-29 12:41:52.374852 | TASK [Return artifact to Zuul]
2025-09-29 12:41:52.403974 | controller | ok
2025-09-29 12:41:52.422231 | 
2025-09-29 12:41:52.422286 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2025-09-29 12:41:52.422390 | 
2025-09-29 12:41:52.422419 | PLAY RECAP
2025-09-29 12:41:52.422456 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2025-09-29 12:41:52.422478 | 
2025-09-29 12:41:52.495146 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2025-09-29 12:41:52.495873 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2025-09-29 12:41:52.986491 | 
2025-09-29 12:41:52.986621 | PLAY [all]
2025-09-29 12:41:53.004652 | 
2025-09-29 12:41:53.004723 | TASK [include_role : fetch-output]
2025-09-29 12:41:53.032570 | controller | ok
2025-09-29 12:41:53.048788 | 
2025-09-29 12:41:53.048874 | TASK [fetch-output : Set log path for multiple nodes]
2025-09-29 12:41:53.092207 | controller | skipping: Conditional result was False
2025-09-29 12:41:53.097652 | 
2025-09-29 12:41:53.097721 | TASK [fetch-output : Set log path for single node]
2025-09-29 12:41:53.124971 | controller | ok
2025-09-29 12:41:53.129803 | 
2025-09-29 12:41:53.129871 | LOOP [fetch-output : Ensure local output dirs]
2025-09-29 12:41:53.435219 | controller -> localhost | ok: "/var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/logs"
2025-09-29 12:41:53.615771 | controller -> localhost | ok: "/var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/artifacts"
2025-09-29 12:41:53.792643 | controller -> localhost | ok: "/var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/docs"
2025-09-29 12:41:53.806608 | 
2025-09-29 12:41:53.806685 | LOOP [fetch-output : Collect logs, artifacts and docs]
2025-09-29 12:41:54.380651 | controller | ok
2025-09-29 12:41:54.380834 | controller | ok: All items complete
2025-09-29 12:41:54.380864 | 
2025-09-29 12:41:54.801757 | controller | ok
2025-09-29 12:41:55.241393 | controller | ok
2025-09-29 12:41:55.257848 | 
2025-09-29 12:41:55.257935 | TASK [include_role : fetch-output-openshift]
2025-09-29 12:41:55.271247 | controller | skipping: Conditional result was False
2025-09-29 12:41:55.276723 | 
2025-09-29 12:41:55.276791 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2025-09-29 12:41:55.597602 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.005792
2025-09-29 12:41:55.785477 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006806
2025-09-29 12:41:55.810621 | 
2025-09-29 12:41:55.810688 | PLAY [all]
2025-09-29 12:41:55.823953 | 
2025-09-29 12:41:55.824020 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2025-09-29 12:41:56.268579 | controller | changed
2025-09-29 12:41:56.290741 | 
2025-09-29 12:41:56.290839 | PLAY RECAP
2025-09-29 12:41:56.290883 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2025-09-29 12:41:56.290950 | 
2025-09-29 12:41:56.357080 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2025-09-29 12:41:56.357761 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2025-09-29 12:41:56.887791 | 
2025-09-29 12:41:56.887945 | PLAY [localhost]
2025-09-29 12:41:56.904828 | 
2025-09-29 12:41:56.904901 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2025-09-29 12:41:57.195395 | localhost | changed
2025-09-29 12:41:57.199814 | 
2025-09-29 12:41:57.199894 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2025-09-29 12:41:57.217354 | localhost | ok
2025-09-29 12:41:57.225020 | 
2025-09-29 12:41:57.225092 | TASK [add-fileserver : Create SSH private key tempfile]
2025-09-29 12:41:57.505016 | localhost | changed
2025-09-29 12:41:57.510462 | 
2025-09-29 12:41:57.510538 | TASK [add-fileserver : Create SSH private key from secret]
2025-09-29 12:41:58.044671 | localhost | changed
2025-09-29 12:41:58.049727 | 
2025-09-29 12:41:58.049800 | TASK [add-fileserver : Add fileserver ssh key]
2025-09-29 12:41:58.371442 | localhost | Identity added: /var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/tmp/ansible.xyuhhtmz (/var/lib/zuul/builds/78eeea42ec294a03aafb1a14dfbf04fe/work/tmp/ansible.xyuhhtmz)
2025-09-29 12:41:58.371621 | localhost | ok: Runtime: 0:00:00.005959
2025-09-29 12:41:58.375725 | 
2025-09-29 12:41:58.375797 | TASK [add-fileserver : Remove SSH private key from disk]
2025-09-29 12:41:58.585665 | localhost | ok: Runtime: 0:00:00.004206
2025-09-29 12:41:58.590256 | 
2025-09-29 12:41:58.590327 | TASK [add-fileserver : Add fileserver to inventory]
2025-09-29 12:41:58.638175 | localhost | changed
2025-09-29 12:41:58.642926 | 
2025-09-29 12:41:58.642996 | TASK [add-fileserver : Add fileserver server to known hosts]
2025-09-29 12:41:58.943643 | localhost | changed
2025-09-29 12:41:58.962187 | 
2025-09-29 12:41:58.962254 | PLAY [localhost]
2025-09-29 12:41:58.973143 | 
2025-09-29 12:41:58.973218 | TASK [Generate bulk log download script]
2025-09-29 12:41:58.991222 | localhost | ok
2025-09-29 12:41:59.002177 | 
2025-09-29 12:41:59.002248 | TASK [local-log-download : Check API endpoint is defined]
2025-09-29 12:41:59.029571 | localhost | ok: All assertions passed
2025-09-29 12:41:59.033901 | 
2025-09-29 12:41:59.033999 | TASK [local-log-download : Create download script]
2025-09-29 12:41:59.371515 | localhost -> localhost | changed
2025-09-29 12:41:59.380222 | 
2025-09-29 12:41:59.380303 | TASK [Register quick-download link]
2025-09-29 12:41:59.396676 | localhost | ok
2025-09-29 12:41:59.428197 | 
2025-09-29 12:41:59.428264 | PLAY [logserver.rdoproject.org]
2025-09-29 12:41:59.437608 | 
2025-09-29 12:41:59.437670 | TASK [Set zuul-log-path fact]
2025-09-29 12:41:59.452685 | logserver.rdoproject.org | ok
2025-09-29 12:41:59.463305 | 
2025-09-29 12:41:59.463373 | TASK [set-zuul-log-path-fact : Set log path for a build]
2025-09-29 12:41:59.488807 | logserver.rdoproject.org | ok
2025-09-29 12:41:59.494703 | 
2025-09-29 12:41:59.494771 | TASK [upload-logs : Create log directories]
2025-09-29 12:42:01.115173 | logserver.rdoproject.org | changed
2025-09-29 12:42:01.118149 | 
2025-09-29 12:42:01.118231 | TASK [upload-logs : Ensure logs are readable before uploading]
2025-09-29 12:42:01.333600 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004542
2025-09-29 12:42:01.338040 | 
2025-09-29 12:42:01.338110 | TASK [upload-logs : Upload logs to log server]
2025-09-29 12:42:02.996524 | logserver.rdoproject.org | Output suppressed because no_log was given
2025-09-29 12:42:02.999364 | 
2025-09-29 12:42:02.999434 | LOOP [upload-logs : Compress console log and json output]
2025-09-29 12:42:03.035477 | logserver.rdoproject.org | skipping: Conditional result was False
2025-09-29 12:42:03.043568 | logserver.rdoproject.org | skipping: Conditional result was False
2025-09-29 12:42:03.056561 | 
2025-09-29 12:42:03.056668 | LOOP [upload-logs : Upload compressed console log and json output]
2025-09-29 12:42:03.088301 | logserver.rdoproject.org | skipping: Conditional result was False
2025-09-29 12:42:03.088507 | 
2025-09-29 12:42:03.091772 | logserver.rdoproject.org | skipping: Conditional result was False
2025-09-29 12:42:03.102901 | 
2025-09-29 12:42:03.103011 | LOOP [upload-logs : Upload console log and json output]