2025-11-27 07:21:27.279114 | Job console starting...
2025-11-27 07:21:27.489236 | Updating repositories
2025-11-27 07:21:28.213669 | Preparing job workspace
2025-11-27 07:21:35.435179 | Running Ansible setup...
2025-11-27 07:21:39.159072 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2025-11-27 07:21:39.677389 | 
2025-11-27 07:21:39.677499 | PLAY [localhost]
2025-11-27 07:21:39.686083 | 
2025-11-27 07:21:39.686168 | TASK [Gathering Facts]
2025-11-27 07:21:40.525367 | localhost | ok
2025-11-27 07:21:40.539710 | 
2025-11-27 07:21:40.539802 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2025-11-27 07:21:40.879206 | localhost -> localhost | changed
2025-11-27 07:21:40.884705 | 
2025-11-27 07:21:40.884790 | TASK [log-inventory : Copy ansible inventory to logs dir]
2025-11-27 07:21:41.598007 | localhost -> localhost | changed
2025-11-27 07:21:41.607197 | 
2025-11-27 07:21:41.607273 | TASK [Setup log path fact]
2025-11-27 07:21:41.625201 | localhost | ok
2025-11-27 07:21:41.635890 | 
2025-11-27 07:21:41.635978 | TASK [set-zuul-log-path-fact : Set log path for a build]
2025-11-27 07:21:41.652963 | localhost | ok
2025-11-27 07:21:41.661729 | 
2025-11-27 07:21:41.661842 | TASK [emit-job-header : Print job information]
2025-11-27 07:21:41.688708 | # Job Information
2025-11-27 07:21:41.688839 | Ansible Version: 2.15.12
2025-11-27 07:21:41.688870 | Job: cifmw-molecule-reproducer
2025-11-27 07:21:41.688894 | Pipeline: github-check
2025-11-27 07:21:41.688935 | Executor: ibm-bm4-ze.softwarefactory-project.io
2025-11-27 07:21:41.688960 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3505
2025-11-27 07:21:41.688982 | Log URL (when completed): https://logserver.rdoproject.org/48e/rdoproject.org/48e1f94789f64c23a07d45722489b7ff/
2025-11-27 07:21:41.689003 | Event ID: 7a3ab760-cb61-11f0-935e-bbe9329346bf
2025-11-27 07:21:41.692611 | 
2025-11-27 07:21:41.692676 | LOOP [emit-job-header : Print node information]
2025-11-27 07:21:41.785090 | localhost | ok:
2025-11-27 07:21:41.785272 | localhost | # Node Information
2025-11-27 07:21:41.785304 | localhost | Inventory Hostname: controller
2025-11-27 07:21:41.785330 | localhost | Hostname: np0005537504
2025-11-27 07:21:41.785350 | localhost | Username: zuul
2025-11-27 07:21:41.785370 | localhost | Distro: CentOS 9
2025-11-27 07:21:41.785389 | localhost | Provider: ibm-bm4-nodepool
2025-11-27 07:21:41.785406 | localhost | Region: regionOne
2025-11-27 07:21:41.785423 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2025-11-27 07:21:41.785439 | localhost | Product Name: OpenStack Compute
2025-11-27 07:21:41.785455 | localhost | Interface IP: 192.168.26.163
2025-11-27 07:21:41.804744 | 
2025-11-27 07:21:41.804831 | PLAY [all]
2025-11-27 07:21:41.811277 | 
2025-11-27 07:21:41.811340 | TASK [Gather network facts]
2025-11-27 07:21:43.280605 | controller | ok
2025-11-27 07:21:43.295267 | 
2025-11-27 07:21:43.295345 | TASK [include_role : start-zuul-console]
2025-11-27 07:21:43.312382 | controller | ok
2025-11-27 07:21:43.323426 | 
2025-11-27 07:21:43.323489 | TASK [start-zuul-console : Start zuul_console daemon.]
2025-11-27 07:21:43.705459 | controller | ok
2025-11-27 07:21:43.713825 | 
2025-11-27 07:21:43.713885 | TASK [include_role : add-build-sshkey]
2025-11-27 07:21:43.731485 | controller | ok
2025-11-27 07:21:43.752648 | 
2025-11-27 07:21:43.752718 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2025-11-27 07:21:43.938338 | controller -> localhost | ok
2025-11-27 07:21:43.943808 | 
2025-11-27 07:21:43.943876 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2025-11-27 07:21:43.962072 | controller | ok
2025-11-27 07:21:43.974401 | controller | included: /var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2025-11-27 07:21:43.980254 | 
2025-11-27 07:21:43.980317 | TASK [add-build-sshkey : Create Temp SSH key]
2025-11-27 07:21:44.512743 | controller -> localhost | Generating public/private rsa key pair.
2025-11-27 07:21:44.512965 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/48e1f94789f64c23a07d45722489b7ff_id_rsa.
2025-11-27 07:21:44.513006 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/48e1f94789f64c23a07d45722489b7ff_id_rsa.pub.
2025-11-27 07:21:44.513033 | controller -> localhost | The key fingerprint is:
2025-11-27 07:21:44.513055 | controller -> localhost | SHA256:6W4rJmtO8fwGCBrP14yqe+Ympg/bmWv5kx4vxS+N2cw zuul-build-sshkey
2025-11-27 07:21:44.513075 | controller -> localhost | The key's randomart image is:
2025-11-27 07:21:44.513094 | controller -> localhost | +---[RSA 3072]----+
2025-11-27 07:21:44.513132 | controller -> localhost | |                 |
2025-11-27 07:21:44.513154 | controller -> localhost | |                 |
2025-11-27 07:21:44.513173 | controller -> localhost | |                 |
2025-11-27 07:21:44.513191 | controller -> localhost | |. .      .       |
2025-11-27 07:21:44.513210 | controller -> localhost | | = ..*  S        |
2025-11-27 07:21:44.513228 | controller -> localhost | |. o ++*.         |
2025-11-27 07:21:44.513245 | controller -> localhost | |.  +oooX.        |
2025-11-27 07:21:44.513263 | controller -> localhost | |.=B+*o*oE        |
2025-11-27 07:21:44.513281 | controller -> localhost | |B@B*=*.=+.       |
2025-11-27 07:21:44.513299 | controller -> localhost | +----[SHA256]-----+
2025-11-27 07:21:44.513352 | controller -> localhost | ok: Runtime: 0:00:00.186985
2025-11-27 07:21:44.518973 | 
2025-11-27 07:21:44.519036 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2025-11-27 07:21:44.538192 | controller | ok
2025-11-27 07:21:44.547408 | controller | included: /var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2025-11-27 07:21:44.556944 | 
2025-11-27 07:21:44.557008 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2025-11-27 07:21:44.570585 | controller | skipping: Conditional result was False
2025-11-27 07:21:44.576472 | 
2025-11-27 07:21:44.576547 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2025-11-27 07:21:45.080279 | controller | changed
2025-11-27 07:21:45.085339 | 
2025-11-27 07:21:45.085458 | TASK [add-build-sshkey : Make sure user has a .ssh]
2025-11-27 07:21:45.356425 | controller | ok
2025-11-27 07:21:45.362071 | 
2025-11-27 07:21:45.362202 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2025-11-27 07:21:46.548497 | controller | changed
2025-11-27 07:21:46.553416 | 
2025-11-27 07:21:46.553500 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2025-11-27 07:21:47.717418 | controller | changed
2025-11-27 07:21:47.722702 | 
2025-11-27 07:21:47.722764 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2025-11-27 07:21:47.737859 | controller | skipping: Conditional result was False
2025-11-27 07:21:47.743277 | 
2025-11-27 07:21:47.743359 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2025-11-27 07:21:48.051628 | controller -> localhost | changed
2025-11-27 07:21:48.062459 | 
2025-11-27 07:21:48.062531 | TASK [add-build-sshkey : Add back temp key]
2025-11-27 07:21:48.288192 | controller -> localhost | Identity added: /var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/48e1f94789f64c23a07d45722489b7ff_id_rsa (zuul-build-sshkey)
2025-11-27 07:21:48.288386 | controller -> localhost | ok: Runtime: 0:00:00.008587
2025-11-27 07:21:48.293902 | 
2025-11-27 07:21:48.293986 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2025-11-27 07:21:48.656451 | controller | ok
2025-11-27 07:21:48.661092 | 
2025-11-27 07:21:48.661186 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2025-11-27 07:21:48.685270 | controller | skipping: Conditional result was False
2025-11-27 07:21:48.694232 | 
2025-11-27 07:21:48.694300 | TASK [include_role : validate-host]
2025-11-27 07:21:48.711470 | controller | ok
2025-11-27 07:21:48.729454 | 
2025-11-27 07:21:48.729517 | TASK [validate-host : Define zuul_info_dir fact]
2025-11-27 07:21:48.758446 | controller | ok
2025-11-27 07:21:48.781429 | 
2025-11-27 07:21:48.781507 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2025-11-27 07:21:49.003885 | controller -> localhost | ok
2025-11-27 07:21:49.009436 | 
2025-11-27 07:21:49.009509 | TASK [validate-host : Collect information about the host]
2025-11-27 07:21:49.747789 | controller | ok
2025-11-27 07:21:49.755781 | 
2025-11-27 07:21:49.755844 | TASK [validate-host : Sanitize hostname]
2025-11-27 07:21:49.805049 | controller | ok
2025-11-27 07:21:49.809566 | 
2025-11-27 07:21:49.809629 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2025-11-27 07:21:50.209065 | controller -> localhost | changed
2025-11-27 07:21:50.214391 | 
2025-11-27 07:21:50.214470 | TASK [validate-host : Collect information about zuul worker]
2025-11-27 07:21:50.596348 | controller | ok
2025-11-27 07:21:50.601273 | 
2025-11-27 07:21:50.601358 | TASK [validate-host : Write out all zuul information for each host]
2025-11-27 07:21:51.000783 | controller -> localhost | changed
2025-11-27 07:21:51.010610 | 
2025-11-27 07:21:51.010693 | TASK [include_role : prepare-workspace-openshift]
2025-11-27 07:21:51.024593 | controller | skipping: Conditional result was False
2025-11-27 07:21:51.030512 | 
2025-11-27 07:21:51.030599 | TASK [include_role : remove-zuul-sshkey]
2025-11-27 07:21:51.045020 | controller | skipping: Conditional result was False
2025-11-27 07:21:51.050048 | 
2025-11-27 07:21:51.050113 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2025-11-27 07:21:51.325244 | controller | ok: "logs"
2025-11-27 07:21:51.325474 | controller | ok: All items complete
2025-11-27 07:21:51.325508 | 
2025-11-27 07:21:51.557729 | controller | ok: "artifacts"
2025-11-27 07:21:51.792391 | controller | ok: "docs"
2025-11-27 07:21:51.803574 | 
2025-11-27 07:21:51.803679 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2025-11-27 07:21:52.067970 | controller | changed: "logs"
2025-11-27 07:21:52.335735 | controller | changed: "artifacts"
2025-11-27 07:21:52.570268 | controller | changed: "docs"
2025-11-27 07:21:52.593646 | 
2025-11-27 07:21:52.593732 | PLAY RECAP
2025-11-27 07:21:52.593779 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2025-11-27 07:21:52.593806 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2025-11-27 07:21:52.593826 | 
2025-11-27 07:21:52.671435 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2025-11-27 07:21:52.672230 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2025-11-27 07:21:53.230325 | 
2025-11-27 07:21:53.230428 | PLAY [all]
2025-11-27 07:21:53.259119 | 
2025-11-27 07:21:53.259224 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2025-11-27 07:21:53.308809 | controller | ok
2025-11-27 07:21:53.313750 | 
2025-11-27 07:21:53.313836 | TASK [mirror-info-fork : Create /etc/ci]
2025-11-27 07:21:53.758963 | controller | changed
2025-11-27 07:21:53.764496 | 
2025-11-27 07:21:53.764569 | TASK [mirror-info-fork : Install ci_mirror script]
2025-11-27 07:21:55.094933 | controller | changed
2025-11-27 07:21:55.105067 | 
2025-11-27 07:21:55.105166 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2025-11-27 07:21:55.572557 | controller | changed:
2025-11-27 07:21:55.572724 | controller | {
2025-11-27 07:21:55.572758 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2025-11-27 07:21:55.572788 | controller | }
2025-11-27 07:21:55.863059 | controller | changed:
2025-11-27 07:21:55.863136 | controller | {
2025-11-27 07:21:55.863179 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2025-11-27 07:21:55.863203 | controller | }
2025-11-27 07:21:56.181029 | controller | changed:
2025-11-27 07:21:56.181121 | controller | {
2025-11-27 07:21:56.181162 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2025-11-27 07:21:56.181186 | controller | }
2025-11-27 07:21:56.487508 | controller | changed:
2025-11-27 07:21:56.487599 | controller | {
2025-11-27 07:21:56.487627 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2025-11-27 07:21:56.487647 | controller | }
2025-11-27 07:21:56.779350 | controller | changed:
2025-11-27 07:21:56.779440 | controller | {
2025-11-27 07:21:56.779467 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2025-11-27 07:21:56.779487 | controller | }
2025-11-27 07:21:57.066962 | controller | changed:
2025-11-27 07:21:57.067109 | controller | {
2025-11-27 07:21:57.067159 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2025-11-27 07:21:57.067186 | controller | }
2025-11-27 07:21:57.350924 | controller | changed:
2025-11-27 07:21:57.351088 | controller | {
2025-11-27 07:21:57.351121 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2025-11-27 07:21:57.351144 | controller | }
2025-11-27 07:21:57.649699 | controller | changed:
2025-11-27 07:21:57.649775 | controller | {
2025-11-27 07:21:57.649803 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2025-11-27 07:21:57.649824 | controller | }
2025-11-27 07:21:57.965070 | controller | changed:
2025-11-27 07:21:57.965179 | controller | {
2025-11-27 07:21:57.965206 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2025-11-27 07:21:57.965229 | controller | }
2025-11-27 07:21:58.276441 | controller | changed:
2025-11-27 07:21:58.276520 | controller | {
2025-11-27 07:21:58.276546 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2025-11-27 07:21:58.276567 | controller | }
2025-11-27 07:21:58.576982 | controller | changed:
2025-11-27 07:21:58.577070 | controller | {
2025-11-27 07:21:58.577096 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2025-11-27 07:21:58.577117 | controller | }
2025-11-27 07:21:58.892858 | controller | changed:
2025-11-27 07:21:58.892991 | controller | {
2025-11-27 07:21:58.893019 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2025-11-27 07:21:58.893039 | controller | }
2025-11-27 07:21:59.179110 | controller | changed:
2025-11-27 07:21:59.179212 | controller | {
2025-11-27 07:21:59.179239 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith"
2025-11-27 07:21:59.179259 | controller | }
2025-11-27 07:21:59.472320 | controller | changed:
2025-11-27 07:21:59.472421 | controller | {
2025-11-27 07:21:59.472450 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2025-11-27 07:21:59.472471 | controller | }
2025-11-27 07:21:59.776943 | controller | changed:
2025-11-27 07:21:59.777047 | controller | {
2025-11-27 07:21:59.777075 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2025-11-27 07:21:59.777097 | controller | }
2025-11-27 07:22:00.080954 | controller | changed:
2025-11-27 07:22:00.081042 | controller | {
2025-11-27 07:22:00.081069 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2025-11-27 07:22:00.081090 | controller | }
2025-11-27 07:22:00.391238 | controller | changed:
2025-11-27 07:22:00.391328 | controller | {
2025-11-27 07:22:00.391353 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2025-11-27 07:22:00.391372 | controller | }
2025-11-27 07:22:00.703391 | controller | changed:
2025-11-27 07:22:00.703478 | controller | {
2025-11-27 07:22:00.703505 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2025-11-27 07:22:00.703535 | controller | }
2025-11-27 07:22:01.011786 | controller | changed:
2025-11-27 07:22:01.011877 | controller | {
2025-11-27 07:22:01.011905 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2025-11-27 07:22:01.011954 | controller | }
2025-11-27 07:22:01.333658 | controller | changed:
2025-11-27 07:22:01.333757 | controller | {
2025-11-27 07:22:01.333786 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2025-11-27 07:22:01.333807 | controller | }
2025-11-27 07:22:01.638034 | controller | changed:
2025-11-27 07:22:01.638137 | controller | {
2025-11-27 07:22:01.638175 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2025-11-27 07:22:01.638198 | controller | }
2025-11-27 07:22:01.948653 | controller | changed:
2025-11-27 07:22:01.948756 | controller | {
2025-11-27 07:22:01.948781 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2025-11-27 07:22:01.948801 | controller | }
2025-11-27 07:22:02.242288 | controller | changed:
2025-11-27 07:22:02.242375 | controller | {
2025-11-27 07:22:02.242402 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2025-11-27 07:22:02.242422 | controller | }
2025-11-27 07:22:02.537478 | controller | changed:
2025-11-27 07:22:02.537563 | controller | {
2025-11-27 07:22:02.537588 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2025-11-27 07:22:02.537607 | controller | }
2025-11-27 07:22:02.834080 | controller | changed:
2025-11-27 07:22:02.834194 | controller | {
2025-11-27 07:22:02.834223 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2025-11-27 07:22:02.834242 | controller | }
2025-11-27 07:22:03.139212 | controller | changed:
2025-11-27 07:22:03.139309 | controller | {
2025-11-27 07:22:03.139337 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2025-11-27 07:22:03.139357 | controller | }
2025-11-27 07:22:03.157311 | 
2025-11-27 07:22:03.157395 | TASK [Set timezone to UTC]
2025-11-27 07:22:03.692527 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2025-11-27 07:22:03.697419 | 
2025-11-27 07:22:03.697494 | TASK [Create nodepool directory]
2025-11-27 07:22:03.992642 | controller | changed
2025-11-27 07:22:03.998580 | 
2025-11-27 07:22:03.998681 | TASK [Create nodepool sub_nodes file]
2025-11-27 07:22:05.009377 | controller | changed
2025-11-27 07:22:05.014283 | 
2025-11-27 07:22:05.014347 | TASK [Create nodepool sub_nodes_private file]
2025-11-27 07:22:05.993960 | controller | changed
2025-11-27 07:22:05.998826 | 
2025-11-27 07:22:05.998887 | LOOP [Populate nodepool sub_nodes file]
2025-11-27 07:22:06.027345 | 
2025-11-27 07:22:06.027470 | LOOP [Populate nodepool sub_nodes_private file]
2025-11-27 07:22:06.055342 | 
2025-11-27 07:22:06.055473 | TASK [Create nodepool primary file]
2025-11-27 07:22:06.078251 | controller | skipping: Conditional result was False
2025-11-27 07:22:06.083444 | 
2025-11-27 07:22:06.083523 | TASK [Create nodepool node_private for this node]
2025-11-27 07:22:07.149441 | controller | changed
2025-11-27 07:22:07.155423 | 
2025-11-27 07:22:07.155501 | LOOP [Copy ssh keys to nodepool directory]
2025-11-27 07:22:07.563331 | controller | ok: Item: id_rsa Runtime: 0:00:00.005219
2025-11-27 07:22:07.563509 | 
2025-11-27 07:22:07.800029 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004701
2025-11-27 07:22:07.811210 | 
2025-11-27 07:22:07.811278 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2025-11-27 07:22:08.832192 | controller | changed
2025-11-27 07:22:08.837038 | 
2025-11-27 07:22:08.837098 | TASK [Validate sudoers config after edits]
2025-11-27 07:22:09.119688 | controller | /etc/sudoers: parsed OK
2025-11-27 07:22:09.119753 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2025-11-27 07:22:09.119780 | controller | /etc/sudoers.d/zuul: parsed OK
2025-11-27 07:22:09.119831 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2025-11-27 07:22:09.362297 | controller | ok: Runtime: 0:00:00.005565
2025-11-27 07:22:09.367958 | 
2025-11-27 07:22:09.368049 | TASK [Show the environment passed in to job shell scripts]
2025-11-27 07:22:09.634997 | controller | SHELL=/bin/bash
2025-11-27 07:22:09.635033 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2025-11-27 07:22:09.635043 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2025-11-27 07:22:09.635048 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/05/3505/b4f2ed698d84316d262dfc202a9a3c3293ff14ff
2025-11-27 07:22:09.635054 | controller | PWD=/home/zuul
2025-11-27 07:22:09.635059 | controller | ZUUL_PIPELINE=github-check
2025-11-27 07:22:09.635064 | controller | LOGNAME=zuul
2025-11-27 07:22:09.635070 | controller | XDG_SESSION_TYPE=tty
2025-11-27 07:22:09.635075 | controller | _=/usr/bin/env
2025-11-27 07:22:09.635080 | controller | MOTD_SHOWN=pam
2025-11-27 07:22:09.635085 | controller | HOME=/home/zuul
2025-11-27 07:22:09.635090 | controller | LANG=en_US.UTF-8
2025-11-27 07:22:09.635119 | controller | SSH_CONNECTION=192.168.26.12 50552 192.168.26.163 22
2025-11-27 07:22:09.635126 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2025-11-27 07:22:09.635134 | controller | ZUUL_CHANGE_IDS=3505,b4f2ed698d84316d262dfc202a9a3c3293ff14ff
2025-11-27 07:22:09.635139 | controller | WORKSPACE=/home/zuul/workspace
2025-11-27 07:22:09.635144 | controller | XDG_SESSION_CLASS=user
2025-11-27 07:22:09.635150 | controller | SELINUX_ROLE_REQUESTED=
2025-11-27 07:22:09.635155 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2025-11-27 07:22:09.635160 | controller | USER=zuul
2025-11-27 07:22:09.635165 | controller | ZUUL_VOTING=True
2025-11-27 07:22:09.635170 | controller | BUILD_TIMEOUT=5400000
2025-11-27 07:22:09.635175 | controller | SELINUX_USE_CURRENT_RANGE=
2025-11-27 07:22:09.635180 | controller | SHLVL=1
2025-11-27 07:22:09.635185 | controller | ZUUL_PATCHSET=b4f2ed698d84316d262dfc202a9a3c3293ff14ff
2025-11-27 07:22:09.635190 | controller | XDG_SESSION_ID=1
2025-11-27 07:22:09.635196 | controller | ZUUL_BRANCH=main
2025-11-27 07:22:09.635201 | controller | XDG_RUNTIME_DIR=/run/user/1000
2025-11-27 07:22:09.635206 | controller | SSH_CLIENT=192.168.26.12 50552 22
2025-11-27 07:22:09.635211 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2025-11-27 07:22:09.635216 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2025-11-27 07:22:09.635232 | controller | which_declare=declare -f
2025-11-27 07:22:09.635237 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2025-11-27 07:22:09.635243 | controller | SELINUX_LEVEL_REQUESTED=
2025-11-27 07:22:09.635248 | controller | ZUUL_CHANGE=3505
2025-11-27 07:22:09.635253 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2025-11-27 07:22:09.635258 | controller | ZUUL_UUID=48e1f94789f64c23a07d45722489b7ff
2025-11-27 07:22:09.635264 | controller | BASH_FUNC_which%%=() {  ( alias;
2025-11-27 07:22:09.635270 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2025-11-27 07:22:09.635275 | controller | }
2025-11-27 07:22:09.894399 | controller | ok: Runtime: 0:00:00.005179
2025-11-27 07:22:09.899868 | 
2025-11-27 07:22:09.899952 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2025-11-27 07:22:09.913443 | controller | skipping: Conditional result was False
2025-11-27 07:22:09.918623 | 
2025-11-27 07:22:09.918687 | TASK [Symlink /home/zuul-worker/workspace]
2025-11-27 07:22:10.467716 | controller | skipping: Conditional result was False
2025-11-27 07:22:10.473656 | 
2025-11-27 07:22:10.473727 | TASK [Ensure legacy workspace directory]
2025-11-27 07:22:10.725454 | controller | changed
2025-11-27 07:22:10.743891 | 
2025-11-27 07:22:10.743980 | PLAY RECAP
2025-11-27 07:22:10.744026 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2025-11-27 07:22:10.744049 | 
2025-11-27 07:22:10.817495 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2025-11-27 07:22:10.818190 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2025-11-27 07:22:11.319236 | 
2025-11-27 07:22:11.319353 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2025-11-27 07:22:11.339801 | 
2025-11-27 07:22:11.339899 | TASK [Create zuul-output directory]
2025-11-27 07:22:11.714612 | controller | changed
2025-11-27 07:22:11.719592 | 
2025-11-27 07:22:11.719669 | TASK [Slurp Zuul inventory test]
2025-11-27 07:22:12.016507 | controller -> localhost | ok
2025-11-27 07:22:12.022425 | 
2025-11-27 07:22:12.022498 | TASK [Save zuul inventory]
2025-11-27 07:22:13.206722 | controller | changed
2025-11-27 07:22:13.212577 | 
2025-11-27 07:22:13.212646 | TASK [Save zuul vars without the change_message]
2025-11-27 07:22:14.272770 | controller | changed
2025-11-27 07:22:14.292014 | 
2025-11-27 07:22:14.292076 | PLAY RECAP
2025-11-27 07:22:14.292203 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2025-11-27 07:22:14.292239 | 
2025-11-27 07:22:14.360768 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2025-11-27 07:22:14.361533 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2025-11-27 07:22:14.948620 | 
2025-11-27 07:22:14.948775 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2025-11-27 07:22:14.970590 | 
2025-11-27 07:22:14.970697 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2025-11-27 07:22:14.992728 | controller | ok
2025-11-27 07:22:15.010617 | 
2025-11-27 07:22:15.010712 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2025-11-27 07:22:15.046297 | controller | skipping: Conditional result was False
2025-11-27 07:22:15.052633 | 
2025-11-27 07:22:15.052728 | TASK [mirror-info-fork : Create /etc/ci]
2025-11-27 07:22:15.470445 | controller | ok
2025-11-27 07:22:15.477282 | 
2025-11-27 07:22:15.477364 | TASK [mirror-info-fork : Install ci_mirror script]
2025-11-27 07:22:16.440547 | controller | ok
2025-11-27 07:22:16.452168 | 
2025-11-27 07:22:16.452259 | TASK [Prepare workspace]
2025-11-27 07:22:16.471929 | controller | ok
2025-11-27 07:22:16.493262 | 
2025-11-27 07:22:16.493344 | TASK [prepare-workspace : Start zuul_console daemon.]
2025-11-27 07:22:16.930863 | controller | ok
2025-11-27 07:22:16.937773 | 
2025-11-27 07:22:16.937887 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2025-11-27 07:22:19.400713 | controller | Output suppressed because no_log was given
2025-11-27 07:22:19.410599 | 
2025-11-27 07:22:19.410675 | LOOP [Create zuul-output directory]
2025-11-27 07:22:19.658379 | controller | changed: "/home/zuul/ci-framework-data/logs"
2025-11-27 07:22:19.879054 | controller | ok: "/home/zuul/zuul-output/logs"
2025-11-27 07:22:19.894115 | 
2025-11-27 07:22:19.894286 | TASK [Install required packages]
2025-11-27 07:22:41.157865 | controller | ok: Nothing to do
2025-11-27 07:22:41.163427 | 
2025-11-27 07:22:41.163521 | TASK [Install venv]
2025-11-27 07:23:41.540590 | controller | changed
2025-11-27 07:23:41.565963 | 
2025-11-27 07:23:41.566086 | PLAY RECAP
2025-11-27 07:23:41.566135 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2025-11-27 07:23:41.566158 | 
2025-11-27 07:23:41.642971 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2025-11-27 07:23:41.643810 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2025-11-27 07:23:42.186866 | 
2025-11-27 07:23:42.186994 | PLAY [Run ci/playbooks/molecule-test.yml]
2025-11-27 07:23:42.208493 | 
2025-11-27 07:23:42.208591 | TASK [Gather required facts]
2025-11-27 07:23:42.786662 | controller | ok
2025-11-27 07:23:42.792261 | 
2025-11-27 07:23:42.792373 | TASK [Load environment var if instructed to]
2025-11-27 07:23:42.817257 | controller | skipping: Conditional result was False
2025-11-27 07:23:42.823089 | 
2025-11-27 07:23:42.823161 | TASK [Ensure group_vars dir exists]
2025-11-27 07:23:43.196655 | controller | ok
2025-11-27 07:23:43.202057 | 
2025-11-27 07:23:43.202137 | TASK [Print related variables]
2025-11-27 07:23:43.230705 | controller | ok:
2025-11-27 07:23:43.230820 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml
2025-11-27 07:23:43.230851 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer
2025-11-27 07:23:43.235752 | 
2025-11-27 07:23:43.235821 | TASK [Run molecule]
2025-11-27 07:23:44.254709 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2025-11-27 07:23:44.536650 | controller | INFO     Performing prerun with role_name_check=0...
2025-11-27 07:24:00.592001 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.592543 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.593108 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.593600 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.594120 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+b4f2ed69 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+b4f2ed69 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.594576 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.595105 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.595544 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.595996 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.596425 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.596922 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.597360 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.597802 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.598277 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.598706 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2025-11-27 07:24:00.608438 | controller | INFO     Running crc_layout > prepare
2025-11-27 07:24:01.299787 | controller |
2025-11-27 07:24:01.299907 | controller | PLAY [Prepare] *****************************************************************
2025-11-27 07:24:01.300014 | controller |
2025-11-27 07:24:01.300118 | controller | TASK [Gathering Facts] *********************************************************
2025-11-27 07:24:01.300227 | controller | Thursday 27 November 2025  07:24:01 +0000 (0:00:00.020)       0:00:00.020 *****
2025-11-27 07:24:02.141040 | controller | ok: [instance]
2025-11-27 07:24:02.141110 | controller |
2025-11-27 07:24:02.141216 | controller | TASK [Create custom basedir] ***************************************************
2025-11-27 07:24:02.141318 | controller | Thursday 27 November 2025  07:24:02 +0000 (0:00:00.841)       0:00:00.861 *****
2025-11-27 07:24:02.458313 | controller | changed: [instance]
2025-11-27 07:24:02.458383 | controller |
2025-11-27 07:24:02.458491 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2025-11-27 07:24:02.458589 | controller | Thursday 27 November 2025  07:24:02 +0000 (0:00:00.317)       0:00:01.179 *****
2025-11-27 07:24:02.476539 | controller | skipping: [instance]
2025-11-27 07:24:02.476644 | controller |
2025-11-27 07:24:02.476788 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2025-11-27 07:24:02.476967 | controller | Thursday 27 November 2025  07:24:02 +0000 (0:00:00.018)       0:00:01.197 *****
2025-11-27 07:24:02.518525 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2025-11-27 07:24:02.518614 | controller |
2025-11-27 07:24:02.518715 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2025-11-27 07:24:02.518844 | controller | Thursday 27 November 2025  07:24:02 +0000 (0:00:00.041)       0:00:01.239 *****
2025-11-27 07:24:02.804633 | controller | ok: [instance]
2025-11-27 07:24:02.804787 | controller |
2025-11-27 07:24:02.804954 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2025-11-27 07:24:02.805089 | controller | Thursday 27 November 2025  07:24:02 +0000 (0:00:00.286)       0:00:01.525 *****
2025-11-27 07:24:03.013978 | controller | ok: [instance]
2025-11-27 07:24:03.014096 | controller |
2025-11-27 07:24:03.014231 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2025-11-27 07:24:03.014358 | controller | Thursday 27 November 2025  07:24:03 +0000 (0:00:00.209)       0:00:01.734 *****
2025-11-27 07:24:03.717623 | controller | ok: [instance] => (item=ubi-9-appstream)
2025-11-27 07:24:03.717713 | controller | ok: [instance] => (item=ubi-9-baseos)
2025-11-27 07:24:03.717838 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2025-11-27 07:24:03.717949 | controller |
2025-11-27 07:24:03.718043 | controller | TASK [Deploy repo-setup] *******************************************************
2025-11-27 07:24:03.718147 | controller | Thursday 27 November 2025  07:24:03 +0000 (0:00:00.703)       0:00:02.438 *****
2025-11-27 07:24:03.776464 | controller |
2025-11-27 07:24:03.776571 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2025-11-27 07:24:03.776720 | controller | Thursday 27 November 2025  07:24:03 +0000 (0:00:00.059)       0:00:02.497 *****
2025-11-27 07:24:03.792728 | controller | skipping: [instance]
2025-11-27 07:24:03.792843 | controller |
2025-11-27 07:24:03.793009 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2025-11-27 07:24:03.793120 | controller | Thursday 27 November 2025  07:24:03 +0000 (0:00:00.016)       0:00:02.513 *****
2025-11-27 07:24:03.821319 | controller | skipping: [instance]
2025-11-27 07:24:03.821404 | controller |
2025-11-27 07:24:03.821560 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2025-11-27 07:24:03.821656 | controller | Thursday 27 November 2025  07:24:03 +0000 (0:00:00.028)       0:00:02.542 *****
2025-11-27 07:24:03.837894 | controller | skipping: [instance]
2025-11-27 07:24:03.837964 | controller |
2025-11-27 07:24:03.838094 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2025-11-27 07:24:03.838171 | controller | Thursday 27 November 2025  07:24:03 +0000 (0:00:00.016)       0:00:02.559 *****
2025-11-27 07:24:03.854018 | controller | skipping: [instance]
2025-11-27 07:24:03.854087 | controller |
2025-11-27 07:24:03.854234 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2025-11-27 07:24:03.854305 | controller | Thursday 27 November 2025  07:24:03 +0000 (0:00:00.016)       0:00:02.575 *****
2025-11-27 07:24:04.401543 | controller | changed: [instance] => (item=tmp)
2025-11-27 07:24:04.401617 | controller | changed: [instance] => (item=artifacts/repositories)
2025-11-27 07:24:04.401723 | controller | changed: [instance] => (item=venv/repo_setup)
2025-11-27 07:24:04.401831 | controller |
2025-11-27 07:24:04.401961 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2025-11-27 07:24:04.402049 | controller | Thursday 27 November 2025  07:24:04 +0000 (0:00:00.547)       0:00:03.122 *****
2025-11-27 07:24:05.242728 | controller | ok: [instance]
2025-11-27 07:24:05.242810 | controller |
2025-11-27 07:24:05.243071 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2025-11-27 07:24:06.314823 | controller | Thursday 27 November 2025  07:24:05 +0000 (0:00:00.841)       0:00:03.963 *****
2025-11-27 07:24:06.314872 | controller | changed: [instance]
2025-11-27 07:24:14.210744 | controller |
2025-11-27 07:24:14.210959 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2025-11-27 07:24:14.210970 | controller | Thursday 27 November 2025  07:24:06 +0000 (0:00:01.071)       0:00:05.035 *****
2025-11-27 07:24:14.210982 | controller | changed: [instance]
2025-11-27 07:24:14.935870 | controller |
2025-11-27 07:24:14.935909 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2025-11-27 07:24:14.935917 | controller | Thursday 27 November 2025  07:24:14 +0000 (0:00:07.895)       0:00:12.930 *****
2025-11-27 07:24:14.935929 | controller | changed: [instance]
2025-11-27 07:24:14.959385 | controller |
2025-11-27 07:24:14.959422 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2025-11-27 07:24:14.959430 | controller | Thursday 27 November 2025  07:24:14 +0000 (0:00:00.725)       0:00:13.656 *****
2025-11-27 07:24:14.959440 | controller | skipping: [instance]
2025-11-27 07:24:15.764111 | controller |
2025-11-27 07:24:15.764144 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2025-11-27 07:24:15.764152 | controller | Thursday 27 November 2025  07:24:14 +0000 (0:00:00.023)       0:00:13.680 *****
2025-11-27 07:24:15.764162 | controller | changed: [instance]
2025-11-27 07:24:15.800443 | controller |
2025-11-27 07:24:15.800470 | controller | TASK [repo_setup : Get component repo] *****************************************
2025-11-27 07:24:15.800479 | controller | Thursday 27 November 2025  07:24:15 +0000 (0:00:00.804)       0:00:14.484 *****
2025-11-27 07:24:15.800491 | controller | skipping: [instance]
2025-11-27 07:24:15.837162 | controller |
2025-11-27 07:24:15.837184 | controller | TASK [repo_setup : Rename component repo] **************************************
2025-11-27 07:24:15.837191 | controller | Thursday 27 November 2025  07:24:15 +0000 (0:00:00.036)       0:00:14.521 *****
2025-11-27 07:24:15.837200 | controller | skipping: [instance]
2025-11-27 07:24:15.873853 | controller |
2025-11-27 07:24:15.873898 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2025-11-27 07:24:15.873906 | controller | Thursday 27 November 2025  07:24:15 +0000 (0:00:00.036)       0:00:14.557 *****
2025-11-27 07:24:15.873921 | controller | skipping: [instance]
2025-11-27 07:24:16.412671 | controller |
2025-11-27 07:24:16.412704 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2025-11-27 07:24:16.412712 | controller | Thursday 27 November 2025  07:24:15 +0000 (0:00:00.036)       0:00:14.594 *****
2025-11-27 07:24:16.412723 | controller | changed: [instance]
2025-11-27 07:24:16.858903 | controller |
2025-11-27 07:24:16.858940 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2025-11-27 07:24:16.858948 | controller | Thursday 27 November 2025  07:24:16 +0000 (0:00:00.538)       0:00:15.133 *****
2025-11-27 07:24:16.858959 | controller | changed: [instance]
2025-11-27 07:24:16.859309 | controller |
2025-11-27 07:24:16.889947 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2025-11-27 07:24:16.889983 | controller | Thursday 27 November 2025  07:24:16 +0000 (0:00:00.446)       0:00:15.579 *****
2025-11-27 07:24:16.890007 | controller | skipping: [instance]
2025-11-27 07:24:16.919624 | controller |
2025-11-27 07:24:16.919647 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2025-11-27 07:24:16.919656 | controller | Thursday 27 November 2025  07:24:16 +0000 (0:00:00.030)       0:00:15.610 *****
2025-11-27 07:24:16.919667 | controller | skipping: [instance]
2025-11-27 07:24:16.948930 | controller |
2025-11-27 07:24:16.948965 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2025-11-27 07:24:16.948974 | controller | Thursday 27 November 2025  07:24:16 +0000 (0:00:00.030)       0:00:15.640 *****
2025-11-27 07:24:16.948986 | controller | skipping: [instance]
2025-11-27 07:24:16.949014 | controller |
2025-11-27 07:24:16.949023 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2025-11-27 07:24:16.949112 | controller | Thursday 27 November 2025  07:24:16 +0000 (0:00:00.029)       0:00:15.669 *****
2025-11-27 07:24:17.021273 | controller | ok: [instance]
2025-11-27 07:24:17.050878 | controller |
2025-11-27 07:24:17.050938 | controller | TASK [repo_setup : Create download directory] **********************************
2025-11-27 07:24:17.050948 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.071)       0:00:15.741 *****
2025-11-27 07:24:17.050966 | controller | skipping: [instance]
2025-11-27 07:24:17.079517 | controller |
2025-11-27 07:24:17.079569 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2025-11-27 07:24:17.079578 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.029)       0:00:15.771 *****
2025-11-27 07:24:17.079594 | controller | skipping: [instance]
2025-11-27 07:24:17.079663 | controller |
2025-11-27 07:24:17.079825 | controller | TASK [Download the RPM] ********************************************************
2025-11-27 07:24:17.080020 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.029)       0:00:15.800 *****
2025-11-27 07:24:17.108792 | controller | skipping: [instance]
2025-11-27 07:24:17.108954 | controller |
2025-11-27 07:24:17.109140 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2025-11-27 07:24:17.109292 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.029)       0:00:15.829 *****
2025-11-27 07:24:17.138012 | controller | skipping: [instance]
2025-11-27 07:24:17.138139 | controller |
2025-11-27 07:24:17.138292 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2025-11-27 07:24:17.138425 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.029)       0:00:15.859 *****
2025-11-27 07:24:17.165884 | controller | skipping: [instance]
2025-11-27 07:24:17.166077 | controller |
2025-11-27 07:24:17.166305 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2025-11-27 07:24:17.166480 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.027)       0:00:15.886 *****
2025-11-27 07:24:17.193950 | controller | skipping: [instance]
2025-11-27 07:24:17.194019 | controller |
2025-11-27 07:24:17.194159 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2025-11-27 07:24:17.194276 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.028)       0:00:15.915 *****
2025-11-27 07:24:17.220822 | controller | skipping: [instance]
2025-11-27 07:24:17.220987 | controller |
2025-11-27 07:24:17.221137 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2025-11-27 07:24:17.221289 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.026)       0:00:15.941 *****
2025-11-27 07:24:17.402212 | controller | ok: [instance]
2025-11-27 07:24:17.620535 | controller |
2025-11-27 07:24:17.620568 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2025-11-27 07:24:17.620576 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.180)       0:00:16.122 *****
2025-11-27 07:24:17.620586 | controller | changed: [instance]
2025-11-27 07:24:17.849464 | controller |
2025-11-27 07:24:17.849495 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2025-11-27 07:24:17.849503 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.218)       0:00:16.341 *****
2025-11-27 07:24:17.849514 | controller | changed: [instance]
2025-11-27 07:24:17.870918 | controller |
2025-11-27 07:24:17.870968 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2025-11-27 07:24:17.870990 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.228)       0:00:16.570 *****
2025-11-27 07:24:17.871006 | controller | skipping: [instance]
2025-11-27 07:24:17.871038 | controller |
2025-11-27 07:24:17.871048 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2025-11-27 07:24:17.894478 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.021)       0:00:16.591 *****
2025-11-27 07:24:17.894514 | controller | skipping: [instance]
2025-11-27 07:24:17.916918 | controller |
2025-11-27 07:24:17.916956 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2025-11-27 07:24:17.916965 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.023)       0:00:16.615 *****
2025-11-27 07:24:17.916978 | controller | skipping: [instance]
2025-11-27 07:24:17.917024 | controller |
2025-11-27 07:24:17.917047 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2025-11-27 07:24:17.917059 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.022)       0:00:16.637 *****
2025-11-27 07:24:17.938906 | controller | skipping: [instance]
2025-11-27 07:24:17.938958 | controller |
2025-11-27 07:24:17.939162 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2025-11-27 07:24:17.961662 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.022)       0:00:16.659 *****
2025-11-27 07:24:17.961696 | controller | skipping: [instance]
2025-11-27 07:24:17.987882 | controller |
2025-11-27 07:24:17.987916 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] ***
2025-11-27 07:24:17.987927 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.022)       0:00:16.682 *****
2025-11-27 07:24:17.987946 | controller | skipping: [instance]
2025-11-27 07:24:17.988069 | controller |
2025-11-27 07:24:17.988081 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2025-11-27 07:24:17.988092 | controller | Thursday 27 November 2025  07:24:17 +0000 (0:00:00.026)       0:00:16.708 *****
2025-11-27 07:24:18.017631 | controller | skipping: [instance]
2025-11-27 07:24:18.017738 | controller |
2025-11-27 07:24:18.017887 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2025-11-27 07:24:18.018017 | controller | Thursday 27 November 2025  07:24:18 +0000 (0:00:00.029)       0:00:16.738 *****
2025-11-27 07:24:18.047531 | controller | skipping: [instance]
2025-11-27 07:24:18.047654 | controller |
2025-11-27 07:24:18.047811 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2025-11-27 07:24:18.047946 | controller | Thursday 27 November 2025  07:24:18 +0000 (0:00:00.029)       0:00:16.768 *****
2025-11-27 07:24:18.077854 | controller | skipping: [instance]
2025-11-27 07:24:18.077970 | controller |
2025-11-27 07:24:18.078137 | controller | TASK [test_deps : Install additional packages] *********************************
2025-11-27 07:24:18.078235 | controller | Thursday 27 November 2025  07:24:18 +0000 (0:00:00.030)       0:00:16.798 *****
2025-11-27 07:24:18.106713 | controller | skipping: [instance]
2025-11-27 07:24:18.106835 | controller |
2025-11-27 07:24:18.107008 | controller | TASK [test_deps : Install selinux python libs] *********************************
2025-11-27 07:24:18.107099 | controller | Thursday 27 November 2025  07:24:18 +0000 (0:00:00.028)       0:00:16.827 *****
2025-11-27 07:25:06.942683 | controller | ok: [instance]
2025-11-27 07:25:08.165683 | controller |
2025-11-27 07:25:08.165713 | controller | TASK [test_deps : Install python yaml libs] ************************************
2025-11-27 07:25:08.165721 | controller | Thursday 27 November 2025  07:25:06 +0000 (0:00:48.835)       0:01:05.663 *****
2025-11-27 07:25:08.165730 | controller | ok: [instance]
2025-11-27 07:25:08.197035 | controller |
2025-11-27 07:25:08.197122 | controller | TASK [test_deps : Install extra packages] **************************************
2025-11-27 07:25:08.197135 | controller | Thursday 27 November 2025  07:25:08 +0000 (0:00:01.223)       0:01:06.886 *****
2025-11-27 07:25:08.197153 | controller | skipping: [instance]
2025-11-27 07:25:08.238784 | controller |
2025-11-27 07:25:08.238836 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2025-11-27 07:25:08.238847 | controller | Thursday 27 November 2025  07:25:08 +0000 (0:00:00.031)       0:01:06.917 *****
2025-11-27 07:25:08.238862 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2025-11-27 07:25:08.255847 | controller |
2025-11-27 07:25:08.255875 | controller | TASK [ci_setup : List packages to install] *************************************
2025-11-27 07:25:08.255890 | controller | Thursday 27 November 2025  07:25:08 +0000 (0:00:00.041)       0:01:06.959 *****
2025-11-27 07:25:08.255901 | controller | ok: [instance] =>
2025-11-27 07:25:08.255925 | controller |   cifmw_ci_setup_packages:
2025-11-27 07:25:08.256833 | controller |   - bash-completion
2025-11-27 07:25:15.834814 | controller |   - ca-certificates
2025-11-27 07:25:15.834849 | controller |   - git-core
2025-11-27 07:25:15.834856 | controller |   - make
2025-11-27 07:25:15.834862 | controller |   - tar
2025-11-27 07:25:15.834868 | controller |   - tmux
2025-11-27 07:25:15.834873 | controller |   - python3-pip
2025-11-27 07:25:15.834878 | controller |
2025-11-27 07:25:15.834884 | controller | TASK [ci_setup : Install needed packages] **************************************
2025-11-27 07:25:15.834890 | controller | Thursday 27 November 2025  07:25:08 +0000 (0:00:00.017)       0:01:06.976 *****
2025-11-27 07:25:15.834899 | controller | changed: [instance]
2025-11-27 07:25:16.396052 | controller |
2025-11-27 07:25:16.396085 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2025-11-27 07:25:16.396094 | controller | Thursday 27 November 2025  07:25:15 +0000 (0:00:07.577)       0:01:14.554 *****
2025-11-27 07:25:16.396104 | controller | ok: [instance]
2025-11-27 07:25:16.396130 | controller |
2025-11-27 07:25:16.396393 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2025-11-27 07:25:16.606004 | controller | Thursday 27 November 2025  07:25:16 +0000 (0:00:00.562)       0:01:15.117 *****
2025-11-27 07:25:16.606054 | controller | changed: [instance]
2025-11-27 07:25:22.575946 | controller |
2025-11-27 07:25:22.575989 | controller | TASK [ci_setup : Install openshift client] *************************************
2025-11-27 07:25:22.575999 | controller | Thursday 27 November 2025  07:25:16 +0000 (0:00:00.209)       0:01:15.326 *****
2025-11-27 07:25:22.576013 | controller | changed: [instance]
2025-11-27 07:25:22.576053 | controller |
2025-11-27 07:25:22.576201 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2025-11-27 07:25:22.576234 | controller | Thursday 27 November 2025  07:25:22 +0000 (0:00:05.970)       0:01:21.296 *****
2025-11-27 07:25:22.630927 | controller | ok: [instance]
2025-11-27 07:25:22.904373 | controller |
2025-11-27 07:25:22.904400 | controller | TASK [ci_setup : Create completion file] ***************************************
2025-11-27 07:25:22.904408 | controller | Thursday 27 November 2025  07:25:22 +0000 (0:00:00.054)       0:01:21.351 *****
2025-11-27 07:25:22.904418 | controller | changed: [instance]
2025-11-27 07:25:23.161826 | controller |
2025-11-27 07:25:23.161854 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2025-11-27 07:25:23.161862 | controller | Thursday 27 November 2025  07:25:22 +0000 (0:00:00.273)       0:01:21.625 *****
2025-11-27 07:25:23.161872 | controller | changed: [instance]
2025-11-27 07:25:23.161894 | controller |
2025-11-27 07:25:23.161902 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2025-11-27 07:25:23.161921 | controller | Thursday 27 November 2025  07:25:23 +0000 (0:00:00.257)       0:01:21.882 *****
2025-11-27 07:25:23.178849 | controller | skipping: [instance]
2025-11-27 07:25:23.194844 | controller |
2025-11-27 07:25:23.194875 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2025-11-27 07:25:23.194884 | controller | Thursday 27 November 2025  07:25:23 +0000 (0:00:00.016)       0:01:21.899 *****
2025-11-27 07:25:23.194894 | controller | skipping: [instance]
2025-11-27 07:25:23.194919 | controller |
2025-11-27 07:25:23.194927 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2025-11-27 07:25:23.195063 | controller | Thursday 27 November 2025  07:25:23 +0000 (0:00:00.016)       0:01:21.915 *****
2025-11-27 07:25:23.211733 | controller | skipping: [instance]
2025-11-27 07:25:23.228512 | controller |
2025-11-27 07:25:23.228533 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2025-11-27 07:25:23.228542 | controller | Thursday 27 November 2025  07:25:23 +0000 (0:00:00.016)       0:01:21.932 *****
2025-11-27 07:25:23.228553 | controller | skipping: [instance]
2025-11-27 07:25:23.245558 | controller |
2025-11-27 07:25:23.245581 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2025-11-27 07:25:23.245598 | controller | Thursday 27 November 2025  07:25:23 +0000 (0:00:00.016)       0:01:21.949 *****
2025-11-27 07:25:23.245609 | controller | skipping: [instance]
2025-11-27 07:25:23.266918 | controller |
2025-11-27 07:25:23.266951 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2025-11-27 07:25:23.266959 | controller | Thursday 27 November 2025  07:25:23 +0000 (0:00:00.016)       0:01:21.966 *****
2025-11-27 07:25:23.266969 | controller | skipping: [instance]
2025-11-27 07:25:23.266994 | controller |
2025-11-27 07:25:23.267210 | controller | TASK [ci_setup : Manage directories] *******************************************
2025-11-27 07:25:24.214900 | controller | Thursday 27 November 2025  07:25:23 +0000 (0:00:00.021)       0:01:21.988 *****
2025-11-27 07:25:24.214937 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2025-11-27 07:25:24.214969 | controller | changed: [instance] => (item=/opt/basedir/logs)
2025-11-27 07:25:24.214977 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2025-11-27 07:25:24.214986 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2025-11-27 07:25:24.215460 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2025-11-27 07:25:24.542487 | controller |
2025-11-27 07:25:24.542517 | controller | TASK [Create secret file] ******************************************************
2025-11-27 07:25:24.542525 | controller | Thursday 27 November 2025  07:25:24 +0000 (0:00:00.947)       0:01:22.935 *****
2025-11-27 07:25:24.542547 | controller | changed: [instance]
2025-11-27 07:25:24.542566 | controller |
2025-11-27 07:25:24.542876 | controller | PLAY RECAP *********************************************************************
2025-11-27 07:25:24.542936 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2025-11-27 07:25:24.542949 | controller |
2025-11-27 07:25:24.544856 | controller | Thursday 27 November 2025  07:25:24 +0000 (0:00:00.327)       0:01:23.263 *****
2025-11-27 07:25:24.544904 | controller | ===============================================================================
2025-11-27 07:25:24.544913 | controller | test_deps : Install selinux python libs -------------------------------- 48.84s
2025-11-27 07:25:24.544918 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.90s
2025-11-27 07:25:24.544924 | controller | ci_setup : Install needed packages -------------------------------------- 7.58s
2025-11-27 07:25:24.544929 | controller | ci_setup : Install openshift client ------------------------------------- 5.97s
2025-11-27 07:25:24.544934 | controller | test_deps : Install python yaml libs ------------------------------------ 1.22s
2025-11-27 07:25:24.544939 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.07s
2025-11-27 07:25:24.544944 | controller | ci_setup : Manage directories ------------------------------------------- 0.95s
2025-11-27 07:25:24.544950 | controller | Gathering Facts --------------------------------------------------------- 0.84s
2025-11-27 07:25:24.544955 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.84s
2025-11-27 07:25:24.544960 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.80s
2025-11-27 07:25:24.544965 | controller | repo_setup : Install repo-setup package --------------------------------- 0.73s
2025-11-27 07:25:24.544970 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.70s
2025-11-27 07:25:24.544975 | controller | ci_setup : Gather version of openshift client --------------------------- 0.56s
2025-11-27 07:25:24.544980 | controller | repo_setup : Ensure directories are present ----------------------------- 0.55s
2025-11-27 07:25:24.544985 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.54s
2025-11-27 07:25:24.544991 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.45s
2025-11-27 07:25:24.544998 | controller | Create secret file ------------------------------------------------------ 0.33s
2025-11-27 07:25:24.545017 | controller | Create custom basedir --------------------------------------------------- 0.32s
2025-11-27 07:25:24.545165 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.29s
2025-11-27 07:25:24.597337 | controller | ci_setup : Create completion file --------------------------------------- 0.27s
2025-11-27 07:25:24.597362 | controller | INFO     Running crc_layout > converge
2025-11-27 07:25:25.194359 | controller |
2025-11-27 07:25:26.004708 | controller | PLAY [Converge] ****************************************************************
2025-11-27 07:25:26.004742 | controller |
2025-11-27 07:25:26.004751 | controller | TASK [Gathering Facts] *********************************************************
2025-11-27 07:25:26.004778 | controller | Thursday 27 November 2025  07:25:25 +0000 (0:00:00.027)       0:00:00.027 *****
2025-11-27 07:25:26.004793 | controller | ok: [instance]
2025-11-27 07:25:26.054911 | controller |
2025-11-27 07:25:26.054946 | controller | TASK [Load networking definition from scenario file] ***************************
2025-11-27 07:25:26.054954 | controller | Thursday 27 November 2025  07:25:26 +0000 (0:00:00.810)       0:00:00.838 *****
2025-11-27 07:25:26.054965 | controller | ok: [instance]
2025-11-27 07:25:26.054991 | controller |
2025-11-27 07:25:26.054998 | controller | TASK [discover_latest_image : Get latest image] ********************************
2025-11-27 07:25:26.055005 | controller | Thursday 27 November 2025  07:25:26 +0000 (0:00:00.050)       0:00:00.888 *****
2025-11-27 07:25:27.788176 | controller | changed: [instance]
2025-11-27 07:25:27.815286 | controller |
2025-11-27 07:25:27.815317 | controller | TASK [discover_latest_image : Export facts accordingly] ************************
2025-11-27 07:25:27.815325 | controller | Thursday 27 November 2025  07:25:27 +0000 (0:00:01.733)       0:00:02.621 *****
2025-11-27 07:25:27.815343 | controller | ok: [instance]
2025-11-27 07:25:27.837279 | controller |
2025-11-27 07:25:27.837303 | controller | TASK [reproducer : Load CI job environment] ************************************
2025-11-27 07:25:27.837312 | controller | Thursday 27 November 2025  07:25:27 +0000 (0:00:00.027)       0:00:02.648 *****
2025-11-27 07:25:27.837323 | controller | skipping: [instance]
2025-11-27 07:25:27.887158 | controller |
2025-11-27 07:25:27.887186 | controller | TASK [Build final libvirt layout] **********************************************
2025-11-27 07:25:27.887195 | controller | Thursday 27 November 2025  07:25:27 +0000 (0:00:00.022)       0:00:02.670 *****
2025-11-27 07:25:27.887207 | controller |
2025-11-27 07:25:27.887394 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2025-11-27 07:25:27.887548 | controller | Thursday 27 November 2025  07:25:27 +0000 (0:00:00.050)       0:00:02.721 *****
2025-11-27 07:25:27.971685 | controller | ok: [instance]
2025-11-27 07:25:27.971909 | controller |
2025-11-27 07:25:27.972366 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2025-11-27 07:25:27.972549 | controller | Thursday 27 November 2025  07:25:27 +0000 (0:00:00.084)       0:00:02.805 *****
2025-11-27 07:25:28.032045 | controller | skipping: [instance]
2025-11-27 07:25:28.032224 | controller |
2025-11-27 07:25:28.032366 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2025-11-27 07:25:28.032502 | controller | Thursday 27 November 2025  07:25:28 +0000 (0:00:00.060)       0:00:02.865 *****
2025-11-27 07:25:28.057614 | controller | ok: [instance]
2025-11-27 07:25:28.057813 | controller |
2025-11-27 07:25:28.057979 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2025-11-27 07:25:28.058138 | controller | Thursday 27 November 2025  07:25:28 +0000 (0:00:00.025)       0:00:02.891 *****
2025-11-27 07:25:28.082085 | controller | ok: [instance] => changed=false
2025-11-27 07:25:28.082286 | controller |   msg: All assertions passed
2025-11-27 07:25:28.082450 | controller |
2025-11-27 07:25:28.082618 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2025-11-27 07:25:28.082805 | controller | Thursday 27 November 2025  07:25:28 +0000 (0:00:00.024)       0:00:02.915 *****
2025-11-27 07:25:28.125698 | controller | ok: [instance]
2025-11-27 07:25:28.125925 | controller |
2025-11-27 07:25:28.126084 | controller | TASK [reproducer : Ensure directories are present] *****************************
2025-11-27 07:25:28.126225 | controller | Thursday 27 November 2025  07:25:28 +0000 (0:00:00.043)       0:00:02.959 *****
2025-11-27 07:25:28.626858 | controller | ok: [instance] => (item=artifacts)
2025-11-27 07:25:28.627178 | controller | ok: [instance] => (item=logs)
2025-11-27 07:25:28.627211 | controller |
2025-11-27 07:25:28.703365 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2025-11-27 07:25:28.703415 | controller | Thursday 27 November 2025  07:25:28 +0000 (0:00:00.500)       0:00:03.460 *****
2025-11-27 07:25:28.703427 | controller |
2025-11-27 07:25:28.905911 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2025-11-27 07:25:28.905949 | controller | Thursday 27 November 2025  07:25:28 +0000 (0:00:00.076)       0:00:03.536 *****
2025-11-27 07:25:28.905961 | controller | ok: [instance]
2025-11-27 07:25:29.189474 | controller |
2025-11-27 07:25:29.189504 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2025-11-27 07:25:29.189512 | controller | Thursday 27 November 2025  07:25:28 +0000 (0:00:00.202)       0:00:03.739 *****
2025-11-27 07:25:29.189521 | controller | changed: [instance]
2025-11-27 07:25:29.478441 | controller |
2025-11-27 07:25:29.478476 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2025-11-27 07:25:29.478484 | controller | Thursday 27 November 2025  07:25:29 +0000 (0:00:00.283)       0:00:04.022 *****
2025-11-27 07:25:29.478494 | controller | ok: [instance]
2025-11-27 07:25:29.507604 | controller |
2025-11-27 07:25:29.507623 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2025-11-27 07:25:29.507631 | controller | Thursday 27 November 2025  07:25:29 +0000 (0:00:00.288)       0:00:04.311 *****
2025-11-27 07:25:29.507639 | controller | skipping: [instance]
2025-11-27 07:25:29.526416 | controller |
2025-11-27 07:25:29.526438 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2025-11-27 07:25:29.526447 | controller | Thursday 27 November 2025  07:25:29 +0000 (0:00:00.029)       0:00:04.341 *****
2025-11-27 07:25:29.526457 | controller | skipping: [instance]
2025-11-27 07:25:29.547808 | controller |
2025-11-27 07:25:29.547845 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2025-11-27 07:25:29.547853 | controller | Thursday 27 November 2025  07:25:29 +0000 (0:00:00.018)       0:00:04.359 *****
2025-11-27 07:25:29.547865 | controller | ok: [instance]
2025-11-27 07:25:29.576343 | controller |
2025-11-27 07:25:29.576368 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2025-11-27 07:25:29.576384 | controller | Thursday 27 November 2025  07:25:29 +0000 (0:00:00.021)       0:00:04.381 *****
2025-11-27 07:25:29.576395 | controller | skipping: [instance]
2025-11-27 07:25:39.332952 | controller |
2025-11-27 07:25:39.332982 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2025-11-27 07:25:39.332990 | controller | Thursday 27 November 2025  07:25:29 +0000 (0:00:00.028)       0:00:04.409 *****
2025-11-27 07:25:39.333000 | controller | changed: [instance]
2025-11-27 07:25:39.540513 | controller |
2025-11-27 07:25:39.540545 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2025-11-27 07:25:39.540553 | controller | Thursday 27 November 2025  07:25:39 +0000 (0:00:09.756)       0:00:14.166 *****
2025-11-27 07:25:39.540563 | controller | changed: [instance]
2025-11-27 07:25:39.540594 | controller |
2025-11-27 07:25:39.540834 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2025-11-27 07:25:40.030901 | controller | Thursday 27 November 2025  07:25:39 +0000 (0:00:00.207)       0:00:14.374 *****
2025-11-27 07:25:40.030945 | controller | changed: [instance]
2025-11-27 07:25:40.031022 | controller |
2025-11-27 07:25:40.031050 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2025-11-27 07:25:40.031062 | controller | Thursday 27 November 2025  07:25:40 +0000 (0:00:00.490)       0:00:14.864 *****
2025-11-27 07:25:40.619677 | controller | changed: [instance]
2025-11-27 07:25:40.813880 | controller |
2025-11-27 07:25:40.813912 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2025-11-27 07:25:40.813921 | controller | Thursday 27 November 2025  07:25:40 +0000 (0:00:00.588)       0:00:15.453 *****
2025-11-27 07:25:40.813933 | controller | ok: [instance]
2025-11-27 07:25:41.474583 | controller |
2025-11-27 07:25:41.474613 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2025-11-27 07:25:41.474621 | controller | Thursday 27 November 2025  07:25:40 +0000 (0:00:00.194)       0:00:15.647 *****
2025-11-27 07:25:41.474631 | controller | ok: [instance]
2025-11-27 07:25:42.301442 | controller |
2025-11-27 07:25:42.301474 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2025-11-27 07:25:42.301492 | controller | Thursday 27 November 2025  07:25:41 +0000 (0:00:00.660)       0:00:16.307 *****
2025-11-27 07:25:42.301504 | controller | changed: [instance]
2025-11-27 07:25:42.384925 | controller |
2025-11-27 07:25:42.384964 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2025-11-27 07:25:42.384974 | controller | Thursday 27 November 2025  07:25:42 +0000 (0:00:00.826)       0:00:17.134 *****
2025-11-27 07:25:42.384987 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2025-11-27 07:25:42.385845 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2025-11-27 07:25:42.385878 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2025-11-27 07:25:43.728825 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2025-11-27 07:25:43.728855 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2025-11-27 07:25:43.728863 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2025-11-27 07:25:43.728868 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2025-11-27 07:25:43.728873 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2025-11-27 07:25:43.728879 | controller |
2025-11-27 07:25:43.728885 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2025-11-27 07:25:43.728891 | controller | Thursday 27 November 2025  07:25:42 +0000 (0:00:00.083)       0:00:17.218 *****
2025-11-27 07:25:43.728900 | controller | ok: [instance]
2025-11-27 07:25:44.043714 | controller |
2025-11-27 07:25:44.043746 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2025-11-27 07:25:44.043755 | controller | Thursday 27 November 2025  07:25:43 +0000 (0:00:01.343)       0:00:18.562 *****
2025-11-27 07:25:44.043788 | controller | ok: [instance]
2025-11-27 07:25:44.364875 | controller |
2025-11-27 07:25:44.364906 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2025-11-27 07:25:44.364913 | controller | Thursday 27 November 2025  07:25:44 +0000 (0:00:00.314)       0:00:18.877 *****
2025-11-27 07:25:44.364923 | controller | ok: [instance]
2025-11-27 07:25:44.364950 | controller |
2025-11-27 07:25:44.365173 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2025-11-27 07:25:44.681411 | controller | Thursday 27 November 2025  07:25:44 +0000 (0:00:00.321)       0:00:19.198 *****
2025-11-27 07:25:44.681444 | controller | ok: [instance]
2025-11-27 07:25:44.996882 | controller |
2025-11-27 07:25:44.996917 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2025-11-27 07:25:44.996926 | controller | Thursday 27 November 2025  07:25:44 +0000 (0:00:00.316)       0:00:19.514 *****
2025-11-27 07:25:44.996940 | controller | ok: [instance]
2025-11-27 07:25:45.311894 | controller |
2025-11-27 07:25:45.311930 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2025-11-27 07:25:45.311939 | controller | Thursday 27 November 2025  07:25:44 +0000 (0:00:00.315)       0:00:19.830 *****
2025-11-27 07:25:45.311951 | controller | ok: [instance]
2025-11-27 07:25:45.630776 | controller |
2025-11-27 07:25:45.630807 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2025-11-27 07:25:45.630815 | controller | Thursday 27 November 2025  07:25:45 +0000 (0:00:00.314)       0:00:20.145 *****
2025-11-27 07:25:45.630831 | controller | ok: [instance]
2025-11-27 07:25:45.948890 | controller |
2025-11-27 07:25:45.948925 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2025-11-27 07:25:45.948935 | controller | Thursday 27 November 2025  07:25:45 +0000 (0:00:00.318)       0:00:20.464 *****
2025-11-27 07:25:45.948955 | controller | ok: [instance]
2025-11-27 07:25:46.268553 | controller |
2025-11-27 07:25:46.268583 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2025-11-27 07:25:46.268591 | controller | Thursday 27 November 2025  07:25:45 +0000 (0:00:00.318)       0:00:20.782 *****
2025-11-27 07:25:46.268600 | controller | ok: [instance]
2025-11-27 07:25:46.582317 | controller |
2025-11-27 07:25:46.582346 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2025-11-27 07:25:46.582354 | controller | Thursday 27 November 2025  07:25:46 +0000 (0:00:00.319)       0:00:21.101 *****
2025-11-27 07:25:46.582364 | controller | ok: [instance]
2025-11-27 07:25:46.899213 | controller |
2025-11-27 07:25:46.899242 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2025-11-27 07:25:46.899250 | controller | Thursday 27 November 2025  07:25:46 +0000 (0:00:00.313)       0:00:21.415 *****
2025-11-27 07:25:46.899260 | controller | ok: [instance]
2025-11-27 07:25:47.217879 | controller |
2025-11-27 07:25:47.217912 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2025-11-27 07:25:47.217922 | controller | Thursday 27 November 2025  07:25:46 +0000 (0:00:00.316)       0:00:21.732 *****
2025-11-27 07:25:47.217933 | controller | ok: [instance]
2025-11-27 07:25:47.217962 | controller |
2025-11-27 07:25:47.218141 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2025-11-27 07:25:47.535375 | controller | Thursday 27 November 2025  07:25:47 +0000 (0:00:00.318)       0:00:22.051 *****
2025-11-27 07:25:47.535410 | controller | ok: [instance]
2025-11-27 07:25:47.854315 | controller |
2025-11-27 07:25:47.854347 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2025-11-27 07:25:47.854355 | controller | Thursday 27 November 2025  07:25:47 +0000 (0:00:00.317)       0:00:22.368 *****
2025-11-27 07:25:47.854365 | controller | ok: [instance]
2025-11-27 07:25:48.168256 | controller |
2025-11-27 07:25:48.168286 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2025-11-27 07:25:48.168294 | controller | Thursday 27 November 2025  07:25:47 +0000 (0:00:00.318)       0:00:22.687 *****
2025-11-27 07:25:48.168304 | controller | ok: [instance]
2025-11-27 07:25:48.490829 | controller |
2025-11-27 07:25:48.490859 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2025-11-27 07:25:48.490867 | controller | Thursday 27 November 2025  07:25:48 +0000 (0:00:00.314)       0:00:23.001 *****
2025-11-27 07:25:48.490877 | controller | ok: [instance]
2025-11-27 07:25:48.490946 | controller |
2025-11-27 07:25:48.490960 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2025-11-27 07:25:48.490968 | controller | Thursday 27 November 2025  07:25:48 +0000 (0:00:00.322)       0:00:23.324 *****
2025-11-27 07:25:48.824401 | controller | ok: [instance]
2025-11-27 07:25:49.145922 | controller |
2025-11-27 07:25:49.145956 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2025-11-27 07:25:49.145966 | controller | Thursday 27 November 2025  07:25:48 +0000 (0:00:00.333)       0:00:23.657 *****
2025-11-27 07:25:49.145978 | controller | ok: [instance]
2025-11-27 07:25:49.146062 | controller |
2025-11-27 07:25:49.146090 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2025-11-27 07:25:49.146102 | controller | Thursday 27 November 2025  07:25:49 +0000 (0:00:00.321)       0:00:23.979 *****
2025-11-27 07:25:49.464519 | controller | ok: [instance]
2025-11-27 07:25:49.782379 | controller |
2025-11-27 07:25:49.782410 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2025-11-27 07:25:49.782418 | controller | Thursday 27 November 2025  07:25:49 +0000 (0:00:00.318)       0:00:24.297 *****
2025-11-27 07:25:49.782428 | controller | ok: [instance]
2025-11-27 07:25:50.100699 | controller |
2025-11-27 07:25:50.100729 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2025-11-27 07:25:50.100737 | controller | Thursday 27 November 2025  07:25:49 +0000 (0:00:00.317)       0:00:24.615 *****
2025-11-27 07:25:50.100747 | controller | ok: [instance]
2025-11-27 07:25:50.418393 | controller |
2025-11-27 07:25:50.418423 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2025-11-27 07:25:50.418430 | controller | Thursday 27 November 2025  07:25:50 +0000 (0:00:00.318)       0:00:24.934 *****
2025-11-27 07:25:50.418446 | controller | ok: [instance]
2025-11-27 07:25:50.735833 | controller |
2025-11-27 07:25:50.735862 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2025-11-27 07:25:50.735875 | controller | Thursday 27 November 2025  07:25:50 +0000 (0:00:00.317)       0:00:25.251 *****
2025-11-27 07:25:50.735885 | controller | ok: [instance]
2025-11-27 07:25:50.736246 | controller |
2025-11-27 07:25:52.054718 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2025-11-27 07:25:52.054746 | controller | Thursday 27 November 2025  07:25:50 +0000 (0:00:00.317)       0:00:25.569 *****
2025-11-27 07:25:52.054757 | controller | ok: [instance]
2025-11-27 07:25:52.072868 | controller |
2025-11-27 07:25:52.072895 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2025-11-27 07:25:52.072905 | controller | Thursday 27 November 2025  07:25:52 +0000 (0:00:01.318)       0:00:26.888 *****
2025-11-27 07:25:52.072916 | controller | skipping: [instance]
2025-11-27 07:25:52.353889 | controller |
2025-11-27 07:25:52.353928 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2025-11-27 07:25:52.353938 | controller | Thursday 27 November 2025  07:25:52 +0000 (0:00:00.018)       0:00:26.906 *****
2025-11-27 07:25:52.353951 | controller | ok: [instance]
2025-11-27 07:25:52.723901 | controller |
2025-11-27 07:25:52.723971 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2025-11-27 07:25:52.723985 | controller | Thursday 27 November 2025  07:25:52 +0000 (0:00:00.279)       0:00:27.186 *****
2025-11-27 07:25:52.724007 | controller | ok: [instance]
2025-11-27 07:25:53.031125 | controller |
2025-11-27 07:25:53.031170 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2025-11-27 07:25:53.031179 | controller | Thursday 27 November 2025  07:25:52 +0000 (0:00:00.370)       0:00:27.557 *****
2025-11-27 07:25:53.031189 | controller | changed: [instance]
2025-11-27 07:25:53.319253 | controller |
2025-11-27 07:25:53.319285 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2025-11-27 07:25:53.319292 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.307)       0:00:27.864 *****
2025-11-27 07:25:53.319303 | controller | [WARNING]: Reset is not implemented for this connection
2025-11-27 07:25:53.328876 | controller | changed: [instance]
2025-11-27 07:25:53.329460 | controller |
2025-11-27 07:25:53.329481 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2025-11-27 07:25:53.401664 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.282)       0:00:28.147 *****
2025-11-27 07:25:53.401689 | controller |
2025-11-27 07:25:53.401698 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2025-11-27 07:25:53.401705 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.015)       0:00:28.162 *****
2025-11-27 07:25:53.401716 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2025-11-27 07:25:53.442666 | controller |
2025-11-27 07:25:53.442692 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2025-11-27 07:25:53.442700 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.072)       0:00:28.235 *****
2025-11-27 07:25:53.442716 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2025-11-27 07:25:53.489869 | controller |
2025-11-27 07:25:53.489907 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2025-11-27 07:25:53.489915 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.041)       0:00:28.276 *****
2025-11-27 07:25:53.489926 | controller | ok: [instance] => (item=compute)
2025-11-27 07:25:53.490111 | controller | ok: [instance] => (item=controller)
2025-11-27 07:25:53.490130 | controller | ok: [instance] => (item=crc)
2025-11-27 07:25:53.490137 | controller |
2025-11-27 07:25:53.490146 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2025-11-27 07:25:53.558421 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.047)       0:00:28.323 *****
2025-11-27 07:25:53.558453 | controller | ok: [instance]
2025-11-27 07:25:53.600248 | controller |
2025-11-27 07:25:53.600271 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2025-11-27 07:25:53.600290 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.068)       0:00:28.391 *****
2025-11-27 07:25:53.600301 | controller | ok: [instance] => changed=false
2025-11-27 07:25:53.600483 | controller |   msg: All assertions passed
2025-11-27 07:25:53.600643 | controller |
2025-11-27 07:25:53.600837 | controller | TASK [Ensure we get latest OCP config] *****************************************
2025-11-27 07:25:53.601019 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.042)       0:00:28.434 *****
2025-11-27 07:25:53.643078 | controller |
2025-11-27 07:25:53.643264 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2025-11-27 07:25:53.643408 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.042)       0:00:28.477 *****
2025-11-27 07:25:53.717333 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2025-11-27 07:25:53.717527 | controller | ok: [instance] => (item={})
2025-11-27 07:25:53.717659 | controller |
2025-11-27 07:25:53.717818 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2025-11-27 07:25:53.717973 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.074)       0:00:28.551 *****
2025-11-27 07:25:53.734897 | controller | skipping: [instance]
2025-11-27 07:25:53.735147 | controller |
2025-11-27 07:25:53.735403 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2025-11-27 07:25:53.735582 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.017)       0:00:28.568 *****
2025-11-27 07:25:53.949551 | controller | ok: [instance]
2025-11-27 07:25:53.949747 | controller |
2025-11-27 07:25:53.949959 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2025-11-27 07:25:53.950108 | controller | Thursday 27 November 2025  07:25:53 +0000 (0:00:00.214)       0:00:28.783 *****
2025-11-27 07:25:54.287915 | controller | changed: [instance]
2025-11-27 07:25:55.029527 | controller |
2025-11-27 07:25:55.029558 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2025-11-27 07:25:55.029566 | controller | Thursday 27 November 2025  07:25:54 +0000 (0:00:00.338)       0:00:29.121 *****
2025-11-27 07:25:55.029576 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2025-11-27 07:25:55.057335 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2025-11-27 07:25:55.057360 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2025-11-27 07:25:55.057367 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2025-11-27 07:25:55.057373 | controller |
2025-11-27 07:25:55.057378 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2025-11-27 07:25:55.057384 | controller | Thursday 27 November 2025  07:25:55 +0000 (0:00:00.741)       0:00:29.862 *****
2025-11-27 07:25:55.057393 | controller | skipping: [instance]
2025-11-27 07:25:55.437879 | controller |
2025-11-27 07:25:55.437911 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2025-11-27 07:25:55.437919 | controller | Thursday 27 November 2025  07:25:55 +0000 (0:00:00.028)       0:00:29.890 *****
2025-11-27 07:25:55.437928 | controller | changed: [instance]
2025-11-27 07:25:55.438486 | controller |
2025-11-27 07:25:55.438509 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2025-11-27 07:25:55.878478 | controller | Thursday 27 November 2025  07:25:55 +0000 (0:00:00.371)       0:00:30.262 *****
2025-11-27 07:25:55.878508 | controller |
2025-11-27 07:25:55.878515 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-11-27 07:25:55.878521 | controller | Thursday 27 November 2025  07:25:55 +0000 (0:00:00.008)       0:00:30.271 *****
2025-11-27 07:25:55.878537 | controller | changed: [instance]
2025-11-27 07:25:55.954700 | controller |
2025-11-27 07:25:55.954730 | controller | TASK [Ensure no default networks exists] ***************************************
2025-11-27 07:25:55.954738 | controller | Thursday 27 November 2025  07:25:55 +0000 (0:00:00.440)       0:00:30.711 *****
2025-11-27 07:25:55.954747 | controller |
2025-11-27 07:25:57.105234 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2025-11-27 07:25:57.105266 | controller | Thursday 27 November 2025  07:25:55 +0000 (0:00:00.076)       0:00:30.788 *****
2025-11-27 07:25:57.105277 | controller | ok: [instance]
2025-11-27 07:25:57.334536 | controller |
2025-11-27 07:25:57.334563 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2025-11-27 07:25:57.334571 | controller | Thursday 27 November 2025  07:25:57 +0000 (0:00:01.150)       0:00:31.938 *****
2025-11-27 07:25:57.334581 | controller | ok: [instance]
2025-11-27 07:25:57.825711 | controller |
2025-11-27 07:25:57.825742 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2025-11-27 07:25:57.825750 | controller | Thursday 27 November 2025  07:25:57 +0000 (0:00:00.229)       0:00:32.167 *****
2025-11-27 07:25:57.825833 | controller | ok: [instance]
2025-11-27 07:25:58.047306 | controller |
2025-11-27 07:25:58.047338 | controller | TASK [libvirt_manager : Removing default] **************************************
2025-11-27 07:25:58.047345 | controller | Thursday 27 November 2025  07:25:57 +0000 (0:00:00.491)       0:00:32.659 *****
2025-11-27 07:25:58.047355 | controller | ok: [instance]
2025-11-27 07:25:59.264222 | controller |
2025-11-27 07:25:59.264256 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2025-11-27 07:25:59.264263 | controller | Thursday 27 November 2025  07:25:58 +0000 (0:00:00.221)       0:00:32.880 *****
2025-11-27 07:25:59.264274 | controller | ok: [instance]
2025-11-27 07:25:59.580473 | controller |
2025-11-27 07:25:59.580505 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2025-11-27 07:25:59.580512 | controller | Thursday 27 November 2025  07:25:59 +0000 (0:00:01.216)       0:00:34.097 *****
2025-11-27 07:25:59.580528 | controller | ok: [instance]
2025-11-27 07:25:59.888624 | controller |
2025-11-27 07:25:59.888655 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2025-11-27 07:25:59.888663 | controller | Thursday 27 November 2025  07:25:59 +0000 (0:00:00.316)       0:00:34.413 *****
2025-11-27 07:25:59.888672 | controller | changed: [instance]
2025-11-27 07:26:00.197902 | controller |
2025-11-27 07:26:00.197944 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2025-11-27 07:26:00.197954 | controller | Thursday 27 November 2025  07:25:59 +0000 (0:00:00.307)       0:00:34.721 *****
2025-11-27 07:26:00.197966 | controller | changed: [instance]
2025-11-27 07:26:00.197995 | controller |
2025-11-27 07:26:00.198005 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2025-11-27 07:26:00.198127 | controller | Thursday 27 November 2025  07:26:00 +0000 (0:00:00.309)       0:00:35.031 *****
2025-11-27 07:26:00.764879 | controller | changed: [instance] => (item=arptables)
2025-11-27 07:26:00.764941 | controller | changed: [instance] => (item=iptables)
2025-11-27 07:26:00.764953 | controller | changed: [instance] => (item=ip6tables)
2025-11-27 07:26:00.764960 | controller |
2025-11-27 07:26:00.764969 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2025-11-27 07:26:00.764995 | controller | Thursday 27 November 2025  07:26:00 +0000 (0:00:00.566)       0:00:35.598 *****
2025-11-27 07:26:01.078985 | controller | ok: [instance]
2025-11-27 07:26:01.172392 | controller |
2025-11-27 07:26:01.172426 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2025-11-27 07:26:01.172436 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.314)       0:00:35.912 *****
2025-11-27 07:26:01.172448 | controller | ok: [instance]
2025-11-27 07:26:01.215467 | controller |
2025-11-27 07:26:01.215497 | controller | TASK [Ensure the required network configurations are applied] ******************
2025-11-27 07:26:01.215506 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.093)       0:00:36.005 *****
2025-11-27 07:26:01.215518 | controller |
2025-11-27 07:26:01.248227 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2025-11-27 07:26:01.248256 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.043)       0:00:36.049 *****
2025-11-27 07:26:01.248266 | controller | skipping: [instance]
2025-11-27 07:26:01.277318 | controller |
2025-11-27 07:26:01.277339 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2025-11-27 07:26:01.277347 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.032)       0:00:36.081 *****
2025-11-27 07:26:01.277358 | controller | skipping: [instance]
2025-11-27 07:26:01.302838 | controller |
2025-11-27 07:26:01.302859 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-11-27 07:26:01.302866 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.029)       0:00:36.110 *****
2025-11-27 07:26:01.302876 | controller | skipping: [instance]
2025-11-27 07:26:01.303068 | controller |
2025-11-27 07:26:01.303091 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2025-11-27 07:26:01.334284 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.025)       0:00:36.136 *****
2025-11-27 07:26:01.334309 | controller | skipping: [instance]
2025-11-27 07:26:01.378382 | controller |
2025-11-27 07:26:01.378405 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2025-11-27 07:26:01.378414 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.031)       0:00:36.167 *****
2025-11-27 07:26:01.378424 | controller | ok: [instance]
2025-11-27 07:26:01.378596 | controller |
2025-11-27 07:26:01.378810 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2025-11-27 07:26:01.379003 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.044)       0:00:36.212 *****
2025-11-27 07:26:01.416417 | controller | skipping: [instance]
2025-11-27 07:26:01.416602 | controller |
2025-11-27 07:26:01.416808 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2025-11-27 07:26:01.416987 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.037)       0:00:36.250 *****
2025-11-27 07:26:01.443058 | controller | skipping: [instance]
2025-11-27 07:26:01.443242 | controller |
2025-11-27 07:26:01.443386 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2025-11-27 07:26:01.443522 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.026)       0:00:36.276 *****
2025-11-27 07:26:01.503688 | controller | ok: [instance]
2025-11-27 07:26:01.503903 | controller |
2025-11-27 07:26:01.504082 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2025-11-27 07:26:01.504264 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.060)       0:00:36.337 *****
2025-11-27 07:26:01.529444 | controller | skipping: [instance]
2025-11-27 07:26:01.529626 | controller |
2025-11-27 07:26:01.529845 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2025-11-27 07:26:01.530026 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.025)       0:00:36.363 *****
2025-11-27 07:26:01.581945 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2025-11-27 07:26:01.582128 | controller |
2025-11-27 07:26:01.582319 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2025-11-27 07:26:01.582473 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.052)       0:00:36.415 *****
2025-11-27 07:26:01.917356 | controller | ok: [instance -> localhost]
2025-11-27 07:26:06.935849 | controller |
2025-11-27 07:26:06.935897 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2025-11-27 07:26:06.935908 | controller | Thursday 27 November 2025  07:26:01 +0000 (0:00:00.334)       0:00:36.750 *****
2025-11-27 07:26:06.935924 | controller | changed: [instance -> localhost]
2025-11-27 07:26:06.935973 | controller |
2025-11-27 07:26:06.936251 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2025-11-27 07:26:07.137383 | controller | Thursday 27 November 2025  07:26:06 +0000 (0:00:05.018)       0:00:41.769 *****
2025-11-27 07:26:07.137415 | controller | changed: [instance]
2025-11-27 07:26:07.481721 | controller |
2025-11-27 07:26:07.481750 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2025-11-27 07:26:07.481776 | controller | Thursday 27 November 2025  07:26:07 +0000 (0:00:00.201)       0:00:41.971 *****
2025-11-27 07:26:07.481796 | controller | changed: [instance]
2025-11-27 07:26:09.092312 | controller |
2025-11-27 07:26:09.092342 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2025-11-27 07:26:09.092350 | controller | Thursday 27 November 2025  07:26:07 +0000 (0:00:00.344)       0:00:42.315 *****
2025-11-27 07:26:09.092360 | controller | changed: [instance -> localhost]
2025-11-27 07:26:09.440839 | controller |
2025-11-27 07:26:09.440870 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2025-11-27 07:26:09.440878 | controller | Thursday 27 November 2025  07:26:09 +0000 (0:00:01.610)       0:00:43.925 *****
2025-11-27 07:26:09.440888 | controller | changed: [instance]
2025-11-27 07:26:09.440913 | controller |
2025-11-27 07:26:09.440919 | controller | TASK [reproducer : Select right domain] ****************************************
2025-11-27 07:26:09.440926 | controller | Thursday 27 November 2025  07:26:09 +0000 (0:00:00.348)       0:00:44.274 *****
2025-11-27 07:26:09.469829 | controller | ok: [instance]
2025-11-27 07:26:09.469881 | controller |
2025-11-27 07:26:09.470244 | controller | TASK [Create the virtual networks] *********************************************
2025-11-27 07:26:09.585303 | controller | Thursday 27 November 2025  07:26:09 +0000 (0:00:00.029)       0:00:44.303 *****
2025-11-27 07:26:09.585346 | controller |
2025-11-27 07:26:09.604345 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2025-11-27 07:26:09.604366 | controller | Thursday 27 November 2025  07:26:09 +0000 (0:00:00.115)       0:00:44.418 *****
2025-11-27 07:26:09.604378 | controller | ok: [instance]
2025-11-27 07:26:09.814377 | controller |
2025-11-27 07:26:09.814402 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2025-11-27 07:26:09.814410 | controller | Thursday 27 November 2025  07:26:09 +0000 (0:00:00.018)       0:00:44.437 *****
2025-11-27 07:26:09.814420 | controller | ok: [instance]
2025-11-27 07:26:09.843339 | controller |
2025-11-27 07:26:09.843362 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2025-11-27 07:26:09.843370 | controller | Thursday 27 November 2025  07:26:09 +0000 (0:00:00.210)       0:00:44.647 *****
2025-11-27 07:26:09.843379 | controller | skipping: [instance]
2025-11-27 07:26:09.871240 | controller |
2025-11-27 07:26:09.871258 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2025-11-27 07:26:09.871266 | controller | Thursday 27 November 2025  07:26:09 +0000 (0:00:00.028)       0:00:44.676 *****
2025-11-27 07:26:09.871274 | controller | skipping: [instance]
2025-11-27 07:26:09.926882 | controller |
2025-11-27 07:26:09.926916 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2025-11-27 07:26:09.926927 | controller | Thursday 27 November 2025  07:26:09 +0000 (0:00:00.027)       0:00:44.704 *****
2025-11-27 07:26:09.926939 | controller | ok: [instance]
2025-11-27 07:26:09.926974 | controller |
2025-11-27 07:26:09.926984 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2025-11-27 07:26:09.927011 | controller | Thursday 27 November 2025  07:26:09 +0000 (0:00:00.055)       0:00:44.760 *****
2025-11-27 07:26:10.051901 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2025-11-27 07:26:10.084626 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2025-11-27 07:26:10.084658 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2025-11-27 07:26:10.084665 | controller |
2025-11-27 07:26:10.084671 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2025-11-27 07:26:10.084677 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.124)       0:00:44.884 *****
2025-11-27 07:26:10.084694 | controller | skipping: [instance]
2025-11-27 07:26:10.429746 | controller |
2025-11-27 07:26:10.429794 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2025-11-27 07:26:10.429802 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.033)       0:00:44.918 *****
2025-11-27 07:26:10.429812 | controller | changed: [instance]
2025-11-27 07:26:10.550621 | controller |
2025-11-27 07:26:10.550647 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2025-11-27 07:26:10.550655 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.344)       0:00:45.263 *****
2025-11-27 07:26:10.550677 | controller | changed: [instance] => (item=Adding compute-0 to computes)
2025-11-27 07:26:10.574671 | controller | changed: [instance] => (item=Adding controller-0 to controllers)
2025-11-27 07:26:10.574689 | controller | changed: [instance] => (item=Adding crc-0 to ocps)
2025-11-27 07:26:10.574696 | controller |
2025-11-27 07:26:10.574702 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-11-27 07:26:10.574707 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.120)       0:00:45.383 *****
2025-11-27 07:26:10.574715 | controller | skipping: [instance]
2025-11-27 07:26:10.598969 | controller |
2025-11-27 07:26:10.599012 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-11-27 07:26:10.599022 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.024)       0:00:45.408 *****
2025-11-27 07:26:10.599035 | controller | skipping: [instance]
2025-11-27 07:26:10.599057 | controller |
2025-11-27 07:26:10.599065 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-11-27 07:26:10.599074 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.024)       0:00:45.432 *****
2025-11-27 07:26:10.622879 | controller | skipping: [instance]
2025-11-27 07:26:10.623020 | controller |
2025-11-27 07:26:10.623042 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-11-27 07:26:10.623055 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.024)       0:00:45.456 *****
2025-11-27 07:26:10.646981 | controller | skipping: [instance]
2025-11-27 07:26:10.665301 | controller |
2025-11-27 07:26:10.665329 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-11-27 07:26:10.665339 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.023)       0:00:45.480 *****
2025-11-27 07:26:10.665351 | controller | ok: [instance]
2025-11-27 07:26:10.665441 | controller |
2025-11-27 07:26:10.665629 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-11-27 07:26:10.665725 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.018)       0:00:45.499 *****
2025-11-27 07:26:10.747598 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2025-11-27 07:26:10.747736 | controller |
2025-11-27 07:26:10.747917 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-11-27 07:26:10.748022 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.082)       0:00:45.581 *****
2025-11-27 07:26:10.767640 | controller | skipping: [instance]
2025-11-27 07:26:10.767803 | controller |
2025-11-27 07:26:10.767926 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-11-27 07:26:10.768050 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.020)       0:00:45.601 *****
2025-11-27 07:26:10.974912 | controller | changed: [instance]
2025-11-27 07:26:10.974946 | controller |
2025-11-27 07:26:10.974955 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-11-27 07:26:10.974965 | controller | Thursday 27 November 2025  07:26:10 +0000 (0:00:00.206)       0:00:45.808 *****
2025-11-27 07:26:11.376913 | controller | changed: [instance]
2025-11-27 07:26:11.377129 | controller |
2025-11-27 07:26:11.377161 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-11-27 07:26:11.437208 | controller | Thursday 27 November 2025  07:26:11 +0000 (0:00:00.401)       0:00:46.210 *****
2025-11-27 07:26:11.437245 | controller | ok: [instance]
2025-11-27 07:26:11.468796 | controller |
2025-11-27 07:26:11.468818 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-11-27 07:26:11.468827 | controller | Thursday 27 November 2025  07:26:11 +0000 (0:00:00.060)       0:00:46.270 *****
2025-11-27 07:26:11.468838 | controller | ok: [instance]
2025-11-27 07:26:11.852911 | controller |
2025-11-27 07:26:11.852940 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-11-27 07:26:11.852948 | controller | Thursday 27 November 2025  07:26:11 +0000 (0:00:00.031)       0:00:46.302 *****
2025-11-27 07:26:11.852959 | controller | changed: [instance]
2025-11-27 07:26:11.852986 | controller |
2025-11-27 07:26:11.852994 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2025-11-27 07:26:11.853125 | controller | Thursday 27 November 2025  07:26:11 +0000 (0:00:00.384)       0:00:46.686 *****
2025-11-27 07:26:11.931893 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2025-11-27 07:26:11.982924 | controller |
2025-11-27 07:26:11.982961 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2025-11-27 07:26:11.982978 | controller | Thursday 27 November 2025  07:26:11 +0000 (0:00:00.079)       0:00:46.765 *****
2025-11-27 07:26:11.982991 | controller | ok: [instance] => (item=public)
2025-11-27 07:26:11.983037 | controller | ok: [instance] => (item=osp_trunk)
2025-11-27 07:26:11.983058 | controller |
2025-11-27 07:26:11.983068 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2025-11-27 07:26:11.983079 | controller | Thursday 27 November 2025  07:26:11 +0000 (0:00:00.050)       0:00:46.816 *****
2025-11-27 07:26:12.422922 | controller | changed: [instance] => (item=cifmw-public)
2025-11-27 07:26:12.422980 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:26:12.422992 | controller |
2025-11-27 07:26:12.423178 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2025-11-27 07:26:13.015222 | controller | Thursday 27 November 2025  07:26:12 +0000 (0:00:00.440)       0:00:47.256 *****
2025-11-27 07:26:13.015273 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 07:26:13.015303 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:26:13.015312 | controller |
2025-11-27 07:26:13.015425 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2025-11-27 07:26:13.015560 | controller | Thursday 27 November 2025  07:26:13 +0000 (0:00:00.592)       0:00:47.848 *****
2025-11-27 07:26:13.451596 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 07:26:13.875635 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:26:13.875665 | controller |
2025-11-27 07:26:13.875673 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2025-11-27 07:26:13.875679 | controller | Thursday 27 November 2025  07:26:13 +0000 (0:00:00.435)       0:00:48.284 *****
2025-11-27 07:26:13.875693 | controller | changed: [instance] => (item=cifmw-public)
2025-11-27 07:26:13.933369 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:26:13.933393 | controller |
2025-11-27 07:26:13.933402 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2025-11-27 07:26:13.933409 | controller | Thursday 27 November 2025  07:26:13 +0000 (0:00:00.424)       0:00:48.708 *****
2025-11-27 07:26:13.933420 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2025-11-27 07:26:14.115548 | controller |
2025-11-27 07:26:14.115577 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2025-11-27 07:26:14.115584 | controller | Thursday 27 November 2025  07:26:13 +0000 (0:00:00.057)       0:00:48.766 *****
2025-11-27 07:26:14.115594 | controller | ok: [instance]
2025-11-27 07:26:14.490901 | controller |
2025-11-27 07:26:14.490956 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2025-11-27 07:26:14.490972 | controller | Thursday 27 November 2025  07:26:14 +0000 (0:00:00.182)       0:00:48.949 *****
2025-11-27 07:26:14.490989 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 07:26:14.491033 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:26:14.491230 | controller |
2025-11-27 07:26:14.491272 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2025-11-27 07:26:14.605806 | controller | Thursday 27 November 2025  07:26:14 +0000 (0:00:00.375)       0:00:49.324 *****
2025-11-27 07:26:14.605845 | controller |
2025-11-27 07:26:14.642139 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2025-11-27 07:26:14.642159 | controller | Thursday 27 November 2025  07:26:14 +0000 (0:00:00.114)       0:00:49.439 *****
2025-11-27 07:26:14.642170 | controller | skipping: [instance]
2025-11-27 07:26:15.894401 | controller |
2025-11-27 07:26:15.894430 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2025-11-27 07:26:15.894438 | controller | Thursday 27 November 2025  07:26:14 +0000 (0:00:00.036)       0:00:49.475 *****
2025-11-27 07:26:15.894448 | controller | ok: [instance]
2025-11-27 07:26:16.100633 | controller |
2025-11-27 07:26:16.100663 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2025-11-27 07:26:16.100671 | controller | Thursday 27 November 2025  07:26:15 +0000 (0:00:01.252)       0:00:50.727 *****
2025-11-27 07:26:16.100681 | controller | ok: [instance]
2025-11-27 07:26:16.467511 | controller |
2025-11-27 07:26:16.467541 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2025-11-27 07:26:16.467548 | controller | Thursday 27 November 2025  07:26:16 +0000 (0:00:00.206)       0:00:50.933 *****
2025-11-27 07:26:16.467558 | controller | changed: [instance]
2025-11-27 07:26:18.126873 | controller |
2025-11-27 07:26:18.126910 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2025-11-27 07:26:18.126918 | controller | Thursday 27 November 2025  07:26:16 +0000 (0:00:00.366)       0:00:51.300 *****
2025-11-27 07:26:18.126928 | controller | changed: [instance]
2025-11-27 07:26:18.126961 | controller |
2025-11-27 07:26:18.126969 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2025-11-27 07:26:18.126976 | controller | Thursday 27 November 2025  07:26:18 +0000 (0:00:01.659)       0:00:52.960 *****
2025-11-27 07:26:18.494615 | controller | changed: [instance]
2025-11-27 07:26:18.528276 | controller |
2025-11-27 07:26:18.528305 | controller | TASK [Create extra network configuration] **************************************
2025-11-27 07:26:18.528313 | controller | Thursday 27 November 2025  07:26:18 +0000 (0:00:00.367)       0:00:53.328 *****
2025-11-27 07:26:18.528329 | controller | skipping: [instance]
2025-11-27 07:26:18.557894 | controller |
2025-11-27 07:26:18.557923 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2025-11-27 07:26:18.557931 | controller | Thursday 27 November 2025  07:26:18 +0000 (0:00:00.033)       0:00:53.361 *****
2025-11-27 07:26:18.557943 | controller | skipping: [instance]
2025-11-27 07:26:18.998812 | controller |
2025-11-27 07:26:18.998848 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2025-11-27 07:26:18.998860 | controller | Thursday 27 November 2025  07:26:18 +0000 (0:00:00.029)       0:00:53.391 *****
2025-11-27 07:26:18.998872 | controller | ok: [instance]
2025-11-27 07:26:19.146830 | controller |
2025-11-27 07:26:19.146861 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2025-11-27 07:26:19.146869 | controller | Thursday 27 November 2025  07:26:18 +0000 (0:00:00.440)       0:00:53.832 *****
2025-11-27 07:26:19.146879 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 07:26:20.420419 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:26:20.420448 | controller |
2025-11-27 07:26:20.420456 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2025-11-27 07:26:20.420462 | controller | Thursday 27 November 2025  07:26:19 +0000 (0:00:00.147)       0:00:53.979 *****
2025-11-27 07:26:20.420472 | controller | ok: [instance]
2025-11-27 07:26:24.199883 | controller |
2025-11-27 07:26:24.199915 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2025-11-27 07:26:24.199923 | controller | Thursday 27 November 2025  07:26:20 +0000 (0:00:01.273)       0:00:55.253 *****
2025-11-27 07:26:24.199933 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2025-11-27 07:26:24.199957 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2025-11-27 07:26:24.200345 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2025-11-27 07:26:24.416881 | controller |
2025-11-27 07:26:24.416911 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2025-11-27 07:26:24.416919 | controller | Thursday 27 November 2025  07:26:24 +0000 (0:00:03.779)       0:00:59.033 *****
2025-11-27 07:26:24.416928 | controller | changed: [instance]
2025-11-27 07:26:24.775533 | controller |
2025-11-27 07:26:24.775564 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2025-11-27 07:26:24.775572 | controller | Thursday 27 November 2025  07:26:24 +0000 (0:00:00.216)       0:00:59.250 *****
2025-11-27 07:26:24.775582 | controller | changed: [instance]
2025-11-27 07:26:25.163350 | controller |
2025-11-27 07:26:25.163382 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2025-11-27 07:26:25.163390 | controller | Thursday 27 November 2025  07:26:24 +0000 (0:00:00.358)       0:00:59.608 *****
2025-11-27 07:26:25.163399 | controller | changed: [instance]
2025-11-27 07:26:25.195340 | controller |
2025-11-27 07:26:25.195361 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2025-11-27 07:26:25.195368 | controller | Thursday 27 November 2025  07:26:25 +0000 (0:00:00.387)       0:00:59.996 *****
2025-11-27 07:26:25.195378 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2025-11-27 07:26:25.586927 | controller |
2025-11-27 07:26:25.586972 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2025-11-27 07:26:25.586982 | controller | Thursday 27 November 2025  07:26:25 +0000 (0:00:00.032)       0:01:00.028 *****
2025-11-27 07:26:25.586997 | controller | changed: [instance]
2025-11-27 07:26:25.606546 | controller |
2025-11-27 07:26:25.606583 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2025-11-27 07:26:25.606593 | controller | Thursday 27 November 2025  07:26:25 +0000 (0:00:00.391)       0:01:00.420 *****
2025-11-27 07:26:25.606605 | controller | skipping: [instance]
2025-11-27 07:26:25.643356 | controller |
2025-11-27 07:26:25.643385 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2025-11-27 07:26:25.643393 | controller | Thursday 27 November 2025  07:26:25 +0000 (0:00:00.019)       0:01:00.440 *****
2025-11-27 07:26:25.643403 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2025-11-27 07:26:26.021542 | controller |
2025-11-27 07:26:26.021571 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2025-11-27 07:26:26.021579 | controller | Thursday 27 November 2025  07:26:25 +0000 (0:00:00.036)       0:01:00.476 *****
2025-11-27 07:26:26.021589 | controller | changed: [instance]
2025-11-27 07:26:26.039799 | controller |
2025-11-27 07:26:26.039830 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2025-11-27 07:26:26.039838 | controller | Thursday 27 November 2025  07:26:26 +0000 (0:00:00.378)       0:01:00.854 *****
2025-11-27 07:26:26.039847 | controller | skipping: [instance]
2025-11-27 07:26:26.254849 | controller |
2025-11-27 07:26:26.254879 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2025-11-27 07:26:26.254887 | controller | Thursday 27 November 2025  07:26:26 +0000 (0:00:00.018)       0:01:00.873 *****
2025-11-27 07:26:26.254897 | controller | ok: [instance] => (item=127.0.0.2)
2025-11-27 07:26:26.255251 | controller |
2025-11-27 07:26:26.930384 | controller | TASK [dnsmasq : Enable and start service] **************************************
2025-11-27 07:26:26.930425 | controller | Thursday 27 November 2025  07:26:26 +0000 (0:00:00.214)       0:01:01.088 *****
2025-11-27 07:26:26.930440 | controller | changed: [instance]
2025-11-27 07:26:26.950922 | controller |
2025-11-27 07:26:26.950961 | controller | TASK [dnsmasq : Stop service] **************************************************
2025-11-27 07:26:26.950971 | controller | Thursday 27 November 2025  07:26:26 +0000 (0:00:00.675)       0:01:01.763 *****
2025-11-27 07:26:26.950983 | controller | skipping: [instance]
2025-11-27 07:26:26.951016 | controller |
2025-11-27 07:26:26.951026 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2025-11-27 07:26:26.951053 | controller | Thursday 27 November 2025  07:26:26 +0000 (0:00:00.020)       0:01:01.784 *****
2025-11-27 07:26:26.970583 | controller | skipping: [instance]
2025-11-27 07:26:27.001865 | controller |
2025-11-27 07:26:27.001888 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2025-11-27 07:26:27.001896 | controller | Thursday 27 November 2025  07:26:26 +0000 (0:00:00.019)       0:01:01.804 *****
2025-11-27 07:26:27.001906 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2025-11-27 07:26:27.149214 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2025-11-27 07:26:27.149244 | controller | skipping: [instance]
2025-11-27 07:26:27.149252 | controller |
2025-11-27 07:26:27.149258 | controller | TASK [Create dnsmasq networks] *************************************************
2025-11-27 07:26:27.149264 | controller | Thursday 27 November 2025  07:26:26 +0000 (0:00:00.030)       0:01:01.834 *****
2025-11-27 07:26:27.149273 | controller |
2025-11-27 07:26:27.180403 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2025-11-27 07:26:27.180425 | controller | Thursday 27 November 2025  07:26:27 +0000 (0:00:00.147)       0:01:01.982 *****
2025-11-27 07:26:27.180438 | controller | ok: [instance] => changed=false
2025-11-27 07:26:27.219418 | controller |   msg: All assertions passed
2025-11-27 07:26:27.219441 | controller |
2025-11-27 07:26:27.219450 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2025-11-27 07:26:27.219457 | controller | Thursday 27 November 2025  07:26:27 +0000 (0:00:00.031)       0:01:02.013 *****
2025-11-27 07:26:27.219467 | controller | ok: [instance] => changed=false
2025-11-27 07:26:27.219649 | controller |   msg: All assertions passed
2025-11-27 07:26:27.219840 | controller |
2025-11-27 07:26:27.220010 | controller | TASK [dnsmasq : Create network] ************************************************
2025-11-27 07:26:27.220144 | controller | Thursday 27 November 2025  07:26:27 +0000 (0:00:00.039)       0:01:02.053 *****
2025-11-27 07:26:27.661409 | controller | changed: [instance]
2025-11-27 07:26:27.681354 | controller |
2025-11-27 07:26:27.681381 | controller | TASK [dnsmasq : Remove network] ************************************************
2025-11-27 07:26:27.681394 | controller | Thursday 27 November 2025  07:26:27 +0000 (0:00:00.441)       0:01:02.494 *****
2025-11-27 07:26:27.681403 | controller | skipping: [instance]
2025-11-27 07:26:27.707482 | controller |
2025-11-27 07:26:27.707507 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2025-11-27 07:26:27.707515 | controller | Thursday 27 November 2025  07:26:27 +0000 (0:00:00.020)       0:01:02.514 *****
2025-11-27 07:26:27.707526 | controller | skipping: [instance]
2025-11-27 07:26:27.738904 | controller |
2025-11-27 07:26:27.738933 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2025-11-27 07:26:27.738943 | controller | Thursday 27 November 2025  07:26:27 +0000 (0:00:00.025)       0:01:02.540 *****
2025-11-27 07:26:27.738961 | controller | ok: [instance] => changed=false
2025-11-27 07:26:27.738995 | controller |   msg: All assertions passed
2025-11-27 07:26:27.739266 | controller |
2025-11-27 07:26:27.778701 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2025-11-27 07:26:27.778732 | controller | Thursday 27 November 2025  07:26:27 +0000 (0:00:00.031)       0:01:02.572 *****
2025-11-27 07:26:27.778743 | controller | ok: [instance] => changed=false
2025-11-27 07:26:28.219396 | controller |   msg: All assertions passed
2025-11-27 07:26:28.219425 | controller |
2025-11-27 07:26:28.219433 | controller | TASK [dnsmasq : Create network] ************************************************
2025-11-27 07:26:28.219440 | controller | Thursday 27 November 2025  07:26:27 +0000 (0:00:00.039)       0:01:02.612 *****
2025-11-27 07:26:28.219449 | controller | changed: [instance]
2025-11-27 07:26:28.239862 | controller |
2025-11-27 07:26:28.239886 | controller | TASK [dnsmasq : Remove network] ************************************************
2025-11-27 07:26:28.239895 | controller | Thursday 27 November 2025  07:26:28 +0000 (0:00:00.440)       0:01:03.052 *****
2025-11-27 07:26:28.239906 | controller | skipping: [instance]
2025-11-27 07:26:28.239938 | controller |
2025-11-27 07:26:28.240160 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2025-11-27 07:26:28.265393 | controller | Thursday 27 November 2025  07:26:28 +0000 (0:00:00.020)       0:01:03.073 *****
2025-11-27 07:26:28.265415 | controller | skipping: [instance]
2025-11-27 07:26:28.300375 | controller |
2025-11-27 07:26:28.300395 | controller | TASK [Deploy radvd for IPv6 router advertisements] *****************************
2025-11-27 07:26:28.300403 | controller | Thursday 27 November 2025  07:26:28 +0000 (0:00:00.025)       0:01:03.098 *****
2025-11-27 07:26:28.300420 | controller | skipping: [instance]
2025-11-27 07:26:28.775849 | controller |
2025-11-27 07:26:28.775885 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2025-11-27 07:26:28.775893 | controller | Thursday 27 November 2025  07:26:28 +0000 (0:00:00.034)       0:01:03.134 *****
2025-11-27 07:26:28.775903 | controller | changed: [instance] => (item=cifmw-public)
2025-11-27 07:26:28.813587 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:26:28.813615 | controller |
2025-11-27 07:26:28.813622 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-11-27 07:26:28.813629 | controller | Thursday 27 November 2025  07:26:28 +0000 (0:00:00.474)       0:01:03.608 *****
2025-11-27 07:26:28.813638 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2025-11-27 07:26:29.155225 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2025-11-27 07:26:29.155254 | controller |
2025-11-27 07:26:29.155262 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-11-27 07:26:29.155268 | controller | Thursday 27 November 2025  07:26:28 +0000 (0:00:00.038)       0:01:03.646 *****
2025-11-27 07:26:29.155285 | controller | ok: [instance]
2025-11-27 07:26:29.155315 | controller |
2025-11-27 07:26:29.155555 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2025-11-27 07:26:29.192779 | controller | Thursday 27 November 2025  07:26:29 +0000 (0:00:00.342)       0:01:03.988 *****
2025-11-27 07:26:29.192813 | controller | ok: [instance]
2025-11-27 07:26:29.403835 | controller |
2025-11-27 07:26:29.403867 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-11-27 07:26:29.403874 | controller | Thursday 27 November 2025  07:26:29 +0000 (0:00:00.037)       0:01:04.026 *****
2025-11-27 07:26:29.403884 | controller | ok: [instance]
2025-11-27 07:26:29.403909 | controller |
2025-11-27 07:26:29.404220 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2025-11-27 07:26:29.439188 | controller | Thursday 27 November 2025  07:26:29 +0000 (0:00:00.211)       0:01:04.237 *****
2025-11-27 07:26:29.439211 | controller | ok: [instance]
2025-11-27 07:26:29.787911 | controller |
2025-11-27 07:26:29.787954 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2025-11-27 07:26:29.787963 | controller | Thursday 27 November 2025  07:26:29 +0000 (0:00:00.035)       0:01:04.272 *****
2025-11-27 07:26:29.787978 | controller | changed: [instance]
2025-11-27 07:26:30.140645 | controller |
2025-11-27 07:26:30.140677 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2025-11-27 07:26:30.140684 | controller | Thursday 27 November 2025  07:26:29 +0000 (0:00:00.348)       0:01:04.621 *****
2025-11-27 07:26:30.140694 | controller | changed: [instance]
2025-11-27 07:26:30.489350 | controller |
2025-11-27 07:26:30.489383 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2025-11-27 07:26:30.489391 | controller | Thursday 27 November 2025  07:26:30 +0000 (0:00:00.352)       0:01:04.973 *****
2025-11-27 07:26:30.489400 | controller | changed: [instance]
2025-11-27 07:26:30.591194 | controller |
2025-11-27 07:26:30.591225 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2025-11-27 07:26:30.591233 | controller | Thursday 27 November 2025  07:26:30 +0000 (0:00:00.348)       0:01:05.322 *****
2025-11-27 07:26:30.591242 | controller | ok: [instance]
2025-11-27 07:26:30.937517 | controller |
2025-11-27 07:26:30.937549 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2025-11-27 07:26:30.937558 | controller | Thursday 27 November 2025  07:26:30 +0000 (0:00:00.101)       0:01:05.424 *****
2025-11-27 07:26:30.937568 | controller | changed: [instance]
2025-11-27 07:26:30.962603 | controller |
2025-11-27 07:26:30.962632 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-11-27 07:26:30.962641 | controller | Thursday 27 November 2025  07:26:30 +0000 (0:00:00.346)       0:01:05.770 *****
2025-11-27 07:26:30.962653 | controller | skipping: [instance]
2025-11-27 07:26:30.987743 | controller |
2025-11-27 07:26:30.987791 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-11-27 07:26:30.987803 | controller | Thursday 27 November 2025  07:26:30 +0000 (0:00:00.025)       0:01:05.796 *****
2025-11-27 07:26:30.987815 | controller | skipping: [instance]
2025-11-27 07:26:31.012686 | controller |
2025-11-27 07:26:31.012710 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-11-27 07:26:31.012718 | controller | Thursday 27 November 2025  07:26:30 +0000 (0:00:00.025)       0:01:05.821 *****
2025-11-27 07:26:31.012729 | controller | skipping: [instance]
2025-11-27 07:26:31.037708 | controller |
2025-11-27 07:26:31.037731 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-11-27 07:26:31.037739 | controller | Thursday 27 November 2025  07:26:31 +0000 (0:00:00.024)       0:01:05.846 *****
2025-11-27 07:26:31.037750 | controller | skipping: [instance]
2025-11-27 07:26:31.057661 | controller |
2025-11-27 07:26:31.057684 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-11-27 07:26:31.057701 | controller | Thursday 27 November 2025  07:26:31 +0000 (0:00:00.024)       0:01:05.871 *****
2025-11-27 07:26:31.057713 | controller | ok: [instance]
2025-11-27 07:26:31.146119 | controller |
2025-11-27 07:26:31.146158 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-11-27 07:26:31.146167 | controller | Thursday 27 November 2025  07:26:31 +0000 (0:00:00.019)       0:01:05.891 *****
2025-11-27 07:26:31.146183 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2025-11-27 07:26:31.146416 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2025-11-27 07:26:31.146558 | controller |
2025-11-27 07:26:31.146695 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-11-27 07:26:31.146864 | controller | Thursday 27 November 2025  07:26:31 +0000 (0:00:00.088)       0:01:05.979 *****
2025-11-27 07:26:31.165329 | controller | skipping: [instance]
2025-11-27 07:26:31.165513 | controller |
2025-11-27 07:26:31.165655 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-11-27 07:26:31.165813 | controller | Thursday 27 November 2025  07:26:31 +0000 (0:00:00.019)       0:01:05.999 *****
2025-11-27 07:26:31.374783 | controller | ok: [instance]
2025-11-27 07:26:31.777610 | controller |
2025-11-27 07:26:31.777639 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-11-27 07:26:31.777648 | controller | Thursday 27 November 2025  07:26:31 +0000 (0:00:00.208)       0:01:06.208 *****
2025-11-27 07:26:31.777658 | controller | changed: [instance]
2025-11-27 07:26:31.840579 | controller |
2025-11-27 07:26:31.840608 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-11-27 07:26:31.840618 | controller | Thursday 27 November 2025  07:26:31 +0000 (0:00:00.402)       0:01:06.610 *****
2025-11-27 07:26:31.840629 | controller | ok: [instance]
2025-11-27 07:26:31.874808 | controller |
2025-11-27 07:26:31.874832 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-11-27 07:26:31.874841 | controller | Thursday 27 November 2025  07:26:31 +0000 (0:00:00.063)       0:01:06.674 *****
2025-11-27 07:26:31.874852 | controller | ok: [instance]
2025-11-27 07:26:32.280447 | controller |
2025-11-27 07:26:32.280477 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-11-27 07:26:32.280485 | controller | Thursday 27 November 2025  07:26:31 +0000 (0:00:00.033)       0:01:06.707 *****
2025-11-27 07:26:32.280495 | controller | changed: [instance]
2025-11-27 07:26:32.309676 | controller |
2025-11-27 07:26:32.309701 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2025-11-27 07:26:32.309709 | controller | Thursday 27 November 2025  07:26:32 +0000 (0:00:00.405)       0:01:07.113 *****
2025-11-27 07:26:32.309719 | controller | ok: [instance]
2025-11-27 07:26:32.329482 | controller |
2025-11-27 07:26:32.329508 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2025-11-27 07:26:32.329517 | controller | Thursday 27 November 2025  07:26:32 +0000 (0:00:00.029)       0:01:07.143 *****
2025-11-27 07:26:32.329528 | controller | ok: [instance]
2025-11-27 07:26:32.350410 | controller |
2025-11-27 07:26:32.350433 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2025-11-27 07:26:32.350442 | controller | Thursday 27 November 2025  07:26:32 +0000 (0:00:00.019)       0:01:07.162 *****
2025-11-27 07:26:32.350452 | controller | ok: [instance]
2025-11-27 07:26:32.428798 | controller |
2025-11-27 07:26:32.428817 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2025-11-27 07:26:32.428825 | controller | Thursday 27 November 2025  07:26:32 +0000 (0:00:00.020)       0:01:07.183 *****
2025-11-27 07:26:32.428834 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2025-11-27 07:26:32.595346 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2025-11-27 07:26:32.595377 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2025-11-27 07:26:32.595385 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2025-11-27 07:26:32.595391 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2025-11-27 07:26:32.595396 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2025-11-27 07:26:32.595401 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2025-11-27 07:26:32.595407 | controller |
2025-11-27 07:26:32.595412 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 07:26:32.595418 | controller | Thursday 27 November 2025  07:26:32 +0000 (0:00:00.077)       0:01:07.261 *****
2025-11-27 07:26:32.595428 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2025-11-27 07:26:32.595589 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2025-11-27 07:26:32.595730 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2025-11-27 07:26:32.595897 | controller |
2025-11-27 07:26:32.596039 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 07:26:32.596172 | controller | Thursday 27 November 2025  07:26:32 +0000 (0:00:00.167)       0:01:07.428 *****
2025-11-27 07:26:32.677237 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2025-11-27 07:26:32.677434 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2025-11-27 07:26:32.677575 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2025-11-27 07:26:32.677707 | controller | skipping: [instance]
2025-11-27 07:26:32.677867 | controller |
2025-11-27 07:26:32.678008 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 07:26:32.678139 | controller | Thursday 27 November 2025  07:26:32 +0000 (0:00:00.082)       0:01:07.511 *****
2025-11-27 07:26:32.760163 | controller | skipping: [instance] => (item=compute-0 - storage)
2025-11-27 07:26:32.760370 | controller | skipping: [instance] => (item=controller-0 - storage)
2025-11-27 07:26:32.760545 | controller | skipping: [instance] => (item=crc-0 - storage)
2025-11-27 07:26:32.760678 | controller | skipping: [instance]
2025-11-27 07:26:32.760827 | controller |
2025-11-27 07:26:32.760965 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 07:26:32.761097 | controller | Thursday 27 November 2025  07:26:32 +0000 (0:00:00.083)       0:01:07.594 *****
2025-11-27 07:26:32.875792 | controller | skipping: [instance] => (item=compute-0 - tenant)
2025-11-27 07:26:32.876000 | controller | skipping: [instance] => (item=controller-0 - tenant)
2025-11-27 07:26:32.876177 | controller | skipping: [instance] => (item=crc-0 - tenant)
2025-11-27 07:26:32.876352 | controller | skipping: [instance]
2025-11-27 07:26:32.876505 | controller |
2025-11-27 07:26:32.876665 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 07:26:32.876834 | controller | Thursday 27 November 2025  07:26:32 +0000 (0:00:00.115)       0:01:07.709 *****
2025-11-27 07:26:32.959414 | controller | skipping: [instance] => (item=compute-0 - external)
2025-11-27 07:26:32.959607 | controller | skipping: [instance] => (item=controller-0 - external)
2025-11-27 07:26:32.959810 | controller | skipping: [instance] => (item=crc-0 - external)
2025-11-27 07:26:32.959969 | controller | skipping: [instance]
2025-11-27 07:26:32.960095 | controller |
2025-11-27 07:26:32.960226 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 07:26:32.960370 | controller | Thursday 27 November 2025  07:26:32 +0000 (0:00:00.083)       0:01:07.793 *****
2025-11-27 07:26:33.043516 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2025-11-27 07:26:33.043712 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2025-11-27 07:26:33.043917 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2025-11-27 07:26:33.044094 | controller | skipping: [instance]
2025-11-27 07:26:33.044219 | controller |
2025-11-27 07:26:33.044374 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-11-27 07:26:33.044509 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.084)       0:01:07.877 *****
2025-11-27 07:26:33.221719 | controller | ok: [instance] => (item=compute-0 - public)
2025-11-27 07:26:33.221943 | controller | ok: [instance] => (item=controller-0 - public)
2025-11-27 07:26:33.222118 | controller | ok: [instance] => (item=crc-0 - public)
2025-11-27 07:26:33.222274 | controller |
2025-11-27 07:26:33.222446 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2025-11-27 07:26:33.222578 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.178)       0:01:08.055 *****
2025-11-27 07:26:33.335383 | controller |
2025-11-27 07:26:33.335582 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2025-11-27 07:26:33.335733 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.113)       0:01:08.169 *****
2025-11-27 07:26:33.379041 | controller | ok: [instance]
2025-11-27 07:26:33.379224 | controller |
2025-11-27 07:26:33.379415 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2025-11-27 07:26:33.379581 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.043)       0:01:08.212 *****
2025-11-27 07:26:33.485572 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:32:ed:0e', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2025-11-27 07:26:33.485813 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:27:ea:27', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2025-11-27 07:26:33.485998 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:8d:98:0e', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2025-11-27 07:26:33.486145 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:88:d4:1c', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2025-11-27 07:26:33.486293 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:bc:00:60', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2025-11-27 07:26:33.486448 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:ec:c6:01', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2025-11-27 07:26:33.486572 | controller |
2025-11-27 07:26:33.486709 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2025-11-27 07:26:33.486881 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.106)       0:01:08.319 *****
2025-11-27 07:26:33.540950 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2025-11-27 07:26:33.541134 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2025-11-27 07:26:33.541266 | controller |
2025-11-27 07:26:33.541418 | controller | TASK [dnsmasq : Check network file status] *************************************
2025-11-27 07:26:33.541551 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.055)       0:01:08.374 *****
2025-11-27 07:26:33.720472 | controller | ok: [instance]
2025-11-27 07:26:33.744879 | controller |
2025-11-27 07:26:33.744921 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2025-11-27 07:26:33.744935 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.179)       0:01:08.553 *****
2025-11-27 07:26:33.744948 | controller | ok: [instance]
2025-11-27 07:26:33.745062 | controller |
2025-11-27 07:26:33.745082 | controller | TASK [dnsmasq : Check network file status] *************************************
2025-11-27 07:26:33.745093 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.024)       0:01:08.578 *****
2025-11-27 07:26:33.929222 | controller | ok: [instance]
2025-11-27 07:26:33.929541 | controller |
2025-11-27 07:26:33.953932 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2025-11-27 07:26:33.953970 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.184)       0:01:08.762 *****
2025-11-27 07:26:33.953985 | controller | ok: [instance]
2025-11-27 07:26:33.953993 | controller |
2025-11-27 07:26:33.954000 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2025-11-27 07:26:33.954009 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.024)       0:01:08.787 *****
2025-11-27 07:26:33.974656 | controller | ok: [instance]
2025-11-27 07:26:34.160938 | controller |
2025-11-27 07:26:34.160972 | controller | TASK [dnsmasq : Compute entry] *************************************************
2025-11-27 07:26:34.160980 | controller | Thursday 27 November 2025  07:26:33 +0000 (0:00:00.020)       0:01:08.808 *****
2025-11-27 07:26:34.160991 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:32:ed:0e', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2025-11-27 07:26:34.161020 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:27:ea:27', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2025-11-27 07:26:34.161029 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:8d:98:0e', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2025-11-27 07:26:34.161638 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:88:d4:1c', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2025-11-27 07:26:34.199858 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:bc:00:60', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2025-11-27 07:26:34.199890 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:ec:c6:01', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2025-11-27 07:26:34.199898 | controller |
2025-11-27 07:26:34.199905 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2025-11-27 07:26:34.199911 | controller | Thursday 27 November 2025  07:26:34 +0000 (0:00:00.186)       0:01:08.994 *****
2025-11-27 07:26:34.199921 | controller | ok: [instance]
2025-11-27 07:26:34.199944 | controller |
2025-11-27 07:26:34.199952 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2025-11-27 07:26:34.200043 | controller | Thursday 27 November 2025  07:26:34 +0000 (0:00:00.039)       0:01:09.033 *****
2025-11-27 07:26:36.292900 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:32:ed:0e', 'entry': 'set:compute,52:54:00:32:ed:0e,192.168.140.100,compute-0', 'state': 'present'})
2025-11-27 07:26:36.292955 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:27:ea:27', 'entry': 'set:controller,52:54:01:27:ea:27,192.168.140.9,controller-0', 'state': 'present'})
2025-11-27 07:26:36.292965 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:8d:98:0e', 'entry': 'set:ocp,52:54:02:8d:98:0e,192.168.140.10,crc-0', 'state': 'present'})
2025-11-27 07:26:36.292973 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:88:d4:1c', 'entry': 'set:compute,52:54:00:88:d4:1c,192.168.101.100,compute-0', 'state': 'present'})
2025-11-27 07:26:36.292982 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:bc:00:60', 'entry': 'set:controller,52:54:01:bc:00:60,192.168.101.9,controller-0', 'state': 'present'})
2025-11-27 07:26:36.293423 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:ec:c6:01', 'entry': 'set:ocp,52:54:02:ec:c6:01,192.168.101.10,crc-0', 'state': 'present'})
2025-11-27 07:26:36.317265 | controller |
2025-11-27 07:26:36.317297 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2025-11-27 07:26:36.317310 | controller | Thursday 27 November 2025  07:26:36 +0000 (0:00:02.092)       0:01:11.126 *****
2025-11-27 07:26:36.317331 | controller | skipping: [instance]
2025-11-27 07:26:36.541732 | controller |
2025-11-27 07:26:36.541781 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2025-11-27 07:26:36.541793 | controller | Thursday 27 November 2025  07:26:36 +0000 (0:00:00.024)       0:01:11.150 *****
2025-11-27 07:26:36.541803 | controller | ok: [instance] => (item=compute-0)
2025-11-27 07:26:36.666785 | controller | ok: [instance] => (item=controller-0)
2025-11-27 07:26:36.666817 | controller | ok: [instance] => (item=crc-0)
2025-11-27 07:26:36.666825 | controller |
2025-11-27 07:26:36.666831 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2025-11-27 07:26:36.666837 | controller | Thursday 27 November 2025  07:26:36 +0000 (0:00:00.224)       0:01:11.374 *****
2025-11-27 07:26:36.666847 | controller |
2025-11-27 07:26:36.710313 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-11-27 07:26:36.710353 | controller | Thursday 27 November 2025  07:26:36 +0000 (0:00:00.125)       0:01:11.500 *****
2025-11-27 07:26:36.710364 | controller | ok: [instance]
2025-11-27 07:26:36.710564 | controller |
2025-11-27 07:26:36.710744 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-11-27 07:26:36.710961 | controller | Thursday 27 November 2025  07:26:36 +0000 (0:00:00.043)       0:01:11.544 *****
2025-11-27 07:26:36.919695 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-11-27 07:26:36.919907 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-11-27 07:26:36.920060 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2025-11-27 07:26:36.920202 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2025-11-27 07:26:36.920359 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2025-11-27 07:26:36.920513 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2025-11-27 07:26:36.920649 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2025-11-27 07:26:36.920826 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 07:26:36.920985 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 07:26:36.921128 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2025-11-27 07:26:36.921265 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-11-27 07:26:36.921410 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-11-27 07:26:36.921545 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2025-11-27 07:26:36.921676 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2025-11-27 07:26:36.921836 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2025-11-27 07:26:36.921975 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2025-11-27 07:26:36.922096 | controller |
2025-11-27 07:26:36.922224 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-11-27 07:26:36.922363 | controller | Thursday 27 November 2025  07:26:36 +0000 (0:00:00.209)       0:01:11.753 *****
2025-11-27 07:26:40.203866 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-11-27 07:26:40.203939 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-11-27 07:26:40.203950 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2025-11-27 07:26:40.203958 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2025-11-27 07:26:40.203968 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2025-11-27 07:26:40.204918 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2025-11-27 07:26:40.204980 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2025-11-27 07:26:40.204990 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 07:26:40.204996 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 07:26:40.205002 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2025-11-27 07:26:40.205007 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-11-27 07:26:40.205013 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-11-27 07:26:40.205018 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2025-11-27 07:26:40.205026 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2025-11-27 07:26:40.205048 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2025-11-27 07:26:40.205350 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2025-11-27 07:26:40.205463 | controller |
2025-11-27 07:26:40.205491 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] ****************
2025-11-27 07:26:40.205504 | controller | Thursday 27 November 2025  07:26:40 +0000 (0:00:03.283)       0:01:15.037 *****
2025-11-27 07:26:40.223621 | controller | ok: [instance]
2025-11-27 07:26:40.265869 | controller |
2025-11-27 07:26:40.265914 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] **************
2025-11-27 07:26:40.265924 | controller | Thursday 27 November 2025  07:26:40 +0000 (0:00:00.020)       0:01:15.057 *****
2025-11-27 07:26:40.265937 | controller | skipping: [instance] => (item=compute)
2025-11-27 07:26:40.265986 | controller | skipping: [instance] => (item=controller)
2025-11-27 07:26:40.266010 | controller | skipping: [instance] => (item=crc)
2025-11-27 07:26:40.266017 | controller | skipping: [instance]
2025-11-27 07:26:40.266024 | controller |
2025-11-27 07:26:40.266030 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] *******
2025-11-27 07:26:40.266039 | controller | Thursday 27 November 2025  07:26:40 +0000 (0:00:00.041)       0:01:15.099 *****
2025-11-27 07:26:40.296201 | controller | skipping: [instance]
2025-11-27 07:26:40.296467 | controller |
2025-11-27 07:26:40.296700 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2025-11-27 07:26:40.296912 | controller | Thursday 27 November 2025  07:26:40 +0000 (0:00:00.030)       0:01:15.130 *****
2025-11-27 07:26:40.667890 | controller | changed: [instance]
2025-11-27 07:26:40.668182 | controller |
2025-11-27 07:26:40.668211 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2025-11-27 07:26:40.668219 | controller | Thursday 27 November 2025  07:26:40 +0000 (0:00:00.360)       0:01:15.490 *****
2025-11-27 07:26:40.668228 | controller |
2025-11-27 07:26:41.474839 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2025-11-27 07:26:41.474868 | controller | Thursday 27 November 2025  07:26:40 +0000 (0:00:00.010)       0:01:15.501 *****
2025-11-27 07:26:41.474879 | controller | changed: [instance]
2025-11-27 07:26:41.475074 | controller |
2025-11-27 07:26:41.475105 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-11-27 07:26:41.475119 | controller | Thursday 27 November 2025  07:26:41 +0000 (0:00:00.806)       0:01:16.308 *****
2025-11-27 07:26:41.821840 | controller | changed: [instance]
2025-11-27 07:26:42.171883 | controller |
2025-11-27 07:26:42.171923 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2025-11-27 07:26:42.171933 | controller | Thursday 27 November 2025  07:26:41 +0000 (0:00:00.347)       0:01:16.655 *****
2025-11-27 07:26:42.171947 | controller | changed: [instance]
2025-11-27 07:26:42.171981 | controller |
2025-11-27 07:26:42.171991 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2025-11-27 07:26:42.172020 | controller | Thursday 27 November 2025  07:26:42 +0000 (0:00:00.350)       0:01:17.005 *****
2025-11-27 07:26:42.542447 | controller | changed: [instance]
2025-11-27 07:26:42.910839 | controller |
2025-11-27 07:26:42.910866 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2025-11-27 07:26:42.910874 | controller | Thursday 27 November 2025  07:26:42 +0000 (0:00:00.370)       0:01:17.375 *****
2025-11-27 07:26:42.910889 | controller | changed: [instance]
2025-11-27 07:26:42.910918 | controller |
2025-11-27 07:26:42.910925 | controller | TASK [Build utility records dataset] *******************************************
2025-11-27 07:26:42.910932 | controller | Thursday 27 November 2025  07:26:42 +0000 (0:00:00.368)       0:01:17.744 *****
2025-11-27 07:26:42.941442 | controller |
2025-11-27 07:26:43.036580 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-11-27 07:26:43.036613 | controller | Thursday 27 November 2025  07:26:42 +0000 (0:00:00.030)       0:01:17.775 *****
2025-11-27 07:26:43.036627 | controller | ok: [instance]
2025-11-27 07:26:43.139730 | controller |
2025-11-27 07:26:43.139758 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-11-27 07:26:43.139787 | controller | Thursday 27 November 2025  07:26:43 +0000 (0:00:00.094)       0:01:17.869 *****
2025-11-27 07:26:43.139798 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2025-11-27 07:26:43.622906 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 07:26:43.622939 | controller |
2025-11-27 07:26:43.622947 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-11-27 07:26:43.622953 | controller | Thursday 27 November 2025  07:26:43 +0000 (0:00:00.103)       0:01:17.973 *****
2025-11-27 07:26:43.622968 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2025-11-27 07:26:44.106320 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-11-27 07:26:44.106362 | controller |
2025-11-27 07:26:44.106371 | controller | TASK [reproducer : Flush handlers] *********************************************
2025-11-27 07:26:44.106377 | controller | Thursday 27 November 2025  07:26:43 +0000 (0:00:00.471)       0:01:18.444 *****
2025-11-27 07:26:44.106382 | controller |
2025-11-27 07:26:44.106387 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-11-27 07:26:44.106393 | controller | Thursday 27 November 2025  07:26:43 +0000 (0:00:00.011)       0:01:18.455 *****
2025-11-27 07:26:44.106402 | controller | changed: [instance]
2025-11-27 07:26:44.106569 | controller |
2025-11-27 07:26:44.106602 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-11-27 07:26:44.459844 | controller | Thursday 27 November 2025  07:26:44 +0000 (0:00:00.484)       0:01:18.939 *****
2025-11-27 07:26:44.459886 | controller | changed: [instance]
2025-11-27 07:26:44.493345 | controller |
2025-11-27 07:26:44.493387 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2025-11-27 07:26:44.493396 | controller | Thursday 27 November 2025  07:26:44 +0000 (0:00:00.353)       0:01:19.293 *****
2025-11-27 07:26:44.493408 | controller | skipping: [instance]
2025-11-27 07:26:44.572882 | controller |
2025-11-27 07:26:44.572907 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2025-11-27 07:26:44.572916 | controller | Thursday 27 November 2025  07:26:44 +0000 (0:00:00.033)       0:01:19.326 *****
2025-11-27 07:26:44.572928 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2025-11-27 07:26:44.572948 | controller |
2025-11-27 07:26:44.572958 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2025-11-27 07:26:44.573019 | controller | Thursday 27 November 2025  07:26:44 +0000 (0:00:00.079)       0:01:19.406 *****
2025-11-27 07:26:44.765859 | controller | ok: [instance]
2025-11-27 07:26:44.766093 | controller |
2025-11-27 07:26:44.766116 | controller | TASK [Deploy CRC if needed] ****************************************************
2025-11-27 07:26:44.785864 | controller | Thursday 27 November 2025  07:26:44 +0000 (0:00:00.193)       0:01:19.599 *****
2025-11-27 07:26:44.785890 | controller | skipping: [instance]
2025-11-27 07:26:44.786055 | controller |
2025-11-27 07:26:44.786081 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2025-11-27 07:26:44.786097 | controller | Thursday 27 November 2025  07:26:44 +0000 (0:00:00.019)       0:01:19.619 *****
2025-11-27 07:26:45.138652 | controller | ok: [instance]
2025-11-27 07:26:45.381685 | controller |
2025-11-27 07:26:45.381714 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2025-11-27 07:26:45.381721 | controller | Thursday 27 November 2025  07:26:45 +0000 (0:00:00.352)       0:01:19.971 *****
2025-11-27 07:26:45.381731 | controller | ok: [instance]
2025-11-27 07:26:45.603869 | controller |
2025-11-27 07:26:45.603900 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2025-11-27 07:26:45.603908 | controller | Thursday 27 November 2025  07:26:45 +0000 (0:00:00.243)       0:01:20.215 *****
2025-11-27 07:26:45.603918 | controller | ok: [instance]
2025-11-27 07:26:45.831517 | controller |
2025-11-27 07:26:45.831549 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2025-11-27 07:26:45.831557 | controller | Thursday 27 November 2025  07:26:45 +0000 (0:00:00.222)       0:01:20.437 *****
2025-11-27 07:26:45.831568 | controller | ok: [instance]
2025-11-27 07:26:46.063463 | controller |
2025-11-27 07:26:46.063494 | controller | TASK [rhol_crc : Destroy default network] **************************************
2025-11-27 07:26:46.063507 | controller | Thursday 27 November 2025  07:26:45 +0000 (0:00:00.227)       0:01:20.664 *****
2025-11-27 07:26:46.063516 | controller | ok: [instance]
2025-11-27 07:26:46.107185 | controller |
2025-11-27 07:26:46.107215 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-11-27 07:26:46.107227 | controller | Thursday 27 November 2025  07:26:46 +0000 (0:00:00.232)       0:01:20.896 *****
2025-11-27 07:26:46.107237 | controller |
2025-11-27 07:26:46.304673 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2025-11-27 07:26:46.304707 | controller | Thursday 27 November 2025  07:26:46 +0000 (0:00:00.043)       0:01:20.940 *****
2025-11-27 07:26:46.304721 | controller | ok: [instance]
2025-11-27 07:26:46.327312 | controller |
2025-11-27 07:26:46.327335 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2025-11-27 07:26:46.327342 | controller | Thursday 27 November 2025  07:26:46 +0000 (0:00:00.197)       0:01:21.138 *****
2025-11-27 07:26:46.327352 | controller | ok: [instance]
2025-11-27 07:26:46.352825 | controller |
2025-11-27 07:26:46.352851 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2025-11-27 07:26:46.352860 | controller | Thursday 27 November 2025  07:26:46 +0000 (0:00:00.022)       0:01:21.160 *****
2025-11-27 07:26:46.352871 | controller | skipping: [instance]
2025-11-27 07:26:46.353114 | controller |
2025-11-27 07:26:46.353132 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2025-11-27 07:26:46.646174 | controller | Thursday 27 November 2025  07:26:46 +0000 (0:00:00.025)       0:01:21.186 *****
2025-11-27 07:26:46.646209 | controller | ok: [instance]
2025-11-27 07:26:46.872920 | controller |
2025-11-27 07:26:46.872965 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2025-11-27 07:26:46.872975 | controller | Thursday 27 November 2025  07:26:46 +0000 (0:00:00.293)       0:01:21.479 *****
2025-11-27 07:26:46.872988 | controller | ok: [instance]
2025-11-27 07:26:47.054560 | controller |
2025-11-27 07:26:47.054598 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2025-11-27 07:26:47.054608 | controller | Thursday 27 November 2025  07:26:46 +0000 (0:00:00.226)       0:01:21.706 *****
2025-11-27 07:26:47.054621 | controller | ok: [instance]
2025-11-27 07:26:47.112913 | controller |
2025-11-27 07:26:47.112956 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2025-11-27 07:26:47.112966 | controller | Thursday 27 November 2025  07:26:47 +0000 (0:00:00.181)       0:01:21.887 *****
2025-11-27 07:26:47.112978 | controller |
2025-11-27 07:26:47.159269 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2025-11-27 07:26:47.159300 | controller | Thursday 27 November 2025  07:26:47 +0000 (0:00:00.058)       0:01:21.946 *****
2025-11-27 07:26:47.159312 | controller | ok: [instance] => changed=false
2025-11-27 07:26:47.343844 | controller |   msg: All assertions passed
2025-11-27 07:26:47.343881 | controller |
2025-11-27 07:26:47.343890 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2025-11-27 07:26:47.343896 | controller | Thursday 27 November 2025  07:26:47 +0000 (0:00:00.046)       0:01:21.992 *****
2025-11-27 07:26:47.343906 | controller | ok: [instance]
2025-11-27 07:26:47.344147 | controller |
2025-11-27 07:26:47.541841 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2025-11-27 07:26:47.541875 | controller | Thursday 27 November 2025  07:26:47 +0000 (0:00:00.184)       0:01:22.177 *****
2025-11-27 07:26:47.541889 | controller | ok: [instance]
2025-11-27 07:26:47.542291 | controller |
2025-11-27 07:26:47.566941 | controller | TASK [openshift_login : Assert files exist] ************************************
2025-11-27 07:26:47.566961 | controller | Thursday 27 November 2025  07:26:47 +0000 (0:00:00.198)       0:01:22.375 *****
2025-11-27 07:26:47.566973 | controller | ok: [instance] => changed=false
2025-11-27 07:26:47.567146 | controller |   msg: All assertions passed
2025-11-27 07:26:47.567303 | controller |
2025-11-27 07:26:47.567496 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2025-11-27 07:26:47.567651 | controller | Thursday 27 November 2025  07:26:47 +0000 (0:00:00.025)       0:01:22.400 *****
2025-11-27 07:26:47.757861 | controller | ok: [instance]
2025-11-27 07:26:47.757914 | controller |
2025-11-27 07:26:47.758104 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2025-11-27 07:26:47.935882 | controller | Thursday 27 November 2025  07:26:47 +0000 (0:00:00.190)       0:01:22.591 *****
2025-11-27 07:26:47.935953 | controller | ok: [instance]
2025-11-27 07:26:47.936024 | controller |
2025-11-27 07:26:47.936161 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2025-11-27 07:26:47.936198 | controller | Thursday 27 November 2025  07:26:47 +0000 (0:00:00.178)       0:01:22.769 *****
2025-11-27 07:26:47.986623 | controller | ok: [instance]
2025-11-27 07:26:48.381552 | controller |
2025-11-27 07:26:48.381582 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2025-11-27 07:26:48.381590 | controller | Thursday 27 November 2025  07:26:47 +0000 (0:00:00.050)       0:01:22.820 *****
2025-11-27 07:26:48.381600 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2025-11-27 07:26:48.400940 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2025-11-27 07:26:48.400979 | controller |
2025-11-27 07:26:48.400987 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2025-11-27 07:26:48.400993 | controller | Thursday 27 November 2025  07:26:48 +0000 (0:00:00.394)       0:01:23.214 *****
2025-11-27 07:26:48.401005 | controller | skipping: [instance]
2025-11-27 07:26:48.401034 | controller |
2025-11-27 07:26:48.401237 | controller | TASK [Load the architecture local kustomize patches] ***************************
2025-11-27 07:26:48.426894 | controller | Thursday 27 November 2025  07:26:48 +0000 (0:00:00.019)       0:01:23.234 *****
2025-11-27 07:26:48.426946 | controller | skipping: [instance]
2025-11-27 07:26:48.561820 | controller |
2025-11-27 07:26:48.561849 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2025-11-27 07:26:48.561857 | controller | Thursday 27 November 2025  07:26:48 +0000 (0:00:00.025)       0:01:23.260 *****
2025-11-27 07:26:48.561873 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2025-11-27 07:26:48.586876 | controller |
2025-11-27 07:26:48.586909 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2025-11-27 07:26:48.586919 | controller | Thursday 27 November 2025  07:26:48 +0000 (0:00:00.134)       0:01:23.395 *****
2025-11-27 07:26:48.586931 | controller | skipping: [instance]
2025-11-27 07:26:48.586965 | controller |
2025-11-27 07:26:48.587206 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2025-11-27 07:26:49.006735 | controller | Thursday 27 November 2025  07:26:48 +0000 (0:00:00.025)       0:01:23.420 *****
2025-11-27 07:26:49.006786 | controller | changed: [instance]
2025-11-27 07:26:49.522724 | controller |
2025-11-27 07:26:49.522754 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2025-11-27 07:26:49.522782 | controller | Thursday 27 November 2025  07:26:49 +0000 (0:00:00.419)       0:01:23.839 *****
2025-11-27 07:26:49.522793 | controller | changed: [instance]
2025-11-27 07:26:49.963271 | controller |
2025-11-27 07:26:49.963303 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2025-11-27 07:26:49.963311 | controller | Thursday 27 November 2025  07:26:49 +0000 (0:00:00.504)       0:01:24.344 *****
2025-11-27 07:26:49.963317 | controller |
2025-11-27 07:26:49.963323 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-11-27 07:26:49.963328 | controller | Thursday 27 November 2025  07:26:49 +0000 (0:00:00.011)       0:01:24.355 *****
2025-11-27 07:26:49.963338 | controller | changed: [instance]
2025-11-27 07:26:50.782336 | controller |
2025-11-27 07:26:50.782365 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2025-11-27 07:26:50.782386 | controller | Thursday 27 November 2025  07:26:49 +0000 (0:00:00.440)       0:01:24.796 *****
2025-11-27 07:26:50.782396 | controller | changed: [instance]
2025-11-27 07:26:50.816722 | controller |
2025-11-27 07:26:50.816748 | controller | TASK [Deploy virtualbmc] *******************************************************
2025-11-27 07:26:50.816757 | controller | Thursday 27 November 2025  07:26:50 +0000 (0:00:00.819)       0:01:25.615 *****
2025-11-27 07:26:50.816795 | controller | skipping: [instance]
2025-11-27 07:26:50.849837 | controller |
2025-11-27 07:26:50.849875 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2025-11-27 07:26:50.849885 | controller | Thursday 27 November 2025  07:26:50 +0000 (0:00:00.034)       0:01:25.650 *****
2025-11-27 07:26:50.849900 | controller | skipping: [instance]
2025-11-27 07:26:51.414840 | controller |
2025-11-27 07:26:51.414878 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2025-11-27 07:26:51.414886 | controller | Thursday 27 November 2025  07:26:50 +0000 (0:00:00.033)       0:01:25.683 *****
2025-11-27 07:26:51.414896 | controller | changed: [instance] => (item=workload)
2025-11-27 07:26:51.841887 | controller | changed: [instance] => (item=reproducer-inventory)
2025-11-27 07:26:51.841927 | controller | ok: [instance] => (item=volumes)
2025-11-27 07:26:51.841937 | controller |
2025-11-27 07:26:51.841944 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2025-11-27 07:26:51.841952 | controller | Thursday 27 November 2025  07:26:51 +0000 (0:00:00.564)       0:01:26.247 *****
2025-11-27 07:26:51.841964 | controller | changed: [instance] => (item=workload)
2025-11-27 07:26:51.867827 | controller | changed: [instance] => (item=volumes)
2025-11-27 07:26:51.867849 | controller |
2025-11-27 07:26:51.867856 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2025-11-27 07:26:51.867863 | controller | Thursday 27 November 2025  07:26:51 +0000 (0:00:00.427)       0:01:26.675 *****
2025-11-27 07:26:51.867874 | controller | skipping: [instance]
2025-11-27 07:26:51.867967 | controller |
2025-11-27 07:26:51.867996 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2025-11-27 07:26:51.868013 | controller | Thursday 27 November 2025  07:26:51 +0000 (0:00:00.026)       0:01:26.701 *****
2025-11-27 07:26:52.925596 | controller | changed: [instance] => (item=compute)
2025-11-27 07:26:53.304910 | controller | changed: [instance] => (item=controller)
2025-11-27 07:26:53.304944 | controller | changed: [instance] => (item=crc)
2025-11-27 07:26:53.304954 | controller |
2025-11-27 07:26:53.304961 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2025-11-27 07:26:53.304969 | controller | Thursday 27 November 2025  07:26:52 +0000 (0:00:01.057)       0:01:27.758 *****
2025-11-27 07:26:53.304980 | controller | changed: [instance]
2025-11-27 07:26:53.344936 | controller |
2025-11-27 07:26:53.344973 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2025-11-27 07:26:53.344983 | controller | Thursday 27 November 2025  07:26:53 +0000 (0:00:00.379)       0:01:28.138 *****
2025-11-27 07:26:53.344995 | controller | skipping: [instance]
2025-11-27 07:26:53.408907 | controller |
2025-11-27 07:26:53.408939 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2025-11-27 07:26:53.408949 | controller | Thursday 27 November 2025  07:26:53 +0000 (0:00:00.040)       0:01:28.178 *****
2025-11-27 07:26:53.408962 | controller | skipping: [instance] => (item=crc)
2025-11-27 07:26:53.619958 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2025-11-27 07:26:53.619985 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2025-11-27 07:26:53.619993 | controller |
2025-11-27 07:26:53.620000 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2025-11-27 07:26:53.620006 | controller | Thursday 27 November 2025  07:26:53 +0000 (0:00:00.063)       0:01:28.242 *****
2025-11-27 07:26:53.620015 | controller | changed: [instance]
2025-11-27 07:26:53.803526 | controller |
2025-11-27 07:26:53.803554 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2025-11-27 07:26:53.803561 | controller | Thursday 27 November 2025  07:26:53 +0000 (0:00:00.211)       0:01:28.453 *****
2025-11-27 07:26:53.803571 | controller | ok: [instance]
2025-11-27 07:27:17.034914 | controller |
2025-11-27 07:27:17.034950 | controller | TASK [libvirt_manager : Download base image] ***********************************
2025-11-27 07:27:17.034960 | controller | Thursday 27 November 2025  07:26:53 +0000 (0:00:00.183)       0:01:28.636 *****
2025-11-27 07:27:17.034972 | controller | changed: [instance]
2025-11-27 07:27:17.234641 | controller |
2025-11-27 07:27:17.234672 | controller | TASK [libvirt_manager : Check image] *******************************************
2025-11-27 07:27:17.234680 | controller | Thursday 27 November 2025  07:27:17 +0000 (0:00:23.231)       0:01:51.868 *****
2025-11-27 07:27:17.234691 | controller | ok: [instance]
2025-11-27 07:27:17.276667 | controller |
2025-11-27 07:27:17.276697 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2025-11-27 07:27:17.276719 | controller | Thursday 27 November 2025  07:27:17 +0000 (0:00:00.199)       0:01:52.068 *****
2025-11-27 07:27:17.276732 | controller | ok: [instance] => changed=false
2025-11-27 07:27:17.487842 | controller |   msg: All assertions passed
2025-11-27 07:27:17.487875 | controller |
2025-11-27 07:27:17.487882 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2025-11-27 07:27:17.487889 | controller | Thursday 27 November 2025  07:27:17 +0000 (0:00:00.041)       0:01:52.109 *****
2025-11-27 07:27:17.487899 | controller | changed: [instance]
2025-11-27 07:27:17.487922 | controller |
2025-11-27 07:27:17.487930 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2025-11-27 07:27:17.488099 | controller | Thursday 27 November 2025  07:27:17 +0000 (0:00:00.211)       0:01:52.321 *****
2025-11-27 07:27:17.694440 | controller | ok: [instance]
2025-11-27 07:27:17.923653 | controller |
2025-11-27 07:27:17.923683 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2025-11-27 07:27:17.923691 | controller | Thursday 27 November 2025  07:27:17 +0000 (0:00:00.206)       0:01:52.527 *****
2025-11-27 07:27:17.923701 | controller | ok: [instance]
2025-11-27 07:27:17.945853 | controller |
2025-11-27 07:27:17.945886 | controller | TASK [libvirt_manager : Download base image] ***********************************
2025-11-27 07:27:17.945895 | controller | Thursday 27 November 2025  07:27:17 +0000 (0:00:00.229)       0:01:52.757 *****
2025-11-27 07:27:17.945905 | controller | skipping: [instance]
2025-11-27 07:27:17.945930 | controller |
2025-11-27 07:27:17.946161 | controller | TASK [libvirt_manager : Check image] *******************************************
2025-11-27 07:27:18.141508 | controller | Thursday 27 November 2025  07:27:17 +0000 (0:00:00.022)       0:01:52.779 *****
2025-11-27 07:27:18.141545 | controller | ok: [instance]
2025-11-27 07:27:18.182935 | controller |
2025-11-27 07:27:18.182971 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2025-11-27 07:27:18.182981 | controller | Thursday 27 November 2025  07:27:18 +0000 (0:00:00.195)       0:01:52.974 *****
2025-11-27 07:27:18.182993 | controller | ok: [instance] => changed=false
2025-11-27 07:27:18.183024 | controller |   msg: All assertions passed
2025-11-27 07:27:18.183031 | controller |
2025-11-27 07:27:18.183040 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2025-11-27 07:27:18.183132 | controller | Thursday 27 November 2025  07:27:18 +0000 (0:00:00.041)       0:01:53.016 *****
2025-11-27 07:27:18.386739 | controller | ok: [instance]
2025-11-27 07:27:18.566551 | controller |
2025-11-27 07:27:18.566581 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2025-11-27 07:27:18.566589 | controller | Thursday 27 November 2025  07:27:18 +0000 (0:00:00.203)       0:01:53.219 *****
2025-11-27 07:27:18.566599 | controller | ok: [instance]
2025-11-27 07:27:18.965306 | controller |
2025-11-27 07:27:18.965336 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2025-11-27 07:27:18.965344 | controller | Thursday 27 November 2025  07:27:18 +0000 (0:00:00.179)       0:01:53.399 *****
2025-11-27 07:27:18.965355 | controller | changed: [instance]
2025-11-27 07:27:19.142849 | controller |
2025-11-27 07:27:19.142895 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2025-11-27 07:27:19.142905 | controller | Thursday 27 November 2025  07:27:18 +0000 (0:00:00.398)       0:01:53.798 *****
2025-11-27 07:27:19.142918 | controller | ok: [instance]
2025-11-27 07:27:19.320585 | controller |
2025-11-27 07:27:19.320615 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2025-11-27 07:27:19.320623 | controller | Thursday 27 November 2025  07:27:19 +0000 (0:00:00.177)       0:01:53.976 *****
2025-11-27 07:27:19.320633 | controller | ok: [instance]
2025-11-27 07:27:19.727227 | controller |
2025-11-27 07:27:19.727260 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2025-11-27 07:27:19.727269 | controller | Thursday 27 November 2025  07:27:19 +0000 (0:00:00.177)       0:01:54.153 *****
2025-11-27 07:27:19.727282 | controller | changed: [instance]
2025-11-27 07:27:19.747703 | controller |
2025-11-27 07:27:19.747724 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2025-11-27 07:27:19.747732 | controller | Thursday 27 November 2025  07:27:19 +0000 (0:00:00.406)       0:01:54.560 *****
2025-11-27 07:27:19.747745 | controller | ok: [instance]
2025-11-27 07:27:19.976867 | controller |
2025-11-27 07:27:19.976898 | controller | TASK [libvirt_manager : List existing networks] ********************************
2025-11-27 07:27:19.976906 | controller | Thursday 27 November 2025  07:27:19 +0000 (0:00:00.020)       0:01:54.581 *****
2025-11-27 07:27:19.976916 | controller | ok: [instance]
2025-11-27 07:27:20.451796 | controller |
2025-11-27 07:27:20.451828 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2025-11-27 07:27:20.451836 | controller | Thursday 27 November 2025  07:27:19 +0000 (0:00:00.228)       0:01:54.810 *****
2025-11-27 07:27:20.451846 | controller | ok: [instance]
2025-11-27 07:27:20.576910 | controller |
2025-11-27 07:27:20.576945 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2025-11-27 07:27:20.576953 | controller | Thursday 27 November 2025  07:27:20 +0000 (0:00:00.474)       0:01:55.285 *****
2025-11-27 07:27:20.576966 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-11-27 07:27:20.576999 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-11-27 07:27:20.577007 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-11-27 07:27:20.577015 | controller |
2025-11-27 07:27:20.577125 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2025-11-27 07:27:20.577154 | controller | Thursday 27 November 2025  07:27:20 +0000 (0:00:00.125)       0:01:55.410 *****
2025-11-27 07:27:20.836267 | controller | changed: [instance]
2025-11-27 07:27:21.057509 | controller |
2025-11-27 07:27:21.057540 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2025-11-27 07:27:21.057550 | controller | Thursday 27 November 2025  07:27:20 +0000 (0:00:00.259)       0:01:55.669 *****
2025-11-27 07:27:21.057560 | controller | changed: [instance]
2025-11-27 07:27:21.348864 | controller |
2025-11-27 07:27:21.348902 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2025-11-27 07:27:21.348912 | controller | Thursday 27 November 2025  07:27:21 +0000 (0:00:00.221)       0:01:55.890 *****
2025-11-27 07:27:21.348924 | controller | changed: [instance]
2025-11-27 07:27:21.348953 | controller |
2025-11-27 07:27:21.348964 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2025-11-27 07:27:21.348990 | controller | Thursday 27 November 2025  07:27:21 +0000 (0:00:00.291)       0:01:56.182 *****
2025-11-27 07:27:21.377922 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-11-27 07:27:21.378030 | controller |
2025-11-27 07:27:21.378058 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-11-27 07:27:21.378070 | controller | Thursday 27 November 2025  07:27:21 +0000 (0:00:00.029)       0:01:56.211 *****
2025-11-27 07:27:21.423930 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-11-27 07:27:21.424019 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-11-27 07:27:21.424039 | controller |
2025-11-27 07:27:21.424046 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 07:27:21.424056 | controller | Thursday 27 November 2025  07:27:21 +0000 (0:00:00.045)       0:01:56.257 *****
2025-11-27 07:27:21.651635 | controller | ok: [instance]
2025-11-27 07:27:21.694887 | controller |
2025-11-27 07:27:21.694938 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 07:27:21.694947 | controller | Thursday 27 November 2025  07:27:21 +0000 (0:00:00.227)       0:01:56.485 *****
2025-11-27 07:27:21.694965 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 07:27:21.695004 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:27:21.695019 | controller |
2025-11-27 07:27:21.695327 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 07:27:21.924916 | controller | Thursday 27 November 2025  07:27:21 +0000 (0:00:00.043)       0:01:56.528 *****
2025-11-27 07:27:21.924958 | controller | ok: [instance]
2025-11-27 07:27:21.924992 | controller |
2025-11-27 07:27:21.925003 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 07:27:21.925113 | controller | Thursday 27 November 2025  07:27:21 +0000 (0:00:00.230)       0:01:56.758 *****
2025-11-27 07:27:22.127856 | controller | ok: [instance]
2025-11-27 07:27:22.127906 | controller |
2025-11-27 07:27:22.128189 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2025-11-27 07:27:22.414880 | controller | Thursday 27 November 2025  07:27:22 +0000 (0:00:00.202)       0:01:56.961 *****
2025-11-27 07:27:22.414920 | controller | changed: [instance]
2025-11-27 07:27:22.647737 | controller |
2025-11-27 07:27:22.647787 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 07:27:22.647799 | controller | Thursday 27 November 2025  07:27:22 +0000 (0:00:00.286)       0:01:57.248 *****
2025-11-27 07:27:22.647809 | controller | ok: [instance]
2025-11-27 07:27:22.692356 | controller |
2025-11-27 07:27:22.692374 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 07:27:22.692381 | controller | Thursday 27 November 2025  07:27:22 +0000 (0:00:00.232)       0:01:57.481 *****
2025-11-27 07:27:22.692390 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 07:27:22.920718 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:27:22.920739 | controller |
2025-11-27 07:27:22.920747 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 07:27:22.920753 | controller | Thursday 27 November 2025  07:27:22 +0000 (0:00:00.044)       0:01:57.525 *****
2025-11-27 07:27:22.920779 | controller | ok: [instance]
2025-11-27 07:27:23.122862 | controller |
2025-11-27 07:27:23.122893 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 07:27:23.122901 | controller | Thursday 27 November 2025  07:27:22 +0000 (0:00:00.228)       0:01:57.754 *****
2025-11-27 07:27:23.122912 | controller | ok: [instance]
2025-11-27 07:27:23.122938 | controller |
2025-11-27 07:27:23.123184 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2025-11-27 07:27:23.405864 | controller | Thursday 27 November 2025  07:27:23 +0000 (0:00:00.202)       0:01:57.956 *****
2025-11-27 07:27:23.405914 | controller | changed: [instance]
2025-11-27 07:27:23.405950 | controller |
2025-11-27 07:27:23.406182 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2025-11-27 07:27:23.426874 | controller | Thursday 27 November 2025  07:27:23 +0000 (0:00:00.282)       0:01:58.239 *****
2025-11-27 07:27:23.426929 | controller | skipping: [instance]
2025-11-27 07:27:23.454496 | controller |
2025-11-27 07:27:23.454549 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2025-11-27 07:27:23.454563 | controller | Thursday 27 November 2025  07:27:23 +0000 (0:00:00.020)       0:01:58.260 *****
2025-11-27 07:27:23.454579 | controller | skipping: [instance]
2025-11-27 07:27:23.483874 | controller |
2025-11-27 07:27:23.483907 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2025-11-27 07:27:23.483916 | controller | Thursday 27 November 2025  07:27:23 +0000 (0:00:00.027)       0:01:58.287 *****
2025-11-27 07:27:23.483926 | controller | skipping: [instance]
2025-11-27 07:27:23.483954 | controller |
2025-11-27 07:27:23.483963 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2025-11-27 07:27:23.484052 | controller | Thursday 27 November 2025  07:27:23 +0000 (0:00:00.029)       0:01:58.317 *****
2025-11-27 07:27:23.510867 | controller | skipping: [instance]
2025-11-27 07:27:23.510981 | controller |
2025-11-27 07:27:23.510999 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-11-27 07:27:23.511009 | controller | Thursday 27 November 2025  07:27:23 +0000 (0:00:00.026)       0:01:58.344 *****
2025-11-27 07:27:24.727891 | controller | changed: [instance]
2025-11-27 07:27:24.763918 | controller |
2025-11-27 07:27:24.763955 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-11-27 07:27:24.763972 | controller | Thursday 27 November 2025  07:27:24 +0000 (0:00:01.216)       0:01:59.561 *****
2025-11-27 07:27:24.763984 | controller | ok: [instance]
2025-11-27 07:27:24.764013 | controller |
2025-11-27 07:27:24.764023 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-11-27 07:27:24.764122 | controller | Thursday 27 November 2025  07:27:24 +0000 (0:00:00.036)       0:01:59.597 *****
2025-11-27 07:27:24.817172 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2025-11-27 07:27:25.017857 | controller |
2025-11-27 07:27:25.017899 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2025-11-27 07:27:25.017909 | controller | Thursday 27 November 2025  07:27:24 +0000 (0:00:00.053)       0:01:59.650 *****
2025-11-27 07:27:25.017923 | controller | ok: [instance]
2025-11-27 07:27:25.078391 | controller |
2025-11-27 07:27:25.078423 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2025-11-27 07:27:25.078433 | controller | Thursday 27 November 2025  07:27:25 +0000 (0:00:00.200)       0:01:59.851 *****
2025-11-27 07:27:25.078445 | controller | ok: [instance]
2025-11-27 07:27:25.122929 | controller |
2025-11-27 07:27:25.122967 | controller | TASK [libvirt_manager : Define the user data] **********************************
2025-11-27 07:27:25.122977 | controller | Thursday 27 November 2025  07:27:25 +0000 (0:00:00.060)       0:01:59.911 *****
2025-11-27 07:27:25.122989 | controller | ok: [instance]
2025-11-27 07:27:25.166529 | controller |
2025-11-27 07:27:25.166568 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2025-11-27 07:27:25.166577 | controller | Thursday 27 November 2025  07:27:25 +0000 (0:00:00.044)       0:01:59.956 *****
2025-11-27 07:27:25.166588 | controller | skipping: [instance]
2025-11-27 07:27:25.166658 | controller |
2025-11-27 07:27:25.166801 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2025-11-27 07:27:25.166935 | controller | Thursday 27 November 2025  07:27:25 +0000 (0:00:00.044)       0:02:00.000 *****
2025-11-27 07:27:25.209685 | controller | skipping: [instance]
2025-11-27 07:27:25.209931 | controller |
2025-11-27 07:27:25.210124 | controller | TASK [Call the config_drive role] **********************************************
2025-11-27 07:27:25.210249 | controller | Thursday 27 November 2025  07:27:25 +0000 (0:00:00.042)       0:02:00.043 *****
2025-11-27 07:27:25.271043 | controller |
2025-11-27 07:27:25.271203 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2025-11-27 07:27:25.271331 | controller | Thursday 27 November 2025  07:27:25 +0000 (0:00:00.061)       0:02:00.104 *****
2025-11-27 07:27:25.676584 | controller | ok: [instance] => (item=artifacts)
2025-11-27 07:27:26.919170 | controller | ok: [instance] => (item=logs)
2025-11-27 07:27:26.919200 | controller |
2025-11-27 07:27:26.919207 | controller | TASK [config_drive : Install required RPM packages] ****************************
2025-11-27 07:27:26.919213 | controller | Thursday 27 November 2025  07:27:25 +0000 (0:00:00.404)       0:02:00.509 *****
2025-11-27 07:27:26.919223 | controller | ok: [instance]
2025-11-27 07:27:27.135892 | controller |
2025-11-27 07:27:27.135927 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2025-11-27 07:27:27.135936 | controller | Thursday 27 November 2025  07:27:26 +0000 (0:00:01.242)       0:02:01.752 *****
2025-11-27 07:27:27.135948 | controller | changed: [instance]
2025-11-27 07:27:27.511641 | controller |
2025-11-27 07:27:27.511671 | controller | TASK [config_drive : Generate meta-data] ***************************************
2025-11-27 07:27:27.511680 | controller | Thursday 27 November 2025  07:27:27 +0000 (0:00:00.216)       0:02:01.969 *****
2025-11-27 07:27:27.511689 | controller | changed: [instance]
2025-11-27 07:27:27.891811 | controller |
2025-11-27 07:27:27.891846 | controller | TASK [config_drive : Generate user-data] ***************************************
2025-11-27 07:27:27.891856 | controller | Thursday 27 November 2025  07:27:27 +0000 (0:00:00.375)       0:02:02.344 *****
2025-11-27 07:27:27.891868 | controller | changed: [instance]
2025-11-27 07:27:27.937588 | controller |
2025-11-27 07:27:27.937616 | controller | TASK [config_drive : Generate network-data] ************************************
2025-11-27 07:27:27.937626 | controller | Thursday 27 November 2025  07:27:27 +0000 (0:00:00.380)       0:02:02.725 *****
2025-11-27 07:27:27.937645 | controller | skipping: [instance]
2025-11-27 07:27:28.141298 | controller |
2025-11-27 07:27:28.141333 | controller | TASK [config_drive : Check ISO availability] ***********************************
2025-11-27 07:27:28.141342 | controller | Thursday 27 November 2025  07:27:27 +0000 (0:00:00.046)       0:02:02.771 *****
2025-11-27 07:27:28.141354 | controller | ok: [instance]
2025-11-27 07:27:28.183912 | controller |
2025-11-27 07:27:28.183947 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2025-11-27 07:27:28.183957 | controller | Thursday 27 November 2025  07:27:28 +0000 (0:00:00.203)       0:02:02.974 *****
2025-11-27 07:27:28.183970 | controller | skipping: [instance]
2025-11-27 07:27:28.183999 | controller |
2025-11-27 07:27:28.184009 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2025-11-27 07:27:28.184153 | controller | Thursday 27 November 2025  07:27:28 +0000 (0:00:00.042)       0:02:03.017 *****
2025-11-27 07:27:28.421850 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2025-11-27 07:27:28.696506 | controller | changed: [instance]
2025-11-27 07:27:28.696550 | controller |
2025-11-27 07:27:28.696562 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-11-27 07:27:28.696568 | controller | Thursday 27 November 2025  07:27:28 +0000 (0:00:00.237)       0:02:03.254 *****
2025-11-27 07:27:28.696577 | controller | changed: [instance]
2025-11-27 07:27:28.743343 | controller |
2025-11-27 07:27:28.743373 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-11-27 07:27:28.743383 | controller | Thursday 27 November 2025  07:27:28 +0000 (0:00:00.274)       0:02:03.529 *****
2025-11-27 07:27:28.743394 | controller | skipping: [instance]
2025-11-27 07:27:28.770903 | controller |
2025-11-27 07:27:28.770927 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ********************
2025-11-27 07:27:28.770935 | controller | Thursday 27 November 2025  07:27:28 +0000 (0:00:00.046)       0:02:03.576 *****
2025-11-27 07:27:28.770945 | controller | skipping: [instance]
2025-11-27 07:27:29.016895 | controller |
2025-11-27 07:27:29.016928 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2025-11-27 07:27:29.016937 | controller | Thursday 27 November 2025  07:27:28 +0000 (0:00:00.027)       0:02:03.604 *****
2025-11-27 07:27:29.016949 | controller | changed: [instance]
2025-11-27 07:27:29.016957 | controller |
2025-11-27 07:27:29.016963 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2025-11-27 07:27:29.016972 | controller | Thursday 27 November 2025  07:27:29 +0000 (0:00:00.245)       0:02:03.850 *****
2025-11-27 07:27:29.242925 | controller | changed: [instance]
2025-11-27 07:27:29.539834 | controller |
2025-11-27 07:27:29.539864 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2025-11-27 07:27:29.539872 | controller | Thursday 27 November 2025  07:27:29 +0000 (0:00:00.226)       0:02:04.076 *****
2025-11-27 07:27:29.539882 | controller | changed: [instance]
2025-11-27 07:27:29.539906 | controller |
2025-11-27 07:27:29.540085 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2025-11-27 07:27:29.568867 | controller | Thursday 27 November 2025  07:27:29 +0000 (0:00:00.297)       0:02:04.373 *****
2025-11-27 07:27:29.568916 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-11-27 07:27:29.612887 | controller |
2025-11-27 07:27:29.612910 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-11-27 07:27:29.612920 | controller | Thursday 27 November 2025  07:27:29 +0000 (0:00:00.028)       0:02:04.402 *****
2025-11-27 07:27:29.612931 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-11-27 07:27:29.613494 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-11-27 07:27:29.843916 | controller |
2025-11-27 07:27:29.843955 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 07:27:29.843966 | controller | Thursday 27 November 2025  07:27:29 +0000 (0:00:00.044)       0:02:04.446 *****
2025-11-27 07:27:29.843985 | controller | ok: [instance]
2025-11-27 07:27:29.889740 | controller |
2025-11-27 07:27:29.889795 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 07:27:29.889807 | controller | Thursday 27 November 2025  07:27:29 +0000 (0:00:00.230)       0:02:04.677 *****
2025-11-27 07:27:29.889819 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 07:27:30.122229 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:27:30.122262 | controller |
2025-11-27 07:27:30.122271 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 07:27:30.122279 | controller | Thursday 27 November 2025  07:27:29 +0000 (0:00:00.045)       0:02:04.723 *****
2025-11-27 07:27:30.122290 | controller | ok: [instance]
2025-11-27 07:27:30.327896 | controller |
2025-11-27 07:27:30.327931 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 07:27:30.327941 | controller | Thursday 27 November 2025  07:27:30 +0000 (0:00:00.232)       0:02:04.955 *****
2025-11-27 07:27:30.327953 | controller | ok: [instance]
2025-11-27 07:27:30.327988 | controller |
2025-11-27 07:27:30.327998 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2025-11-27 07:27:30.616830 | controller | Thursday 27 November 2025  07:27:30 +0000 (0:00:00.205)       0:02:05.161 *****
2025-11-27 07:27:30.616863 | controller | changed: [instance]
2025-11-27 07:27:30.617211 | controller |
2025-11-27 07:27:30.849829 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 07:27:30.849858 | controller | Thursday 27 November 2025  07:27:30 +0000 (0:00:00.289)       0:02:05.450 *****
2025-11-27 07:27:30.849870 | controller | ok: [instance]
2025-11-27 07:27:30.850166 | controller |
2025-11-27 07:27:30.894691 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 07:27:30.894714 | controller | Thursday 27 November 2025  07:27:30 +0000 (0:00:00.232)       0:02:05.683 *****
2025-11-27 07:27:30.894727 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 07:27:31.126686 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:27:31.126709 | controller |
2025-11-27 07:27:31.126719 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 07:27:31.126727 | controller | Thursday 27 November 2025  07:27:30 +0000 (0:00:00.044)       0:02:05.728 *****
2025-11-27 07:27:31.126741 | controller | ok: [instance]
2025-11-27 07:27:31.335302 | controller |
2025-11-27 07:27:31.335321 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 07:27:31.335329 | controller | Thursday 27 November 2025  07:27:31 +0000 (0:00:00.232)       0:02:05.960 *****
2025-11-27 07:27:31.335338 | controller | ok: [instance]
2025-11-27 07:27:32.630362 | controller |
2025-11-27 07:27:32.630393 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2025-11-27 07:27:32.630400 | controller | Thursday 27 November 2025  07:27:31 +0000 (0:00:00.208)       0:02:06.168 *****
2025-11-27 07:27:32.630410 | controller | changed: [instance]
2025-11-27 07:27:32.653775 | controller |
2025-11-27 07:27:32.653801 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2025-11-27 07:27:32.653809 | controller | Thursday 27 November 2025  07:27:32 +0000 (0:00:01.294)       0:02:07.463 *****
2025-11-27 07:27:32.653818 | controller | skipping: [instance]
2025-11-27 07:27:32.683933 | controller |
2025-11-27 07:27:32.683968 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2025-11-27 07:27:32.683978 | controller | Thursday 27 November 2025  07:27:32 +0000 (0:00:00.023)       0:02:07.487 *****
2025-11-27 07:27:32.683990 | controller | skipping: [instance]
2025-11-27 07:27:32.684022 | controller |
2025-11-27 07:27:32.684032 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2025-11-27 07:27:32.684145 | controller | Thursday 27 November 2025  07:27:32 +0000 (0:00:00.030)       0:02:07.517 *****
2025-11-27 07:27:32.712867 | controller | skipping: [instance]
2025-11-27 07:27:32.739391 | controller |
2025-11-27 07:27:32.739412 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2025-11-27 07:27:32.739420 | controller | Thursday 27 November 2025  07:27:32 +0000 (0:00:00.028)       0:02:07.546 *****
2025-11-27 07:27:32.739434 | controller | skipping: [instance]
2025-11-27 07:27:32.956880 | controller |
2025-11-27 07:27:32.956919 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-11-27 07:27:32.956929 | controller | Thursday 27 November 2025  07:27:32 +0000 (0:00:00.026)       0:02:07.572 *****
2025-11-27 07:27:32.956942 | controller | changed: [instance]
2025-11-27 07:27:32.956972 | controller |
2025-11-27 07:27:32.956982 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-11-27 07:27:32.995573 | controller | Thursday 27 November 2025  07:27:32 +0000 (0:00:00.217)       0:02:07.790 *****
2025-11-27 07:27:32.995607 | controller | ok: [instance]
2025-11-27 07:27:33.049890 | controller |
2025-11-27 07:27:33.049922 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-11-27 07:27:33.049932 | controller | Thursday 27 November 2025  07:27:32 +0000 (0:00:00.038)       0:02:07.829 *****
2025-11-27 07:27:33.049945 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2025-11-27 07:27:33.251957 | controller |
2025-11-27 07:27:33.251997 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2025-11-27 07:27:33.252006 | controller | Thursday 27 November 2025  07:27:33 +0000 (0:00:00.054)       0:02:07.883 *****
2025-11-27 07:27:33.252018 | controller | ok: [instance]
2025-11-27 07:27:33.252099 | controller |
2025-11-27 07:27:33.252248 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2025-11-27 07:27:33.252370 | controller | Thursday 27 November 2025  07:27:33 +0000 (0:00:00.202)       0:02:08.085 *****
2025-11-27 07:27:33.314658 | controller | ok: [instance]
2025-11-27 07:27:33.314779 | controller |
2025-11-27 07:27:33.314913 | controller | TASK [libvirt_manager : Define the user data] **********************************
2025-11-27 07:27:33.315036 | controller | Thursday 27 November 2025  07:27:33 +0000 (0:00:00.062)       0:02:08.148 *****
2025-11-27 07:27:33.359585 | controller | ok: [instance]
2025-11-27 07:27:33.359728 | controller |
2025-11-27 07:27:33.359897 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2025-11-27 07:27:33.360047 | controller | Thursday 27 November 2025  07:27:33 +0000 (0:00:00.045)       0:02:08.193 *****
2025-11-27 07:27:33.402971 | controller | skipping: [instance]
2025-11-27 07:27:33.403138 | controller |
2025-11-27 07:27:33.403269 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2025-11-27 07:27:33.403387 | controller | Thursday 27 November 2025  07:27:33 +0000 (0:00:00.043)       0:02:08.236 *****
2025-11-27 07:27:33.445993 | controller | skipping: [instance]
2025-11-27 07:27:33.446133 | controller |
2025-11-27 07:27:33.446289 | controller | TASK [Call the config_drive role] **********************************************
2025-11-27 07:27:33.446430 | controller | Thursday 27 November 2025  07:27:33 +0000 (0:00:00.043)       0:02:08.279 *****
2025-11-27 07:27:33.508691 | controller |
2025-11-27 07:27:33.508844 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2025-11-27 07:27:33.509002 | controller | Thursday 27 November 2025  07:27:33 +0000 (0:00:00.062)       0:02:08.342 *****
2025-11-27 07:27:33.915305 | controller | ok: [instance] => (item=artifacts)
2025-11-27 07:27:35.154741 | controller | ok: [instance] => (item=logs)
2025-11-27 07:27:35.154796 | controller |
2025-11-27 07:27:35.154804 | controller | TASK [config_drive : Install required RPM packages] ****************************
2025-11-27 07:27:35.154811 | controller | Thursday 27 November 2025  07:27:33 +0000 (0:00:00.406)       0:02:08.748 *****
2025-11-27 07:27:35.154820 | controller | ok: [instance]
2025-11-27 07:27:35.370853 | controller |
2025-11-27 07:27:35.370886 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2025-11-27 07:27:35.370895 | controller | Thursday 27 November 2025  07:27:35 +0000 (0:00:01.239)       0:02:09.988 *****
2025-11-27 07:27:35.370906 | controller | changed: [instance]
2025-11-27 07:27:35.745789 | controller |
2025-11-27 07:27:35.745819 | controller | TASK [config_drive : Generate meta-data] ***************************************
2025-11-27 07:27:35.745827 | controller | Thursday 27 November 2025  07:27:35 +0000 (0:00:00.216)       0:02:10.204 *****
2025-11-27 07:27:35.745837 | controller | changed: [instance]
2025-11-27 07:27:36.155483 | controller |
2025-11-27 07:27:36.155514 | controller | TASK [config_drive : Generate user-data] ***************************************
2025-11-27 07:27:36.155528 | controller | Thursday 27 November 2025  07:27:35 +0000 (0:00:00.374)       0:02:10.579 *****
2025-11-27 07:27:36.155538 | controller | changed: [instance]
2025-11-27 07:27:36.201521 | controller |
2025-11-27 07:27:36.201549 | controller | TASK [config_drive : Generate network-data] ************************************
2025-11-27 07:27:36.201575 | controller | Thursday 27 November 2025  07:27:36 +0000 (0:00:00.409)       0:02:10.988 *****
2025-11-27 07:27:36.201585 | controller | skipping: [instance]
2025-11-27 07:27:36.407610 | controller |
2025-11-27 07:27:36.407640 | controller | TASK [config_drive : Check ISO availability] ***********************************
2025-11-27 07:27:36.407648 | controller | Thursday 27 November 2025  07:27:36 +0000 (0:00:00.045)       0:02:11.034 *****
2025-11-27 07:27:36.407658 | controller | ok: [instance]
2025-11-27 07:27:36.451786 | controller |
2025-11-27 07:27:36.451815 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2025-11-27 07:27:36.451823 | controller | Thursday 27 November 2025  07:27:36 +0000 (0:00:00.205)       0:02:11.240 *****
2025-11-27 07:27:36.451833 | controller | skipping: [instance]
2025-11-27 07:27:36.695505 | controller |
2025-11-27 07:27:36.695539 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2025-11-27 07:27:36.695547 | controller | Thursday 27 November 2025  07:27:36 +0000 (0:00:00.044)       0:02:11.285 *****
2025-11-27 07:27:36.695570 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2025-11-27 07:27:36.980807 | controller | changed: [instance]
2025-11-27 07:27:36.980851 | controller |
2025-11-27 07:27:36.980860 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-11-27 07:27:36.980866 | controller | Thursday 27 November 2025  07:27:36 +0000 (0:00:00.243)       0:02:11.528 *****
2025-11-27 07:27:36.980876 | controller | changed: [instance]
2025-11-27 07:27:37.028864 | controller |
2025-11-27 07:27:37.028896 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-11-27 07:27:37.028905 | controller | Thursday 27 November 2025  07:27:36 +0000 (0:00:00.285)       0:02:11.814 *****
2025-11-27 07:27:37.028915 | controller | skipping: [instance]
2025-11-27 07:27:37.056824 | controller |
2025-11-27 07:27:37.056849 | controller | TASK [libvirt_manager : Configure boot order for controller-0] *****************
2025-11-27 07:27:37.056857 | controller | Thursday 27 November 2025  07:27:37 +0000 (0:00:00.048)       0:02:11.862 *****
2025-11-27 07:27:37.056866 | controller | skipping: [instance]
2025-11-27 07:27:37.303874 | controller |
2025-11-27 07:27:37.303908 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2025-11-27 07:27:37.303916 | controller | Thursday 27 November 2025  07:27:37 +0000 (0:00:00.028)       0:02:11.890 *****
2025-11-27 07:27:37.303927 | controller | changed: [instance]
2025-11-27 07:27:37.303952 | controller |
2025-11-27 07:27:37.303960 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2025-11-27 07:27:37.303982 | controller | Thursday 27 November 2025  07:27:37 +0000 (0:00:00.247)       0:02:12.137 *****
2025-11-27 07:27:37.533703 | controller | changed: [instance]
2025-11-27 07:27:37.826888 | controller |
2025-11-27 07:27:37.826935 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2025-11-27 07:27:37.826944 | controller | Thursday 27 November 2025  07:27:37 +0000 (0:00:00.229)       0:02:12.367 *****
2025-11-27 07:27:37.826959 | controller | changed: [instance]
2025-11-27 07:27:37.826995 | controller |
2025-11-27 07:27:37.827004 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2025-11-27 07:27:37.827109 | controller | Thursday 27 November 2025  07:27:37 +0000 (0:00:00.293)       0:02:12.660 *****
2025-11-27 07:27:37.855931 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-11-27 07:27:37.856042 | controller |
2025-11-27 07:27:37.856055 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-11-27 07:27:37.856066 | controller | Thursday 27 November 2025  07:27:37 +0000 (0:00:00.029)       0:02:12.689 *****
2025-11-27 07:27:37.901911 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-11-27 07:27:37.901981 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-11-27 07:27:37.902328 | controller |
2025-11-27 07:27:38.134729 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 07:27:38.134778 | controller | Thursday 27 November 2025  07:27:37 +0000 (0:00:00.046)       0:02:12.735 *****
2025-11-27 07:27:38.134795 | controller | ok: [instance]
2025-11-27 07:27:38.181782 | controller |
2025-11-27 07:27:38.181801 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 07:27:38.181809 | controller | Thursday 27 November 2025  07:27:38 +0000 (0:00:00.232)       0:02:12.967 *****
2025-11-27 07:27:38.181820 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 07:27:38.413413 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:27:38.413444 | controller |
2025-11-27 07:27:38.413452 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 07:27:38.413458 | controller | Thursday 27 November 2025  07:27:38 +0000 (0:00:00.047)       0:02:13.015 *****
2025-11-27 07:27:38.413468 | controller | ok: [instance]
2025-11-27 07:27:38.615563 | controller |
2025-11-27 07:27:38.615611 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 07:27:38.615618 | controller | Thursday 27 November 2025  07:27:38 +0000 (0:00:00.231)       0:02:13.246 *****
2025-11-27 07:27:38.615628 | controller | ok: [instance]
2025-11-27 07:27:38.902212 | controller |
2025-11-27 07:27:38.902242 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2025-11-27 07:27:38.902251 | controller | Thursday 27 November 2025  07:27:38 +0000 (0:00:00.202)       0:02:13.448 *****
2025-11-27 07:27:38.902261 | controller | changed: [instance]
2025-11-27 07:27:39.131352 | controller |
2025-11-27 07:27:39.131386 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-11-27 07:27:39.131396 | controller | Thursday 27 November 2025  07:27:38 +0000 (0:00:00.286)       0:02:13.735 *****
2025-11-27 07:27:39.131408 | controller | ok: [instance]
2025-11-27 07:27:39.175921 | controller |
2025-11-27 07:27:39.175986 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-11-27 07:27:39.175997 | controller | Thursday 27 November 2025  07:27:39 +0000 (0:00:00.229)       0:02:13.964 *****
2025-11-27 07:27:39.176014 | controller | ok: [instance] => (item=cifmw-public)
2025-11-27 07:27:39.176066 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-11-27 07:27:39.176251 | controller |
2025-11-27 07:27:39.176274 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-11-27 07:27:39.408274 | controller | Thursday 27 November 2025  07:27:39 +0000 (0:00:00.045)       0:02:14.009 *****
2025-11-27 07:27:39.408308 | controller | ok: [instance]
2025-11-27 07:27:39.609672 | controller |
2025-11-27 07:27:39.609700 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-11-27 07:27:39.609708 | controller | Thursday 27 November 2025  07:27:39 +0000 (0:00:00.231)       0:02:14.241 *****
2025-11-27 07:27:39.609718 | controller | ok: [instance]
2025-11-27 07:27:39.898790 | controller |
2025-11-27 07:27:39.898820 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2025-11-27 07:27:39.898828 | controller | Thursday 27 November 2025  07:27:39 +0000 (0:00:00.201)       0:02:14.443 *****
2025-11-27 07:27:39.898838 | controller | changed: [instance]
2025-11-27 07:27:39.919687 | controller |
2025-11-27 07:27:39.919706 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2025-11-27 07:27:39.919713 | controller | Thursday 27 November 2025  07:27:39 +0000 (0:00:00.289)       0:02:14.732 *****
2025-11-27 07:27:39.919722 | controller | skipping: [instance]
2025-11-27 07:27:39.947734 | controller |
2025-11-27 07:27:39.947756 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2025-11-27 07:27:39.947789 | controller | Thursday 27 November 2025  07:27:39 +0000 (0:00:00.021)       0:02:14.753 *****
2025-11-27 07:27:39.947802 | controller | skipping: [instance]
2025-11-27 07:27:39.975879 | controller |
2025-11-27 07:27:39.975902 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2025-11-27 07:27:39.975916 | controller | Thursday 27 November 2025  07:27:39 +0000 (0:00:00.027)       0:02:14.781 *****
2025-11-27 07:27:39.975927 | controller | skipping: [instance]
2025-11-27 07:27:39.975955 | controller |
2025-11-27 07:27:39.975965 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2025-11-27 07:27:39.976095 | controller | Thursday 27 November 2025  07:27:39 +0000 (0:00:00.028)       0:02:14.809 *****
2025-11-27 07:27:40.002907 | controller | skipping: [instance]
2025-11-27 07:27:41.221392 | controller |
2025-11-27 07:27:41.221421 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-11-27 07:27:41.221429 | controller | Thursday 27 November 2025  07:27:39 +0000 (0:00:00.026)       0:02:14.836 *****
2025-11-27 07:27:41.221438 | controller | changed: [instance]
2025-11-27 07:27:41.258908 | controller |
2025-11-27 07:27:41.258931 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-11-27 07:27:41.258940 | controller | Thursday 27 November 2025  07:27:41 +0000 (0:00:01.218)       0:02:16.054 *****
2025-11-27 07:27:41.258951 | controller | ok: [instance]
2025-11-27 07:27:41.259121 | controller |
2025-11-27 07:27:41.259292 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-11-27 07:27:41.259465 | controller | Thursday 27 November 2025  07:27:41 +0000 (0:00:00.037)       0:02:16.092 *****
2025-11-27 07:27:41.286522 | controller | skipping: [instance]
2025-11-27 07:27:41.286722 | controller |
2025-11-27 07:27:41.286926 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-11-27 07:27:41.287226 | controller | Thursday 27 November 2025  07:27:41 +0000 (0:00:00.027)       0:02:16.120 *****
2025-11-27 07:27:41.313984 | controller | skipping: [instance]
2025-11-27 07:27:41.314169 | controller |
2025-11-27 07:27:41.314341 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-11-27 07:27:41.314506 | controller | Thursday 27 November 2025  07:27:41 +0000 (0:00:00.027)       0:02:16.147 *****
2025-11-27 07:27:41.361037 | controller | skipping: [instance]
2025-11-27 07:27:41.361220 | controller |
2025-11-27 07:27:41.361391 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************
2025-11-27 07:27:41.361552 | controller | Thursday 27 November 2025  07:27:41 +0000 (0:00:00.047)       0:02:16.194 *****
2025-11-27 07:27:41.388612 | controller | skipping: [instance]
2025-11-27 07:27:41.388801 | controller |
2025-11-27 07:27:41.388951 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2025-11-27 07:27:41.389096 | controller | Thursday 27 November 2025  07:27:41 +0000 (0:00:00.027)       0:02:16.222 *****
2025-11-27 07:27:41.450970 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2025-11-27 07:27:41.451160 | controller |
2025-11-27 07:27:41.451332 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2025-11-27 07:27:41.451495 | controller | Thursday 27 November 2025  07:27:41 +0000 (0:00:00.062)       0:02:16.284 *****
2025-11-27 07:27:41.694288 | controller | ok: [instance] => (item=crc)
2025-11-27 07:27:43.771973 | controller |
2025-11-27 07:27:43.772018 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2025-11-27 07:27:43.772028 | controller | Thursday 27 November 2025  07:27:41 +0000 (0:00:00.242)       0:02:16.527 *****
2025-11-27 07:27:43.772040 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-11-27 07:27:43.772074 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-11-27 07:27:43.772084 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-11-27 07:27:43.772482 | controller |
2025-11-27 07:27:44.681942 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-11-27 07:27:44.681983 | controller | Thursday 27 November 2025  07:27:43 +0000 (0:00:02.077)       0:02:18.604 *****
2025-11-27 07:27:44.682007 | controller | changed: [instance]
2025-11-27 07:27:45.465385 | controller |
2025-11-27 07:27:45.465419 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-11-27 07:27:45.465427 | controller | Thursday 27 November 2025  07:27:44 +0000 (0:00:00.910)       0:02:19.515 *****
2025-11-27 07:27:45.465438 | controller | changed: [instance]
2025-11-27 07:27:46.320072 | controller |
2025-11-27 07:27:46.320105 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-11-27 07:27:46.320113 | controller | Thursday 27 November 2025  07:27:45 +0000 (0:00:00.783)       0:02:20.298 *****
2025-11-27 07:27:46.320123 | controller | changed: [instance]
2025-11-27 07:27:47.039886 | controller |
2025-11-27 07:27:47.039916 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2025-11-27 07:27:47.039925 | controller | Thursday 27 November 2025  07:27:46 +0000 (0:00:00.854)       0:02:21.153 *****
2025-11-27 07:27:47.039935 | controller | changed: [instance] => (item=compute-0.utility)
2025-11-27 07:28:06.799030 | controller | changed: [instance] => (item=controller-0.utility)
2025-11-27 07:28:06.799062 | controller | changed: [instance] => (item=crc-0.utility)
2025-11-27 07:28:06.799070 | controller |
2025-11-27 07:28:06.799076 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2025-11-27 07:28:06.799082 | controller | Thursday 27 November 2025  07:27:47 +0000 (0:00:00.719)       0:02:21.872 *****
2025-11-27 07:28:06.799092 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2025-11-27 07:28:06.799355 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2025-11-27 07:28:06.799520 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2025-11-27 07:28:06.799533 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2025-11-27 07:28:06.799891 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2025-11-27 07:28:06.799965 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j20872179368.24160', 'results_file': '/home/zuul/.ansible_async/j20872179368.24160', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2025-11-27 07:28:06.799987 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j812518763755.24177', 'results_file': '/home/zuul/.ansible_async/j812518763755.24177', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2025-11-27 07:28:06.800134 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2025-11-27 07:28:06.800345 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j503800372058.24193', 'results_file': '/home/zuul/.ansible_async/j503800372058.24193', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2025-11-27 07:28:06.800426 | controller |
2025-11-27 07:28:06.800600 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2025-11-27 07:28:06.800729 | controller | Thursday 27 November 2025  07:28:06 +0000 (0:00:19.759)       0:02:41.632 *****
2025-11-27 07:28:06.913980 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-11-27 07:28:06.936431 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-11-27 07:28:06.936462 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-11-27 07:28:06.936470 | controller |
2025-11-27 07:28:06.936477 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-11-27 07:28:06.936483 | controller | Thursday 27 November 2025  07:28:06 +0000 (0:00:00.114)       0:02:41.747 *****
2025-11-27 07:28:06.936493 | controller | skipping: [instance]
2025-11-27 07:28:06.936574 | controller |
2025-11-27 07:28:06.936611 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2025-11-27 07:28:06.975827 | controller | Thursday 27 November 2025  07:28:06 +0000 (0:00:00.023)       0:02:41.770 *****
2025-11-27 07:28:06.975861 | controller |
2025-11-27 07:28:07.096929 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-11-27 07:28:07.096964 | controller | Thursday 27 November 2025  07:28:06 +0000 (0:00:00.039)       0:02:41.809 *****
2025-11-27 07:28:07.096983 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2025-11-27 07:28:07.309910 | controller |
2025-11-27 07:28:07.309942 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-11-27 07:28:07.309950 | controller | Thursday 27 November 2025  07:28:07 +0000 (0:00:00.120)       0:02:41.930 *****
2025-11-27 07:28:07.309961 | controller | changed: [instance]
2025-11-27 07:28:07.531195 | controller |
2025-11-27 07:28:07.531227 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-11-27 07:28:07.531236 | controller | Thursday 27 November 2025  07:28:07 +0000 (0:00:00.212)       0:02:42.143 *****
2025-11-27 07:28:07.531247 | controller | changed: [instance]
2025-11-27 07:28:07.942441 | controller |
2025-11-27 07:28:07.942477 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2025-11-27 07:28:07.942485 | controller | Thursday 27 November 2025  07:28:07 +0000 (0:00:00.221)       0:02:42.364 *****
2025-11-27 07:28:07.942495 | controller | changed: [instance]
2025-11-27 07:28:07.970685 | controller |
2025-11-27 07:28:07.970719 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2025-11-27 07:28:07.970727 | controller | Thursday 27 November 2025  07:28:07 +0000 (0:00:00.411)       0:02:42.775 *****
2025-11-27 07:28:07.970737 | controller | skipping: [instance]
2025-11-27 07:28:07.999330 | controller |
2025-11-27 07:28:07.999361 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-11-27 07:28:07.999369 | controller | Thursday 27 November 2025  07:28:07 +0000 (0:00:00.028)       0:02:42.803 *****
2025-11-27 07:28:07.999379 | controller | skipping: [instance]
2025-11-27 07:28:08.047465 | controller |
2025-11-27 07:28:08.047495 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2025-11-27 07:28:08.047503 | controller | Thursday 27 November 2025  07:28:07 +0000 (0:00:00.028)       0:02:42.832 *****
2025-11-27 07:28:08.047513 | controller | skipping: [instance]
2025-11-27 07:28:08.100916 | controller |
2025-11-27 07:28:08.100947 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2025-11-27 07:28:08.100955 | controller | Thursday 27 November 2025  07:28:08 +0000 (0:00:00.048)       0:02:42.880 *****
2025-11-27 07:28:08.100965 | controller | skipping: [instance]
2025-11-27 07:28:08.129075 | controller |
2025-11-27 07:28:08.129106 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-11-27 07:28:08.129114 | controller | Thursday 27 November 2025  07:28:08 +0000 (0:00:00.053)       0:02:42.934 *****
2025-11-27 07:28:08.129124 | controller | skipping: [instance]
2025-11-27 07:28:08.167102 | controller |
2025-11-27 07:28:08.167131 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2025-11-27 07:28:08.167139 | controller | Thursday 27 November 2025  07:28:08 +0000 (0:00:00.028)       0:02:42.962 *****
2025-11-27 07:28:08.167149 | controller |
2025-11-27 07:28:08.252792 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-11-27 07:28:08.252824 | controller | Thursday 27 November 2025  07:28:08 +0000 (0:00:00.038)       0:02:43.000 *****
2025-11-27 07:28:08.252836 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2025-11-27 07:28:08.465375 | controller |
2025-11-27 07:28:08.465408 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-11-27 07:28:08.465416 | controller | Thursday 27 November 2025  07:28:08 +0000 (0:00:00.085)       0:02:43.086 *****
2025-11-27 07:28:08.465426 | controller | ok: [instance]
2025-11-27 07:28:08.686451 | controller |
2025-11-27 07:28:08.686482 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-11-27 07:28:08.686490 | controller | Thursday 27 November 2025  07:28:08 +0000 (0:00:00.212)       0:02:43.298 *****
2025-11-27 07:28:08.686500 | controller | ok: [instance]
2025-11-27 07:28:09.077916 | controller |
2025-11-27 07:28:09.077947 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2025-11-27 07:28:09.077959 | controller | Thursday 27 November 2025  07:28:08 +0000 (0:00:00.221)       0:02:43.519 *****
2025-11-27 07:28:09.077969 | controller | changed: [instance]
2025-11-27 07:28:09.078237 | controller |
2025-11-27 07:28:09.078253 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2025-11-27 07:28:09.105612 | controller | Thursday 27 November 2025  07:28:09 +0000 (0:00:00.391)       0:02:43.911 *****
2025-11-27 07:28:09.105636 | controller | skipping: [instance]
2025-11-27 07:28:09.133697 | controller |
2025-11-27 07:28:09.133725 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-11-27 07:28:09.133734 | controller | Thursday 27 November 2025  07:28:09 +0000 (0:00:00.027)       0:02:43.939 *****
2025-11-27 07:28:09.133743 | controller | skipping: [instance]
2025-11-27 07:28:10.678930 | controller |
2025-11-27 07:28:10.678975 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2025-11-27 07:28:10.678984 | controller | Thursday 27 November 2025  07:28:09 +0000 (0:00:00.028)       0:02:43.967 *****
2025-11-27 07:28:10.678994 | controller | changed: [instance -> controller-0.instance]
2025-11-27 07:28:10.679012 | controller |
2025-11-27 07:28:10.679018 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2025-11-27 07:28:10.679025 | controller | Thursday 27 November 2025  07:28:10 +0000 (0:00:01.545)       0:02:45.512 *****
2025-11-27 07:28:11.782142 | controller | changed: [instance -> controller-0.instance]
2025-11-27 07:28:11.782195 | controller |
2025-11-27 07:28:11.782310 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-11-27 07:28:11.782403 | controller | Thursday 27 November 2025  07:28:11 +0000 (0:00:01.103)       0:02:46.615 *****
2025-11-27 07:28:11.823790 | controller |
2025-11-27 07:28:11.823875 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2025-11-27 07:28:11.823981 | controller | Thursday 27 November 2025  07:28:11 +0000 (0:00:00.041)       0:02:46.657 *****
2025-11-27 07:28:12.032611 | controller | ok: [instance]
2025-11-27 07:28:12.032662 | controller |
2025-11-27 07:28:12.032817 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2025-11-27 07:28:12.032930 | controller | Thursday 27 November 2025  07:28:12 +0000 (0:00:00.208)       0:02:46.866 *****
2025-11-27 07:28:12.058924 | controller | ok: [instance]
2025-11-27 07:28:12.086944 | controller |
2025-11-27 07:28:12.086971 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2025-11-27 07:28:12.086979 | controller | Thursday 27 November 2025  07:28:12 +0000 (0:00:00.025)       0:02:46.892 *****
2025-11-27 07:28:12.086989 | controller | skipping: [instance]
2025-11-27 07:28:12.133004 | controller |
2025-11-27 07:28:12.133032 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2025-11-27 07:28:12.133041 | controller | Thursday 27 November 2025  07:28:12 +0000 (0:00:00.028)       0:02:46.920 *****
2025-11-27 07:28:12.133050 | controller |
2025-11-27 07:28:12.214275 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-11-27 07:28:12.214308 | controller | Thursday 27 November 2025  07:28:12 +0000 (0:00:00.046)       0:02:46.966 *****
2025-11-27 07:28:12.214321 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2025-11-27 07:28:12.432283 | controller |
2025-11-27 07:28:12.432314 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-11-27 07:28:12.432322 | controller | Thursday 27 November 2025  07:28:12 +0000 (0:00:00.080)       0:02:47.047 *****
2025-11-27 07:28:12.432332 | controller | ok: [instance]
2025-11-27 07:28:12.644211 | controller |
2025-11-27 07:28:12.644242 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-11-27 07:28:12.644250 | controller | Thursday 27 November 2025  07:28:12 +0000 (0:00:00.218)       0:02:47.265 *****
2025-11-27 07:28:12.644261 | controller | ok: [instance]
2025-11-27 07:28:13.031521 | controller |
2025-11-27 07:28:13.031551 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2025-11-27 07:28:13.031560 | controller | Thursday 27 November 2025  07:28:12 +0000 (0:00:00.211)       0:02:47.477 *****
2025-11-27 07:28:13.031570 | controller | changed: [instance]
2025-11-27 07:28:13.861426 | controller |
2025-11-27 07:28:13.861459 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2025-11-27 07:28:13.861467 | controller | Thursday 27 November 2025  07:28:13 +0000 (0:00:00.387)       0:02:47.864 *****
2025-11-27 07:28:13.861478 | controller | changed: [instance]
2025-11-27 07:28:13.889213 | controller |
2025-11-27 07:28:13.889242 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-11-27 07:28:13.889250 | controller | Thursday 27 November 2025  07:28:13 +0000 (0:00:00.829)       0:02:48.694 *****
2025-11-27 07:28:13.889263 | controller | skipping: [instance]
2025-11-27 07:28:13.936874 | controller |
2025-11-27 07:28:13.936903 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2025-11-27 07:28:13.936912 | controller | Thursday 27 November 2025  07:28:13 +0000 (0:00:00.027)       0:02:48.722 *****
2025-11-27 07:28:13.936922 | controller | skipping: [instance]
2025-11-27 07:28:13.982313 | controller |
2025-11-27 07:28:13.982343 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2025-11-27 07:28:13.982351 | controller | Thursday 27 November 2025  07:28:13 +0000 (0:00:00.047)       0:02:48.770 *****
2025-11-27 07:28:13.982361 | controller | skipping: [instance]
2025-11-27 07:28:14.031185 | controller |
2025-11-27 07:28:14.031215 | controller | TASK [Create VBMC entity] ******************************************************
2025-11-27 07:28:14.031223 | controller | Thursday 27 November 2025  07:28:13 +0000 (0:00:00.045)       0:02:48.815 *****
2025-11-27 07:28:14.031234 | controller | skipping: [instance] => (item=compute-0)
2025-11-27 07:28:14.271876 | controller | skipping: [instance] => (item=controller-0)
2025-11-27 07:28:14.271907 | controller | skipping: [instance] => (item=crc-0)
2025-11-27 07:28:14.271915 | controller | skipping: [instance]
2025-11-27 07:28:14.271922 | controller |
2025-11-27 07:28:14.271928 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2025-11-27 07:28:14.271934 | controller | Thursday 27 November 2025  07:28:14 +0000 (0:00:00.048)       0:02:48.864 *****
2025-11-27 07:28:14.271943 | controller | ok: [instance]
2025-11-27 07:28:14.636835 | controller |
2025-11-27 07:28:14.636864 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2025-11-27 07:28:14.636872 | controller | Thursday 27 November 2025  07:28:14 +0000 (0:00:00.237)       0:02:49.101 *****
2025-11-27 07:28:14.636882 | controller | changed: [instance]
2025-11-27 07:28:14.637219 | controller |
2025-11-27 07:28:14.669235 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2025-11-27 07:28:14.669259 | controller | Thursday 27 November 2025  07:28:14 +0000 (0:00:00.368)       0:02:49.470 *****
2025-11-27 07:28:14.669270 | controller | skipping: [instance]
2025-11-27 07:28:14.701533 | controller |
2025-11-27 07:28:14.701558 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2025-11-27 07:28:14.701567 | controller | Thursday 27 November 2025  07:28:14 +0000 (0:00:00.032)       0:02:49.502 *****
2025-11-27 07:28:14.701585 | controller | skipping: [instance]
2025-11-27 07:28:14.733825 | controller |
2025-11-27 07:28:14.733850 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2025-11-27 07:28:14.733860 | controller | Thursday 27 November 2025  07:28:14 +0000 (0:00:00.032)       0:02:49.534 *****
2025-11-27 07:28:14.733871 | controller | skipping: [instance]
2025-11-27 07:28:14.734101 | controller |
2025-11-27 07:28:14.734115 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2025-11-27 07:28:15.365389 | controller | Thursday 27 November 2025  07:28:14 +0000 (0:00:00.032)       0:02:49.567 *****
2025-11-27 07:28:15.365438 | controller | changed: [instance]
2025-11-27 07:28:15.365459 | controller |
2025-11-27 07:28:15.365665 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2025-11-27 07:28:15.926874 | controller | Thursday 27 November 2025  07:28:15 +0000 (0:00:00.631)       0:02:50.199 *****
2025-11-27 07:28:15.926909 | controller | changed: [instance]
2025-11-27 07:28:15.926936 | controller |
2025-11-27 07:28:15.926945 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2025-11-27 07:28:15.927030 | controller | Thursday 27 November 2025  07:28:15 +0000 (0:00:00.561)       0:02:50.760 *****
2025-11-27 07:28:15.965801 | controller | skipping: [instance]
2025-11-27 07:28:16.024873 | controller |
2025-11-27 07:28:16.024910 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2025-11-27 07:28:16.024920 | controller | Thursday 27 November 2025  07:28:15 +0000 (0:00:00.038)       0:02:50.799 *****
2025-11-27 07:28:16.024933 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2025-11-27 07:28:16.024965 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2025-11-27 07:28:16.024973 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2025-11-27 07:28:16.024980 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2025-11-27 07:28:16.024986 | controller |
2025-11-27 07:28:16.024995 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2025-11-27 07:28:16.064253 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.058)       0:02:50.858 *****
2025-11-27 07:28:16.064278 | controller | skipping: [instance]
2025-11-27 07:28:16.099840 | controller |
2025-11-27 07:28:16.099862 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2025-11-27 07:28:16.099871 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.039)       0:02:50.897 *****
2025-11-27 07:28:16.099882 | controller | skipping: [instance]
2025-11-27 07:28:16.100190 | controller |
2025-11-27 07:28:16.137922 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2025-11-27 07:28:16.137963 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.035)       0:02:50.933 *****
2025-11-27 07:28:16.137977 | controller | skipping: [instance]
2025-11-27 07:28:16.138011 | controller |
2025-11-27 07:28:16.138021 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2025-11-27 07:28:16.138116 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.037)       0:02:50.971 *****
2025-11-27 07:28:16.172389 | controller | skipping: [instance]
2025-11-27 07:28:16.757075 | controller |
2025-11-27 07:28:16.757105 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2025-11-27 07:28:16.757113 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.034)       0:02:51.005 *****
2025-11-27 07:28:16.757122 | controller | changed: [instance]
2025-11-27 07:28:16.757146 | controller |
2025-11-27 07:28:16.757336 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2025-11-27 07:28:16.787905 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.584)       0:02:51.590 *****
2025-11-27 07:28:16.787946 | controller | skipping: [instance]
2025-11-27 07:28:16.787982 | controller |
2025-11-27 07:28:16.787992 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2025-11-27 07:28:16.788088 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.030)       0:02:51.621 *****
2025-11-27 07:28:16.819898 | controller | skipping: [instance]
2025-11-27 07:28:16.820141 | controller |
2025-11-27 07:28:16.820168 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2025-11-27 07:28:16.851898 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.032)       0:02:51.653 *****
2025-11-27 07:28:16.851973 | controller | skipping: [instance]
2025-11-27 07:28:16.852026 | controller |
2025-11-27 07:28:16.852220 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2025-11-27 07:28:16.882394 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.031)       0:02:51.684 *****
2025-11-27 07:28:16.882422 | controller | skipping: [instance]
2025-11-27 07:28:16.914615 | controller |
2025-11-27 07:28:16.914638 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2025-11-27 07:28:16.914647 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.030)       0:02:51.715 *****
2025-11-27 07:28:16.914657 | controller | skipping: [instance]
2025-11-27 07:28:16.945555 | controller |
2025-11-27 07:28:16.945578 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2025-11-27 07:28:16.945587 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.032)       0:02:51.747 *****
2025-11-27 07:28:16.945598 | controller | skipping: [instance]
2025-11-27 07:28:16.945810 | controller |
2025-11-27 07:28:16.945996 | controller | TASK [openshift_login : Assert files exist] ************************************
2025-11-27 07:28:16.946159 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.031)       0:02:51.779 *****
2025-11-27 07:28:16.979142 | controller | skipping: [instance]
2025-11-27 07:28:16.979307 | controller |
2025-11-27 07:28:16.979450 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2025-11-27 07:28:16.979587 | controller | Thursday 27 November 2025  07:28:16 +0000 (0:00:00.033)       0:02:51.813 *****
2025-11-27 07:28:17.011447 | controller | skipping: [instance]
2025-11-27 07:28:17.011631 | controller |
2025-11-27 07:28:17.011856 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2025-11-27 07:28:17.012030 | controller | Thursday 27 November 2025  07:28:17 +0000 (0:00:00.032)       0:02:51.845 *****
2025-11-27 07:28:17.043254 | controller | skipping: [instance]
2025-11-27 07:28:17.043418 | controller |
2025-11-27 07:28:17.043560 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2025-11-27 07:28:17.043718 | controller | Thursday 27 November 2025  07:28:17 +0000 (0:00:00.031)       0:02:51.877 *****
2025-11-27 07:28:17.086679 | controller | skipping: [instance]
2025-11-27 07:28:17.086912 | controller |
2025-11-27 07:28:17.087089 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2025-11-27 07:28:17.087255 | controller | Thursday 27 November 2025  07:28:17 +0000 (0:00:00.043)       0:02:51.920 *****
2025-11-27 07:28:17.118156 | controller | skipping: [instance]
2025-11-27 07:28:17.118339 | controller |
2025-11-27 07:28:17.118510 | controller | TASK [reproducer : Configure Controller node] **********************************
2025-11-27 07:28:17.118647 | controller | Thursday 27 November 2025  07:28:17 +0000 (0:00:00.031)       0:02:51.952 *****
2025-11-27 07:28:17.307135 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2025-11-27 07:28:17.307334 | controller |
2025-11-27 07:28:17.307504 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2025-11-27 07:28:17.307666 | controller | Thursday 27 November 2025  07:28:17 +0000 (0:00:00.188)       0:02:52.140 *****
2025-11-27 07:28:18.579906 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2025-11-27 07:28:18.579947 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2025-11-27 07:28:18.580048 | controller |
2025-11-27 07:28:18.580162 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2025-11-27 07:28:18.580270 | controller | Thursday 27 November 2025  07:28:18 +0000 (0:00:01.272)       0:02:53.413 *****
2025-11-27 07:28:18.598613 | controller | skipping: [instance]
2025-11-27 07:28:18.598741 | controller |
2025-11-27 07:28:18.598797 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2025-11-27 07:28:18.598813 | controller | Thursday 27 November 2025  07:28:18 +0000 (0:00:00.018)       0:02:53.432 *****
2025-11-27 07:28:19.199440 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:19.234751 | controller |
2025-11-27 07:28:19.234799 | controller | TASK [install_ca : Install internal CA from url] *******************************
2025-11-27 07:28:19.234807 | controller | Thursday 27 November 2025  07:28:19 +0000 (0:00:00.600)       0:02:54.032 *****
2025-11-27 07:28:19.234817 | controller | skipping: [instance]
2025-11-27 07:28:19.267606 | controller |
2025-11-27 07:28:19.267635 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2025-11-27 07:28:19.267643 | controller | Thursday 27 November 2025  07:28:19 +0000 (0:00:00.035)       0:02:54.068 *****
2025-11-27 07:28:19.267652 | controller | skipping: [instance]
2025-11-27 07:28:19.300743 | controller |
2025-11-27 07:28:19.300784 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2025-11-27 07:28:19.300795 | controller | Thursday 27 November 2025  07:28:19 +0000 (0:00:00.032)       0:02:54.101 *****
2025-11-27 07:28:19.300804 | controller | skipping: [instance]
2025-11-27 07:28:20.941708 | controller |
2025-11-27 07:28:20.941774 | controller | TASK [install_ca : Update ca bundle] *******************************************
2025-11-27 07:28:20.941786 | controller | Thursday 27 November 2025  07:28:19 +0000 (0:00:00.033)       0:02:54.134 *****
2025-11-27 07:28:20.941798 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:20.941827 | controller |
2025-11-27 07:28:20.941835 | controller | TASK [reproducer : Get rhos-release] *******************************************
2025-11-27 07:28:20.941958 | controller | Thursday 27 November 2025  07:28:20 +0000 (0:00:01.640)       0:02:55.775 *****
2025-11-27 07:28:20.976215 | controller | skipping: [instance]
2025-11-27 07:28:21.010155 | controller |
2025-11-27 07:28:21.010196 | controller | TASK [reproducer : Install repos] **********************************************
2025-11-27 07:28:21.010206 | controller | Thursday 27 November 2025  07:28:20 +0000 (0:00:00.034)       0:02:55.809 *****
2025-11-27 07:28:21.010216 | controller | skipping: [instance]
2025-11-27 07:28:21.010235 | controller |
2025-11-27 07:28:21.010243 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2025-11-27 07:28:21.010338 | controller | Thursday 27 November 2025  07:28:21 +0000 (0:00:00.034)       0:02:55.843 *****
2025-11-27 07:28:21.044168 | controller | skipping: [instance]
2025-11-27 07:28:21.044325 | controller |
2025-11-27 07:28:21.044397 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2025-11-27 07:28:21.044418 | controller | Thursday 27 November 2025  07:28:21 +0000 (0:00:00.034)       0:02:55.878 *****
2025-11-27 07:28:21.077574 | controller | skipping: [instance]
2025-11-27 07:28:21.077613 | controller |
2025-11-27 07:28:21.077623 | controller | TASK [reproducer : Install some tools] *****************************************
2025-11-27 07:28:21.077632 | controller | Thursday 27 November 2025  07:28:21 +0000 (0:00:00.032)       0:02:55.910 *****
2025-11-27 07:28:22.147672 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:23.215086 | controller |
2025-11-27 07:28:23.215126 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2025-11-27 07:28:23.215134 | controller | Thursday 27 November 2025  07:28:22 +0000 (0:00:01.069)       0:02:56.980 *****
2025-11-27 07:28:23.215146 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:23.775913 | controller |
2025-11-27 07:28:23.775979 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2025-11-27 07:28:23.775992 | controller | Thursday 27 November 2025  07:28:23 +0000 (0:00:01.067)       0:02:58.048 *****
2025-11-27 07:28:23.776012 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:23.776096 | controller |
2025-11-27 07:28:23.776128 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2025-11-27 07:28:23.776140 | controller | Thursday 27 November 2025  07:28:23 +0000 (0:00:00.560)       0:02:58.609 *****
2025-11-27 07:28:24.738936 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:24.739029 | controller |
2025-11-27 07:28:24.739077 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2025-11-27 07:28:24.739090 | controller | Thursday 27 November 2025  07:28:24 +0000 (0:00:00.963)       0:02:59.572 *****
2025-11-27 07:28:25.776513 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2025-11-27 07:28:25.776880 | controller | skipping: [instance] => (item=compute-0)
2025-11-27 07:28:25.777002 | controller | skipping: [instance] => (item=controller-0)
2025-11-27 07:28:25.777020 | controller | skipping: [instance] => (item=crc-0)
2025-11-27 07:28:25.777292 | controller |
2025-11-27 07:28:26.425753 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2025-11-27 07:28:26.425811 | controller | Thursday 27 November 2025  07:28:25 +0000 (0:00:01.037)       0:03:00.609 *****
2025-11-27 07:28:26.425834 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2025-11-27 07:28:28.162928 | controller | skipping: [instance] => (item=compute-0)
2025-11-27 07:28:28.162961 | controller | skipping: [instance] => (item=controller-0)
2025-11-27 07:28:28.162969 | controller | skipping: [instance] => (item=crc-0)
2025-11-27 07:28:28.162975 | controller |
2025-11-27 07:28:28.162981 | controller | TASK [reproducer : Inject SSH configuration] ***********************************
2025-11-27 07:28:28.162987 | controller | Thursday 27 November 2025  07:28:26 +0000 (0:00:00.649)       0:03:01.258 *****
2025-11-27 07:28:28.162997 | controller | skipping: [instance] => (item=instance)
2025-11-27 07:28:28.163109 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
2025-11-27 07:28:28.163121 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2025-11-27 07:28:28.163127 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
2025-11-27 07:28:28.163133 | controller |
2025-11-27 07:28:28.163138 | controller | TASK [reproducer : Create kube directory] **************************************
2025-11-27 07:28:28.163146 | controller | Thursday 27 November 2025  07:28:28 +0000 (0:00:01.737)       0:03:02.995 *****
2025-11-27 07:28:28.742073 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:29.703432 | controller |
2025-11-27 07:28:29.703483 | controller | TASK [reproducer : Inject kubeconfig content] **********************************
2025-11-27 07:28:29.703494 | controller | Thursday 27 November 2025  07:28:28 +0000 (0:00:00.579)       0:03:03.575 *****
2025-11-27 07:28:29.703508 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:30.647908 | controller |
2025-11-27 07:28:30.647947 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************
2025-11-27 07:28:30.647956 | controller | Thursday 27 November 2025  07:28:29 +0000 (0:00:00.961)       0:03:04.536 *****
2025-11-27 07:28:30.647975 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:30.679151 | controller |
2025-11-27 07:28:30.679184 | controller | TASK [reproducer : Inject devscripts private key if set] ***********************
2025-11-27 07:28:30.679193 | controller | Thursday 27 November 2025  07:28:30 +0000 (0:00:00.943)       0:03:05.480 *****
2025-11-27 07:28:30.679206 | controller | skipping: [instance]
2025-11-27 07:28:31.288572 | controller |
2025-11-27 07:28:31.288606 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ******************************
2025-11-27 07:28:31.288614 | controller | Thursday 27 November 2025  07:28:30 +0000 (0:00:00.032)       0:03:05.512 *****
2025-11-27 07:28:31.288625 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:31.288832 | controller |
2025-11-27 07:28:31.288864 | controller | TASK [manage_secrets : Ensure directory tree exist] ****************************
2025-11-27 07:28:31.288876 | controller | Thursday 27 November 2025  07:28:31 +0000 (0:00:00.609)       0:03:06.122 *****
2025-11-27 07:28:31.890150 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:31.929540 | controller |
2025-11-27 07:28:31.929563 | controller | TASK [manage_secrets : Assert we get needed data] ******************************
2025-11-27 07:28:31.929571 | controller | Thursday 27 November 2025  07:28:31 +0000 (0:00:00.601)       0:03:06.723 *****
2025-11-27 07:28:31.929580 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:31.993578 | controller |
2025-11-27 07:28:31.993608 | controller | TASK [manage_secrets : Push reproducer secrets] ********************************
2025-11-27 07:28:31.993618 | controller | Thursday 27 November 2025  07:28:31 +0000 (0:00:00.039)       0:03:06.763 *****
2025-11-27 07:28:31.993630 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
2025-11-27 07:28:32.045052 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
2025-11-27 07:28:32.045072 | controller |
2025-11-27 07:28:32.045079 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2025-11-27 07:28:32.045085 | controller | Thursday 27 November 2025  07:28:31 +0000 (0:00:00.063)       0:03:06.826 *****
2025-11-27 07:28:32.045093 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 07:28:32.092034 | controller |   _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
2025-11-27 07:28:32.092055 | controller |
2025-11-27 07:28:32.092063 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2025-11-27 07:28:32.092070 | controller | Thursday 27 November 2025  07:28:32 +0000 (0:00:00.051)       0:03:06.878 *****
2025-11-27 07:28:32.092079 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 07:28:32.140330 | controller |   _secret_file: ''
2025-11-27 07:28:32.140348 | controller |
2025-11-27 07:28:32.140355 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2025-11-27 07:28:32.140361 | controller | Thursday 27 November 2025  07:28:32 +0000 (0:00:00.047)       0:03:06.925 *****
2025-11-27 07:28:32.140369 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 07:28:32.188478 | controller |   _secret_content: my-default-location-place
2025-11-27 07:28:32.188494 | controller |
2025-11-27 07:28:32.188501 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2025-11-27 07:28:32.188507 | controller | Thursday 27 November 2025  07:28:32 +0000 (0:00:00.048)       0:03:06.973 *****
2025-11-27 07:28:32.188515 | controller | skipping: [instance]
2025-11-27 07:28:32.234891 | controller |
2025-11-27 07:28:32.234913 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2025-11-27 07:28:32.234921 | controller | Thursday 27 November 2025  07:28:32 +0000 (0:00:00.048)       0:03:07.022 *****
2025-11-27 07:28:32.234932 | controller | skipping: [instance]
2025-11-27 07:28:32.281221 | controller |
2025-11-27 07:28:32.281243 | controller | TASK [manage_secrets : Copy file to location] **********************************
2025-11-27 07:28:32.281251 | controller | Thursday 27 November 2025  07:28:32 +0000 (0:00:00.046)       0:03:07.068 *****
2025-11-27 07:28:32.281263 | controller | skipping: [instance]
2025-11-27 07:28:33.261403 | controller |
2025-11-27 07:28:33.261434 | controller | TASK [manage_secrets : Create file from content] *******************************
2025-11-27 07:28:33.261442 | controller | Thursday 27 November 2025  07:28:32 +0000 (0:00:00.046)       0:03:07.114 *****
2025-11-27 07:28:33.261452 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:33.313691 | controller |
2025-11-27 07:28:33.313719 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2025-11-27 07:28:33.313728 | controller | Thursday 27 November 2025  07:28:33 +0000 (0:00:00.980)       0:03:08.094 *****
2025-11-27 07:28:33.313738 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 07:28:33.360005 | controller |   _secret_dest: /home/zuul/ipmi-things
2025-11-27 07:28:33.360032 | controller |
2025-11-27 07:28:33.360039 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2025-11-27 07:28:33.360046 | controller | Thursday 27 November 2025  07:28:33 +0000 (0:00:00.052)       0:03:08.147 *****
2025-11-27 07:28:33.360055 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 07:28:33.406588 | controller |   _secret_file: /tmp/ipmi-things
2025-11-27 07:28:33.406613 | controller |
2025-11-27 07:28:33.406621 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2025-11-27 07:28:33.406630 | controller | Thursday 27 November 2025  07:28:33 +0000 (0:00:00.046)       0:03:08.193 *****
2025-11-27 07:28:33.406640 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-11-27 07:28:33.459423 | controller |   _secret_content: ''
2025-11-27 07:28:33.459449 | controller |
2025-11-27 07:28:33.459463 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2025-11-27 07:28:33.459470 | controller | Thursday 27 November 2025  07:28:33 +0000 (0:00:00.046)       0:03:08.239 *****
2025-11-27 07:28:33.459480 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false
2025-11-27 07:28:34.032463 | controller |   msg: All assertions passed
2025-11-27 07:28:34.032494 | controller |
2025-11-27 07:28:34.032502 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2025-11-27 07:28:34.032509 | controller | Thursday 27 November 2025  07:28:33 +0000 (0:00:00.052)       0:03:08.292 *****
2025-11-27 07:28:34.032518 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:35.037972 | controller |
2025-11-27 07:28:35.038006 | controller | TASK [manage_secrets : Copy file to location] **********************************
2025-11-27 07:28:35.038015 | controller | Thursday 27 November 2025  07:28:34 +0000 (0:00:00.573)       0:03:08.865 *****
2025-11-27 07:28:35.038025 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:35.094521 | controller |
2025-11-27 07:28:35.094545 | controller | TASK [manage_secrets : Create file from content] *******************************
2025-11-27 07:28:35.094552 | controller | Thursday 27 November 2025  07:28:35 +0000 (0:00:01.005)       0:03:09.871 *****
2025-11-27 07:28:35.094562 | controller | skipping: [instance]
2025-11-27 07:28:35.671481 | controller |
2025-11-27 07:28:35.671514 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
2025-11-27 07:28:35.671523 | controller | Thursday 27 November 2025  07:28:35 +0000 (0:00:00.056)       0:03:09.928 *****
2025-11-27 07:28:35.671533 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:36.256432 | controller |
2025-11-27 07:28:36.256464 | controller | TASK [reproducer : Check if async file is still available] *********************
2025-11-27 07:28:36.256473 | controller | Thursday 27 November 2025  07:28:35 +0000 (0:00:00.576)       0:03:10.504 *****
2025-11-27 07:28:36.256483 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:28:36.256526 | controller |
2025-11-27 07:28:36.256536 | controller | TASK [reproducer : Check package install status] *******************************
2025-11-27 07:28:36.256634 | controller | Thursday 27 November 2025  07:28:36 +0000 (0:00:00.585)       0:03:11.089 *****
2025-11-27 07:29:37.408645 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
2025-11-27 07:29:37.973717 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
2025-11-27 07:29:37.973746 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
2025-11-27 07:29:37.973753 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
2025-11-27 07:29:37.973780 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
2025-11-27 07:29:37.973789 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
2025-11-27 07:29:37.973795 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
2025-11-27 07:29:37.973800 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left).
2025-11-27 07:29:37.973805 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left).
2025-11-27 07:29:37.973811 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left).
2025-11-27 07:29:37.973827 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left).
2025-11-27 07:29:37.973835 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:37.973841 | controller |
2025-11-27 07:29:37.973846 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
2025-11-27 07:29:37.973857 | controller | Thursday 27 November 2025  07:29:37 +0000 (0:01:01.150)       0:04:12.240 *****
2025-11-27 07:29:37.973867 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:40.671396 | controller |
2025-11-27 07:29:40.671424 | controller | TASK [sushy_emulator : Install required packages] ******************************
2025-11-27 07:29:40.671433 | controller | Thursday 27 November 2025  07:29:37 +0000 (0:00:00.562)       0:04:12.803 *****
2025-11-27 07:29:40.671443 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:40.720474 | controller |
2025-11-27 07:29:40.720499 | controller | TASK [sushy_emulator : Get ingresses domain] ***********************************
2025-11-27 07:29:40.720506 | controller | Thursday 27 November 2025  07:29:40 +0000 (0:00:02.701)       0:04:15.504 *****
2025-11-27 07:29:40.720516 | controller | skipping: [instance]
2025-11-27 07:29:40.770778 | controller |
2025-11-27 07:29:40.770804 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] *********************
2025-11-27 07:29:40.770811 | controller | Thursday 27 November 2025  07:29:40 +0000 (0:00:00.048)       0:04:15.553 *****
2025-11-27 07:29:40.770821 | controller | skipping: [instance]
2025-11-27 07:29:41.403085 | controller |
2025-11-27 07:29:41.403116 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
2025-11-27 07:29:41.403125 | controller | Thursday 27 November 2025  07:29:40 +0000 (0:00:00.051)       0:04:15.604 *****
2025-11-27 07:29:41.403135 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:42.049097 | controller |
2025-11-27 07:29:42.049129 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ********************
2025-11-27 07:29:42.049137 | controller | Thursday 27 November 2025  07:29:41 +0000 (0:00:00.632)       0:04:16.236 *****
2025-11-27 07:29:42.049147 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:42.435470 | controller |
2025-11-27 07:29:42.435505 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
2025-11-27 07:29:42.435513 | controller | Thursday 27 November 2025  07:29:42 +0000 (0:00:00.645)       0:04:16.882 *****
2025-11-27 07:29:42.435523 | controller | changed: [instance]
2025-11-27 07:29:43.112226 | controller |
2025-11-27 07:29:43.112257 | controller | TASK [sushy_emulator : Run ssh-keyscan] ****************************************
2025-11-27 07:29:43.112265 | controller | Thursday 27 November 2025  07:29:42 +0000 (0:00:00.386)       0:04:17.268 *****
2025-11-27 07:29:43.112275 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:44.132221 | controller |
2025-11-27 07:29:44.132252 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************
2025-11-27 07:29:44.132260 | controller | Thursday 27 November 2025  07:29:43 +0000 (0:00:00.676)       0:04:17.944 *****
2025-11-27 07:29:44.132270 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:44.177217 | controller |
2025-11-27 07:29:44.177243 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2025-11-27 07:29:44.177251 | controller | Thursday 27 November 2025  07:29:44 +0000 (0:00:01.020)       0:04:18.965 *****
2025-11-27 07:29:44.177262 | controller | skipping: [instance]
2025-11-27 07:29:44.222495 | controller |
2025-11-27 07:29:44.222524 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2025-11-27 07:29:44.222532 | controller | Thursday 27 November 2025  07:29:44 +0000 (0:00:00.045)       0:04:19.010 *****
2025-11-27 07:29:44.222542 | controller | skipping: [instance]
2025-11-27 07:29:44.258096 | controller |
2025-11-27 07:29:44.258120 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2025-11-27 07:29:44.258128 | controller | Thursday 27 November 2025  07:29:44 +0000 (0:00:00.045)       0:04:19.056 *****
2025-11-27 07:29:44.258137 | controller | skipping: [instance]
2025-11-27 07:29:44.307526 | controller |
2025-11-27 07:29:44.307549 | controller | TASK [sushy_emulator : Generate list of filtered VMs] **************************
2025-11-27 07:29:44.307556 | controller | Thursday 27 November 2025  07:29:44 +0000 (0:00:00.035)       0:04:19.091 *****
2025-11-27 07:29:44.307566 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:44.344812 | controller |
2025-11-27 07:29:44.344837 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
2025-11-27 07:29:44.344844 | controller | Thursday 27 November 2025  07:29:44 +0000 (0:00:00.049)       0:04:19.141 *****
2025-11-27 07:29:44.344855 | controller | skipping: [instance]
2025-11-27 07:29:44.384002 | controller |
2025-11-27 07:29:44.384039 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
2025-11-27 07:29:44.384047 | controller | Thursday 27 November 2025  07:29:44 +0000 (0:00:00.037)       0:04:19.178 *****
2025-11-27 07:29:44.384056 | controller | skipping: [instance]
2025-11-27 07:29:44.423699 | controller |
2025-11-27 07:29:44.423727 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
2025-11-27 07:29:44.423735 | controller | Thursday 27 November 2025  07:29:44 +0000 (0:00:00.039)       0:04:19.217 *****
2025-11-27 07:29:44.423744 | controller | skipping: [instance]
2025-11-27 07:29:44.423869 | controller |
2025-11-27 07:29:44.423883 | controller | TASK [sushy_emulator : Generate htpasswd string] *******************************
2025-11-27 07:29:44.423891 | controller | Thursday 27 November 2025  07:29:44 +0000 (0:00:00.039)       0:04:19.256 *****
2025-11-27 07:29:45.047490 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:45.152570 | controller |
2025-11-27 07:29:45.152604 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] *********************
2025-11-27 07:29:45.152613 | controller | Thursday 27 November 2025  07:29:45 +0000 (0:00:00.623)       0:04:19.880 *****
2025-11-27 07:29:45.152623 | controller | skipping: [instance] => (item=secret)
2025-11-27 07:29:46.212432 | controller | skipping: [instance] => (item=configmap)
2025-11-27 07:29:46.212462 | controller | skipping: [instance] => (item=pod)
2025-11-27 07:29:46.212470 | controller | skipping: [instance] => (item=service)
2025-11-27 07:29:46.212475 | controller | skipping: [instance] => (item=route)
2025-11-27 07:29:46.212481 | controller | skipping: [instance]
2025-11-27 07:29:46.212487 | controller |
2025-11-27 07:29:46.212493 | controller | TASK [sushy_emulator : Write sushy emulator config] ****************************
2025-11-27 07:29:46.212499 | controller | Thursday 27 November 2025  07:29:45 +0000 (0:00:00.104)       0:04:19.985 *****
2025-11-27 07:29:46.212508 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:47.204935 | controller |
2025-11-27 07:29:47.204965 | controller | TASK [sushy_emulator : Write htpasswd string to file] **************************
2025-11-27 07:29:47.204973 | controller | Thursday 27 November 2025  07:29:46 +0000 (0:00:01.060)       0:04:21.045 *****
2025-11-27 07:29:47.204983 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:47.244231 | controller |
2025-11-27 07:29:47.244251 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
2025-11-27 07:29:47.244258 | controller | Thursday 27 November 2025  07:29:47 +0000 (0:00:00.992)       0:04:22.038 *****
2025-11-27 07:29:47.244268 | controller | skipping: [instance]
2025-11-27 07:29:47.283321 | controller |
2025-11-27 07:29:47.283342 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
2025-11-27 07:29:47.283349 | controller | Thursday 27 November 2025  07:29:47 +0000 (0:00:00.039)       0:04:22.077 *****
2025-11-27 07:29:47.283358 | controller | skipping: [instance]
2025-11-27 07:29:47.359921 | controller |
2025-11-27 07:29:47.359941 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
2025-11-27 07:29:47.359948 | controller | Thursday 27 November 2025  07:29:47 +0000 (0:00:00.039)       0:04:22.116 *****
2025-11-27 07:29:47.359957 | controller | skipping: [instance] => (item=secret)
2025-11-27 07:29:47.397878 | controller | skipping: [instance] => (item=configmap)
2025-11-27 07:29:47.397896 | controller | skipping: [instance] => (item=service)
2025-11-27 07:29:47.397903 | controller | skipping: [instance] => (item=route)
2025-11-27 07:29:47.397909 | controller | skipping: [instance]
2025-11-27 07:29:47.397914 | controller |
2025-11-27 07:29:47.397920 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
2025-11-27 07:29:47.397925 | controller | Thursday 27 November 2025  07:29:47 +0000 (0:00:00.076)       0:04:22.192 *****
2025-11-27 07:29:47.397933 | controller | skipping: [instance]
2025-11-27 07:29:48.891159 | controller |
2025-11-27 07:29:48.891206 | controller | TASK [podman : Ensure podman is installed] *************************************
2025-11-27 07:29:48.891214 | controller | Thursday 27 November 2025  07:29:47 +0000 (0:00:00.038)       0:04:22.231 *****
2025-11-27 07:29:48.891225 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:49.659862 | controller |
2025-11-27 07:29:49.659904 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] *********************
2025-11-27 07:29:49.659914 | controller | Thursday 27 November 2025  07:29:48 +0000 (0:00:01.492)       0:04:23.724 *****
2025-11-27 07:29:49.659924 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:29:49.700646 | controller |
2025-11-27 07:29:49.700667 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
2025-11-27 07:29:49.700675 | controller | Thursday 27 November 2025  07:29:49 +0000 (0:00:00.768)       0:04:24.493 *****
2025-11-27 07:29:49.700685 | controller | skipping: [instance]
2025-11-27 07:29:49.740651 | controller |
2025-11-27 07:29:49.740671 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
2025-11-27 07:29:49.740679 | controller | Thursday 27 November 2025  07:29:49 +0000 (0:00:00.040)       0:04:24.533 *****
2025-11-27 07:29:49.740688 | controller | skipping: [instance]
2025-11-27 07:29:49.854088 | controller |
2025-11-27 07:29:49.854120 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
2025-11-27 07:29:49.854129 | controller | Thursday 27 November 2025  07:29:49 +0000 (0:00:00.040)       0:04:24.574 *****
2025-11-27 07:29:49.854139 | controller | skipping: [instance]
2025-11-27 07:30:00.456674 | controller |
2025-11-27 07:30:00.456705 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
2025-11-27 07:30:00.456713 | controller | Thursday 27 November 2025  07:29:49 +0000 (0:00:00.113)       0:04:24.687 *****
2025-11-27 07:30:00.456723 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:01.877749 | controller |
2025-11-27 07:30:01.877806 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] **************
2025-11-27 07:30:01.877814 | controller | Thursday 27 November 2025  07:30:00 +0000 (0:00:10.602)       0:04:35.289 *****
2025-11-27 07:30:01.877825 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:03.035106 | controller |
2025-11-27 07:30:03.035137 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2025-11-27 07:30:03.035145 | controller | Thursday 27 November 2025  07:30:01 +0000 (0:00:01.414)       0:04:36.704 *****
2025-11-27 07:30:03.035166 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2025-11-27 07:30:03.073595 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2025-11-27 07:30:03.073622 | controller |
2025-11-27 07:30:03.073630 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] *************
2025-11-27 07:30:03.073636 | controller | Thursday 27 November 2025  07:30:03 +0000 (0:00:01.163)       0:04:37.868 *****
2025-11-27 07:30:03.073646 | controller | skipping: [instance]
2025-11-27 07:30:03.647186 | controller |
2025-11-27 07:30:03.647217 | controller | TASK [reproducer : Check if baremetal-info.yml exists] *************************
2025-11-27 07:30:03.647225 | controller | Thursday 27 November 2025  07:30:03 +0000 (0:00:00.038)       0:04:37.907 *****
2025-11-27 07:30:03.647236 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:03.684629 | controller |
2025-11-27 07:30:03.684659 | controller | TASK [reproducer : Get content of baremetal-info file] *************************
2025-11-27 07:30:03.684667 | controller | Thursday 27 November 2025  07:30:03 +0000 (0:00:00.573)       0:04:38.480 *****
2025-11-27 07:30:03.684678 | controller | skipping: [instance]
2025-11-27 07:30:03.729604 | controller |
2025-11-27 07:30:03.729628 | controller | TASK [reproducer : Interpret remote file content as yaml] **********************
2025-11-27 07:30:03.729637 | controller | Thursday 27 November 2025  07:30:03 +0000 (0:00:00.037)       0:04:38.518 *****
2025-11-27 07:30:03.729646 | controller | skipping: [instance]
2025-11-27 07:30:03.729934 | controller |
2025-11-27 07:30:03.729952 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2025-11-27 07:30:03.772729 | controller | Thursday 27 November 2025  07:30:03 +0000 (0:00:00.045)       0:04:38.563 *****
2025-11-27 07:30:03.772781 | controller | skipping: [instance]
2025-11-27 07:30:03.808221 | controller |
2025-11-27 07:30:03.808244 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2025-11-27 07:30:03.808252 | controller | Thursday 27 November 2025  07:30:03 +0000 (0:00:00.042)       0:04:38.606 *****
2025-11-27 07:30:03.808262 | controller | skipping: [instance]
2025-11-27 07:30:03.941047 | controller |
2025-11-27 07:30:03.941080 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
2025-11-27 07:30:03.941101 | controller | Thursday 27 November 2025  07:30:03 +0000 (0:00:00.035)       0:04:38.641 *****
2025-11-27 07:30:03.941111 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': 'e2940d5a-9141-4d22-8873-506e2414e349'})
2025-11-27 07:30:04.945995 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '64d32439-1af1-43b4-b45f-0ebaa11ac1e3'})
2025-11-27 07:30:04.946026 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '6a88905d-7e6a-406e-9ceb-02ecae60fa9b'})
2025-11-27 07:30:04.946033 | controller |
2025-11-27 07:30:04.946040 | controller | TASK [reproducer : Output baremetal info file] *********************************
2025-11-27 07:30:04.946046 | controller | Thursday 27 November 2025  07:30:03 +0000 (0:00:00.132)       0:04:38.774 *****
2025-11-27 07:30:04.946055 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:04.983891 | controller |
2025-11-27 07:30:04.983915 | controller | TASK [reproducer : Output ironic_nodes to file] ********************************
2025-11-27 07:30:04.983938 | controller | Thursday 27 November 2025  07:30:04 +0000 (0:00:01.005)       0:04:39.779 *****
2025-11-27 07:30:04.983949 | controller | skipping: [instance]
2025-11-27 07:30:05.116059 | controller |
2025-11-27 07:30:05.116103 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
2025-11-27 07:30:05.116111 | controller | Thursday 27 November 2025  07:30:04 +0000 (0:00:00.038)       0:04:39.817 *****
2025-11-27 07:30:05.116122 | controller |
2025-11-27 07:30:05.164815 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
2025-11-27 07:30:05.164841 | controller | Thursday 27 November 2025  07:30:05 +0000 (0:00:00.132)       0:04:39.949 *****
2025-11-27 07:30:05.164853 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:05.209458 | controller |
2025-11-27 07:30:05.209481 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2025-11-27 07:30:05.209489 | controller | Thursday 27 November 2025  07:30:05 +0000 (0:00:00.048)       0:04:39.998 *****
2025-11-27 07:30:05.209499 | controller | skipping: [instance]
2025-11-27 07:30:05.252793 | controller |
2025-11-27 07:30:05.252818 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2025-11-27 07:30:05.252826 | controller | Thursday 27 November 2025  07:30:05 +0000 (0:00:00.044)       0:04:40.043 *****
2025-11-27 07:30:05.252836 | controller | skipping: [instance]
2025-11-27 07:30:06.582848 | controller |
2025-11-27 07:30:06.582882 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
2025-11-27 07:30:06.582890 | controller | Thursday 27 November 2025  07:30:05 +0000 (0:00:00.043)       0:04:40.086 *****
2025-11-27 07:30:06.582901 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:11.258429 | controller |
2025-11-27 07:30:11.258459 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
2025-11-27 07:30:11.258468 | controller | Thursday 27 November 2025  07:30:06 +0000 (0:00:01.329)       0:04:41.415 *****
2025-11-27 07:30:11.258478 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=e2940d5a-9141-4d22-8873-506e2414e349)
2025-11-27 07:30:11.360551 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=64d32439-1af1-43b4-b45f-0ebaa11ac1e3)
2025-11-27 07:30:11.360586 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=6a88905d-7e6a-406e-9ceb-02ecae60fa9b)
2025-11-27 07:30:11.360602 | controller |
2025-11-27 07:30:11.360609 | controller | TASK [sushy_emulator : Verify baremetal VM power status] ***********************
2025-11-27 07:30:11.360614 | controller | Thursday 27 November 2025  07:30:11 +0000 (0:00:04.675)       0:04:46.091 *****
2025-11-27 07:30:11.360625 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
2025-11-27 07:30:11.577953 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
2025-11-27 07:30:11.577985 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
2025-11-27 07:30:11.577993 | controller |
2025-11-27 07:30:11.577999 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
2025-11-27 07:30:11.578011 | controller | Thursday 27 November 2025  07:30:11 +0000 (0:00:00.101)       0:04:46.193 *****
2025-11-27 07:30:11.578020 | controller | ok: [instance -> localhost]
2025-11-27 07:30:13.714252 | controller |
2025-11-27 07:30:13.714283 | controller | TASK [reproducer : Sync local repositories to other hosts if present] **********
2025-11-27 07:30:13.714291 | controller | Thursday 27 November 2025  07:30:11 +0000 (0:00:00.217)       0:04:46.411 *****
2025-11-27 07:30:13.714301 | controller | changed: [instance -> localhost] => (item=controller-0)
2025-11-27 07:30:14.293833 | controller |
2025-11-27 07:30:14.293868 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
2025-11-27 07:30:14.293877 | controller | Thursday 27 November 2025  07:30:13 +0000 (0:00:02.136)       0:04:48.547 *****
2025-11-27 07:30:14.293887 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:14.972668 | controller |
2025-11-27 07:30:14.972699 | controller | TASK [reproducer : Install ansible dependencies] *******************************
2025-11-27 07:30:14.972708 | controller | Thursday 27 November 2025  07:30:14 +0000 (0:00:00.579)       0:04:49.127 *****
2025-11-27 07:30:14.972718 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:16.043816 | controller |
2025-11-27 07:30:16.043845 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
2025-11-27 07:30:16.043853 | controller | Thursday 27 November 2025  07:30:14 +0000 (0:00:00.678)       0:04:49.805 *****
2025-11-27 07:30:16.043864 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:16.680310 | controller |
2025-11-27 07:30:16.680340 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
2025-11-27 07:30:16.680348 | controller | Thursday 27 November 2025  07:30:16 +0000 (0:00:01.071)       0:04:50.877 *****
2025-11-27 07:30:16.680358 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:17.747316 | controller |
2025-11-27 07:30:17.747345 | controller | TASK [reproducer : Inject local environment parameters] ************************
2025-11-27 07:30:17.747354 | controller | Thursday 27 November 2025  07:30:16 +0000 (0:00:00.636)       0:04:51.513 *****
2025-11-27 07:30:17.747364 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:17.747424 | controller |
2025-11-27 07:30:17.747435 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
2025-11-27 07:30:17.747529 | controller | Thursday 27 November 2025  07:30:17 +0000 (0:00:01.067)       0:04:52.580 *****
2025-11-27 07:30:18.355725 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:18.355803 | controller |
2025-11-27 07:30:18.355921 | controller | TASK [reproducer : Get interfaces-info content] ********************************
2025-11-27 07:30:18.356038 | controller | Thursday 27 November 2025  07:30:18 +0000 (0:00:00.608)       0:04:53.189 *****
2025-11-27 07:30:18.976902 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:18.976956 | controller |
2025-11-27 07:30:18.977073 | controller | TASK [reproducer : Wait for OCP nodes to be ready] *****************************
2025-11-27 07:30:18.977202 | controller | Thursday 27 November 2025  07:30:18 +0000 (0:00:00.620)       0:04:53.810 *****
2025-11-27 07:30:20.346574 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2025-11-27 07:30:20.346627 | controller |
2025-11-27 07:30:20.346742 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-11-27 07:30:20.346875 | controller | Thursday 27 November 2025  07:30:20 +0000 (0:00:01.369)       0:04:55.180 *****
2025-11-27 07:30:20.382626 | controller | skipping: [instance]
2025-11-27 07:30:20.382689 | controller |
2025-11-27 07:30:20.382788 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-11-27 07:30:20.382912 | controller | Thursday 27 November 2025  07:30:20 +0000 (0:00:00.036)       0:04:55.216 *****
2025-11-27 07:30:20.416858 | controller | skipping: [instance]
2025-11-27 07:30:20.416920 | controller |
2025-11-27 07:30:20.417037 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-11-27 07:30:20.417151 | controller | Thursday 27 November 2025  07:30:20 +0000 (0:00:00.034)       0:04:55.250 *****
2025-11-27 07:30:20.456585 | controller | skipping: [instance]
2025-11-27 07:30:20.493200 | controller |
2025-11-27 07:30:20.493225 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-11-27 07:30:20.493232 | controller | Thursday 27 November 2025  07:30:20 +0000 (0:00:00.038)       0:04:55.288 *****
2025-11-27 07:30:20.493242 | controller | skipping: [instance]
2025-11-27 07:30:20.493286 | controller |
2025-11-27 07:30:20.493393 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-11-27 07:30:20.493497 | controller | Thursday 27 November 2025  07:30:20 +0000 (0:00:00.038)       0:04:55.327 *****
2025-11-27 07:30:20.529666 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:20.529739 | controller |
2025-11-27 07:30:20.529875 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-11-27 07:30:20.529974 | controller | Thursday 27 November 2025  07:30:20 +0000 (0:00:00.036)       0:04:55.363 *****
2025-11-27 07:30:20.644582 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
2025-11-27 07:30:20.700242 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={})
2025-11-27 07:30:20.700271 | controller |
2025-11-27 07:30:20.700284 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-11-27 07:30:20.700290 | controller | Thursday 27 November 2025  07:30:20 +0000 (0:00:00.114)       0:04:55.477 *****
2025-11-27 07:30:20.700300 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
2025-11-27 07:30:23.878859 | controller |
2025-11-27 07:30:23.878894 | controller | TASK [networking_mapper : Gather the facts] ************************************
2025-11-27 07:30:23.878903 | controller | Thursday 27 November 2025  07:30:20 +0000 (0:00:00.055)       0:04:55.533 *****
2025-11-27 07:30:23.878914 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2025-11-27 07:30:23.879205 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
2025-11-27 07:30:23.879218 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2025-11-27 07:30:23.879224 | controller |
2025-11-27 07:30:23.879232 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
2025-11-27 07:30:24.894267 | controller | Thursday 27 November 2025  07:30:23 +0000 (0:00:03.178)       0:04:58.712 *****
2025-11-27 07:30:24.894322 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:25.367185 | controller |
2025-11-27 07:30:25.367216 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-11-27 07:30:25.367224 | controller | Thursday 27 November 2025  07:30:24 +0000 (0:00:01.015)       0:04:59.727 *****
2025-11-27 07:30:25.367235 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:26.387886 | controller |
2025-11-27 07:30:26.387916 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-11-27 07:30:26.387924 | controller | Thursday 27 November 2025  07:30:25 +0000 (0:00:00.472)       0:05:00.200 *****
2025-11-27 07:30:26.387934 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:26.459983 | controller |
2025-11-27 07:30:26.460013 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-11-27 07:30:26.460021 | controller | Thursday 27 November 2025  07:30:26 +0000 (0:00:01.020)       0:05:01.221 *****
2025-11-27 07:30:26.460032 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:26.460077 | controller |
2025-11-27 07:30:26.460205 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-11-27 07:30:26.460317 | controller | Thursday 27 November 2025  07:30:26 +0000 (0:00:00.072)       0:05:01.293 *****
2025-11-27 07:30:26.505744 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:26.505853 | controller |
2025-11-27 07:30:26.505970 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-11-27 07:30:26.506104 | controller | Thursday 27 November 2025  07:30:26 +0000 (0:00:00.045)       0:05:01.339 *****
2025-11-27 07:30:27.444582 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:27.444649 | controller |
2025-11-27 07:30:27.444773 | controller | TASK [reproducer : Inject CRC ssh key] *****************************************
2025-11-27 07:30:27.444892 | controller | Thursday 27 November 2025  07:30:27 +0000 (0:00:00.938)       0:05:02.278 *****
2025-11-27 07:30:28.323468 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:34.274328 | controller |
2025-11-27 07:30:34.274363 | controller | TASK [reproducer : Ensure we have all dependencies installed] ******************
2025-11-27 07:30:34.274371 | controller | Thursday 27 November 2025  07:30:28 +0000 (0:00:00.878)       0:05:03.156 *****
2025-11-27 07:30:34.274382 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
2025-11-27 07:30:34.274544 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:34.274683 | controller |
2025-11-27 07:30:34.274876 | controller | TASK [Configure ntp service] ***************************************************
2025-11-27 07:30:34.275033 | controller | Thursday 27 November 2025  07:30:34 +0000 (0:00:05.951)       0:05:09.107 *****
2025-11-27 07:30:34.490129 | controller |
2025-11-27 07:30:34.490325 | controller | TASK [cifmw_ntp : Install chrony] **********************************************
2025-11-27 07:30:34.490478 | controller | Thursday 27 November 2025  07:30:34 +0000 (0:00:00.215)       0:05:09.323 *****
2025-11-27 07:30:35.446133 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:36.337996 | controller |
2025-11-27 07:30:36.338028 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] *************************
2025-11-27 07:30:36.338036 | controller | Thursday 27 November 2025  07:30:35 +0000 (0:00:00.955)       0:05:10.279 *****
2025-11-27 07:30:36.338047 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
2025-11-27 07:30:37.236386 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
2025-11-27 07:30:37.236419 | controller |
2025-11-27 07:30:37.236426 | controller | TASK [cifmw_ntp : Render chrony extra config file] *****************************
2025-11-27 07:30:37.236432 | controller | Thursday 27 November 2025  07:30:36 +0000 (0:00:00.891)       0:05:11.171 *****
2025-11-27 07:30:37.236442 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:37.876212 | controller |
2025-11-27 07:30:37.876251 | controller | TASK [cifmw_ntp : Enable chrony service] ***************************************
2025-11-27 07:30:37.876261 | controller | Thursday 27 November 2025  07:30:37 +0000 (0:00:00.898)       0:05:12.069 *****
2025-11-27 07:30:37.876273 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:38.008322 | controller |
2025-11-27 07:30:38.008355 | controller | TASK [reproducer : Configure CRC node if available] ****************************
2025-11-27 07:30:38.008374 | controller | Thursday 27 November 2025  07:30:37 +0000 (0:00:00.639)       0:05:12.709 *****
2025-11-27 07:30:38.008385 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
2025-11-27 07:30:38.439818 | controller |
2025-11-27 07:30:38.439850 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] ***
2025-11-27 07:30:38.439859 | controller | Thursday 27 November 2025  07:30:38 +0000 (0:00:00.132)       0:05:12.841 *****
2025-11-27 07:30:38.439870 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:38.929129 | controller |
2025-11-27 07:30:38.929160 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ********************
2025-11-27 07:30:38.929168 | controller | Thursday 27 November 2025  07:30:38 +0000 (0:00:00.431)       0:05:13.273 *****
2025-11-27 07:30:38.929178 | controller | ok: [instance -> crc-0(crc-0.instance)]
2025-11-27 07:30:39.598296 | controller |
2025-11-27 07:30:39.598334 | controller | TASK [reproducer : Configure local DNS for CRC pod] ****************************
2025-11-27 07:30:39.598343 | controller | Thursday 27 November 2025  07:30:38 +0000 (0:00:00.485)       0:05:13.758 *****
2025-11-27 07:30:39.598354 | controller | changed: [instance -> crc-0(crc-0.instance)]
2025-11-27 07:30:40.103971 | controller |
2025-11-27 07:30:40.104008 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
2025-11-27 07:30:40.104016 | controller | Thursday 27 November 2025  07:30:39 +0000 (0:00:00.672)       0:05:14.431 *****
2025-11-27 07:30:40.104027 | controller | changed: [instance -> crc-0(crc-0.instance)]
2025-11-27 07:30:40.150325 | controller |
2025-11-27 07:30:40.150350 | controller | TASK [Restart DNS in CRC VM] ***************************************************
2025-11-27 07:30:40.150358 | controller | Thursday 27 November 2025  07:30:40 +0000 (0:00:00.502)       0:05:14.933 *****
2025-11-27 07:30:40.150368 | controller |
2025-11-27 07:30:40.588719 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
2025-11-27 07:30:40.588752 | controller | Thursday 27 November 2025  07:30:40 +0000 (0:00:00.050)       0:05:14.983 *****
2025-11-27 07:30:40.588778 | controller | ok: [instance -> crc-0(crc-0.instance)]
2025-11-27 07:30:41.274742 | controller |
2025-11-27 07:30:41.274787 | controller | TASK [openshift_setup : Restart dnsmasq service if used] ***********************
2025-11-27 07:30:41.274799 | controller | Thursday 27 November 2025  07:30:40 +0000 (0:00:00.438)       0:05:15.421 *****
2025-11-27 07:30:41.274810 | controller | changed: [instance -> crc-0(crc-0.instance)]
2025-11-27 07:30:41.303361 | controller |
2025-11-27 07:30:41.303394 | controller | TASK [openshift_setup : Stop dnsmasq] ******************************************
2025-11-27 07:30:41.303402 | controller | Thursday 27 November 2025  07:30:41 +0000 (0:00:00.686)       0:05:16.108 *****
2025-11-27 07:30:41.303412 | controller | skipping: [instance]
2025-11-27 07:30:41.337616 | controller |
2025-11-27 07:30:41.337635 | controller | TASK [openshift_setup : Start dnsmasq] *****************************************
2025-11-27 07:30:41.337642 | controller | Thursday 27 November 2025  07:30:41 +0000 (0:00:00.028)       0:05:16.136 *****
2025-11-27 07:30:41.337650 | controller | skipping: [instance]
2025-11-27 07:30:41.566646 | controller |
2025-11-27 07:30:41.566678 | controller | TASK [reproducer : Remove entry from /etc/hosts] *******************************
2025-11-27 07:30:41.566686 | controller | Thursday 27 November 2025  07:30:41 +0000 (0:00:00.034)       0:05:16.171 *****
2025-11-27 07:30:41.566697 | controller | changed: [instance]
2025-11-27 07:30:41.641131 | controller |
2025-11-27 07:30:41.641161 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
2025-11-27 07:30:41.641168 | controller | Thursday 27 November 2025  07:30:41 +0000 (0:00:00.225)       0:05:16.396 *****
2025-11-27 07:30:41.641178 | controller | skipping: [instance] => (item=)
2025-11-27 07:30:41.674671 | controller |
2025-11-27 07:30:41.674704 | controller | TASK [dnsmasq : Assert we have needed address data] ****************************
2025-11-27 07:30:41.674712 | controller | Thursday 27 November 2025  07:30:41 +0000 (0:00:00.078)       0:05:16.474 *****
2025-11-27 07:30:41.674723 | controller | ok: [instance]
2025-11-27 07:30:41.744783 | controller |
2025-11-27 07:30:41.744809 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-11-27 07:30:41.744817 | controller | Thursday 27 November 2025  07:30:41 +0000 (0:00:00.033)       0:05:16.508 *****
2025-11-27 07:30:41.744827 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2025-11-27 07:30:41.998636 | controller |
2025-11-27 07:30:41.998669 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-11-27 07:30:41.998677 | controller | Thursday 27 November 2025  07:30:41 +0000 (0:00:00.070)       0:05:16.578 *****
2025-11-27 07:30:41.998687 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2025-11-27 07:30:42.044633 | controller |
2025-11-27 07:30:42.044661 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
2025-11-27 07:30:42.044669 | controller | Thursday 27 November 2025  07:30:41 +0000 (0:00:00.253)       0:05:16.831 *****
2025-11-27 07:30:42.044679 | controller |
2025-11-27 07:30:42.101725 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-11-27 07:30:42.101752 | controller | Thursday 27 November 2025  07:30:42 +0000 (0:00:00.046)       0:05:16.878 *****
2025-11-27 07:30:42.101780 | controller | ok: [instance]
2025-11-27 07:30:42.152986 | controller |
2025-11-27 07:30:42.153006 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-11-27 07:30:42.153014 | controller | Thursday 27 November 2025  07:30:42 +0000 (0:00:00.057)       0:05:16.935 *****
2025-11-27 07:30:42.153023 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2025-11-27 07:30:42.407017 | controller |
2025-11-27 07:30:42.407049 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-11-27 07:30:42.407057 | controller | Thursday 27 November 2025  07:30:42 +0000 (0:00:00.051)       0:05:16.986 *****
2025-11-27 07:30:42.407067 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2025-11-27 07:30:42.820018 | controller |
2025-11-27 07:30:42.820049 | controller | TASK [reproducer : Ensure "testing" domain is "local"] *************************
2025-11-27 07:30:42.820057 | controller | Thursday 27 November 2025  07:30:42 +0000 (0:00:00.252)       0:05:17.239 *****
2025-11-27 07:30:42.820068 | controller | changed: [instance]
2025-11-27 07:30:43.494412 | controller |
2025-11-27 07:30:43.494443 | controller | TASK [reproducer : Flush handlers] *********************************************
2025-11-27 07:30:43.494451 | controller | Thursday 27 November 2025  07:30:42 +0000 (0:00:00.401)       0:05:17.641 *****
2025-11-27 07:30:43.494463 | controller |
2025-11-27 07:30:43.494468 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
2025-11-27 07:30:43.494474 | controller | Thursday 27 November 2025  07:30:42 +0000 (0:00:00.012)       0:05:17.653 *****
2025-11-27 07:30:43.494484 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:43.852862 | controller |
2025-11-27 07:30:43.852919 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-11-27 07:30:43.852931 | controller | Thursday 27 November 2025  07:30:43 +0000 (0:00:00.671)       0:05:18.324 *****
2025-11-27 07:30:43.852946 | controller | changed: [instance]
2025-11-27 07:30:44.069279 | controller |
2025-11-27 07:30:44.069334 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
2025-11-27 07:30:44.069343 | controller | Thursday 27 November 2025  07:30:43 +0000 (0:00:00.361)       0:05:18.686 *****
2025-11-27 07:30:44.069357 | controller | skipping: [instance] => (item=controller-0)
2025-11-27 07:30:44.069526 | controller | skipping: [instance] => (item=crc-0)
2025-11-27 07:30:44.069538 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
2025-11-27 07:30:44.069625 | controller |
2025-11-27 07:30:44.069726 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
2025-11-27 07:30:44.069922 | controller | Thursday 27 November 2025  07:30:44 +0000 (0:00:00.216)       0:05:18.903 *****
2025-11-27 07:30:45.520839 | controller | changed: [instance -> compute-0(compute-0.instance)]
2025-11-27 07:30:45.520892 | controller |
2025-11-27 07:30:45.521019 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2025-11-27 07:30:45.521119 | controller | Thursday 27 November 2025  07:30:45 +0000 (0:00:01.451)       0:05:20.354 *****
2025-11-27 07:30:45.540428 | controller | skipping: [instance]
2025-11-27 07:30:45.540508 | controller |
2025-11-27 07:30:45.540607 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2025-11-27 07:30:45.540706 | controller | Thursday 27 November 2025  07:30:45 +0000 (0:00:00.019)       0:05:20.374 *****
2025-11-27 07:30:46.006050 | controller | ok: [instance -> compute-0(compute-0.instance)]
2025-11-27 07:30:46.006169 | controller |
2025-11-27 07:30:46.006347 | controller | TASK [install_ca : Install internal CA from url] *******************************
2025-11-27 07:30:46.006479 | controller | Thursday 27 November 2025  07:30:46 +0000 (0:00:00.465)       0:05:20.839 *****
2025-11-27 07:30:46.038571 | controller | skipping: [instance]
2025-11-27 07:30:46.038671 | controller |
2025-11-27 07:30:46.038820 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2025-11-27 07:30:46.038955 | controller | Thursday 27 November 2025  07:30:46 +0000 (0:00:00.032)       0:05:20.872 *****
2025-11-27 07:30:46.072396 | controller | skipping: [instance]
2025-11-27 07:30:46.072532 | controller |
2025-11-27 07:30:46.072668 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2025-11-27 07:30:46.072686 | controller | Thursday 27 November 2025  07:30:46 +0000 (0:00:00.033)       0:05:20.906 *****
2025-11-27 07:30:46.108351 | controller | skipping: [instance]
2025-11-27 07:30:46.108385 | controller |
2025-11-27 07:30:46.108515 | controller | TASK [install_ca : Update ca bundle] *******************************************
2025-11-27 07:30:46.108624 | controller | Thursday 27 November 2025  07:30:46 +0000 (0:00:00.035)       0:05:20.942 *****
2025-11-27 07:30:47.592885 | controller | changed: [instance -> compute-0(compute-0.instance)]
2025-11-27 07:30:47.592953 | controller |
2025-11-27 07:30:47.592965 | controller | TASK [reproducer : Get rhos-release and setup repos] ***************************
2025-11-27 07:30:47.593106 | controller | Thursday 27 November 2025  07:30:47 +0000 (0:00:01.484)       0:05:22.426 *****
2025-11-27 07:30:47.626898 | controller | skipping: [instance]
2025-11-27 07:30:47.626955 | controller |
2025-11-27 07:30:47.627177 | controller | TASK [reproducer : Create repositories on computes] ****************************
2025-11-27 07:30:47.645645 | controller | Thursday 27 November 2025  07:30:47 +0000 (0:00:00.034)       0:05:22.460 *****
2025-11-27 07:30:47.645679 | controller | skipping: [instance]
2025-11-27 07:30:47.676035 | controller |
2025-11-27 07:30:47.676069 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
2025-11-27 07:30:47.676088 | controller | Thursday 27 November 2025  07:30:47 +0000 (0:00:00.018)       0:05:22.479 *****
2025-11-27 07:30:47.676099 | controller | skipping: [instance]
2025-11-27 07:30:47.676125 | controller |
2025-11-27 07:30:47.676133 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2025-11-27 07:30:47.676274 | controller | Thursday 27 November 2025  07:30:47 +0000 (0:00:00.030)       0:05:22.509 *****
2025-11-27 07:30:47.729715 | controller | ok: [instance]
2025-11-27 07:30:47.825718 | controller |
2025-11-27 07:30:47.825751 | controller | TASK [reproducer : Push local code] ********************************************
2025-11-27 07:30:47.825775 | controller | Thursday 27 November 2025  07:30:47 +0000 (0:00:00.053)       0:05:22.563 *****
2025-11-27 07:30:47.825788 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
2025-11-27 07:30:47.825972 | controller |
2025-11-27 07:30:47.826135 | controller | TASK [reproducer : Check if repository directories already exist] **************
2025-11-27 07:30:47.826296 | controller | Thursday 27 November 2025  07:30:47 +0000 (0:00:00.096)       0:05:22.659 *****
2025-11-27 07:30:47.866432 | controller | skipping: [instance]
2025-11-27 07:30:47.866594 | controller |
2025-11-27 07:30:47.866733 | controller | TASK [reproducer : Ensure we are not in the job_id branch] *********************
2025-11-27 07:30:47.866894 | controller | Thursday 27 November 2025  07:30:47 +0000 (0:00:00.040)       0:05:22.700 *****
2025-11-27 07:30:47.906333 | controller | skipping: [instance]
2025-11-27 07:30:47.906517 | controller |
2025-11-27 07:30:47.906659 | controller | TASK [reproducer : Fetch zuul.items repositories] ******************************
2025-11-27 07:30:47.906835 | controller | Thursday 27 November 2025  07:30:47 +0000 (0:00:00.039)       0:05:22.740 *****
2025-11-27 07:30:47.944204 | controller | skipping: [instance]
2025-11-27 07:30:47.944407 | controller |
2025-11-27 07:30:47.944577 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
2025-11-27 07:30:47.944720 | controller | Thursday 27 November 2025  07:30:47 +0000 (0:00:00.037)       0:05:22.778 *****
2025-11-27 07:30:47.983181 | controller | skipping: [instance]
2025-11-27 07:30:47.983394 | controller |
2025-11-27 07:30:47.983577 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
2025-11-27 07:30:47.983725 | controller | Thursday 27 November 2025  07:30:47 +0000 (0:00:00.038)       0:05:22.816 *****
2025-11-27 07:30:48.017243 | controller | skipping: [instance]
2025-11-27 07:30:48.017444 | controller |
2025-11-27 07:30:48.017613 | controller | TASK [reproducer : Create target directories beforehand] ***********************
2025-11-27 07:30:48.017756 | controller | Thursday 27 November 2025  07:30:48 +0000 (0:00:00.034)       0:05:22.851 *****
2025-11-27 07:30:48.479863 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
2025-11-27 07:30:48.480064 | controller |
2025-11-27 07:30:48.480083 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2025-11-27 07:30:49.039621 | controller | Thursday 27 November 2025  07:30:48 +0000 (0:00:00.462)       0:05:23.313 *****
2025-11-27 07:30:49.039657 | controller | ok: [instance -> localhost] => (item=ci-framework)
2025-11-27 07:30:49.079830 | controller |
2025-11-27 07:30:49.079873 | controller | TASK [reproducer : Sync remote repositories] ***********************************
2025-11-27 07:30:49.079884 | controller | Thursday 27 November 2025  07:30:49 +0000 (0:00:00.559)       0:05:23.872 *****
2025-11-27 07:30:49.079898 | controller | skipping: [instance] => (item=ci-framework)
2025-11-27 07:30:49.156864 | controller | skipping: [instance]
2025-11-27 07:30:49.156908 | controller |
2025-11-27 07:30:49.156918 | controller | TASK [reproducer : Ensure default repositories are present] ********************
2025-11-27 07:30:49.156926 | controller | Thursday 27 November 2025  07:30:49 +0000 (0:00:00.040)       0:05:23.913 *****
2025-11-27 07:30:49.156940 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework)
2025-11-27 07:30:49.156984 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls)
2025-11-27 07:30:49.157004 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture)
2025-11-27 07:30:49.157011 | controller |
2025-11-27 07:30:49.157020 | controller | TASK [reproducer : Check repository availability: ci-framework] ****************
2025-11-27 07:30:49.614589 | controller | Thursday 27 November 2025  07:30:49 +0000 (0:00:00.076)       0:05:23.990 *****
2025-11-27 07:30:49.614639 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:49.650373 | controller |
2025-11-27 07:30:49.650401 | controller | TASK [reproducer : Clone repository if needed: ci-framework] *******************
2025-11-27 07:30:49.650411 | controller | Thursday 27 November 2025  07:30:49 +0000 (0:00:00.457)       0:05:24.447 *****
2025-11-27 07:30:49.650422 | controller | skipping: [instance]
2025-11-27 07:30:50.093503 | controller |
2025-11-27 07:30:50.093533 | controller | TASK [reproducer : Check repository availability: install_yamls] ***************
2025-11-27 07:30:50.093545 | controller | Thursday 27 November 2025  07:30:49 +0000 (0:00:00.035)       0:05:24.483 *****
2025-11-27 07:30:50.093556 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:50.129374 | controller |
2025-11-27 07:30:50.129405 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ******************
2025-11-27 07:30:50.129414 | controller | Thursday 27 November 2025  07:30:50 +0000 (0:00:00.443)       0:05:24.926 *****
2025-11-27 07:30:50.129424 | controller | skipping: [instance]
2025-11-27 07:30:50.129539 | controller |
2025-11-27 07:30:50.129563 | controller | TASK [reproducer : Check repository availability: architecture] ****************
2025-11-27 07:30:50.569002 | controller | Thursday 27 November 2025  07:30:50 +0000 (0:00:00.036)       0:05:24.962 *****
2025-11-27 07:30:50.569049 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:30:50.569077 | controller |
2025-11-27 07:30:50.569101 | controller | TASK [reproducer : Clone repository if needed: architecture] *******************
2025-11-27 07:30:50.569275 | controller | Thursday 27 November 2025  07:30:50 +0000 (0:00:00.439)       0:05:25.402 *****
2025-11-27 07:30:52.795388 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:31:12.058955 | controller |
2025-11-27 07:31:12.059004 | controller | TASK [reproducer : Install collections on controller-0] ************************
2025-11-27 07:31:12.059014 | controller | Thursday 27 November 2025  07:30:52 +0000 (0:00:02.226)       0:05:27.628 *****
2025-11-27 07:31:12.059027 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:31:12.059049 | controller |
2025-11-27 07:31:12.059057 | controller | TASK [reproducer : Inject CI Framework motd] ***********************************
2025-11-27 07:31:12.059066 | controller | Thursday 27 November 2025  07:31:12 +0000 (0:00:19.263)       0:05:46.892 *****
2025-11-27 07:31:13.032357 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:31:13.032567 | controller |
2025-11-27 07:31:13.032601 | controller | TASK [reproducer : Rotate some logs] *******************************************
2025-11-27 07:31:13.129716 | controller | Thursday 27 November 2025  07:31:13 +0000 (0:00:00.973)       0:05:47.865 *****
2025-11-27 07:31:13.129754 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log)
2025-11-27 07:31:13.129904 | controller |
2025-11-27 07:31:13.129967 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] *********************
2025-11-27 07:31:13.130075 | controller | Thursday 27 November 2025  07:31:13 +0000 (0:00:00.097)       0:05:47.963 *****
2025-11-27 07:31:13.556142 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:31:13.556197 | controller |
2025-11-27 07:31:13.556208 | controller | TASK [reproducer : Rotate log if present] **************************************
2025-11-27 07:31:13.556345 | controller | Thursday 27 November 2025  07:31:13 +0000 (0:00:00.426)       0:05:48.389 *****
2025-11-27 07:31:13.590747 | controller | skipping: [instance]
2025-11-27 07:31:13.631815 | controller |
2025-11-27 07:31:13.631839 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] ***********************
2025-11-27 07:31:13.631861 | controller | Thursday 27 November 2025  07:31:13 +0000 (0:00:00.034)       0:05:48.424 *****
2025-11-27 07:31:13.631872 | controller | skipping: [instance]
2025-11-27 07:31:13.632083 | controller |
2025-11-27 07:31:13.715360 | controller | TASK [cifmw_setup : Get customized parameters] *********************************
2025-11-27 07:31:13.715382 | controller | Thursday 27 November 2025  07:31:13 +0000 (0:00:00.041)       0:05:48.465 *****
2025-11-27 07:31:13.715395 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:31:13.715439 | controller |
2025-11-27 07:31:13.715557 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2025-11-27 07:31:13.715678 | controller | Thursday 27 November 2025  07:31:13 +0000 (0:00:00.083)       0:05:48.549 *****
2025-11-27 07:31:14.183460 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:31:14.218370 | controller |
2025-11-27 07:31:14.218398 | controller | TASK [install_ca : Install internal CA from url] *******************************
2025-11-27 07:31:14.218406 | controller | Thursday 27 November 2025  07:31:14 +0000 (0:00:00.467)       0:05:49.016 *****
2025-11-27 07:31:14.218416 | controller | skipping: [instance]
2025-11-27 07:31:14.257612 | controller |
2025-11-27 07:31:14.257636 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2025-11-27 07:31:14.257644 | controller | Thursday 27 November 2025  07:31:14 +0000 (0:00:00.035)       0:05:49.051 *****
2025-11-27 07:31:14.257654 | controller | skipping: [instance]
2025-11-27 07:31:14.297088 | controller |
2025-11-27 07:31:14.297121 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2025-11-27 07:31:14.297129 | controller | Thursday 27 November 2025  07:31:14 +0000 (0:00:00.039)       0:05:49.091 *****
2025-11-27 07:31:14.297140 | controller | skipping: [instance]
2025-11-27 07:31:14.297166 | controller |
2025-11-27 07:31:14.297433 | controller | TASK [install_ca : Update ca bundle] *******************************************
2025-11-27 07:31:15.771600 | controller | Thursday 27 November 2025  07:31:14 +0000 (0:00:00.039)       0:05:49.130 *****
2025-11-27 07:31:15.771643 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:31:15.771674 | controller |
2025-11-27 07:31:15.771892 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2025-11-27 07:31:16.365866 | controller | Thursday 27 November 2025  07:31:15 +0000 (0:00:01.474)       0:05:50.605 *****
2025-11-27 07:31:16.365907 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:31:16.365934 | controller |
2025-11-27 07:31:16.366129 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2025-11-27 07:31:17.351697 | controller | Thursday 27 November 2025  07:31:16 +0000 (0:00:00.594)       0:05:51.199 *****
2025-11-27 07:31:17.351734 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-11-27 07:31:18.073864 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-11-27 07:31:18.073919 | controller | changed: [instance -> controller-0]
2025-11-27 07:31:18.073928 | controller |
2025-11-27 07:31:18.073934 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2025-11-27 07:31:18.073940 | controller | Thursday 27 November 2025  07:31:17 +0000 (0:00:00.985)       0:05:52.184 *****
2025-11-27 07:31:18.073951 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-11-27 07:31:18.074057 | controller |
2025-11-27 07:31:18.074075 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2025-11-27 07:31:18.074086 | controller | Thursday 27 November 2025  07:31:18 +0000 (0:00:00.722)       0:05:52.907 *****
2025-11-27 07:31:18.555996 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false
2025-11-27 07:31:18.556075 | controller |   censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result'
2025-11-27 07:31:18.564336 | controller |
2025-11-27 07:31:18.564437 | controller | TASK [Create dnsmasq dir] ******************************************************
2025-11-27 07:31:18.564543 | controller | Thursday 27 November 2025  07:31:18 +0000 (0:00:00.490)       0:05:53.398 *****
2025-11-27 07:31:18.765611 | controller | changed: [instance]
2025-11-27 07:31:18.765661 | controller |
2025-11-27 07:31:18.765779 | controller | TASK [Get journalctl in a file] ************************************************
2025-11-27 07:31:18.765914 | controller | Thursday 27 November 2025  07:31:18 +0000 (0:00:00.201)       0:05:53.599 *****
2025-11-27 07:31:18.995369 | controller | changed: [instance]
2025-11-27 07:31:18.995407 | controller |
2025-11-27 07:31:18.995533 | controller | TASK [Dump journalctl output] **************************************************
2025-11-27 07:31:18.995629 | controller | Thursday 27 November 2025  07:31:18 +0000 (0:00:00.229)       0:05:53.829 *****
2025-11-27 07:31:19.394388 | controller | changed: [instance]
2025-11-27 07:31:19.394491 | controller |
2025-11-27 07:31:19.394614 | controller | TASK [Copy all dnsmasq config] *************************************************
2025-11-27 07:31:19.394742 | controller | Thursday 27 November 2025  07:31:19 +0000 (0:00:00.399)       0:05:54.228 *****
2025-11-27 07:31:19.891620 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2025-11-27 07:31:19.891794 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2025-11-27 07:31:19.891966 | controller |
2025-11-27 07:31:19.892080 | controller | TASK [Create log directory] ****************************************************
2025-11-27 07:31:19.892110 | controller | Thursday 27 November 2025  07:31:19 +0000 (0:00:00.497)       0:05:54.725 *****
2025-11-27 07:31:20.100174 | controller | changed: [instance]
2025-11-27 07:31:20.100240 | controller |
2025-11-27 07:31:20.100269 | controller | TASK [Sync logs from controller-0] *********************************************
2025-11-27 07:31:20.100451 | controller | Thursday 27 November 2025  07:31:20 +0000 (0:00:00.207)       0:05:54.932 *****
2025-11-27 07:31:20.975895 | controller | changed: [instance]
2025-11-27 07:31:20.975946 | controller |
2025-11-27 07:31:20.975955 | controller | PLAY RECAP *********************************************************************
2025-11-27 07:31:20.975963 | controller | instance                   : ok=492  changed=182  unreachable=0    failed=1    skipped=183  rescued=0    ignored=0
2025-11-27 07:31:20.976127 | controller |
2025-11-27 07:31:20.976884 | controller | Thursday 27 November 2025  07:31:20 +0000 (0:00:00.874)       0:05:55.807 *****
2025-11-27 07:31:20.976907 | controller | ===============================================================================
2025-11-27 07:31:20.977086 | controller | reproducer : Check package install status ------------------------------ 61.15s
2025-11-27 07:31:20.977137 | controller | libvirt_manager : Download base image ---------------------------------- 23.23s
2025-11-27 07:31:20.977145 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.76s
2025-11-27 07:31:20.977151 | controller | reproducer : Install collections on controller-0 ----------------------- 19.26s
2025-11-27 07:31:20.977157 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.60s
2025-11-27 07:31:20.977162 | controller | libvirt_manager : Install packages required for using KVM --------------- 9.76s
2025-11-27 07:31:20.977167 | controller | reproducer : Ensure we have all dependencies installed ------------------ 5.95s
2025-11-27 07:31:20.977197 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.02s
2025-11-27 07:31:20.977227 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 4.68s
2025-11-27 07:31:20.977251 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.78s
2025-11-27 07:31:20.977259 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.28s
2025-11-27 07:31:20.977724 | controller | networking_mapper : Gather the facts ------------------------------------ 3.18s
2025-11-27 07:31:20.977779 | controller | sushy_emulator : Install required packages ------------------------------ 2.70s
2025-11-27 07:31:20.977796 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.23s
2025-11-27 07:31:20.977802 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.14s
2025-11-27 07:31:20.977811 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.09s
2025-11-27 07:31:20.977841 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.08s
2025-11-27 07:31:20.978138 | controller | reproducer : Inject SSH configuration ----------------------------------- 1.74s
2025-11-27 07:31:21.098425 | controller | discover_latest_image : Get latest image -------------------------------- 1.73s
2025-11-27 07:31:21.098487 | controller | ci_nmstate : Apply the desidered state on instance ---------------------- 1.66s
2025-11-27 07:31:21.098503 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml']
2025-11-27 07:31:21.098979 | controller | WARNING  An error occurred during the test sequence action: 'converge'. Cleaning up.
2025-11-27 07:31:21.107840 | controller | INFO     Running crc_layout > cleanup
2025-11-27 07:31:21.108314 | controller | WARNING  Skipping, cleanup playbook not configured.
2025-11-27 07:31:21.116878 | controller | INFO     Running crc_layout > destroy
2025-11-27 07:31:21.117254 | controller | WARNING  Skipping, instances are delegated.
2025-11-27 07:31:21.117609 | controller | INFO     Pruning extra files from scenario ephemeral directory
2025-11-27 07:31:21.119163 | controller | INFO     Writing /tmp/report.html report.
2025-11-27 07:31:21.277472 | [controller] Waiting on logger
2025-11-27 07:31:26.450492 | [controller] Waiting on logger
2025-11-27 07:31:36.882425 | [controller] Waiting on logger
2025-11-27 07:31:47.314487 | [controller] Waiting on logger
2025-11-27 07:31:51.222102 | [Zuul] Log Stream did not terminate
2025-11-27 07:31:51.223067 | controller | ERROR
2025-11-27 07:31:51.223242 | controller | {
2025-11-27 07:31:51.223286 | controller |   "delta": "0:07:37.576027",
2025-11-27 07:31:51.223311 | controller |   "end": "2025-11-27 07:31:21.186396",
2025-11-27 07:31:51.223331 | controller |   "msg": "non-zero return code",
2025-11-27 07:31:51.223348 | controller |   "rc": 1,
2025-11-27 07:31:51.223364 | controller |   "start": "2025-11-27 07:23:43.610369"
2025-11-27 07:31:51.223378 | controller | }
failure
2025-11-27 07:31:51.273661 | 
2025-11-27 07:31:51.273720 | PLAY RECAP
2025-11-27 07:31:51.273766 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0
2025-11-27 07:31:51.273789 | 
2025-11-27 07:31:51.344537 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2025-11-27 07:31:51.345415 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2025-11-27 07:31:51.889334 | 
2025-11-27 07:31:51.889471 | PLAY [Run ci/playbooks/collect-logs.yml]
2025-11-27 07:31:51.909756 | 
2025-11-27 07:31:51.909835 | TASK [Filter out host if needed]
2025-11-27 07:31:51.918254 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2025-11-27 07:31:51.922702 | 
2025-11-27 07:31:51.922768 | TASK [Ensure file is present]
2025-11-27 07:31:52.326329 | controller | ok
2025-11-27 07:31:52.333538 | 
2025-11-27 07:31:52.333611 | TASK [Manage molecule report file]
2025-11-27 07:31:52.358332 | [controller] Waiting on logger
2025-11-27 07:32:01.714546 | [controller] Waiting on logger
2025-11-27 07:32:12.147395 | [controller] Waiting on logger
2025-11-27 07:32:21.490485 | [controller] Waiting on logger
2025-11-27 07:32:22.780957 | [Zuul] Log Stream did not terminate
2025-11-27 07:32:22.781371 | controller | changed
2025-11-27 07:32:22.788995 | 
2025-11-27 07:32:22.789088 | TASK [Check if we get ci-framework-data basedir]
2025-11-27 07:32:23.055739 | controller | ok
2025-11-27 07:32:23.061145 | 
2025-11-27 07:32:23.061232 | TASK [Create ci-framework-data log directory for zuul]
2025-11-27 07:32:23.438391 | controller | changed
2025-11-27 07:32:23.444727 | 
2025-11-27 07:32:23.444798 | TASK [Copy ci-framework interesting files]
2025-11-27 07:32:23.466521 | [controller] Waiting on logger
2025-11-27 07:32:33.906402 | [controller] Waiting on logger
2025-11-27 07:32:43.288038 | [controller] Waiting on logger
2025-11-27 07:32:53.682453 | [controller] Waiting on logger
2025-11-27 07:32:53.751310 | [Zuul] Log Stream did not terminate
2025-11-27 07:32:53.751667 | controller | changed
2025-11-27 07:32:53.758263 | 
2025-11-27 07:32:53.758383 | TASK [Get SELinux listing]
2025-11-27 07:32:54.834444 | [controller] Waiting on logger
2025-11-27 07:33:01.093206 | controller | changed
2025-11-27 07:33:01.099825 | 
2025-11-27 07:33:01.099923 | TASK [Generate log index]
2025-11-27 07:33:02.245686 | controller | changed
2025-11-27 07:33:02.250869 | 
2025-11-27 07:33:02.250963 | TASK [Get some env related data]
2025-11-27 07:33:03.282727 | [controller] Waiting on logger
2025-11-27 07:33:13.714584 | [controller] Waiting on logger
2025-11-27 07:33:24.146336 | [controller] Waiting on logger
2025-11-27 07:33:33.479974 | [Zuul] Log Stream did not terminate
2025-11-27 07:33:33.480261 | controller | changed
2025-11-27 07:33:33.486206 | 
2025-11-27 07:33:33.486298 | TASK [Generate list of logs to collect in home directory]
2025-11-27 07:33:33.491320 | [controller] Waiting on logger
2025-11-27 07:33:33.865337 | controller | ok: All paths examined
2025-11-27 07:33:33.870977 | 
2025-11-27 07:33:33.871053 | LOOP [Copy logs from home directory]
2025-11-27 07:33:34.440529 | controller | changed:
2025-11-27 07:33:34.440814 | controller | {
2025-11-27 07:33:34.440843 | controller |   "atime": 1743544925.4788878,
2025-11-27 07:33:34.440868 | controller |   "ctime": 1743545329.1409318,
2025-11-27 07:33:34.441004 | controller |   "dev": 64513,
2025-11-27 07:33:34.441156 | controller |   "gid": 1000,
2025-11-27 07:33:34.441189 | controller |   "gr_name": "zuul",
2025-11-27 07:33:34.441223 | controller |   "inode": 4518807,
2025-11-27 07:33:34.441242 | controller |   "isblk": false,
2025-11-27 07:33:34.441259 | controller |   "ischr": false,
2025-11-27 07:33:34.441276 | controller |   "isdir": false,
2025-11-27 07:33:34.441291 | controller |   "isfifo": false,
2025-11-27 07:33:34.441306 | controller |   "isgid": false,
2025-11-27 07:33:34.441320 | controller |   "islnk": false,
2025-11-27 07:33:34.441334 | controller |   "isreg": true,
2025-11-27 07:33:34.441418 | controller |   "issock": false,
2025-11-27 07:33:34.441446 | controller |   "isuid": false,
2025-11-27 07:33:34.441531 | controller |   "mode": "0644",
2025-11-27 07:33:34.441556 | controller |   "mtime": 1743545329.1409318,
2025-11-27 07:33:34.441588 | controller |   "nlink": 1,
2025-11-27 07:33:34.441603 | controller |   "path": "/home/zuul/crc-setup.log",
2025-11-27 07:33:34.441618 | controller |   "pw_name": "zuul",
2025-11-27 07:33:34.441633 | controller |   "rgrp": true,
2025-11-27 07:33:34.441647 | controller |   "roth": true,
2025-11-27 07:33:34.441660 | controller |   "rusr": true,
2025-11-27 07:33:34.441674 | controller |   "size": 4108,
2025-11-27 07:33:34.441688 | controller |   "uid": 1000,
2025-11-27 07:33:34.441702 | controller |   "wgrp": false,
2025-11-27 07:33:34.441717 | controller |   "woth": false,
2025-11-27 07:33:34.441731 | controller |   "wusr": true,
2025-11-27 07:33:34.441745 | controller |   "xgrp": false,
2025-11-27 07:33:34.441759 | controller |   "xoth": false,
2025-11-27 07:33:34.441773 | controller |   "xusr": false
2025-11-27 07:33:34.441792 | controller | }
2025-11-27 07:33:34.951279 | controller | changed:
2025-11-27 07:33:34.951393 | controller | {
2025-11-27 07:33:34.951420 | controller |   "atime": 1743545331.0429637,
2025-11-27 07:33:34.951439 | controller |   "ctime": 1743545842.0111232,
2025-11-27 07:33:34.951456 | controller |   "dev": 64513,
2025-11-27 07:33:34.951473 | controller |   "gid": 1000,
2025-11-27 07:33:34.951488 | controller |   "gr_name": "zuul",
2025-11-27 07:33:34.951503 | controller |   "inode": 4194437,
2025-11-27 07:33:34.951518 | controller |   "isblk": false,
2025-11-27 07:33:34.951532 | controller |   "ischr": false,
2025-11-27 07:33:34.951546 | controller |   "isdir": false,
2025-11-27 07:33:34.951572 | controller |   "isfifo": false,
2025-11-27 07:33:34.951588 | controller |   "isgid": false,
2025-11-27 07:33:34.951603 | controller |   "islnk": false,
2025-11-27 07:33:34.951617 | controller |   "isreg": true,
2025-11-27 07:33:34.951632 | controller |   "issock": false,
2025-11-27 07:33:34.951648 | controller |   "isuid": false,
2025-11-27 07:33:34.951662 | controller |   "mode": "0644",
2025-11-27 07:33:34.951676 | controller |   "mtime": 1743545842.0111232,
2025-11-27 07:33:34.951691 | controller |   "nlink": 1,
2025-11-27 07:33:34.951704 | controller |   "path": "/home/zuul/crc-start.log",
2025-11-27 07:33:34.951718 | controller |   "pw_name": "zuul",
2025-11-27 07:33:34.951733 | controller |   "rgrp": true,
2025-11-27 07:33:34.952053 | controller |   "roth": true,
2025-11-27 07:33:34.952089 | controller |   "rusr": true,
2025-11-27 07:33:34.952110 | controller |   "size": 4023,
2025-11-27 07:33:34.952128 | controller |   "uid": 1000,
2025-11-27 07:33:34.952143 | controller |   "wgrp": false,
2025-11-27 07:33:34.952159 | controller |   "woth": false,
2025-11-27 07:33:34.952173 | controller |   "wusr": true,
2025-11-27 07:33:34.952192 | controller |   "xgrp": false,
2025-11-27 07:33:34.952209 | controller |   "xoth": false,
2025-11-27 07:33:34.952283 | controller |   "xusr": false
2025-11-27 07:33:34.952313 | controller | }
2025-11-27 07:33:35.450639 | controller | changed:
2025-11-27 07:33:35.450798 | controller | {
2025-11-27 07:33:35.450829 | controller |   "atime": 1764228204.5500166,
2025-11-27 07:33:35.450851 | controller |   "ctime": 1764228221.1091845,
2025-11-27 07:33:35.450868 | controller |   "dev": 64513,
2025-11-27 07:33:35.450885 | controller |   "gid": 1000,
2025-11-27 07:33:35.450901 | controller |   "gr_name": "zuul",
2025-11-27 07:33:35.451000 | controller |   "inode": 4340273,
2025-11-27 07:33:35.451025 | controller |   "isblk": false,
2025-11-27 07:33:35.451042 | controller |   "ischr": false,
2025-11-27 07:33:35.451061 | controller |   "isdir": false,
2025-11-27 07:33:35.451078 | controller |   "isfifo": false,
2025-11-27 07:33:35.451092 | controller |   "isgid": false,
2025-11-27 07:33:35.451107 | controller |   "islnk": false,
2025-11-27 07:33:35.451121 | controller |   "isreg": true,
2025-11-27 07:33:35.451135 | controller |   "issock": false,
2025-11-27 07:33:35.451148 | controller |   "isuid": false,
2025-11-27 07:33:35.451161 | controller |   "mode": "0644",
2025-11-27 07:33:35.451175 | controller |   "mtime": 1764228221.1091845,
2025-11-27 07:33:35.451191 | controller |   "nlink": 1,
2025-11-27 07:33:35.451206 | controller |   "path": "/home/zuul/ansible.log",
2025-11-27 07:33:35.451221 | controller |   "pw_name": "zuul",
2025-11-27 07:33:35.451235 | controller |   "rgrp": true,
2025-11-27 07:33:35.451251 | controller |   "roth": true,
2025-11-27 07:33:35.451265 | controller |   "rusr": true,
2025-11-27 07:33:35.451280 | controller |   "size": 6749,
2025-11-27 07:33:35.451294 | controller |   "uid": 1000,
2025-11-27 07:33:35.451308 | controller |   "wgrp": false,
2025-11-27 07:33:35.451322 | controller |   "woth": false,
2025-11-27 07:33:35.451335 | controller |   "wusr": true,
2025-11-27 07:33:35.451348 | controller |   "xgrp": false,
2025-11-27 07:33:35.451361 | controller |   "xoth": false,
2025-11-27 07:33:35.451374 | controller |   "xusr": false
2025-11-27 07:33:35.451387 | controller | }
2025-11-27 07:33:35.467248 | 
2025-11-27 07:33:35.467328 | TASK [Copy crio stats log file]
2025-11-27 07:33:35.491983 | controller | skipping: Conditional result was False
2025-11-27 07:33:35.497538 | 
2025-11-27 07:33:35.497623 | TASK [Get SELinux related data]
2025-11-27 07:33:35.518977 | [controller] Waiting on logger
2025-11-27 07:33:45.906416 | [controller] Waiting on logger
2025-11-27 07:33:55.287358 | [controller] Waiting on logger
2025-11-27 07:34:05.682227 | [controller] Waiting on logger
2025-11-27 07:34:05.791596 | [Zuul] Log Stream did not terminate
2025-11-27 07:34:05.791971 | controller | ERROR
2025-11-27 07:34:05.792117 | controller | {
2025-11-27 07:34:05.792155 | controller |   "delta": "0:00:00.008840",
2025-11-27 07:34:05.792179 | controller |   "end": "2025-11-27 07:33:35.770171",
2025-11-27 07:34:05.792201 | controller |   "msg": "non-zero return code",
2025-11-27 07:34:05.792220 | controller |   "rc": 1,
2025-11-27 07:34:05.792238 | controller |   "start": "2025-11-27 07:33:35.761331"
2025-11-27 07:34:05.792257 | controller | }
2025-11-27 07:34:05.792285 | controller | ERROR: Ignoring Errors
2025-11-27 07:34:05.798149 | 
2025-11-27 07:34:05.798224 | TASK [Create system configuration directory]
2025-11-27 07:34:06.051841 | controller | changed
2025-11-27 07:34:06.057313 | 
2025-11-27 07:34:06.057393 | TASK [Get some of the system configurations]
2025-11-27 07:34:11.085430 | controller | changed
2025-11-27 07:34:11.092059 | 
2025-11-27 07:34:11.092138 | TASK [Copy generated documentation if available]
2025-11-27 07:34:11.117948 | controller | skipping: Conditional result was False
2025-11-27 07:34:11.124037 | 
2025-11-27 07:34:11.124110 | TASK [Copy generated AsciiDoc documentation if available]
2025-11-27 07:34:11.149550 | controller | skipping: Conditional result was False
2025-11-27 07:34:11.155389 | 
2025-11-27 07:34:11.155460 | TASK [Compress logs bigger than 2MB]
2025-11-27 07:34:16.114443 | [controller] Waiting on logger
2025-11-27 07:34:16.183487 | controller | changed
2025-11-27 07:34:16.189973 | 
2025-11-27 07:34:16.190047 | TASK [Copy files from workspace on node]
2025-11-27 07:34:16.212890 | controller | ok
2025-11-27 07:34:16.238445 | 
2025-11-27 07:34:16.238566 | TASK [fetch-output : Set log path for multiple nodes]
2025-11-27 07:34:16.263110 | controller | skipping: Conditional result was False
2025-11-27 07:34:16.269277 | 
2025-11-27 07:34:16.269361 | TASK [fetch-output : Set log path for single node]
2025-11-27 07:34:16.299064 | controller | ok
2025-11-27 07:34:16.304023 | 
2025-11-27 07:34:16.304093 | LOOP [fetch-output : Ensure local output dirs]
2025-11-27 07:34:16.512848 | controller -> localhost | ok: "/var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/logs"
2025-11-27 07:34:16.513254 | controller -> localhost | changed: All items complete
2025-11-27 07:34:16.513292 | 
2025-11-27 07:34:16.701609 | controller -> localhost | changed: "/var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/artifacts"
2025-11-27 07:34:16.887138 | controller -> localhost | changed: "/var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/docs"
2025-11-27 07:34:16.902937 | 
2025-11-27 07:34:16.903073 | LOOP [fetch-output : Collect logs, artifacts and docs]
2025-11-27 07:34:17.569169 | controller | changed:
2025-11-27 07:34:17.569432 | controller | .d..t...... ./
2025-11-27 07:34:17.569462 | controller | >f+++++++++ README.html
2025-11-27 07:34:17.569484 | controller | >f+++++++++ ansible-execution.log
2025-11-27 07:34:17.569505 | controller | >f+++++++++ ansible.log
2025-11-27 07:34:17.569523 | controller | >f+++++++++ crc-setup.log
2025-11-27 07:34:17.569540 | controller | >f+++++++++ crc-start.log
2025-11-27 07:34:17.569555 | controller | >f+++++++++ dmesg.log
2025-11-27 07:34:17.569570 | controller | >f+++++++++ installed-pkgs.log
2025-11-27 07:34:17.569585 | controller | >f+++++++++ python.log
2025-11-27 07:34:17.569600 | controller | >f+++++++++ registries.conf
2025-11-27 07:34:17.569615 | controller | >f+++++++++ report.html
2025-11-27 07:34:17.569629 | controller | >f+++++++++ selinux-denials.log
2025-11-27 07:34:17.569644 | controller | >f+++++++++ selinux-listing.log
2025-11-27 07:34:17.569658 | controller | cd+++++++++ ci-framework-data/
2025-11-27 07:34:17.569673 | controller | cd+++++++++ ci-framework-data/artifacts/
2025-11-27 07:34:17.569689 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2025-11-27 07:34:17.569717 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2025-11-27 07:34:17.569734 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf
2025-11-27 07:34:17.569749 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2025-11-27 07:34:17.569764 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf
2025-11-27 07:34:17.569778 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2025-11-27 07:34:17.569793 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2025-11-27 07:34:17.569807 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2025-11-27 07:34:17.569821 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2025-11-27 07:34:17.569835 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2025-11-27 07:34:17.569849 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2025-11-27 07:34:17.569863 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2025-11-27 07:34:17.569877 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2025-11-27 07:34:17.569891 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:32:ed:0e
2025-11-27 07:34:17.569906 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:27:ea:27
2025-11-27 07:34:17.569958 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:8d:98:0e
2025-11-27 07:34:17.569987 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:88:d4:1c
2025-11-27 07:34:17.570013 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:bc:00:60
2025-11-27 07:34:17.570036 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:ec:c6:01
2025-11-27 07:34:17.570058 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2025-11-27 07:34:17.570258 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2025-11-27 07:34:17.570296 | controller | cd+++++++++ ci-framework-data/logs/
2025-11-27 07:34:17.570317 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2025-11-27 07:34:17.570335 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2025-11-27 07:34:17.570352 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log
2025-11-27 07:34:17.570369 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2025-11-27 07:34:17.570384 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2025-11-27 07:34:17.570399 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml
2025-11-27 07:34:17.570416 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2025-11-27 07:34:17.570430 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/
2025-11-27 07:34:17.570444 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd
2025-11-27 07:34:17.570459 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf
2025-11-27 07:34:17.570474 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts
2025-11-27 07:34:17.570490 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2025-11-27 07:34:17.570508 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml
2025-11-27 07:34:17.570523 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2025-11-27 07:34:17.570538 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml
2025-11-27 07:34:17.570552 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml
2025-11-27 07:34:17.570566 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/
2025-11-27 07:34:17.570580 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt
2025-11-27 07:34:17.570595 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2025-11-27 07:34:17.570610 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd
2025-11-27 07:34:17.570625 | controller | cd+++++++++ registries.conf.d/
2025-11-27 07:34:17.570640 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2025-11-27 07:34:17.570654 | controller | cd+++++++++ system-config/
2025-11-27 07:34:17.570669 | controller | cd+++++++++ system-config/libvirt/
2025-11-27 07:34:17.570683 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2025-11-27 07:34:17.570697 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2025-11-27 07:34:17.570730 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2025-11-27 07:34:17.570746 | controller | >f+++++++++ system-config/libvirt/network.conf
2025-11-27 07:34:17.570760 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2025-11-27 07:34:17.570775 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2025-11-27 07:34:17.570788 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2025-11-27 07:34:17.570802 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2025-11-27 07:34:17.570816 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2025-11-27 07:34:17.570830 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2025-11-27 07:34:17.570844 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2025-11-27 07:34:17.570858 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2025-11-27 07:34:17.570876 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2025-11-27 07:34:17.570891 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2025-11-27 07:34:17.570905 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2025-11-27 07:34:17.570945 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2025-11-27 07:34:18.020968 | controller | changed: .d..t...... ./
2025-11-27 07:34:18.483350 | controller | changed: .d..t...... ./
2025-11-27 07:34:18.502860 | 
2025-11-27 07:34:18.503013 | TASK [Return artifact to Zuul]
2025-11-27 07:34:18.532656 | controller | ok
2025-11-27 07:34:18.552334 | 
2025-11-27 07:34:18.552437 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2025-11-27 07:34:18.552549 | 
2025-11-27 07:34:18.552576 | PLAY RECAP
2025-11-27 07:34:18.552617 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2025-11-27 07:34:18.552639 | 
2025-11-27 07:34:18.661907 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2025-11-27 07:34:18.662839 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2025-11-27 07:34:19.212278 | 
2025-11-27 07:34:19.212420 | PLAY [all]
2025-11-27 07:34:19.232050 | 
2025-11-27 07:34:19.232163 | TASK [include_role : fetch-output]
2025-11-27 07:34:19.262250 | controller | ok
2025-11-27 07:34:19.280682 | 
2025-11-27 07:34:19.280831 | TASK [fetch-output : Set log path for multiple nodes]
2025-11-27 07:34:19.326298 | controller | skipping: Conditional result was False
2025-11-27 07:34:19.337494 | 
2025-11-27 07:34:19.337651 | TASK [fetch-output : Set log path for single node]
2025-11-27 07:34:19.368450 | controller | ok
2025-11-27 07:34:19.373639 | 
2025-11-27 07:34:19.373743 | LOOP [fetch-output : Ensure local output dirs]
2025-11-27 07:34:19.722540 | controller -> localhost | ok: "/var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/logs"
2025-11-27 07:34:19.916391 | controller -> localhost | ok: "/var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/artifacts"
2025-11-27 07:34:20.117385 | controller -> localhost | ok: "/var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/docs"
2025-11-27 07:34:20.131222 | 
2025-11-27 07:34:20.131418 | LOOP [fetch-output : Collect logs, artifacts and docs]
2025-11-27 07:34:20.737863 | controller | ok
2025-11-27 07:34:20.746030 | controller | ok: All items complete
2025-11-27 07:34:20.746093 | 
2025-11-27 07:34:21.205600 | controller | ok
2025-11-27 07:34:21.677737 | controller | ok
2025-11-27 07:34:21.694282 | 
2025-11-27 07:34:21.694467 | TASK [include_role : fetch-output-openshift]
2025-11-27 07:34:21.721748 | controller | skipping: Conditional result was False
2025-11-27 07:34:21.729506 | 
2025-11-27 07:34:21.729615 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2025-11-27 07:34:22.121412 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.007420
2025-11-27 07:34:22.320603 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.007546
2025-11-27 07:34:22.351841 | 
2025-11-27 07:34:22.351990 | PLAY [all]
2025-11-27 07:34:22.366699 | 
2025-11-27 07:34:22.366800 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2025-11-27 07:34:22.824356 | controller | changed
2025-11-27 07:34:22.846313 | 
2025-11-27 07:34:22.846372 | PLAY RECAP
2025-11-27 07:34:22.846419 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2025-11-27 07:34:22.846442 | 
2025-11-27 07:34:22.929244 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2025-11-27 07:34:22.930006 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2025-11-27 07:34:23.519944 | 
2025-11-27 07:34:23.520095 | PLAY [localhost]
2025-11-27 07:34:23.537846 | 
2025-11-27 07:34:23.537962 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2025-11-27 07:34:23.886299 | localhost | changed
2025-11-27 07:34:23.891398 | 
2025-11-27 07:34:23.891508 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2025-11-27 07:34:23.920877 | localhost | ok
2025-11-27 07:34:23.929095 | 
2025-11-27 07:34:23.929182 | TASK [add-fileserver : Create SSH private key tempfile]
2025-11-27 07:34:24.293258 | localhost | changed
2025-11-27 07:34:24.299765 | 
2025-11-27 07:34:24.299854 | TASK [add-fileserver : Create SSH private key from secret]
2025-11-27 07:34:24.921023 | localhost | changed
2025-11-27 07:34:24.926020 | 
2025-11-27 07:34:24.926092 | TASK [add-fileserver : Add fileserver ssh key]
2025-11-27 07:34:25.313233 | localhost | Identity added: /var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/tmp/ansible.9ve8dpxf (/var/lib/zuul/builds/48e1f94789f64c23a07d45722489b7ff/work/tmp/ansible.9ve8dpxf)
2025-11-27 07:34:25.313458 | localhost | ok: Runtime: 0:00:00.015731
2025-11-27 07:34:25.318159 | 
2025-11-27 07:34:25.318238 | TASK [add-fileserver : Remove SSH private key from disk]
2025-11-27 07:34:25.572398 | localhost | ok: Runtime: 0:00:00.007156
2025-11-27 07:34:25.577446 | 
2025-11-27 07:34:25.577525 | TASK [add-fileserver : Add fileserver to inventory]
2025-11-27 07:34:25.639898 | localhost | changed
2025-11-27 07:34:25.644555 | 
2025-11-27 07:34:25.644648 | TASK [add-fileserver : Add fileserver server to known hosts]
2025-11-27 07:34:25.999157 | localhost | changed
2025-11-27 07:34:26.019865 | 
2025-11-27 07:34:26.019957 | PLAY [localhost]
2025-11-27 07:34:26.032171 | 
2025-11-27 07:34:26.032243 | TASK [Generate bulk log download script]
2025-11-27 07:34:26.052404 | localhost | ok
2025-11-27 07:34:26.065371 | 
2025-11-27 07:34:26.065452 | TASK [local-log-download : Check API endpoint is defined]
2025-11-27 07:34:26.105824 | localhost | ok: All assertions passed
2025-11-27 07:34:26.110734 | 
2025-11-27 07:34:26.110810 | TASK [local-log-download : Create download script]
2025-11-27 07:34:26.503202 | localhost -> localhost | changed
2025-11-27 07:34:26.512856 | 
2025-11-27 07:34:26.512991 | TASK [Register quick-download link]
2025-11-27 07:34:26.543111 | localhost | ok
2025-11-27 07:34:26.590477 | 
2025-11-27 07:34:26.590600 | PLAY [logserver.rdoproject.org]
2025-11-27 07:34:26.600552 | 
2025-11-27 07:34:26.600618 | TASK [Set zuul-log-path fact]
2025-11-27 07:34:26.619413 | logserver.rdoproject.org | ok
2025-11-27 07:34:26.629117 | 
2025-11-27 07:34:26.629186 | TASK [set-zuul-log-path-fact : Set log path for a build]
2025-11-27 07:34:26.657426 | logserver.rdoproject.org | ok
2025-11-27 07:34:26.664033 | 
2025-11-27 07:34:26.664105 | TASK [upload-logs : Create log directories]
2025-11-27 07:34:28.424651 | logserver.rdoproject.org | changed
2025-11-27 07:34:28.428191 | 
2025-11-27 07:34:28.428261 | TASK [upload-logs : Ensure logs are readable before uploading]
2025-11-27 07:34:28.686093 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.007035
2025-11-27 07:34:28.691611 | 
2025-11-27 07:34:28.691691 | TASK [upload-logs : Upload logs to log server]
2025-11-27 07:34:30.289425 | logserver.rdoproject.org | Output suppressed because no_log was given
2025-11-27 07:34:30.293114 | 
2025-11-27 07:34:30.293212 | LOOP [upload-logs : Compress console log and json output]
2025-11-27 07:34:30.338135 | logserver.rdoproject.org | skipping: Conditional result was False
2025-11-27 07:34:30.347275 | logserver.rdoproject.org | skipping: Conditional result was False
2025-11-27 07:34:30.352629 | 
2025-11-27 07:34:30.352766 | LOOP [upload-logs : Upload compressed console log and json output]
2025-11-27 07:34:30.392661 | logserver.rdoproject.org | skipping: Conditional result was False
2025-11-27 07:34:30.393027 | 
2025-11-27 07:34:30.395799 | logserver.rdoproject.org | skipping: Conditional result was False
2025-11-27 07:34:30.401239 | 
2025-11-27 07:34:30.401346 | LOOP [upload-logs : Upload console log and json output]