2026-03-19 14:41:39.020243 | Job console starting...
2026-03-19 14:41:39.231940 | Updating repositories
2026-03-19 14:41:39.945720 | Preparing job workspace
2026-03-19 14:41:47.391020 | Running Ansible setup...
2026-03-19 14:41:51.006031 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-19 14:41:51.497541 | 
2026-03-19 14:41:51.497668 | PLAY [localhost]
2026-03-19 14:41:51.505615 | 
2026-03-19 14:41:51.505680 | TASK [Gathering Facts]
2026-03-19 14:41:52.372995 | localhost | ok
2026-03-19 14:41:52.384808 | 
2026-03-19 14:41:52.384892 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-19 14:41:52.692338 | localhost -> localhost | changed
2026-03-19 14:41:52.697481 | 
2026-03-19 14:41:52.697560 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-19 14:41:53.422719 | localhost -> localhost | changed
2026-03-19 14:41:53.430412 | 
2026-03-19 14:41:53.430493 | TASK [Setup log path fact]
2026-03-19 14:41:53.453906 | localhost | ok
2026-03-19 14:41:53.465568 | 
2026-03-19 14:41:53.465640 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-19 14:41:53.493165 | localhost | ok
2026-03-19 14:41:53.499821 | 
2026-03-19 14:41:53.499885 | TASK [emit-job-header : Print job information]
2026-03-19 14:41:53.538102 | # Job Information
2026-03-19 14:41:53.538227 | Ansible Version: 2.15.12
2026-03-19 14:41:53.538253 | Job: cifmw-molecule-reproducer
2026-03-19 14:41:53.538272 | Pipeline: github-check
2026-03-19 14:41:53.538291 | Executor: ibm-bm4-ze.softwarefactory-project.io
2026-03-19 14:41:53.538328 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3783
2026-03-19 14:41:53.538348 | Log URL (when completed): https://logserver.rdoproject.org/10c/rdoproject.org/10c803c4da0540928516934696bea169/
2026-03-19 14:41:53.538364 | Event ID: 921e4480-23a1-11f1-92c8-d30e474fbd2e
2026-03-19 14:41:53.541794 | 
2026-03-19 14:41:53.541868 | LOOP [emit-job-header : Print node information]
2026-03-19 14:41:53.635529 | localhost | ok:
2026-03-19 14:41:53.635785 | localhost | # Node Information
2026-03-19 14:41:53.635814 | localhost | Inventory Hostname: controller
2026-03-19 14:41:53.635842 | localhost | Hostname: np0005652057
2026-03-19 14:41:53.635862 | localhost | Username: zuul
2026-03-19 14:41:53.635881 | localhost | Distro: CentOS 9
2026-03-19 14:41:53.635897 | localhost | Provider: ibm-bm4-nodepool
2026-03-19 14:41:53.635912 | localhost | Region: regionOne
2026-03-19 14:41:53.635926 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2026-03-19 14:41:53.635940 | localhost | Product Name: OpenStack Compute
2026-03-19 14:41:53.635954 | localhost | Interface IP: 192.168.26.210
2026-03-19 14:41:53.655231 | 
2026-03-19 14:41:53.655329 | PLAY [all]
2026-03-19 14:41:53.661550 | 
2026-03-19 14:41:53.661610 | TASK [Gather network facts]
2026-03-19 14:41:54.097494 | controller | ok
2026-03-19 14:41:54.110173 | 
2026-03-19 14:41:54.110239 | TASK [include_role : start-zuul-console]
2026-03-19 14:41:54.130103 | controller | ok
2026-03-19 14:41:54.140558 | 
2026-03-19 14:41:54.140619 | TASK [start-zuul-console : Start zuul_console daemon.]
2026-03-19 14:41:54.523500 | controller | ok
2026-03-19 14:41:54.531810 | 
2026-03-19 14:41:54.531877 | TASK [include_role : add-build-sshkey]
2026-03-19 14:41:54.559736 | controller | ok
2026-03-19 14:41:54.572135 | 
2026-03-19 14:41:54.572203 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-19 14:41:54.768636 | controller -> localhost | ok
2026-03-19 14:41:54.773530 | 
2026-03-19 14:41:54.773590 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-19 14:41:54.791315 | controller | ok
2026-03-19 14:41:54.802901 | controller | included: /var/lib/zuul/builds/10c803c4da0540928516934696bea169/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-19 14:41:54.807920 | 
2026-03-19 14:41:54.807981 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-19 14:41:55.154741 | controller -> localhost | Generating public/private rsa key pair.
2026-03-19 14:41:55.155005 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/10c803c4da0540928516934696bea169_id_rsa.
2026-03-19 14:41:55.155045 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/10c803c4da0540928516934696bea169_id_rsa.pub.
2026-03-19 14:41:55.155071 | controller -> localhost | The key fingerprint is:
2026-03-19 14:41:55.155101 | controller -> localhost | SHA256:i0lWhG4RTAQPk8QQkymJK9fvZJZmMczdcYZ7yPdFdmE zuul-build-sshkey
2026-03-19 14:41:55.155123 | controller -> localhost | The key's randomart image is:
2026-03-19 14:41:55.155142 | controller -> localhost | +---[RSA 3072]----+
2026-03-19 14:41:55.155159 | controller -> localhost | |..+B=*+o.  .   E.|
2026-03-19 14:41:55.155178 | controller -> localhost | |+ o.o++.  o o . +|
2026-03-19 14:41:55.155195 | controller -> localhost | | o . +.o.o *   o.|
2026-03-19 14:41:55.155212 | controller -> localhost | |o . . B.. = o   .|
2026-03-19 14:41:55.155229 | controller -> localhost | |..   oo+S  o . . |
2026-03-19 14:41:55.155246 | controller -> localhost | |     oOo .    .  |
2026-03-19 14:41:55.155264 | controller -> localhost | |     Bo .        |
2026-03-19 14:41:55.155285 | controller -> localhost | |      .          |
2026-03-19 14:41:55.155324 | controller -> localhost | |                 |
2026-03-19 14:41:55.155345 | controller -> localhost | +----[SHA256]-----+
2026-03-19 14:41:55.155392 | controller -> localhost | ok: Runtime: 0:00:00.036762
2026-03-19 14:41:55.160869 | 
2026-03-19 14:41:55.160941 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-19 14:41:55.178034 | controller | ok
2026-03-19 14:41:55.186632 | controller | included: /var/lib/zuul/builds/10c803c4da0540928516934696bea169/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-19 14:41:55.193661 | 
2026-03-19 14:41:55.193722 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-19 14:41:55.206628 | controller | skipping: Conditional result was False
2026-03-19 14:41:55.211434 | 
2026-03-19 14:41:55.211497 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-19 14:41:55.654225 | controller | changed
2026-03-19 14:41:55.658741 | 
2026-03-19 14:41:55.658803 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-19 14:41:55.930596 | controller | ok
2026-03-19 14:41:55.935225 | 
2026-03-19 14:41:55.935289 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-19 14:41:57.135273 | controller | changed
2026-03-19 14:41:57.140004 | 
2026-03-19 14:41:57.140071 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-19 14:41:58.309362 | controller | changed
2026-03-19 14:41:58.314094 | 
2026-03-19 14:41:58.314161 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-19 14:41:58.338635 | controller | skipping: Conditional result was False
2026-03-19 14:41:58.344277 | 
2026-03-19 14:41:58.344361 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-19 14:41:58.662983 | controller -> localhost | changed
2026-03-19 14:41:58.672489 | 
2026-03-19 14:41:58.672559 | TASK [add-build-sshkey : Add back temp key]
2026-03-19 14:41:58.889732 | controller -> localhost | Identity added: /var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/10c803c4da0540928516934696bea169_id_rsa (zuul-build-sshkey)
2026-03-19 14:41:58.889941 | controller -> localhost | ok: Runtime: 0:00:00.007092
2026-03-19 14:41:58.895327 | 
2026-03-19 14:41:58.895396 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-19 14:41:59.301360 | controller | ok
2026-03-19 14:41:59.305452 | 
2026-03-19 14:41:59.305516 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-19 14:41:59.330289 | controller | skipping: Conditional result was False
2026-03-19 14:41:59.338943 | 
2026-03-19 14:41:59.339006 | TASK [include_role : validate-host]
2026-03-19 14:41:59.355631 | controller | ok
2026-03-19 14:41:59.372457 | 
2026-03-19 14:41:59.372519 | TASK [validate-host : Define zuul_info_dir fact]
2026-03-19 14:41:59.399311 | controller | ok
2026-03-19 14:41:59.403322 | 
2026-03-19 14:41:59.403383 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2026-03-19 14:41:59.588126 | controller -> localhost | ok
2026-03-19 14:41:59.593157 | 
2026-03-19 14:41:59.593221 | TASK [validate-host : Collect information about the host]
2026-03-19 14:42:00.318851 | controller | ok
2026-03-19 14:42:00.326054 | 
2026-03-19 14:42:00.326130 | TASK [validate-host : Sanitize hostname]
2026-03-19 14:42:00.365555 | controller | ok
2026-03-19 14:42:00.370012 | 
2026-03-19 14:42:00.370077 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2026-03-19 14:42:00.738649 | controller -> localhost | changed
2026-03-19 14:42:00.743652 | 
2026-03-19 14:42:00.743724 | TASK [validate-host : Collect information about zuul worker]
2026-03-19 14:42:01.125497 | controller | ok
2026-03-19 14:42:01.130527 | 
2026-03-19 14:42:01.130597 | TASK [validate-host : Write out all zuul information for each host]
2026-03-19 14:42:01.478393 | controller -> localhost | changed
2026-03-19 14:42:01.487690 | 
2026-03-19 14:42:01.487758 | TASK [include_role : prepare-workspace-openshift]
2026-03-19 14:42:01.512223 | controller | skipping: Conditional result was False
2026-03-19 14:42:01.516834 | 
2026-03-19 14:42:01.516895 | TASK [include_role : remove-zuul-sshkey]
2026-03-19 14:42:01.541249 | controller | skipping: Conditional result was False
2026-03-19 14:42:01.546582 | 
2026-03-19 14:42:01.546648 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-19 14:42:01.819611 | controller | ok: "logs"
2026-03-19 14:42:01.819849 | controller | ok: All items complete
2026-03-19 14:42:01.819877 | 
2026-03-19 14:42:02.059167 | controller | ok: "artifacts"
2026-03-19 14:42:02.297443 | controller | ok: "docs"
2026-03-19 14:42:02.307483 | 
2026-03-19 14:42:02.307557 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-19 14:42:02.584683 | controller | changed: "logs"
2026-03-19 14:42:02.834926 | controller | changed: "artifacts"
2026-03-19 14:42:03.083587 | controller | changed: "docs"
2026-03-19 14:42:03.112512 | 
2026-03-19 14:42:03.112630 | PLAY RECAP
2026-03-19 14:42:03.112684 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-19 14:42:03.112716 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-19 14:42:03.112735 | 
2026-03-19 14:42:03.206494 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-19 14:42:03.207458 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-03-19 14:42:03.742850 | 
2026-03-19 14:42:03.742992 | PLAY [all]
2026-03-19 14:42:03.761435 | 
2026-03-19 14:42:03.761507 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-03-19 14:42:03.821218 | controller | ok
2026-03-19 14:42:03.825747 | 
2026-03-19 14:42:03.825823 | TASK [mirror-info-fork : Create /etc/ci]
2026-03-19 14:42:04.230874 | controller | changed
2026-03-19 14:42:04.236184 | 
2026-03-19 14:42:04.236253 | TASK [mirror-info-fork : Install ci_mirror script]
2026-03-19 14:42:05.563024 | controller | changed
2026-03-19 14:42:05.572599 | 
2026-03-19 14:42:05.572671 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2026-03-19 14:42:05.997112 | controller | changed:
2026-03-19 14:42:05.997286 | controller | {
2026-03-19 14:42:05.997334 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2026-03-19 14:42:05.997363 | controller | }
2026-03-19 14:42:06.310828 | controller | changed:
2026-03-19 14:42:06.310916 | controller | {
2026-03-19 14:42:06.310942 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2026-03-19 14:42:06.310961 | controller | }
2026-03-19 14:42:06.609962 | controller | changed:
2026-03-19 14:42:06.610058 | controller | {
2026-03-19 14:42:06.610095 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2026-03-19 14:42:06.610117 | controller | }
2026-03-19 14:42:06.896639 | controller | changed:
2026-03-19 14:42:06.896703 | controller | {
2026-03-19 14:42:06.896729 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2026-03-19 14:42:06.896749 | controller | }
2026-03-19 14:42:07.197270 | controller | changed:
2026-03-19 14:42:07.197360 | controller | {
2026-03-19 14:42:07.197386 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2026-03-19 14:42:07.197405 | controller | }
2026-03-19 14:42:07.490374 | controller | changed:
2026-03-19 14:42:07.490463 | controller | {
2026-03-19 14:42:07.490488 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2026-03-19 14:42:07.490507 | controller | }
2026-03-19 14:42:07.794284 | controller | changed:
2026-03-19 14:42:07.794455 | controller | {
2026-03-19 14:42:07.794482 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2026-03-19 14:42:07.794503 | controller | }
2026-03-19 14:42:08.090758 | controller | changed:
2026-03-19 14:42:08.090919 | controller | {
2026-03-19 14:42:08.090954 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2026-03-19 14:42:08.090977 | controller | }
2026-03-19 14:42:08.403557 | controller | changed:
2026-03-19 14:42:08.403658 | controller | {
2026-03-19 14:42:08.403683 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2026-03-19 14:42:08.403701 | controller | }
2026-03-19 14:42:08.712011 | controller | changed:
2026-03-19 14:42:08.712104 | controller | {
2026-03-19 14:42:08.712131 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2026-03-19 14:42:08.712151 | controller | }
2026-03-19 14:42:09.017191 | controller | changed:
2026-03-19 14:42:09.017291 | controller | {
2026-03-19 14:42:09.017339 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2026-03-19 14:42:09.017359 | controller | }
2026-03-19 14:42:09.314897 | controller | changed:
2026-03-19 14:42:09.314951 | controller | {
2026-03-19 14:42:09.314975 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2026-03-19 14:42:09.314994 | controller | }
2026-03-19 14:42:09.613982 | controller | changed:
2026-03-19 14:42:09.614092 | controller | {
2026-03-19 14:42:09.614118 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com"
2026-03-19 14:42:09.614139 | controller | }
2026-03-19 14:42:09.924076 | controller | changed:
2026-03-19 14:42:09.924223 | controller | {
2026-03-19 14:42:09.924254 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2026-03-19 14:42:09.924274 | controller | }
2026-03-19 14:42:10.216253 | controller | changed:
2026-03-19 14:42:10.216385 | controller | {
2026-03-19 14:42:10.216412 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2026-03-19 14:42:10.216431 | controller | }
2026-03-19 14:42:10.509177 | controller | changed:
2026-03-19 14:42:10.509276 | controller | {
2026-03-19 14:42:10.509321 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2026-03-19 14:42:10.509345 | controller | }
2026-03-19 14:42:10.801952 | controller | changed:
2026-03-19 14:42:10.802029 | controller | {
2026-03-19 14:42:10.802053 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2026-03-19 14:42:10.802073 | controller | }
2026-03-19 14:42:11.114692 | controller | changed:
2026-03-19 14:42:11.114751 | controller | {
2026-03-19 14:42:11.114781 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2026-03-19 14:42:11.114817 | controller | }
2026-03-19 14:42:11.397032 | controller | changed:
2026-03-19 14:42:11.397088 | controller | {
2026-03-19 14:42:11.397113 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2026-03-19 14:42:11.397131 | controller | }
2026-03-19 14:42:11.697233 | controller | changed:
2026-03-19 14:42:11.697291 | controller | {
2026-03-19 14:42:11.697348 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2026-03-19 14:42:11.697369 | controller | }
2026-03-19 14:42:11.996357 | controller | changed:
2026-03-19 14:42:11.996407 | controller | {
2026-03-19 14:42:11.996430 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2026-03-19 14:42:11.996448 | controller | }
2026-03-19 14:42:12.284385 | controller | changed:
2026-03-19 14:42:12.284434 | controller | {
2026-03-19 14:42:12.284457 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2026-03-19 14:42:12.284474 | controller | }
2026-03-19 14:42:12.583515 | controller | changed:
2026-03-19 14:42:12.583564 | controller | {
2026-03-19 14:42:12.583587 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2026-03-19 14:42:12.583605 | controller | }
2026-03-19 14:42:12.881608 | controller | changed:
2026-03-19 14:42:12.881651 | controller | {
2026-03-19 14:42:12.881673 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2026-03-19 14:42:12.881691 | controller | }
2026-03-19 14:42:13.194370 | controller | changed:
2026-03-19 14:42:13.194457 | controller | {
2026-03-19 14:42:13.194484 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2026-03-19 14:42:13.194503 | controller | }
2026-03-19 14:42:13.486969 | controller | changed:
2026-03-19 14:42:13.487014 | controller | {
2026-03-19 14:42:13.487036 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2026-03-19 14:42:13.487053 | controller | }
2026-03-19 14:42:13.502433 | 
2026-03-19 14:42:13.502491 | TASK [Set timezone to UTC]
2026-03-19 14:42:13.998198 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2026-03-19 14:42:14.002658 | 
2026-03-19 14:42:14.002718 | TASK [Create nodepool directory]
2026-03-19 14:42:14.285671 | controller | changed
2026-03-19 14:42:14.290851 | 
2026-03-19 14:42:14.290916 | TASK [Create nodepool sub_nodes file]
2026-03-19 14:42:15.305921 | controller | changed
2026-03-19 14:42:15.310822 | 
2026-03-19 14:42:15.310886 | TASK [Create nodepool sub_nodes_private file]
2026-03-19 14:42:16.287092 | controller | changed
2026-03-19 14:42:16.291839 | 
2026-03-19 14:42:16.291900 | LOOP [Populate nodepool sub_nodes file]
2026-03-19 14:42:16.320589 | 
2026-03-19 14:42:16.320701 | LOOP [Populate nodepool sub_nodes_private file]
2026-03-19 14:42:16.348968 | 
2026-03-19 14:42:16.349092 | TASK [Create nodepool primary file]
2026-03-19 14:42:16.372311 | controller | skipping: Conditional result was False
2026-03-19 14:42:16.377063 | 
2026-03-19 14:42:16.377135 | TASK [Create nodepool node_private for this node]
2026-03-19 14:42:17.375052 | controller | changed
2026-03-19 14:42:17.380486 | 
2026-03-19 14:42:17.380556 | LOOP [Copy ssh keys to nodepool directory]
2026-03-19 14:42:17.756533 | controller | ok: Item: id_rsa Runtime: 0:00:00.004804
2026-03-19 14:42:17.756822 | 
2026-03-19 14:42:17.972485 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005117
2026-03-19 14:42:17.979645 | 
2026-03-19 14:42:17.979733 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2026-03-19 14:42:18.995952 | controller | changed
2026-03-19 14:42:19.000767 | 
2026-03-19 14:42:19.000829 | TASK [Validate sudoers config after edits]
2026-03-19 14:42:19.277193 | controller | /etc/sudoers: parsed OK
2026-03-19 14:42:19.277254 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2026-03-19 14:42:19.277263 | controller | /etc/sudoers.d/zuul: parsed OK
2026-03-19 14:42:19.277268 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2026-03-19 14:42:19.528987 | controller | ok: Runtime: 0:00:00.005238
2026-03-19 14:42:19.534251 | 
2026-03-19 14:42:19.534320 | TASK [Show the environment passed in to job shell scripts]
2026-03-19 14:42:19.807061 | controller | SHELL=/bin/bash
2026-03-19 14:42:19.807111 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2026-03-19 14:42:19.807121 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2026-03-19 14:42:19.807190 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/83/3783/eb8d33b9cdc4a6ee90c6a78a02d04804bc384301
2026-03-19 14:42:19.807199 | controller | PWD=/home/zuul
2026-03-19 14:42:19.807205 | controller | ZUUL_PIPELINE=github-check
2026-03-19 14:42:19.807211 | controller | LOGNAME=zuul
2026-03-19 14:42:19.807217 | controller | XDG_SESSION_TYPE=tty
2026-03-19 14:42:19.807222 | controller | _=/usr/bin/env
2026-03-19 14:42:19.807228 | controller | MOTD_SHOWN=pam
2026-03-19 14:42:19.807233 | controller | HOME=/home/zuul
2026-03-19 14:42:19.807239 | controller | LANG=en_US.UTF-8
2026-03-19 14:42:19.807244 | controller | SSH_CONNECTION=192.168.26.12 57602 192.168.26.210 22
2026-03-19 14:42:19.807250 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2026-03-19 14:42:19.807259 | controller | ZUUL_CHANGE_IDS=3783,eb8d33b9cdc4a6ee90c6a78a02d04804bc384301
2026-03-19 14:42:19.807265 | controller | WORKSPACE=/home/zuul/workspace
2026-03-19 14:42:19.807271 | controller | XDG_SESSION_CLASS=user
2026-03-19 14:42:19.807277 | controller | SELINUX_ROLE_REQUESTED=
2026-03-19 14:42:19.807282 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2026-03-19 14:42:19.807288 | controller | USER=zuul
2026-03-19 14:42:19.807293 | controller | ZUUL_VOTING=True
2026-03-19 14:42:19.807299 | controller | BUILD_TIMEOUT=5400000
2026-03-19 14:42:19.807304 | controller | SELINUX_USE_CURRENT_RANGE=
2026-03-19 14:42:19.807309 | controller | SHLVL=1
2026-03-19 14:42:19.807315 | controller | ZUUL_PATCHSET=eb8d33b9cdc4a6ee90c6a78a02d04804bc384301
2026-03-19 14:42:19.807321 | controller | XDG_SESSION_ID=1
2026-03-19 14:42:19.807326 | controller | ZUUL_BRANCH=main
2026-03-19 14:42:19.807355 | controller | XDG_RUNTIME_DIR=/run/user/1000
2026-03-19 14:42:19.807365 | controller | SSH_CLIENT=192.168.26.12 57602 22
2026-03-19 14:42:19.807372 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2026-03-19 14:42:19.807378 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2026-03-19 14:42:19.807384 | controller | which_declare=declare -f
2026-03-19 14:42:19.807390 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2026-03-19 14:42:19.807396 | controller | SELINUX_LEVEL_REQUESTED=
2026-03-19 14:42:19.807402 | controller | ZUUL_CHANGE=3783
2026-03-19 14:42:19.807407 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2026-03-19 14:42:19.807412 | controller | ZUUL_UUID=10c803c4da0540928516934696bea169
2026-03-19 14:42:19.807418 | controller | BASH_FUNC_which%%=() {  ( alias;
2026-03-19 14:42:19.807424 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2026-03-19 14:42:19.807430 | controller | }
2026-03-19 14:42:20.058483 | controller | ok: Runtime: 0:00:00.005462
2026-03-19 14:42:20.063667 | 
2026-03-19 14:42:20.063726 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2026-03-19 14:42:20.078738 | controller | skipping: Conditional result was False
2026-03-19 14:42:20.084848 | 
2026-03-19 14:42:20.084914 | TASK [Symlink /home/zuul-worker/workspace]
2026-03-19 14:42:20.641123 | controller | skipping: Conditional result was False
2026-03-19 14:42:20.646533 | 
2026-03-19 14:42:20.646596 | TASK [Ensure legacy workspace directory]
2026-03-19 14:42:20.909579 | controller | changed
2026-03-19 14:42:20.927721 | 
2026-03-19 14:42:20.927800 | PLAY RECAP
2026-03-19 14:42:20.927850 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-19 14:42:20.927872 | 
2026-03-19 14:42:21.016973 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-03-19 14:42:21.018855 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-03-19 14:42:21.490753 | 
2026-03-19 14:42:21.490859 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2026-03-19 14:42:21.509484 | 
2026-03-19 14:42:21.509562 | TASK [Create zuul-output directory]
2026-03-19 14:42:21.884241 | controller | changed
2026-03-19 14:42:21.889266 | 
2026-03-19 14:42:21.889368 | TASK [Slurp Zuul inventory test]
2026-03-19 14:42:22.156546 | controller -> localhost | ok
2026-03-19 14:42:22.163447 | 
2026-03-19 14:42:22.163530 | TASK [Save zuul inventory]
2026-03-19 14:42:23.437215 | controller | changed
2026-03-19 14:42:23.442745 | 
2026-03-19 14:42:23.442813 | TASK [Save zuul vars without the change_message]
2026-03-19 14:42:24.548856 | controller | changed
2026-03-19 14:42:24.566774 | 
2026-03-19 14:42:24.566830 | PLAY RECAP
2026-03-19 14:42:24.566877 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-19 14:42:24.566900 | 
2026-03-19 14:42:24.634620 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-03-19 14:42:24.635518 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-03-19 14:42:25.148553 | 
2026-03-19 14:42:25.148662 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2026-03-19 14:42:25.167425 | 
2026-03-19 14:42:25.167497 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2026-03-19 14:42:25.186539 | controller | ok
2026-03-19 14:42:25.201771 | 
2026-03-19 14:42:25.201849 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-03-19 14:42:25.225565 | controller | skipping: Conditional result was False
2026-03-19 14:42:25.230953 | 
2026-03-19 14:42:25.231018 | TASK [mirror-info-fork : Create /etc/ci]
2026-03-19 14:42:25.625981 | controller | ok
2026-03-19 14:42:25.631658 | 
2026-03-19 14:42:25.631726 | TASK [mirror-info-fork : Install ci_mirror script]
2026-03-19 14:42:26.660655 | controller | ok
2026-03-19 14:42:26.669900 | 
2026-03-19 14:42:26.669966 | TASK [Prepare workspace]
2026-03-19 14:42:26.687836 | controller | ok
2026-03-19 14:42:26.703821 | 
2026-03-19 14:42:26.703890 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-19 14:42:27.078127 | controller | ok
2026-03-19 14:42:27.083892 | 
2026-03-19 14:42:27.083959 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-19 14:42:29.532793 | controller | Output suppressed because no_log was given
2026-03-19 14:42:29.541268 | 
2026-03-19 14:42:29.541341 | LOOP [Create zuul-output directory]
2026-03-19 14:42:29.806550 | controller | changed: "/home/zuul/ci-framework-data/logs"
2026-03-19 14:42:30.041753 | controller | ok: "/home/zuul/zuul-output/logs"
2026-03-19 14:42:30.048241 | 
2026-03-19 14:42:30.048353 | TASK [Install required packages]
2026-03-19 14:42:47.706829 | controller | ok: Nothing to do
2026-03-19 14:42:47.711407 | 
2026-03-19 14:42:47.711489 | TASK [Install venv]
2026-03-19 14:43:46.751464 | controller | changed
2026-03-19 14:43:46.797660 | 
2026-03-19 14:43:46.797740 | PLAY RECAP
2026-03-19 14:43:46.797779 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-19 14:43:46.797801 | 
2026-03-19 14:43:46.856289 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-03-19 14:43:46.857167 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-03-19 14:43:47.331483 | 
2026-03-19 14:43:47.331604 | PLAY [Run ci/playbooks/molecule-test.yml]
2026-03-19 14:43:47.350139 | 
2026-03-19 14:43:47.350209 | TASK [Gather required facts]
2026-03-19 14:43:47.887599 | controller | ok
2026-03-19 14:43:47.892291 | 
2026-03-19 14:43:47.892374 | TASK [Load environment var if instructed to]
2026-03-19 14:43:47.916008 | controller | skipping: Conditional result was False
2026-03-19 14:43:47.920933 | 
2026-03-19 14:43:47.920994 | TASK [Ensure group_vars dir exists]
2026-03-19 14:43:48.295057 | controller | ok
2026-03-19 14:43:48.299627 | 
2026-03-19 14:43:48.299686 | TASK [Print related variables]
2026-03-19 14:43:48.327705 | controller | ok:
2026-03-19 14:43:48.327810 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml
2026-03-19 14:43:48.327838 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer
2026-03-19 14:43:48.332071 | 
2026-03-19 14:43:48.332131 | TASK [Run molecule]
2026-03-19 14:43:49.368782 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2026-03-19 14:43:49.632256 | controller | INFO     Performing prerun with role_name_check=0...
2026-03-19 14:44:06.862464 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.862591 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.862893 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.862914 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.863330 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+27b616e1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+27b616e1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.863737 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.864127 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.864532 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.864910 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.869039 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.869465 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.869864 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.870261 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.870675 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.871069 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-19 14:44:06.883002 | controller | INFO     Running crc_layout > prepare
2026-03-19 14:44:07.547925 | controller |
2026-03-19 14:44:07.548040 | controller | PLAY [Prepare] *****************************************************************
2026-03-19 14:44:07.548049 | controller |
2026-03-19 14:44:07.548057 | controller | TASK [Gathering Facts] *********************************************************
2026-03-19 14:44:07.548157 | controller | Thursday 19 March 2026  14:44:07 +0000 (0:00:00.019)       0:00:00.019 ********
2026-03-19 14:44:08.441084 | controller | ok: [instance]
2026-03-19 14:44:08.441145 | controller |
2026-03-19 14:44:08.441158 | controller | TASK [Create custom basedir] ***************************************************
2026-03-19 14:44:08.441210 | controller | Thursday 19 March 2026  14:44:08 +0000 (0:00:00.893)       0:00:00.912 ********
2026-03-19 14:44:08.758477 | controller | changed: [instance]
2026-03-19 14:44:08.758538 | controller |
2026-03-19 14:44:08.758640 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2026-03-19 14:44:08.758741 | controller | Thursday 19 March 2026  14:44:08 +0000 (0:00:00.317)       0:00:01.230 ********
2026-03-19 14:44:08.779800 | controller | skipping: [instance]
2026-03-19 14:44:08.779970 | controller |
2026-03-19 14:44:08.780145 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2026-03-19 14:44:08.780262 | controller | Thursday 19 March 2026  14:44:08 +0000 (0:00:00.021)       0:00:01.252 ********
2026-03-19 14:44:08.825314 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2026-03-19 14:44:08.825424 | controller |
2026-03-19 14:44:08.825537 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2026-03-19 14:44:08.825652 | controller | Thursday 19 March 2026  14:44:08 +0000 (0:00:00.045)       0:00:01.297 ********
2026-03-19 14:44:09.135154 | controller | ok: [instance]
2026-03-19 14:44:09.135257 | controller |
2026-03-19 14:44:09.135268 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2026-03-19 14:44:09.135277 | controller | Thursday 19 March 2026  14:44:09 +0000 (0:00:00.309)       0:00:01.606 ********
2026-03-19 14:44:09.363164 | controller | ok: [instance]
2026-03-19 14:44:09.363255 | controller |
2026-03-19 14:44:09.363385 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2026-03-19 14:44:09.363498 | controller | Thursday 19 March 2026  14:44:09 +0000 (0:00:00.228)       0:00:01.835 ********
2026-03-19 14:44:10.154055 | controller | ok: [instance] => (item=ubi-9-appstream)
2026-03-19 14:44:10.154106 | controller | ok: [instance] => (item=ubi-9-baseos)
2026-03-19 14:44:10.154205 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2026-03-19 14:44:10.154304 | controller |
2026-03-19 14:44:10.154454 | controller | TASK [Deploy repo-setup] *******************************************************
2026-03-19 14:44:10.154557 | controller | Thursday 19 March 2026  14:44:10 +0000 (0:00:00.790)       0:00:02.625 ********
2026-03-19 14:44:10.217185 | controller |
2026-03-19 14:44:10.217217 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-03-19 14:44:10.217371 | controller | Thursday 19 March 2026  14:44:10 +0000 (0:00:00.063)       0:00:02.689 ********
2026-03-19 14:44:10.788061 | controller | changed: [instance] => (item=tmp)
2026-03-19 14:44:10.788107 | controller | changed: [instance] => (item=artifacts/repositories)
2026-03-19 14:44:10.788206 | controller | changed: [instance] => (item=venv/repo_setup)
2026-03-19 14:44:10.788287 | controller |
2026-03-19 14:44:10.788384 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-03-19 14:44:10.788484 | controller | Thursday 19 March 2026  14:44:10 +0000 (0:00:00.569)       0:00:03.259 ********
2026-03-19 14:44:11.692186 | controller | ok: [instance]
2026-03-19 14:44:11.692275 | controller |
2026-03-19 14:44:11.692479 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-03-19 14:44:11.692542 | controller | Thursday 19 March 2026  14:44:11 +0000 (0:00:00.904)       0:00:04.163 ********
2026-03-19 14:44:12.788351 | controller | changed: [instance]
2026-03-19 14:44:20.356159 | controller |
2026-03-19 14:44:20.356207 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-03-19 14:44:20.356216 | controller | Thursday 19 March 2026  14:44:12 +0000 (0:00:01.096)       0:00:05.259 ********
2026-03-19 14:44:20.356227 | controller | changed: [instance]
2026-03-19 14:44:21.097289 | controller |
2026-03-19 14:44:21.097329 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-03-19 14:44:21.097358 | controller | Thursday 19 March 2026  14:44:20 +0000 (0:00:07.567)       0:00:12.827 ********
2026-03-19 14:44:21.097371 | controller | changed: [instance]
2026-03-19 14:44:21.122273 | controller |
2026-03-19 14:44:21.122291 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-03-19 14:44:21.122299 | controller | Thursday 19 March 2026  14:44:21 +0000 (0:00:00.740)       0:00:13.568 ********
2026-03-19 14:44:21.122308 | controller | skipping: [instance]
2026-03-19 14:44:21.932736 | controller |
2026-03-19 14:44:21.932775 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-03-19 14:44:21.932784 | controller | Thursday 19 March 2026  14:44:21 +0000 (0:00:00.025)       0:00:13.594 ********
2026-03-19 14:44:21.932795 | controller | changed: [instance]
2026-03-19 14:44:21.970822 | controller |
2026-03-19 14:44:21.970841 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-03-19 14:44:21.970847 | controller | Thursday 19 March 2026  14:44:21 +0000 (0:00:00.809)       0:00:14.404 ********
2026-03-19 14:44:21.970855 | controller | skipping: [instance]
2026-03-19 14:44:22.010435 | controller |
2026-03-19 14:44:22.010485 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-03-19 14:44:22.010495 | controller | Thursday 19 March 2026  14:44:21 +0000 (0:00:00.038)       0:00:14.442 ********
2026-03-19 14:44:22.010508 | controller | skipping: [instance]
2026-03-19 14:44:22.010538 | controller |
2026-03-19 14:44:22.010554 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-03-19 14:44:22.010649 | controller | Thursday 19 March 2026  14:44:22 +0000 (0:00:00.039)       0:00:14.482 ********
2026-03-19 14:44:22.046469 | controller | skipping: [instance]
2026-03-19 14:44:22.988857 | controller |
2026-03-19 14:44:22.988885 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-03-19 14:44:22.988893 | controller | Thursday 19 March 2026  14:44:22 +0000 (0:00:00.036)       0:00:14.518 ********
2026-03-19 14:44:22.988903 | controller | changed: [instance]
2026-03-19 14:44:23.438013 | controller |
2026-03-19 14:44:23.438037 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-03-19 14:44:23.438045 | controller | Thursday 19 March 2026  14:44:22 +0000 (0:00:00.942)       0:00:15.460 ********
2026-03-19 14:44:23.438054 | controller | changed: [instance]
2026-03-19 14:44:23.470084 | controller |
2026-03-19 14:44:23.470106 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-03-19 14:44:23.470116 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.449)       0:00:15.910 ********
2026-03-19 14:44:23.470126 | controller | skipping: [instance]
2026-03-19 14:44:23.500469 | controller |
2026-03-19 14:44:23.500518 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-03-19 14:44:23.500529 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.031)       0:00:15.942 ********
2026-03-19 14:44:23.500548 | controller | skipping: [instance]
2026-03-19 14:44:23.531537 | controller |
2026-03-19 14:44:23.531583 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-03-19 14:44:23.531593 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.030)       0:00:15.972 ********
2026-03-19 14:44:23.531607 | controller | skipping: [instance]
2026-03-19 14:44:23.531695 | controller |
2026-03-19 14:44:23.531728 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-03-19 14:44:23.531746 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.030)       0:00:16.003 ********
2026-03-19 14:44:23.570503 | controller | ok: [instance]
2026-03-19 14:44:23.570879 | controller |
2026-03-19 14:44:23.570911 | controller | TASK [repo_setup : Create download directory] **********************************
2026-03-19 14:44:23.600445 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.039)       0:00:16.042 ********
2026-03-19 14:44:23.600497 | controller | skipping: [instance]
2026-03-19 14:44:23.600717 | controller |
2026-03-19 14:44:23.600741 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-03-19 14:44:23.628244 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.030)       0:00:16.072 ********
2026-03-19 14:44:23.628270 | controller | skipping: [instance]
2026-03-19 14:44:23.628469 | controller |
2026-03-19 14:44:23.628638 | controller | TASK [Download the RPM] ********************************************************
2026-03-19 14:44:23.628797 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.028)       0:00:16.100 ********
2026-03-19 14:44:23.657623 | controller | skipping: [instance]
2026-03-19 14:44:23.657802 | controller |
2026-03-19 14:44:23.657966 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-03-19 14:44:23.658104 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.029)       0:00:16.130 ********
2026-03-19 14:44:23.686230 | controller | skipping: [instance]
2026-03-19 14:44:23.686440 | controller |
2026-03-19 14:44:23.686614 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-03-19 14:44:23.686772 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.028)       0:00:16.158 ********
2026-03-19 14:44:23.713439 | controller | skipping: [instance]
2026-03-19 14:44:23.713585 | controller |
2026-03-19 14:44:23.713783 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-03-19 14:44:23.713969 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.027)       0:00:16.185 ********
2026-03-19 14:44:23.741611 | controller | skipping: [instance]
2026-03-19 14:44:23.741816 | controller |
2026-03-19 14:44:23.742010 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-03-19 14:44:23.742193 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.028)       0:00:16.213 ********
2026-03-19 14:44:23.768325 | controller | skipping: [instance]
2026-03-19 14:44:23.768515 | controller |
2026-03-19 14:44:23.768678 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-03-19 14:44:23.768782 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.026)       0:00:16.240 ********
2026-03-19 14:44:23.959273 | controller | ok: [instance]
2026-03-19 14:44:24.185481 | controller |
2026-03-19 14:44:24.185531 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-03-19 14:44:24.185545 | controller | Thursday 19 March 2026  14:44:23 +0000 (0:00:00.190)       0:00:16.431 ********
2026-03-19 14:44:24.185563 | controller | changed: [instance]
2026-03-19 14:44:24.429544 | controller |
2026-03-19 14:44:24.429601 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-03-19 14:44:24.429611 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.225)       0:00:16.657 ********
2026-03-19 14:44:24.429625 | controller | changed: [instance]
2026-03-19 14:44:24.458113 | controller |
2026-03-19 14:44:24.458138 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-03-19 14:44:24.458148 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.243)       0:00:16.901 ********
2026-03-19 14:44:24.458160 | controller | skipping: [instance]
2026-03-19 14:44:24.484467 | controller |
2026-03-19 14:44:24.484505 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-03-19 14:44:24.484518 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.029)       0:00:16.930 ********
2026-03-19 14:44:24.484535 | controller | skipping: [instance]
2026-03-19 14:44:24.484780 | controller |
2026-03-19 14:44:24.484795 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-03-19 14:44:24.510157 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.026)       0:00:16.956 ********
2026-03-19 14:44:24.510175 | controller | skipping: [instance]
2026-03-19 14:44:24.533847 | controller |
2026-03-19 14:44:24.533868 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-03-19 14:44:24.533875 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.025)       0:00:16.982 ********
2026-03-19 14:44:24.533883 | controller | skipping: [instance]
2026-03-19 14:44:24.558949 | controller |
2026-03-19 14:44:24.558965 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-03-19 14:44:24.558978 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.023)       0:00:17.005 ********
2026-03-19 14:44:24.558987 | controller | skipping: [instance]
2026-03-19 14:44:24.582911 | controller |
2026-03-19 14:44:24.582926 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-03-19 14:44:24.582932 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.024)       0:00:17.030 ********
2026-03-19 14:44:24.582940 | controller | skipping: [instance]
2026-03-19 14:44:24.600717 | controller |
2026-03-19 14:44:24.600734 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-03-19 14:44:24.600740 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.024)       0:00:17.055 ********
2026-03-19 14:44:24.600749 | controller | skipping: [instance]
2026-03-19 14:44:24.600881 | controller |
2026-03-19 14:44:24.601019 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-03-19 14:44:24.601152 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.018)       0:00:17.073 ********
2026-03-19 14:44:24.629962 | controller | skipping: [instance]
2026-03-19 14:44:24.649908 | controller |
2026-03-19 14:44:24.649951 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-03-19 14:44:24.649959 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.029)       0:00:17.102 ********
2026-03-19 14:44:24.649971 | controller | skipping: [instance]
2026-03-19 14:44:24.671933 | controller |
2026-03-19 14:44:24.671959 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-03-19 14:44:24.671971 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.019)       0:00:17.121 ********
2026-03-19 14:44:24.671984 | controller | skipping: [instance]
2026-03-19 14:44:24.704160 | controller |
2026-03-19 14:44:24.704179 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2026-03-19 14:44:24.704187 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.021)       0:00:17.143 ********
2026-03-19 14:44:24.704196 | controller | skipping: [instance]
2026-03-19 14:44:24.734430 | controller |
2026-03-19 14:44:24.734472 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2026-03-19 14:44:24.734481 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.032)       0:00:17.176 ********
2026-03-19 14:44:24.734492 | controller | skipping: [instance]
2026-03-19 14:44:24.734521 | controller |
2026-03-19 14:44:24.734544 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2026-03-19 14:44:24.734664 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.030)       0:00:17.206 ********
2026-03-19 14:44:24.764484 | controller | skipping: [instance]
2026-03-19 14:44:24.764742 | controller |
2026-03-19 14:44:24.799822 | controller | TASK [test_deps : Install additional packages] *********************************
2026-03-19 14:44:24.799844 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.030)       0:00:17.236 ********
2026-03-19 14:44:24.799857 | controller | skipping: [instance]
2026-03-19 14:44:24.800022 | controller |
2026-03-19 14:44:24.800186 | controller | TASK [test_deps : Install selinux python libs] *********************************
2026-03-19 14:44:24.800374 | controller | Thursday 19 March 2026  14:44:24 +0000 (0:00:00.035)       0:00:17.272 ********
2026-03-19 14:45:08.362297 | controller | ok: [instance]
2026-03-19 14:45:09.627475 | controller |
2026-03-19 14:45:09.627541 | controller | TASK [test_deps : Install python yaml libs] ************************************
2026-03-19 14:45:09.627557 | controller | Thursday 19 March 2026  14:45:08 +0000 (0:00:43.560)       0:01:00.833 ********
2026-03-19 14:45:09.627580 | controller | ok: [instance]
2026-03-19 14:45:09.627646 | controller |
2026-03-19 14:45:09.666068 | controller | TASK [test_deps : Install extra packages] **************************************
2026-03-19 14:45:09.666107 | controller | Thursday 19 March 2026  14:45:09 +0000 (0:00:01.266)       0:01:02.099 ********
2026-03-19 14:45:09.666119 | controller | skipping: [instance]
2026-03-19 14:45:09.714533 | controller |
2026-03-19 14:45:09.714571 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-03-19 14:45:09.714586 | controller | Thursday 19 March 2026  14:45:09 +0000 (0:00:00.038)       0:01:02.138 ********
2026-03-19 14:45:09.714603 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2026-03-19 14:45:09.739569 | controller |
2026-03-19 14:45:09.739604 | controller | TASK [ci_setup : List packages to install] *************************************
2026-03-19 14:45:09.739618 | controller | Thursday 19 March 2026  14:45:09 +0000 (0:00:00.048)       0:01:02.186 ********
2026-03-19 14:45:09.739646 | controller | ok: [instance] =>
2026-03-19 14:45:09.739693 | controller |   cifmw_ci_setup_packages:
2026-03-19 14:45:09.739705 | controller |   - bash-completion
2026-03-19 14:45:09.739715 | controller |   - ca-certificates
2026-03-19 14:45:09.739725 | controller |   - git-core
2026-03-19 14:45:09.739735 | controller |   - make
2026-03-19 14:45:09.739745 | controller |   - tar
2026-03-19 14:45:09.739757 | controller |   - tmux
2026-03-19 14:45:09.739795 | controller |   - python3-pip
2026-03-19 14:45:09.740003 | controller |
2026-03-19 14:45:09.740031 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-03-19 14:45:14.832062 | controller | Thursday 19 March 2026  14:45:09 +0000 (0:00:00.024)       0:01:02.211 ********
2026-03-19 14:45:14.832110 | controller | changed: [instance]
2026-03-19 14:45:15.435808 | controller |
2026-03-19 14:45:15.435845 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-03-19 14:45:15.435854 | controller | Thursday 19 March 2026  14:45:14 +0000 (0:00:05.092)       0:01:07.303 ********
2026-03-19 14:45:15.435865 | controller | ok: [instance]
2026-03-19 14:45:15.654527 | controller |
2026-03-19 14:45:15.654568 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-03-19 14:45:15.654579 | controller | Thursday 19 March 2026  14:45:15 +0000 (0:00:00.603)       0:01:07.907 ********
2026-03-19 14:45:15.654593 | controller | changed: [instance]
2026-03-19 14:45:20.708724 | controller |
2026-03-19 14:45:20.708766 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-03-19 14:45:20.708774 | controller | Thursday 19 March 2026  14:45:15 +0000 (0:00:00.218)       0:01:08.126 ********
2026-03-19 14:45:20.708785 | controller | changed: [instance]
2026-03-19 14:45:20.744886 | controller |
2026-03-19 14:45:20.744916 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-03-19 14:45:20.744926 | controller | Thursday 19 March 2026  14:45:20 +0000 (0:00:05.050)       0:01:13.177 ********
2026-03-19 14:45:20.744938 | controller | ok: [instance]
2026-03-19 14:45:21.046267 | controller |
2026-03-19 14:45:21.046302 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-03-19 14:45:21.046312 | controller | Thursday 19 March 2026  14:45:20 +0000 (0:00:00.039)       0:01:13.216 ********
2026-03-19 14:45:21.046325 | controller | changed: [instance]
2026-03-19 14:45:21.351380 | controller |
2026-03-19 14:45:21.351421 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-03-19 14:45:21.351429 | controller | Thursday 19 March 2026  14:45:21 +0000 (0:00:00.301)       0:01:13.518 ********
2026-03-19 14:45:21.351440 | controller | changed: [instance]
2026-03-19 14:45:21.372432 | controller |
2026-03-19 14:45:21.372467 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-03-19 14:45:21.372475 | controller | Thursday 19 March 2026  14:45:21 +0000 (0:00:00.305)       0:01:13.823 ********
2026-03-19 14:45:21.372486 | controller | skipping: [instance]
2026-03-19 14:45:21.393110 | controller |
2026-03-19 14:45:21.393136 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-03-19 14:45:21.393145 | controller | Thursday 19 March 2026  14:45:21 +0000 (0:00:00.021)       0:01:13.844 ********
2026-03-19 14:45:21.393156 | controller | skipping: [instance]
2026-03-19 14:45:21.413510 | controller |
2026-03-19 14:45:21.413543 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-03-19 14:45:21.413557 | controller | Thursday 19 March 2026  14:45:21 +0000 (0:00:00.020)       0:01:13.865 ********
2026-03-19 14:45:21.413572 | controller | skipping: [instance]
2026-03-19 14:45:21.435481 | controller |
2026-03-19 14:45:21.435544 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-03-19 14:45:21.435558 | controller | Thursday 19 March 2026  14:45:21 +0000 (0:00:00.020)       0:01:13.885 ********
2026-03-19 14:45:21.435579 | controller | skipping: [instance]
2026-03-19 14:45:21.454809 | controller |
2026-03-19 14:45:21.454849 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-03-19 14:45:21.454872 | controller | Thursday 19 March 2026  14:45:21 +0000 (0:00:00.022)       0:01:13.907 ********
2026-03-19 14:45:21.454886 | controller | skipping: [instance]
2026-03-19 14:45:21.454982 | controller |
2026-03-19 14:45:21.455222 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-03-19 14:45:21.455453 | controller | Thursday 19 March 2026  14:45:21 +0000 (0:00:00.019)       0:01:13.927 ********
2026-03-19 14:45:21.478472 | controller | skipping: [instance]
2026-03-19 14:45:21.478655 | controller |
2026-03-19 14:45:21.478742 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-03-19 14:45:21.478849 | controller | Thursday 19 March 2026  14:45:21 +0000 (0:00:00.023)       0:01:13.950 ********
2026-03-19 14:45:22.499383 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2026-03-19 14:45:22.856485 | controller | changed: [instance] => (item=/opt/basedir/logs)
2026-03-19 14:45:22.856526 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2026-03-19 14:45:22.856534 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2026-03-19 14:45:22.856541 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2026-03-19 14:45:22.856547 | controller |
2026-03-19 14:45:22.856553 | controller | TASK [Create secret file] ******************************************************
2026-03-19 14:45:22.856560 | controller | Thursday 19 March 2026  14:45:22 +0000 (0:00:01.019)       0:01:14.970 ********
2026-03-19 14:45:22.856571 | controller | changed: [instance]
2026-03-19 14:45:22.856601 | controller |
2026-03-19 14:45:22.856608 | controller | PLAY RECAP *********************************************************************
2026-03-19 14:45:22.856615 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2026-03-19 14:45:22.856621 | controller |
2026-03-19 14:45:22.856633 | controller | Thursday 19 March 2026  14:45:22 +0000 (0:00:00.357)       0:01:15.327 ********
2026-03-19 14:45:22.856639 | controller | ===============================================================================
2026-03-19 14:45:22.856644 | controller | test_deps : Install selinux python libs -------------------------------- 43.56s
2026-03-19 14:45:22.856650 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.57s
2026-03-19 14:45:22.856656 | controller | ci_setup : Install needed packages -------------------------------------- 5.09s
2026-03-19 14:45:22.856663 | controller | ci_setup : Install openshift client ------------------------------------- 5.05s
2026-03-19 14:45:22.856686 | controller | test_deps : Install python yaml libs ------------------------------------ 1.27s
2026-03-19 14:45:22.856694 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.10s
2026-03-19 14:45:22.858078 | controller | ci_setup : Manage directories ------------------------------------------- 1.02s
2026-03-19 14:45:22.932118 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.94s
2026-03-19 14:45:22.932142 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.90s
2026-03-19 14:45:22.932149 | controller | Gathering Facts --------------------------------------------------------- 0.89s
2026-03-19 14:45:22.932154 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.81s
2026-03-19 14:45:22.932159 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.79s
2026-03-19 14:45:22.932164 | controller | repo_setup : Install repo-setup package --------------------------------- 0.74s
2026-03-19 14:45:22.932169 | controller | ci_setup : Gather version of openshift client --------------------------- 0.60s
2026-03-19 14:45:22.932174 | controller | repo_setup : Ensure directories are present ----------------------------- 0.57s
2026-03-19 14:45:22.932179 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.45s
2026-03-19 14:45:22.932184 | controller | Create secret file ------------------------------------------------------ 0.36s
2026-03-19 14:45:22.932189 | controller | Create custom basedir --------------------------------------------------- 0.32s
2026-03-19 14:45:22.932193 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.31s
2026-03-19 14:45:22.932204 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.31s
2026-03-19 14:45:22.932214 | controller | INFO     Running crc_layout > converge
2026-03-19 14:45:23.495267 | controller |
2026-03-19 14:45:23.495489 | controller | PLAY [Converge] ****************************************************************
2026-03-19 14:45:23.495613 | controller |
2026-03-19 14:45:23.495740 | controller | TASK [Gathering Facts] *********************************************************
2026-03-19 14:45:23.495859 | controller | Thursday 19 March 2026  14:45:23 +0000 (0:00:00.025)       0:00:00.025 ********
2026-03-19 14:45:24.320434 | controller | ok: [instance]
2026-03-19 14:45:24.320492 | controller |
2026-03-19 14:45:24.320502 | controller | TASK [Load networking definition from scenario file] ***************************
2026-03-19 14:45:24.320672 | controller | Thursday 19 March 2026  14:45:24 +0000 (0:00:00.825)       0:00:00.850 ********
2026-03-19 14:45:24.343542 | controller | ok: [instance]
2026-03-19 14:45:24.363899 | controller |
2026-03-19 14:45:24.363927 | controller | TASK [discover_latest_image : Set the discovered images dict to empty] *********
2026-03-19 14:45:24.363936 | controller | Thursday 19 March 2026  14:45:24 +0000 (0:00:00.022)       0:00:00.873 ********
2026-03-19 14:45:24.363947 | controller | ok: [instance]
2026-03-19 14:45:24.405174 | controller |
2026-03-19 14:45:24.405191 | controller | TASK [discover_latest_image : Discover images] *********************************
2026-03-19 14:45:24.405198 | controller | Thursday 19 March 2026  14:45:24 +0000 (0:00:00.020)       0:00:00.894 ********
2026-03-19 14:45:24.405217 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/discover_latest_image/tasks/per-image.yml for instance => (item={'key': 'default', 'value': {'base_url': 'https://cloud.centos.org/centos/9-stream/x86_64/images/', 'qcow_prefix': 'CentOS-Stream-GenericCloud-', 'images_file': 'CHECKSUM'}})
2026-03-19 14:45:24.449509 | controller |
2026-03-19 14:45:24.449540 | controller | TASK [discover_latest_image : Ensure the current image dict entry has the expected data] ***
2026-03-19 14:45:24.449551 | controller | Thursday 19 March 2026  14:45:24 +0000 (0:00:00.041)       0:00:00.935 ********
2026-03-19 14:45:24.449564 | controller | ok: [instance] => changed=false
2026-03-19 14:45:26.084272 | controller |   msg: All assertions passed
2026-03-19 14:45:26.084318 | controller |
2026-03-19 14:45:26.084326 | controller | TASK [discover_latest_image : Get latest image for the current entry] **********
2026-03-19 14:45:26.084352 | controller | Thursday 19 March 2026  14:45:24 +0000 (0:00:00.044)       0:00:00.979 ********
2026-03-19 14:45:26.084366 | controller | changed: [instance]
2026-03-19 14:45:26.117526 | controller |
2026-03-19 14:45:26.117569 | controller | TASK [discover_latest_image : Append the current return value to the discovered images dict] ***
2026-03-19 14:45:26.117579 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:01.634)       0:00:02.613 ********
2026-03-19 14:45:26.117591 | controller | ok: [instance]
2026-03-19 14:45:26.117610 | controller |
2026-03-19 14:45:26.117618 | controller | TASK [discover_latest_image : Export single-image facts if an image with name 'default' was discovered] ***
2026-03-19 14:45:26.118028 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:00.034)       0:00:02.648 ********
2026-03-19 14:45:26.151909 | controller | ok: [instance]
2026-03-19 14:45:26.175664 | controller |
2026-03-19 14:45:26.175733 | controller | TASK [reproducer : Load CI job environment] ************************************
2026-03-19 14:45:26.175748 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:00.034)       0:00:02.682 ********
2026-03-19 14:45:26.175767 | controller | skipping: [instance]
2026-03-19 14:45:26.228174 | controller |
2026-03-19 14:45:26.228212 | controller | TASK [Build final libvirt layout] **********************************************
2026-03-19 14:45:26.228226 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:00.023)       0:00:02.705 ********
2026-03-19 14:45:26.228243 | controller |
2026-03-19 14:45:26.308805 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2026-03-19 14:45:26.308824 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:00.052)       0:00:02.758 ********
2026-03-19 14:45:26.308835 | controller | ok: [instance]
2026-03-19 14:45:26.377990 | controller |
2026-03-19 14:45:26.378012 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2026-03-19 14:45:26.378021 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:00.080)       0:00:02.839 ********
2026-03-19 14:45:26.378060 | controller | skipping: [instance]
2026-03-19 14:45:26.378231 | controller |
2026-03-19 14:45:26.378426 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2026-03-19 14:45:26.378592 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:00.069)       0:00:02.908 ********
2026-03-19 14:45:26.406953 | controller | ok: [instance]
2026-03-19 14:45:26.407136 | controller |
2026-03-19 14:45:26.407275 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2026-03-19 14:45:26.407434 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:00.029)       0:00:02.937 ********
2026-03-19 14:45:26.439660 | controller | ok: [instance] => changed=false
2026-03-19 14:45:26.439828 | controller |   msg: All assertions passed
2026-03-19 14:45:26.439951 | controller |
2026-03-19 14:45:26.440094 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2026-03-19 14:45:26.440230 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:00.032)       0:00:02.970 ********
2026-03-19 14:45:26.488246 | controller | ok: [instance]
2026-03-19 14:45:26.488454 | controller |
2026-03-19 14:45:26.488640 | controller | TASK [reproducer : Ensure directories are present] *****************************
2026-03-19 14:45:26.488798 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:00.048)       0:00:03.018 ********
2026-03-19 14:45:26.975362 | controller | ok: [instance] => (item=artifacts)
2026-03-19 14:45:27.067612 | controller | ok: [instance] => (item=logs)
2026-03-19 14:45:27.067632 | controller |
2026-03-19 14:45:27.067640 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2026-03-19 14:45:27.067646 | controller | Thursday 19 March 2026  14:45:26 +0000 (0:00:00.486)       0:00:03.505 ********
2026-03-19 14:45:27.067655 | controller |
2026-03-19 14:45:27.261320 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2026-03-19 14:45:27.261364 | controller | Thursday 19 March 2026  14:45:27 +0000 (0:00:00.092)       0:00:03.598 ********
2026-03-19 14:45:27.261376 | controller | ok: [instance]
2026-03-19 14:45:27.558278 | controller |
2026-03-19 14:45:27.558300 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2026-03-19 14:45:27.558307 | controller | Thursday 19 March 2026  14:45:27 +0000 (0:00:00.193)       0:00:03.791 ********
2026-03-19 14:45:27.558316 | controller | changed: [instance]
2026-03-19 14:45:27.860102 | controller |
2026-03-19 14:45:27.860137 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2026-03-19 14:45:27.860152 | controller | Thursday 19 March 2026  14:45:27 +0000 (0:00:00.296)       0:00:04.088 ********
2026-03-19 14:45:27.860168 | controller | ok: [instance]
2026-03-19 14:45:27.892706 | controller |
2026-03-19 14:45:27.892723 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2026-03-19 14:45:27.892730 | controller | Thursday 19 March 2026  14:45:27 +0000 (0:00:00.301)       0:00:04.390 ********
2026-03-19 14:45:27.892745 | controller | skipping: [instance]
2026-03-19 14:45:27.914485 | controller |
2026-03-19 14:45:27.914537 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2026-03-19 14:45:27.914547 | controller | Thursday 19 March 2026  14:45:27 +0000 (0:00:00.032)       0:00:04.423 ********
2026-03-19 14:45:27.914560 | controller | skipping: [instance]
2026-03-19 14:45:27.914591 | controller |
2026-03-19 14:45:27.914602 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2026-03-19 14:45:27.914788 | controller | Thursday 19 March 2026  14:45:27 +0000 (0:00:00.021)       0:00:04.444 ********
2026-03-19 14:45:27.938412 | controller | ok: [instance]
2026-03-19 14:45:27.974004 | controller |
2026-03-19 14:45:27.974041 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2026-03-19 14:45:27.974076 | controller | Thursday 19 March 2026  14:45:27 +0000 (0:00:00.024)       0:00:04.468 ********
2026-03-19 14:45:27.974093 | controller | skipping: [instance]
2026-03-19 14:45:38.041379 | controller |
2026-03-19 14:45:38.041427 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2026-03-19 14:45:38.041437 | controller | Thursday 19 March 2026  14:45:27 +0000 (0:00:00.035)       0:00:04.504 ********
2026-03-19 14:45:38.041448 | controller | changed: [instance]
2026-03-19 14:45:38.041481 | controller |
2026-03-19 14:45:38.041490 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2026-03-19 14:45:38.041518 | controller | Thursday 19 March 2026  14:45:38 +0000 (0:00:10.066)       0:00:14.571 ********
2026-03-19 14:45:38.275238 | controller | changed: [instance]
2026-03-19 14:45:38.801995 | controller |
2026-03-19 14:45:38.802040 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2026-03-19 14:45:38.802058 | controller | Thursday 19 March 2026  14:45:38 +0000 (0:00:00.233)       0:00:14.804 ********
2026-03-19 14:45:38.802071 | controller | changed: [instance]
2026-03-19 14:45:38.802108 | controller |
2026-03-19 14:45:38.802118 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2026-03-19 14:45:39.457193 | controller | Thursday 19 March 2026  14:45:38 +0000 (0:00:00.527)       0:00:15.331 ********
2026-03-19 14:45:39.457245 | controller | changed: [instance]
2026-03-19 14:45:39.665588 | controller |
2026-03-19 14:45:39.665628 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2026-03-19 14:45:39.665638 | controller | Thursday 19 March 2026  14:45:39 +0000 (0:00:00.655)       0:00:15.987 ********
2026-03-19 14:45:39.665650 | controller | ok: [instance]
2026-03-19 14:45:39.665758 | controller |
2026-03-19 14:45:39.665793 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2026-03-19 14:45:39.665812 | controller | Thursday 19 March 2026  14:45:39 +0000 (0:00:00.208)       0:00:16.195 ********
2026-03-19 14:45:40.373072 | controller | ok: [instance]
2026-03-19 14:45:41.199065 | controller |
2026-03-19 14:45:41.199104 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2026-03-19 14:45:41.199113 | controller | Thursday 19 March 2026  14:45:40 +0000 (0:00:00.707)       0:00:16.903 ********
2026-03-19 14:45:41.199125 | controller | changed: [instance]
2026-03-19 14:45:41.288536 | controller |
2026-03-19 14:45:41.288607 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2026-03-19 14:45:41.288619 | controller | Thursday 19 March 2026  14:45:41 +0000 (0:00:00.825)       0:00:17.729 ********
2026-03-19 14:45:41.288639 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2026-03-19 14:45:41.288685 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2026-03-19 14:45:41.288694 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2026-03-19 14:45:41.288702 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2026-03-19 14:45:41.288710 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2026-03-19 14:45:41.288718 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2026-03-19 14:45:41.288728 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2026-03-19 14:45:41.288914 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2026-03-19 14:45:41.288946 | controller |
2026-03-19 14:45:41.288959 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2026-03-19 14:45:41.633510 | controller | Thursday 19 March 2026  14:45:41 +0000 (0:00:00.089)       0:00:17.818 ********
2026-03-19 14:45:41.633568 | controller | ok: [instance]
2026-03-19 14:45:41.971192 | controller |
2026-03-19 14:45:41.971220 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2026-03-19 14:45:41.971228 | controller | Thursday 19 March 2026  14:45:41 +0000 (0:00:00.345)       0:00:18.163 ********
2026-03-19 14:45:41.971237 | controller | ok: [instance]
2026-03-19 14:45:42.312169 | controller |
2026-03-19 14:45:42.312191 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2026-03-19 14:45:42.312206 | controller | Thursday 19 March 2026  14:45:41 +0000 (0:00:00.337)       0:00:18.501 ********
2026-03-19 14:45:42.312216 | controller | ok: [instance]
2026-03-19 14:45:42.645527 | controller |
2026-03-19 14:45:42.645581 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2026-03-19 14:45:42.645594 | controller | Thursday 19 March 2026  14:45:42 +0000 (0:00:00.340)       0:00:18.842 ********
2026-03-19 14:45:42.645610 | controller | ok: [instance]
2026-03-19 14:45:42.645646 | controller |
2026-03-19 14:45:42.645658 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2026-03-19 14:45:42.645703 | controller | Thursday 19 March 2026  14:45:42 +0000 (0:00:00.333)       0:00:19.175 ********
2026-03-19 14:45:42.983306 | controller | ok: [instance]
2026-03-19 14:45:43.325534 | controller |
2026-03-19 14:45:43.325581 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2026-03-19 14:45:43.325591 | controller | Thursday 19 March 2026  14:45:42 +0000 (0:00:00.337)       0:00:19.513 ********
2026-03-19 14:45:43.325605 | controller | ok: [instance]
2026-03-19 14:45:43.325639 | controller |
2026-03-19 14:45:43.325649 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2026-03-19 14:45:43.667083 | controller | Thursday 19 March 2026  14:45:43 +0000 (0:00:00.342)       0:00:19.855 ********
2026-03-19 14:45:43.667114 | controller | ok: [instance]
2026-03-19 14:45:44.007130 | controller |
2026-03-19 14:45:44.007154 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2026-03-19 14:45:44.007162 | controller | Thursday 19 March 2026  14:45:43 +0000 (0:00:00.341)       0:00:20.197 ********
2026-03-19 14:45:44.007172 | controller | ok: [instance]
2026-03-19 14:45:44.347243 | controller |
2026-03-19 14:45:44.347266 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2026-03-19 14:45:44.347274 | controller | Thursday 19 March 2026  14:45:44 +0000 (0:00:00.339)       0:00:20.537 ********
2026-03-19 14:45:44.347283 | controller | ok: [instance]
2026-03-19 14:45:44.681742 | controller |
2026-03-19 14:45:44.681762 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2026-03-19 14:45:44.681769 | controller | Thursday 19 March 2026  14:45:44 +0000 (0:00:00.340)       0:00:20.877 ********
2026-03-19 14:45:44.681778 | controller | ok: [instance]
2026-03-19 14:45:45.020327 | controller |
2026-03-19 14:45:45.020385 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2026-03-19 14:45:45.020393 | controller | Thursday 19 March 2026  14:45:44 +0000 (0:00:00.334)       0:00:21.212 ********
2026-03-19 14:45:45.020405 | controller | ok: [instance]
2026-03-19 14:45:45.387803 | controller |
2026-03-19 14:45:45.387844 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2026-03-19 14:45:45.387851 | controller | Thursday 19 March 2026  14:45:45 +0000 (0:00:00.338)       0:00:21.550 ********
2026-03-19 14:45:45.387863 | controller | ok: [instance]
2026-03-19 14:45:45.717459 | controller |
2026-03-19 14:45:45.717501 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2026-03-19 14:45:45.717516 | controller | Thursday 19 March 2026  14:45:45 +0000 (0:00:00.367)       0:00:21.918 ********
2026-03-19 14:45:45.717533 | controller | ok: [instance]
2026-03-19 14:45:45.717577 | controller |
2026-03-19 14:45:45.717591 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2026-03-19 14:45:46.053741 | controller | Thursday 19 March 2026  14:45:45 +0000 (0:00:00.329)       0:00:22.247 ********
2026-03-19 14:45:46.053797 | controller | ok: [instance]
2026-03-19 14:45:46.053819 | controller |
2026-03-19 14:45:46.054056 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2026-03-19 14:45:46.394501 | controller | Thursday 19 March 2026  14:45:46 +0000 (0:00:00.336)       0:00:22.584 ********
2026-03-19 14:45:46.394545 | controller | ok: [instance]
2026-03-19 14:45:46.731402 | controller |
2026-03-19 14:45:46.731438 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2026-03-19 14:45:46.731447 | controller | Thursday 19 March 2026  14:45:46 +0000 (0:00:00.340)       0:00:22.924 ********
2026-03-19 14:45:46.731458 | controller | ok: [instance]
2026-03-19 14:45:47.054418 | controller |
2026-03-19 14:45:47.054454 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2026-03-19 14:45:47.054472 | controller | Thursday 19 March 2026  14:45:46 +0000 (0:00:00.336)       0:00:23.261 ********
2026-03-19 14:45:47.054483 | controller | ok: [instance]
2026-03-19 14:45:47.054510 | controller |
2026-03-19 14:45:47.054743 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2026-03-19 14:45:47.373492 | controller | Thursday 19 March 2026  14:45:47 +0000 (0:00:00.323)       0:00:23.584 ********
2026-03-19 14:45:47.373543 | controller | ok: [instance]
2026-03-19 14:45:47.373575 | controller |
2026-03-19 14:45:47.373586 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2026-03-19 14:45:47.373717 | controller | Thursday 19 March 2026  14:45:47 +0000 (0:00:00.319)       0:00:23.903 ********
2026-03-19 14:45:47.709821 | controller | ok: [instance]
2026-03-19 14:45:48.029815 | controller |
2026-03-19 14:45:48.029848 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2026-03-19 14:45:48.029856 | controller | Thursday 19 March 2026  14:45:47 +0000 (0:00:00.336)       0:00:24.239 ********
2026-03-19 14:45:48.029875 | controller | ok: [instance]
2026-03-19 14:45:48.368104 | controller |
2026-03-19 14:45:48.368139 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2026-03-19 14:45:48.368148 | controller | Thursday 19 March 2026  14:45:48 +0000 (0:00:00.320)       0:00:24.560 ********
2026-03-19 14:45:48.368158 | controller | ok: [instance]
2026-03-19 14:45:48.720109 | controller |
2026-03-19 14:45:48.720154 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2026-03-19 14:45:48.720162 | controller | Thursday 19 March 2026  14:45:48 +0000 (0:00:00.338)       0:00:24.898 ********
2026-03-19 14:45:48.720174 | controller | ok: [instance]
2026-03-19 14:45:49.059859 | controller |
2026-03-19 14:45:49.059906 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2026-03-19 14:45:49.059918 | controller | Thursday 19 March 2026  14:45:48 +0000 (0:00:00.351)       0:00:25.250 ********
2026-03-19 14:45:49.059930 | controller | ok: [instance]
2026-03-19 14:45:49.393409 | controller |
2026-03-19 14:45:49.393447 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2026-03-19 14:45:49.393456 | controller | Thursday 19 March 2026  14:45:49 +0000 (0:00:00.339)       0:00:25.589 ********
2026-03-19 14:45:49.393468 | controller | ok: [instance]
2026-03-19 14:45:49.414993 | controller |
2026-03-19 14:45:49.415012 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2026-03-19 14:45:49.415020 | controller | Thursday 19 March 2026  14:45:49 +0000 (0:00:00.333)       0:00:25.923 ********
2026-03-19 14:45:49.415030 | controller | skipping: [instance]
2026-03-19 14:45:49.714505 | controller |
2026-03-19 14:45:49.714569 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2026-03-19 14:45:49.714584 | controller | Thursday 19 March 2026  14:45:49 +0000 (0:00:00.021)       0:00:25.945 ********
2026-03-19 14:45:49.714605 | controller | ok: [instance]
2026-03-19 14:45:50.108872 | controller |
2026-03-19 14:45:50.108918 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2026-03-19 14:45:50.108927 | controller | Thursday 19 March 2026  14:45:49 +0000 (0:00:00.299)       0:00:26.244 ********
2026-03-19 14:45:50.108938 | controller | ok: [instance]
2026-03-19 14:45:50.450854 | controller |
2026-03-19 14:45:50.450894 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2026-03-19 14:45:50.450905 | controller | Thursday 19 March 2026  14:45:50 +0000 (0:00:00.394)       0:00:26.638 ********
2026-03-19 14:45:50.450918 | controller | changed: [instance]
2026-03-19 14:45:50.731666 | controller |
2026-03-19 14:45:50.731698 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2026-03-19 14:45:50.731706 | controller | Thursday 19 March 2026  14:45:50 +0000 (0:00:00.341)       0:00:26.980 ********
2026-03-19 14:45:50.731716 | controller | [WARNING]: Reset is not implemented for this connection
2026-03-19 14:45:50.742514 | controller | changed: [instance]
2026-03-19 14:45:50.742574 | controller |
2026-03-19 14:45:50.742585 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2026-03-19 14:45:50.742594 | controller | Thursday 19 March 2026  14:45:50 +0000 (0:00:00.274)       0:00:27.255 ********
2026-03-19 14:45:50.742603 | controller |
2026-03-19 14:45:50.742617 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2026-03-19 14:45:50.742628 | controller | Thursday 19 March 2026  14:45:50 +0000 (0:00:00.016)       0:00:27.272 ********
2026-03-19 14:45:50.823151 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2026-03-19 14:45:50.869231 | controller |
2026-03-19 14:45:50.869257 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2026-03-19 14:45:50.869266 | controller | Thursday 19 March 2026  14:45:50 +0000 (0:00:00.080)       0:00:27.353 ********
2026-03-19 14:45:50.869276 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2026-03-19 14:45:50.921549 | controller |
2026-03-19 14:45:50.921605 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-19 14:45:50.921620 | controller | Thursday 19 March 2026  14:45:50 +0000 (0:00:00.046)       0:00:27.399 ********
2026-03-19 14:45:50.921638 | controller | ok: [instance] => (item=compute)
2026-03-19 14:45:50.968834 | controller | ok: [instance] => (item=controller)
2026-03-19 14:45:50.968864 | controller | ok: [instance] => (item=crc)
2026-03-19 14:45:50.968874 | controller |
2026-03-19 14:45:50.968882 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-19 14:45:50.968890 | controller | Thursday 19 March 2026  14:45:50 +0000 (0:00:00.052)       0:00:27.451 ********
2026-03-19 14:45:50.968901 | controller | ok: [instance]
2026-03-19 14:45:51.014562 | controller |
2026-03-19 14:45:51.014626 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-19 14:45:51.014636 | controller | Thursday 19 March 2026  14:45:50 +0000 (0:00:00.047)       0:00:27.499 ********
2026-03-19 14:45:51.014652 | controller | ok: [instance] => changed=false
2026-03-19 14:45:51.060927 | controller |   msg: All assertions passed
2026-03-19 14:45:51.060962 | controller |
2026-03-19 14:45:51.060973 | controller | TASK [Ensure we get latest OCP config] *****************************************
2026-03-19 14:45:51.060993 | controller | Thursday 19 March 2026  14:45:51 +0000 (0:00:00.045)       0:00:27.544 ********
2026-03-19 14:45:51.061006 | controller |
2026-03-19 14:45:51.144308 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2026-03-19 14:45:51.144357 | controller | Thursday 19 March 2026  14:45:51 +0000 (0:00:00.046)       0:00:27.591 ********
2026-03-19 14:45:51.144378 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.54', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2026-03-19 14:45:51.144572 | controller | ok: [instance] => (item={})
2026-03-19 14:45:51.144727 | controller |
2026-03-19 14:45:51.144872 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2026-03-19 14:45:51.144998 | controller | Thursday 19 March 2026  14:45:51 +0000 (0:00:00.083)       0:00:27.675 ********
2026-03-19 14:45:51.168401 | controller | skipping: [instance]
2026-03-19 14:45:51.168650 | controller |
2026-03-19 14:45:51.168888 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2026-03-19 14:45:51.169070 | controller | Thursday 19 March 2026  14:45:51 +0000 (0:00:00.023)       0:00:27.698 ********
2026-03-19 14:45:51.408508 | controller | ok: [instance]
2026-03-19 14:45:51.408581 | controller |
2026-03-19 14:45:51.408595 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2026-03-19 14:45:51.795100 | controller | Thursday 19 March 2026  14:45:51 +0000 (0:00:00.239)       0:00:27.938 ********
2026-03-19 14:45:51.795152 | controller | changed: [instance]
2026-03-19 14:45:52.585443 | controller |
2026-03-19 14:45:52.585486 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2026-03-19 14:45:52.585504 | controller | Thursday 19 March 2026  14:45:51 +0000 (0:00:00.386)       0:00:28.324 ********
2026-03-19 14:45:52.585516 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2026-03-19 14:45:52.617437 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2026-03-19 14:45:52.617499 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2026-03-19 14:45:52.617508 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2026-03-19 14:45:52.617516 | controller |
2026-03-19 14:45:52.617523 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2026-03-19 14:45:52.617530 | controller | Thursday 19 March 2026  14:45:52 +0000 (0:00:00.789)       0:00:29.114 ********
2026-03-19 14:45:52.617542 | controller | skipping: [instance]
2026-03-19 14:45:52.999496 | controller |
2026-03-19 14:45:52.999539 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2026-03-19 14:45:52.999548 | controller | Thursday 19 March 2026  14:45:52 +0000 (0:00:00.032)       0:00:29.147 ********
2026-03-19 14:45:52.999561 | controller | changed: [instance]
2026-03-19 14:45:52.999589 | controller |
2026-03-19 14:45:52.999599 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2026-03-19 14:45:53.000005 | controller | Thursday 19 March 2026  14:45:52 +0000 (0:00:00.373)       0:00:29.521 ********
2026-03-19 14:45:53.473504 | controller |
2026-03-19 14:45:53.473563 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-19 14:45:53.473571 | controller | Thursday 19 March 2026  14:45:52 +0000 (0:00:00.008)       0:00:29.529 ********
2026-03-19 14:45:53.473584 | controller | changed: [instance]
2026-03-19 14:45:53.554465 | controller |
2026-03-19 14:45:53.554517 | controller | TASK [Ensure no default networks exists] ***************************************
2026-03-19 14:45:53.554526 | controller | Thursday 19 March 2026  14:45:53 +0000 (0:00:00.473)       0:00:30.003 ********
2026-03-19 14:45:53.554540 | controller |
2026-03-19 14:45:54.884418 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2026-03-19 14:45:54.884459 | controller | Thursday 19 March 2026  14:45:53 +0000 (0:00:00.081)       0:00:30.084 ********
2026-03-19 14:45:54.884472 | controller | ok: [instance]
2026-03-19 14:45:55.133842 | controller |
2026-03-19 14:45:55.133869 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2026-03-19 14:45:55.133876 | controller | Thursday 19 March 2026  14:45:54 +0000 (0:00:01.330)       0:00:31.414 ********
2026-03-19 14:45:55.133886 | controller | ok: [instance]
2026-03-19 14:45:55.681256 | controller |
2026-03-19 14:45:55.681293 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2026-03-19 14:45:55.681301 | controller | Thursday 19 March 2026  14:45:55 +0000 (0:00:00.249)       0:00:31.664 ********
2026-03-19 14:45:55.681312 | controller | ok: [instance]
2026-03-19 14:45:55.928280 | controller |
2026-03-19 14:45:55.928313 | controller | TASK [libvirt_manager : Removing default] **************************************
2026-03-19 14:45:55.928325 | controller | Thursday 19 March 2026  14:45:55 +0000 (0:00:00.547)       0:00:32.211 ********
2026-03-19 14:45:55.928359 | controller | ok: [instance]
2026-03-19 14:45:57.163947 | controller |
2026-03-19 14:45:57.163984 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2026-03-19 14:45:57.163993 | controller | Thursday 19 March 2026  14:45:55 +0000 (0:00:00.247)       0:00:32.458 ********
2026-03-19 14:45:57.164003 | controller | ok: [instance]
2026-03-19 14:45:57.488381 | controller |
2026-03-19 14:45:57.488421 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2026-03-19 14:45:57.488431 | controller | Thursday 19 March 2026  14:45:57 +0000 (0:00:01.235)       0:00:33.693 ********
2026-03-19 14:45:57.488442 | controller | ok: [instance]
2026-03-19 14:45:57.816089 | controller |
2026-03-19 14:45:57.816126 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2026-03-19 14:45:57.816135 | controller | Thursday 19 March 2026  14:45:57 +0000 (0:00:00.324)       0:00:34.018 ********
2026-03-19 14:45:57.816145 | controller | changed: [instance]
2026-03-19 14:45:58.130890 | controller |
2026-03-19 14:45:58.130926 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2026-03-19 14:45:58.130941 | controller | Thursday 19 March 2026  14:45:57 +0000 (0:00:00.327)       0:00:34.346 ********
2026-03-19 14:45:58.130952 | controller | changed: [instance]
2026-03-19 14:45:58.730534 | controller |
2026-03-19 14:45:58.730589 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2026-03-19 14:45:58.730604 | controller | Thursday 19 March 2026  14:45:58 +0000 (0:00:00.314)       0:00:34.660 ********
2026-03-19 14:45:58.730622 | controller | changed: [instance] => (item=arptables)
2026-03-19 14:45:58.730702 | controller | changed: [instance] => (item=iptables)
2026-03-19 14:45:58.730738 | controller | changed: [instance] => (item=ip6tables)
2026-03-19 14:45:58.730745 | controller |
2026-03-19 14:45:58.730751 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2026-03-19 14:45:58.730762 | controller | Thursday 19 March 2026  14:45:58 +0000 (0:00:00.599)       0:00:35.260 ********
2026-03-19 14:45:59.062761 | controller | ok: [instance]
2026-03-19 14:45:59.153776 | controller |
2026-03-19 14:45:59.153810 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2026-03-19 14:45:59.153819 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.332)       0:00:35.592 ********
2026-03-19 14:45:59.153829 | controller | ok: [instance]
2026-03-19 14:45:59.200370 | controller |
2026-03-19 14:45:59.200397 | controller | TASK [Ensure the required network configurations are applied] ******************
2026-03-19 14:45:59.200405 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.091)       0:00:35.684 ********
2026-03-19 14:45:59.200422 | controller |
2026-03-19 14:45:59.231505 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2026-03-19 14:45:59.231577 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.046)       0:00:35.730 ********
2026-03-19 14:45:59.231599 | controller | skipping: [instance]
2026-03-19 14:45:59.258499 | controller |
2026-03-19 14:45:59.258528 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2026-03-19 14:45:59.258537 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.030)       0:00:35.761 ********
2026-03-19 14:45:59.258549 | controller | skipping: [instance]
2026-03-19 14:45:59.258585 | controller |
2026-03-19 14:45:59.258594 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-19 14:45:59.258676 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.027)       0:00:35.789 ********
2026-03-19 14:45:59.286647 | controller | skipping: [instance]
2026-03-19 14:45:59.320921 | controller |
2026-03-19 14:45:59.320944 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2026-03-19 14:45:59.320952 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.027)       0:00:35.817 ********
2026-03-19 14:45:59.320961 | controller | skipping: [instance]
2026-03-19 14:45:59.363773 | controller |
2026-03-19 14:45:59.363789 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2026-03-19 14:45:59.363796 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.034)       0:00:35.851 ********
2026-03-19 14:45:59.363804 | controller | ok: [instance]
2026-03-19 14:45:59.401146 | controller |
2026-03-19 14:45:59.401166 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2026-03-19 14:45:59.401175 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.042)       0:00:35.894 ********
2026-03-19 14:45:59.401185 | controller | skipping: [instance]
2026-03-19 14:45:59.427438 | controller |
2026-03-19 14:45:59.427474 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2026-03-19 14:45:59.427484 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.037)       0:00:35.931 ********
2026-03-19 14:45:59.427504 | controller | skipping: [instance]
2026-03-19 14:45:59.484620 | controller |
2026-03-19 14:45:59.484651 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2026-03-19 14:45:59.484661 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.026)       0:00:35.957 ********
2026-03-19 14:45:59.484672 | controller | ok: [instance]
2026-03-19 14:45:59.484758 | controller |
2026-03-19 14:45:59.484892 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2026-03-19 14:45:59.485020 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.057)       0:00:36.015 ********
2026-03-19 14:45:59.511481 | controller | skipping: [instance]
2026-03-19 14:45:59.511641 | controller |
2026-03-19 14:45:59.511803 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2026-03-19 14:45:59.511927 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.026)       0:00:36.042 ********
2026-03-19 14:45:59.564621 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2026-03-19 14:45:59.564780 | controller |
2026-03-19 14:45:59.564900 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-03-19 14:45:59.565011 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.052)       0:00:36.095 ********
2026-03-19 14:45:59.900444 | controller | ok: [instance -> localhost]
2026-03-19 14:45:59.900474 | controller |
2026-03-19 14:45:59.900483 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2026-03-19 14:45:59.900493 | controller | Thursday 19 March 2026  14:45:59 +0000 (0:00:00.335)       0:00:36.430 ********
2026-03-19 14:46:04.801079 | controller | changed: [instance -> localhost]
2026-03-19 14:46:05.018528 | controller |
2026-03-19 14:46:05.018588 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-03-19 14:46:05.018599 | controller | Thursday 19 March 2026  14:46:04 +0000 (0:00:04.900)       0:00:41.331 ********
2026-03-19 14:46:05.018624 | controller | changed: [instance]
2026-03-19 14:46:05.018652 | controller |
2026-03-19 14:46:05.018679 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2026-03-19 14:46:05.018689 | controller | Thursday 19 March 2026  14:46:05 +0000 (0:00:00.217)       0:00:41.548 ********
2026-03-19 14:46:05.387815 | controller | changed: [instance]
2026-03-19 14:46:05.387880 | controller |
2026-03-19 14:46:05.388144 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2026-03-19 14:46:07.061551 | controller | Thursday 19 March 2026  14:46:05 +0000 (0:00:00.368)       0:00:41.917 ********
2026-03-19 14:46:07.061610 | controller | changed: [instance -> localhost]
2026-03-19 14:46:07.061620 | controller |
2026-03-19 14:46:07.061629 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2026-03-19 14:46:07.440486 | controller | Thursday 19 March 2026  14:46:07 +0000 (0:00:01.674)       0:00:43.591 ********
2026-03-19 14:46:07.440542 | controller | changed: [instance]
2026-03-19 14:46:07.440581 | controller |
2026-03-19 14:46:07.440722 | controller | TASK [reproducer : Select right domain] ****************************************
2026-03-19 14:46:07.440759 | controller | Thursday 19 March 2026  14:46:07 +0000 (0:00:00.379)       0:00:43.970 ********
2026-03-19 14:46:07.474777 | controller | ok: [instance]
2026-03-19 14:46:07.632529 | controller |
2026-03-19 14:46:07.632564 | controller | TASK [Create the virtual networks] *********************************************
2026-03-19 14:46:07.632578 | controller | Thursday 19 March 2026  14:46:07 +0000 (0:00:00.033)       0:00:44.004 ********
2026-03-19 14:46:07.632595 | controller |
2026-03-19 14:46:07.653388 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2026-03-19 14:46:07.653409 | controller | Thursday 19 March 2026  14:46:07 +0000 (0:00:00.158)       0:00:44.162 ********
2026-03-19 14:46:07.653421 | controller | ok: [instance]
2026-03-19 14:46:07.864184 | controller |
2026-03-19 14:46:07.864206 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2026-03-19 14:46:07.864215 | controller | Thursday 19 March 2026  14:46:07 +0000 (0:00:00.021)       0:00:44.183 ********
2026-03-19 14:46:07.864225 | controller | ok: [instance]
2026-03-19 14:46:07.897487 | controller |
2026-03-19 14:46:07.897510 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2026-03-19 14:46:07.897520 | controller | Thursday 19 March 2026  14:46:07 +0000 (0:00:00.210)       0:00:44.394 ********
2026-03-19 14:46:07.897531 | controller | skipping: [instance]
2026-03-19 14:46:07.929137 | controller |
2026-03-19 14:46:07.929160 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2026-03-19 14:46:07.929168 | controller | Thursday 19 March 2026  14:46:07 +0000 (0:00:00.033)       0:00:44.427 ********
2026-03-19 14:46:07.929177 | controller | skipping: [instance]
2026-03-19 14:46:07.987066 | controller |
2026-03-19 14:46:07.987084 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2026-03-19 14:46:07.987100 | controller | Thursday 19 March 2026  14:46:07 +0000 (0:00:00.031)       0:00:44.459 ********
2026-03-19 14:46:07.987110 | controller | ok: [instance]
2026-03-19 14:46:08.116465 | controller |
2026-03-19 14:46:08.116500 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2026-03-19 14:46:08.116508 | controller | Thursday 19 March 2026  14:46:07 +0000 (0:00:00.057)       0:00:44.517 ********
2026-03-19 14:46:08.116520 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-19 14:46:08.116785 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-19 14:46:08.116794 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-19 14:46:08.116802 | controller |
2026-03-19 14:46:08.153415 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2026-03-19 14:46:08.153440 | controller | Thursday 19 March 2026  14:46:08 +0000 (0:00:00.129)       0:00:44.646 ********
2026-03-19 14:46:08.153452 | controller | skipping: [instance]
2026-03-19 14:46:08.525466 | controller |
2026-03-19 14:46:08.525508 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2026-03-19 14:46:08.525517 | controller | Thursday 19 March 2026  14:46:08 +0000 (0:00:00.037)       0:00:44.683 ********
2026-03-19 14:46:08.525529 | controller | changed: [instance]
2026-03-19 14:46:08.525630 | controller |
2026-03-19 14:46:08.525640 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2026-03-19 14:46:08.621056 | controller | Thursday 19 March 2026  14:46:08 +0000 (0:00:00.371)       0:00:45.055 ********
2026-03-19 14:46:08.621084 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes)
2026-03-19 14:46:08.680467 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers)
2026-03-19 14:46:08.680492 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps)
2026-03-19 14:46:08.680500 | controller |
2026-03-19 14:46:08.680506 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-19 14:46:08.680513 | controller | Thursday 19 March 2026  14:46:08 +0000 (0:00:00.095)       0:00:45.151 ********
2026-03-19 14:46:08.680522 | controller | changed: [instance]
2026-03-19 14:46:08.680541 | controller |
2026-03-19 14:46:08.680547 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-19 14:46:08.680555 | controller | Thursday 19 March 2026  14:46:08 +0000 (0:00:00.059)       0:00:45.210 ********
2026-03-19 14:46:09.023282 | controller | changed: [instance]
2026-03-19 14:46:09.250175 | controller |
2026-03-19 14:46:09.250208 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-19 14:46:09.250217 | controller | Thursday 19 March 2026  14:46:09 +0000 (0:00:00.342)       0:00:45.553 ********
2026-03-19 14:46:09.250228 | controller | changed: [instance]
2026-03-19 14:46:09.307189 | controller |
2026-03-19 14:46:09.307218 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-19 14:46:09.307227 | controller | Thursday 19 March 2026  14:46:09 +0000 (0:00:00.227)       0:00:45.780 ********
2026-03-19 14:46:09.307237 | controller | changed: [instance]
2026-03-19 14:46:09.511576 | controller |
2026-03-19 14:46:09.511657 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-19 14:46:09.511673 | controller | Thursday 19 March 2026  14:46:09 +0000 (0:00:00.057)       0:00:45.837 ********
2026-03-19 14:46:09.511695 | controller | changed: [instance]
2026-03-19 14:46:09.733528 | controller |
2026-03-19 14:46:09.733566 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-19 14:46:09.733579 | controller | Thursday 19 March 2026  14:46:09 +0000 (0:00:00.204)       0:00:46.041 ********
2026-03-19 14:46:09.733596 | controller | changed: [instance]
2026-03-19 14:46:09.733646 | controller |
2026-03-19 14:46:09.733672 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-19 14:46:09.792461 | controller | Thursday 19 March 2026  14:46:09 +0000 (0:00:00.221)       0:00:46.263 ********
2026-03-19 14:46:09.792524 | controller | changed: [instance]
2026-03-19 14:46:09.792552 | controller |
2026-03-19 14:46:09.792569 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-19 14:46:09.792586 | controller | Thursday 19 March 2026  14:46:09 +0000 (0:00:00.058)       0:00:46.322 ********
2026-03-19 14:46:10.001120 | controller | changed: [instance]
2026-03-19 14:46:10.227785 | controller |
2026-03-19 14:46:10.227834 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-19 14:46:10.227843 | controller | Thursday 19 March 2026  14:46:09 +0000 (0:00:00.208)       0:00:46.531 ********
2026-03-19 14:46:10.227854 | controller | changed: [instance]
2026-03-19 14:46:10.429900 | controller |
2026-03-19 14:46:10.429959 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ********************
2026-03-19 14:46:10.429969 | controller | Thursday 19 March 2026  14:46:10 +0000 (0:00:00.226)       0:00:46.757 ********
2026-03-19 14:46:10.429982 | controller | ok: [instance]
2026-03-19 14:46:10.931059 | controller |
2026-03-19 14:46:10.931105 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ******************
2026-03-19 14:46:10.931114 | controller | Thursday 19 March 2026  14:46:10 +0000 (0:00:00.201)       0:00:46.959 ********
2026-03-19 14:46:10.931133 | controller | changed: [instance]
2026-03-19 14:46:11.121509 | controller |
2026-03-19 14:46:11.121559 | controller | TASK [libvirt_manager : Remove ini file after conversion] **********************
2026-03-19 14:46:11.121568 | controller | Thursday 19 March 2026  14:46:10 +0000 (0:00:00.501)       0:00:47.461 ********
2026-03-19 14:46:11.121580 | controller | changed: [instance]
2026-03-19 14:46:11.148817 | controller |
2026-03-19 14:46:11.148852 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-19 14:46:11.148863 | controller | Thursday 19 March 2026  14:46:11 +0000 (0:00:00.190)       0:00:47.651 ********
2026-03-19 14:46:11.148874 | controller | skipping: [instance]
2026-03-19 14:46:11.174753 | controller |
2026-03-19 14:46:11.174782 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-19 14:46:11.174790 | controller | Thursday 19 March 2026  14:46:11 +0000 (0:00:00.027)       0:00:47.679 ********
2026-03-19 14:46:11.174800 | controller | skipping: [instance]
2026-03-19 14:46:11.199434 | controller |
2026-03-19 14:46:11.199475 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-19 14:46:11.199483 | controller | Thursday 19 March 2026  14:46:11 +0000 (0:00:00.026)       0:00:47.705 ********
2026-03-19 14:46:11.199493 | controller | skipping: [instance]
2026-03-19 14:46:11.199518 | controller |
2026-03-19 14:46:11.199525 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-19 14:46:11.227374 | controller | Thursday 19 March 2026  14:46:11 +0000 (0:00:00.024)       0:00:47.730 ********
2026-03-19 14:46:11.227408 | controller | skipping: [instance]
2026-03-19 14:46:11.249277 | controller |
2026-03-19 14:46:11.249302 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-19 14:46:11.249311 | controller | Thursday 19 March 2026  14:46:11 +0000 (0:00:00.027)       0:00:47.757 ********
2026-03-19 14:46:11.249322 | controller | ok: [instance]
2026-03-19 14:46:11.356579 | controller |
2026-03-19 14:46:11.356642 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-19 14:46:11.356657 | controller | Thursday 19 March 2026  14:46:11 +0000 (0:00:00.021)       0:00:47.779 ********
2026-03-19 14:46:11.356681 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-03-19 14:46:11.356703 | controller |
2026-03-19 14:46:11.356713 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-19 14:46:11.356727 | controller | Thursday 19 March 2026  14:46:11 +0000 (0:00:00.106)       0:00:47.886 ********
2026-03-19 14:46:11.377110 | controller | skipping: [instance]
2026-03-19 14:46:11.596860 | controller |
2026-03-19 14:46:11.596909 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-19 14:46:11.596918 | controller | Thursday 19 March 2026  14:46:11 +0000 (0:00:00.020)       0:00:47.907 ********
2026-03-19 14:46:11.596929 | controller | changed: [instance]
2026-03-19 14:46:12.011233 | controller |
2026-03-19 14:46:12.011287 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-19 14:46:12.011296 | controller | Thursday 19 March 2026  14:46:11 +0000 (0:00:00.219)       0:00:48.127 ********
2026-03-19 14:46:12.011309 | controller | changed: [instance]
2026-03-19 14:46:12.133537 | controller |
2026-03-19 14:46:12.133582 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-19 14:46:12.133590 | controller | Thursday 19 March 2026  14:46:12 +0000 (0:00:00.413)       0:00:48.541 ********
2026-03-19 14:46:12.133602 | controller | ok: [instance]
2026-03-19 14:46:12.169217 | controller |
2026-03-19 14:46:12.169263 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-19 14:46:12.169274 | controller | Thursday 19 March 2026  14:46:12 +0000 (0:00:00.122)       0:00:48.663 ********
2026-03-19 14:46:12.169286 | controller | ok: [instance]
2026-03-19 14:46:12.567027 | controller |
2026-03-19 14:46:12.567084 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-19 14:46:12.567093 | controller | Thursday 19 March 2026  14:46:12 +0000 (0:00:00.035)       0:00:48.699 ********
2026-03-19 14:46:12.567105 | controller | changed: [instance]
2026-03-19 14:46:12.650197 | controller |
2026-03-19 14:46:12.650220 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2026-03-19 14:46:12.650229 | controller | Thursday 19 March 2026  14:46:12 +0000 (0:00:00.397)       0:00:49.097 ********
2026-03-19 14:46:12.650240 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2026-03-19 14:46:12.699900 | controller |
2026-03-19 14:46:12.699922 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2026-03-19 14:46:12.699930 | controller | Thursday 19 March 2026  14:46:12 +0000 (0:00:00.083)       0:00:49.180 ********
2026-03-19 14:46:12.699941 | controller | ok: [instance] => (item=public)
2026-03-19 14:46:13.167069 | controller | ok: [instance] => (item=osp_trunk)
2026-03-19 14:46:13.167114 | controller |
2026-03-19 14:46:13.167122 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2026-03-19 14:46:13.167136 | controller | Thursday 19 March 2026  14:46:12 +0000 (0:00:00.049)       0:00:49.230 ********
2026-03-19 14:46:13.167147 | controller | changed: [instance] => (item=cifmw-public)
2026-03-19 14:46:13.788441 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:46:13.788477 | controller |
2026-03-19 14:46:13.788486 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2026-03-19 14:46:13.788492 | controller | Thursday 19 March 2026  14:46:13 +0000 (0:00:00.466)       0:00:49.696 ********
2026-03-19 14:46:13.788503 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 14:46:14.271343 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:46:14.271378 | controller |
2026-03-19 14:46:14.271385 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2026-03-19 14:46:14.271391 | controller | Thursday 19 March 2026  14:46:13 +0000 (0:00:00.621)       0:00:50.318 ********
2026-03-19 14:46:14.271401 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 14:46:14.728352 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:46:14.728391 | controller |
2026-03-19 14:46:14.728399 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2026-03-19 14:46:14.728406 | controller | Thursday 19 March 2026  14:46:14 +0000 (0:00:00.483)       0:00:50.801 ********
2026-03-19 14:46:14.728416 | controller | changed: [instance] => (item=cifmw-public)
2026-03-19 14:46:14.795437 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:46:14.795467 | controller |
2026-03-19 14:46:14.795476 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2026-03-19 14:46:14.795484 | controller | Thursday 19 March 2026  14:46:14 +0000 (0:00:00.456)       0:00:51.258 ********
2026-03-19 14:46:14.795494 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2026-03-19 14:46:14.795519 | controller |
2026-03-19 14:46:14.795528 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2026-03-19 14:46:14.795611 | controller | Thursday 19 March 2026  14:46:14 +0000 (0:00:00.067)       0:00:51.325 ********
2026-03-19 14:46:15.004281 | controller | ok: [instance]
2026-03-19 14:46:15.425293 | controller |
2026-03-19 14:46:15.425327 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2026-03-19 14:46:15.425351 | controller | Thursday 19 March 2026  14:46:15 +0000 (0:00:00.208)       0:00:51.534 ********
2026-03-19 14:46:15.425362 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 14:46:15.502452 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:46:15.502495 | controller |
2026-03-19 14:46:15.502509 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2026-03-19 14:46:15.502519 | controller | Thursday 19 March 2026  14:46:15 +0000 (0:00:00.420)       0:00:51.955 ********
2026-03-19 14:46:15.502535 | controller |
2026-03-19 14:46:15.541491 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-03-19 14:46:15.541531 | controller | Thursday 19 March 2026  14:46:15 +0000 (0:00:00.077)       0:00:52.032 ********
2026-03-19 14:46:15.541546 | controller | skipping: [instance]
2026-03-19 14:46:15.541579 | controller |
2026-03-19 14:46:15.541590 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2026-03-19 14:46:15.541713 | controller | Thursday 19 March 2026  14:46:15 +0000 (0:00:00.039)       0:00:52.072 ********
2026-03-19 14:46:16.828994 | controller | ok: [instance]
2026-03-19 14:46:17.030417 | controller |
2026-03-19 14:46:17.030450 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-03-19 14:46:17.030459 | controller | Thursday 19 March 2026  14:46:16 +0000 (0:00:01.286)       0:00:53.358 ********
2026-03-19 14:46:17.030470 | controller | ok: [instance]
2026-03-19 14:46:17.030494 | controller |
2026-03-19 14:46:17.030503 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2026-03-19 14:46:17.030525 | controller | Thursday 19 March 2026  14:46:17 +0000 (0:00:00.201)       0:00:53.560 ********
2026-03-19 14:46:17.404559 | controller | changed: [instance]
2026-03-19 14:46:17.404720 | controller |
2026-03-19 14:46:17.404779 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2026-03-19 14:46:19.087985 | controller | Thursday 19 March 2026  14:46:17 +0000 (0:00:00.374)       0:00:53.934 ********
2026-03-19 14:46:19.088031 | controller | changed: [instance]
2026-03-19 14:46:19.432994 | controller |
2026-03-19 14:46:19.433063 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2026-03-19 14:46:19.433072 | controller | Thursday 19 March 2026  14:46:19 +0000 (0:00:01.683)       0:00:55.618 ********
2026-03-19 14:46:19.433084 | controller | changed: [instance]
2026-03-19 14:46:19.464255 | controller |
2026-03-19 14:46:19.464280 | controller | TASK [Create extra network configuration] **************************************
2026-03-19 14:46:19.464288 | controller | Thursday 19 March 2026  14:46:19 +0000 (0:00:00.344)       0:00:55.963 ********
2026-03-19 14:46:19.464298 | controller | skipping: [instance]
2026-03-19 14:46:19.491201 | controller |
2026-03-19 14:46:19.491229 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2026-03-19 14:46:19.491238 | controller | Thursday 19 March 2026  14:46:19 +0000 (0:00:00.031)       0:00:55.994 ********
2026-03-19 14:46:19.491257 | controller | skipping: [instance]
2026-03-19 14:46:19.965476 | controller |
2026-03-19 14:46:19.965522 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2026-03-19 14:46:19.965534 | controller | Thursday 19 March 2026  14:46:19 +0000 (0:00:00.026)       0:00:56.021 ********
2026-03-19 14:46:19.965548 | controller | ok: [instance]
2026-03-19 14:46:20.169142 | controller |
2026-03-19 14:46:20.169182 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2026-03-19 14:46:20.169190 | controller | Thursday 19 March 2026  14:46:19 +0000 (0:00:00.473)       0:00:56.495 ********
2026-03-19 14:46:20.169201 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 14:46:21.411807 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:46:21.411850 | controller |
2026-03-19 14:46:21.411858 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2026-03-19 14:46:21.411865 | controller | Thursday 19 March 2026  14:46:20 +0000 (0:00:00.203)       0:00:56.699 ********
2026-03-19 14:46:21.411876 | controller | ok: [instance]
2026-03-19 14:46:25.202446 | controller |
2026-03-19 14:46:25.202485 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2026-03-19 14:46:25.202493 | controller | Thursday 19 March 2026  14:46:21 +0000 (0:00:01.242)       0:00:57.941 ********
2026-03-19 14:46:25.202504 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2026-03-19 14:46:25.202531 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2026-03-19 14:46:25.202539 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2026-03-19 14:46:25.202857 | controller |
2026-03-19 14:46:25.440578 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2026-03-19 14:46:25.440635 | controller | Thursday 19 March 2026  14:46:25 +0000 (0:00:03.790)       0:01:01.732 ********
2026-03-19 14:46:25.440651 | controller | changed: [instance]
2026-03-19 14:46:25.819532 | controller |
2026-03-19 14:46:25.819586 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2026-03-19 14:46:25.819598 | controller | Thursday 19 March 2026  14:46:25 +0000 (0:00:00.238)       0:01:01.970 ********
2026-03-19 14:46:25.819612 | controller | changed: [instance]
2026-03-19 14:46:26.233543 | controller |
2026-03-19 14:46:26.233589 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2026-03-19 14:46:26.233599 | controller | Thursday 19 March 2026  14:46:25 +0000 (0:00:00.378)       0:01:02.349 ********
2026-03-19 14:46:26.233613 | controller | changed: [instance]
2026-03-19 14:46:26.268505 | controller |
2026-03-19 14:46:26.268573 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2026-03-19 14:46:26.268589 | controller | Thursday 19 March 2026  14:46:26 +0000 (0:00:00.413)       0:01:02.763 ********
2026-03-19 14:46:26.268609 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2026-03-19 14:46:26.689069 | controller |
2026-03-19 14:46:26.689127 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2026-03-19 14:46:26.689137 | controller | Thursday 19 March 2026  14:46:26 +0000 (0:00:00.035)       0:01:02.798 ********
2026-03-19 14:46:26.689151 | controller | changed: [instance]
2026-03-19 14:46:26.710721 | controller |
2026-03-19 14:46:26.710735 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2026-03-19 14:46:26.710742 | controller | Thursday 19 March 2026  14:46:26 +0000 (0:00:00.419)       0:01:03.218 ********
2026-03-19 14:46:26.710751 | controller | skipping: [instance]
2026-03-19 14:46:26.746239 | controller |
2026-03-19 14:46:26.746260 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2026-03-19 14:46:26.746270 | controller | Thursday 19 March 2026  14:46:26 +0000 (0:00:00.022)       0:01:03.241 ********
2026-03-19 14:46:26.746283 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2026-03-19 14:46:27.144457 | controller |
2026-03-19 14:46:27.144504 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2026-03-19 14:46:27.144513 | controller | Thursday 19 March 2026  14:46:26 +0000 (0:00:00.035)       0:01:03.276 ********
2026-03-19 14:46:27.144525 | controller | changed: [instance]
2026-03-19 14:46:27.144561 | controller |
2026-03-19 14:46:27.144571 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2026-03-19 14:46:27.144597 | controller | Thursday 19 March 2026  14:46:27 +0000 (0:00:00.397)       0:01:03.674 ********
2026-03-19 14:46:27.168306 | controller | skipping: [instance]
2026-03-19 14:46:27.400548 | controller |
2026-03-19 14:46:27.400602 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2026-03-19 14:46:27.400613 | controller | Thursday 19 March 2026  14:46:27 +0000 (0:00:00.024)       0:01:03.698 ********
2026-03-19 14:46:27.400629 | controller | ok: [instance] => (item=127.0.0.2)
2026-03-19 14:46:27.400668 | controller |
2026-03-19 14:46:27.400678 | controller | TASK [dnsmasq : Enable and start service] **************************************
2026-03-19 14:46:28.131981 | controller | Thursday 19 March 2026  14:46:27 +0000 (0:00:00.232)       0:01:03.931 ********
2026-03-19 14:46:28.132045 | controller | changed: [instance]
2026-03-19 14:46:28.152249 | controller |
2026-03-19 14:46:28.152273 | controller | TASK [dnsmasq : Stop service] **************************************************
2026-03-19 14:46:28.152291 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.730)       0:01:04.661 ********
2026-03-19 14:46:28.152304 | controller | skipping: [instance]
2026-03-19 14:46:28.171088 | controller |
2026-03-19 14:46:28.171106 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2026-03-19 14:46:28.171113 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.020)       0:01:04.682 ********
2026-03-19 14:46:28.171121 | controller | skipping: [instance]
2026-03-19 14:46:28.203042 | controller |
2026-03-19 14:46:28.203084 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2026-03-19 14:46:28.203092 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.018)       0:01:04.701 ********
2026-03-19 14:46:28.203103 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-03-19 14:46:28.323027 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2026-03-19 14:46:28.323096 | controller | skipping: [instance]
2026-03-19 14:46:28.323105 | controller |
2026-03-19 14:46:28.323113 | controller | TASK [Create dnsmasq networks] *************************************************
2026-03-19 14:46:28.323121 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.031)       0:01:04.733 ********
2026-03-19 14:46:28.323135 | controller |
2026-03-19 14:46:28.357583 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-03-19 14:46:28.357641 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.119)       0:01:04.852 ********
2026-03-19 14:46:28.357662 | controller | ok: [instance] => changed=false
2026-03-19 14:46:28.357837 | controller |   msg: All assertions passed
2026-03-19 14:46:28.357876 | controller |
2026-03-19 14:46:28.397519 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-03-19 14:46:28.397555 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.034)       0:01:04.887 ********
2026-03-19 14:46:28.397569 | controller | ok: [instance] => changed=false
2026-03-19 14:46:28.397867 | controller |   msg: All assertions passed
2026-03-19 14:46:28.397895 | controller |
2026-03-19 14:46:28.847950 | controller | TASK [dnsmasq : Create network] ************************************************
2026-03-19 14:46:28.847992 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.040)       0:01:04.928 ********
2026-03-19 14:46:28.848005 | controller | changed: [instance]
2026-03-19 14:46:28.869255 | controller |
2026-03-19 14:46:28.869277 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-03-19 14:46:28.869285 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.449)       0:01:05.377 ********
2026-03-19 14:46:28.869295 | controller | skipping: [instance]
2026-03-19 14:46:28.896466 | controller |
2026-03-19 14:46:28.896512 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-03-19 14:46:28.896523 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.021)       0:01:05.399 ********
2026-03-19 14:46:28.896537 | controller | skipping: [instance]
2026-03-19 14:46:28.896571 | controller |
2026-03-19 14:46:28.896582 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-03-19 14:46:28.927268 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.027)       0:01:05.427 ********
2026-03-19 14:46:28.927295 | controller | ok: [instance] => changed=false
2026-03-19 14:46:28.965116 | controller |   msg: All assertions passed
2026-03-19 14:46:28.965139 | controller |
2026-03-19 14:46:28.965149 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-03-19 14:46:28.965158 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.030)       0:01:05.457 ********
2026-03-19 14:46:28.965169 | controller | ok: [instance] => changed=false
2026-03-19 14:46:29.417026 | controller |   msg: All assertions passed
2026-03-19 14:46:29.417071 | controller |
2026-03-19 14:46:29.417080 | controller | TASK [dnsmasq : Create network] ************************************************
2026-03-19 14:46:29.417087 | controller | Thursday 19 March 2026  14:46:28 +0000 (0:00:00.037)       0:01:05.495 ********
2026-03-19 14:46:29.417097 | controller | changed: [instance]
2026-03-19 14:46:29.437878 | controller |
2026-03-19 14:46:29.437900 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-03-19 14:46:29.437909 | controller | Thursday 19 March 2026  14:46:29 +0000 (0:00:00.451)       0:01:05.947 ********
2026-03-19 14:46:29.437921 | controller | skipping: [instance]
2026-03-19 14:46:29.463561 | controller |
2026-03-19 14:46:29.463611 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-03-19 14:46:29.463625 | controller | Thursday 19 March 2026  14:46:29 +0000 (0:00:00.021)       0:01:05.968 ********
2026-03-19 14:46:29.463643 | controller | skipping: [instance]
2026-03-19 14:46:29.463688 | controller |
2026-03-19 14:46:29.463703 | controller | TASK [Deploy radvd for IPv6 router advertisements] *****************************
2026-03-19 14:46:29.463759 | controller | Thursday 19 March 2026  14:46:29 +0000 (0:00:00.025)       0:01:05.994 ********
2026-03-19 14:46:29.494851 | controller | skipping: [instance]
2026-03-19 14:46:30.013314 | controller |
2026-03-19 14:46:30.013379 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2026-03-19 14:46:30.013389 | controller | Thursday 19 March 2026  14:46:29 +0000 (0:00:00.031)       0:01:06.025 ********
2026-03-19 14:46:30.013406 | controller | changed: [instance] => (item=cifmw-public)
2026-03-19 14:46:30.051234 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:46:30.051257 | controller |
2026-03-19 14:46:30.051265 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-19 14:46:30.051272 | controller | Thursday 19 March 2026  14:46:30 +0000 (0:00:00.517)       0:01:06.543 ********
2026-03-19 14:46:30.051283 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2026-03-19 14:46:30.400548 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2026-03-19 14:46:30.400586 | controller |
2026-03-19 14:46:30.400595 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-19 14:46:30.400602 | controller | Thursday 19 March 2026  14:46:30 +0000 (0:00:00.038)       0:01:06.581 ********
2026-03-19 14:46:30.400612 | controller | ok: [instance]
2026-03-19 14:46:30.440045 | controller |
2026-03-19 14:46:30.440079 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-03-19 14:46:30.440087 | controller | Thursday 19 March 2026  14:46:30 +0000 (0:00:00.349)       0:01:06.930 ********
2026-03-19 14:46:30.440097 | controller | ok: [instance]
2026-03-19 14:46:30.684551 | controller |
2026-03-19 14:46:30.684605 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-19 14:46:30.684621 | controller | Thursday 19 March 2026  14:46:30 +0000 (0:00:00.039)       0:01:06.970 ********
2026-03-19 14:46:30.684639 | controller | ok: [instance]
2026-03-19 14:46:30.721491 | controller |
2026-03-19 14:46:30.721525 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-03-19 14:46:30.721540 | controller | Thursday 19 March 2026  14:46:30 +0000 (0:00:00.244)       0:01:07.214 ********
2026-03-19 14:46:30.721556 | controller | ok: [instance]
2026-03-19 14:46:30.721616 | controller |
2026-03-19 14:46:30.721644 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2026-03-19 14:46:30.721656 | controller | Thursday 19 March 2026  14:46:30 +0000 (0:00:00.037)       0:01:07.251 ********
2026-03-19 14:46:31.078215 | controller | changed: [instance]
2026-03-19 14:46:31.414476 | controller |
2026-03-19 14:46:31.414515 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2026-03-19 14:46:31.414526 | controller | Thursday 19 March 2026  14:46:31 +0000 (0:00:00.356)       0:01:07.608 ********
2026-03-19 14:46:31.414538 | controller | changed: [instance]
2026-03-19 14:46:31.747620 | controller |
2026-03-19 14:46:31.747662 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2026-03-19 14:46:31.747671 | controller | Thursday 19 March 2026  14:46:31 +0000 (0:00:00.336)       0:01:07.944 ********
2026-03-19 14:46:31.747683 | controller | changed: [instance]
2026-03-19 14:46:31.847659 | controller |
2026-03-19 14:46:31.847683 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2026-03-19 14:46:31.847691 | controller | Thursday 19 March 2026  14:46:31 +0000 (0:00:00.332)       0:01:08.277 ********
2026-03-19 14:46:31.847701 | controller | ok: [instance]
2026-03-19 14:46:31.847727 | controller |
2026-03-19 14:46:31.847735 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2026-03-19 14:46:31.847877 | controller | Thursday 19 March 2026  14:46:31 +0000 (0:00:00.100)       0:01:08.377 ********
2026-03-19 14:46:32.186964 | controller | changed: [instance]
2026-03-19 14:46:32.213488 | controller |
2026-03-19 14:46:32.213524 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-19 14:46:32.213534 | controller | Thursday 19 March 2026  14:46:32 +0000 (0:00:00.339)       0:01:08.717 ********
2026-03-19 14:46:32.213546 | controller | skipping: [instance]
2026-03-19 14:46:32.213589 | controller |
2026-03-19 14:46:32.213611 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-19 14:46:32.213622 | controller | Thursday 19 March 2026  14:46:32 +0000 (0:00:00.026)       0:01:08.744 ********
2026-03-19 14:46:32.241440 | controller | skipping: [instance]
2026-03-19 14:46:32.241476 | controller |
2026-03-19 14:46:32.241695 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-19 14:46:32.270475 | controller | Thursday 19 March 2026  14:46:32 +0000 (0:00:00.027)       0:01:08.772 ********
2026-03-19 14:46:32.270527 | controller | skipping: [instance]
2026-03-19 14:46:32.298482 | controller |
2026-03-19 14:46:32.298513 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-19 14:46:32.298524 | controller | Thursday 19 March 2026  14:46:32 +0000 (0:00:00.028)       0:01:08.800 ********
2026-03-19 14:46:32.298535 | controller | skipping: [instance]
2026-03-19 14:46:32.320435 | controller |
2026-03-19 14:46:32.320467 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-19 14:46:32.320477 | controller | Thursday 19 March 2026  14:46:32 +0000 (0:00:00.027)       0:01:08.828 ********
2026-03-19 14:46:32.320498 | controller | ok: [instance]
2026-03-19 14:46:32.418304 | controller |
2026-03-19 14:46:32.418351 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-19 14:46:32.418369 | controller | Thursday 19 March 2026  14:46:32 +0000 (0:00:00.021)       0:01:08.850 ********
2026-03-19 14:46:32.418384 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-03-19 14:46:32.440199 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2026-03-19 14:46:32.440222 | controller |
2026-03-19 14:46:32.440231 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-19 14:46:32.440238 | controller | Thursday 19 March 2026  14:46:32 +0000 (0:00:00.097)       0:01:08.948 ********
2026-03-19 14:46:32.440249 | controller | skipping: [instance]
2026-03-19 14:46:32.440444 | controller |
2026-03-19 14:46:32.440621 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-19 14:46:32.440790 | controller | Thursday 19 March 2026  14:46:32 +0000 (0:00:00.022)       0:01:08.970 ********
2026-03-19 14:46:32.645922 | controller | ok: [instance]
2026-03-19 14:46:33.065139 | controller |
2026-03-19 14:46:33.065174 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-19 14:46:33.065183 | controller | Thursday 19 March 2026  14:46:32 +0000 (0:00:00.204)       0:01:09.175 ********
2026-03-19 14:46:33.065193 | controller | changed: [instance]
2026-03-19 14:46:33.131270 | controller |
2026-03-19 14:46:33.131287 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-19 14:46:33.131294 | controller | Thursday 19 March 2026  14:46:33 +0000 (0:00:00.418)       0:01:09.594 ********
2026-03-19 14:46:33.131303 | controller | ok: [instance]
2026-03-19 14:46:33.165398 | controller |
2026-03-19 14:46:33.165452 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-19 14:46:33.165461 | controller | Thursday 19 March 2026  14:46:33 +0000 (0:00:00.066)       0:01:09.661 ********
2026-03-19 14:46:33.165474 | controller | ok: [instance]
2026-03-19 14:46:33.572002 | controller |
2026-03-19 14:46:33.572029 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-19 14:46:33.572038 | controller | Thursday 19 March 2026  14:46:33 +0000 (0:00:00.034)       0:01:09.695 ********
2026-03-19 14:46:33.572049 | controller | changed: [instance]
2026-03-19 14:46:33.602085 | controller |
2026-03-19 14:46:33.602102 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2026-03-19 14:46:33.602110 | controller | Thursday 19 March 2026  14:46:33 +0000 (0:00:00.406)       0:01:10.102 ********
2026-03-19 14:46:33.602118 | controller | ok: [instance]
2026-03-19 14:46:33.623590 | controller |
2026-03-19 14:46:33.623632 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2026-03-19 14:46:33.623642 | controller | Thursday 19 March 2026  14:46:33 +0000 (0:00:00.030)       0:01:10.132 ********
2026-03-19 14:46:33.623655 | controller | ok: [instance]
2026-03-19 14:46:33.623677 | controller |
2026-03-19 14:46:33.623684 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2026-03-19 14:46:33.623692 | controller | Thursday 19 March 2026  14:46:33 +0000 (0:00:00.021)       0:01:10.153 ********
2026-03-19 14:46:33.646127 | controller | ok: [instance]
2026-03-19 14:46:33.719479 | controller |
2026-03-19 14:46:33.719511 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2026-03-19 14:46:33.719521 | controller | Thursday 19 March 2026  14:46:33 +0000 (0:00:00.022)       0:01:10.176 ********
2026-03-19 14:46:33.719535 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2026-03-19 14:46:33.719571 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2026-03-19 14:46:33.719580 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2026-03-19 14:46:33.719588 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2026-03-19 14:46:33.719596 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2026-03-19 14:46:33.719607 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2026-03-19 14:46:33.719655 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2026-03-19 14:46:33.719685 | controller |
2026-03-19 14:46:33.719869 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 14:46:33.853994 | controller | Thursday 19 March 2026  14:46:33 +0000 (0:00:00.073)       0:01:10.249 ********
2026-03-19 14:46:33.854016 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2026-03-19 14:46:33.934362 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2026-03-19 14:46:33.934385 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2026-03-19 14:46:33.934396 | controller |
2026-03-19 14:46:33.934403 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 14:46:33.934410 | controller | Thursday 19 March 2026  14:46:33 +0000 (0:00:00.134)       0:01:10.384 ********
2026-03-19 14:46:33.934421 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2026-03-19 14:46:33.934605 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2026-03-19 14:46:33.934758 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2026-03-19 14:46:33.934882 | controller | skipping: [instance]
2026-03-19 14:46:33.935002 | controller |
2026-03-19 14:46:33.935144 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 14:46:33.935280 | controller | Thursday 19 March 2026  14:46:33 +0000 (0:00:00.080)       0:01:10.465 ********
2026-03-19 14:46:34.014134 | controller | skipping: [instance] => (item=compute-0 - storage)
2026-03-19 14:46:34.014320 | controller | skipping: [instance] => (item=controller-0 - storage)
2026-03-19 14:46:34.014521 | controller | skipping: [instance] => (item=crc-0 - storage)
2026-03-19 14:46:34.014680 | controller | skipping: [instance]
2026-03-19 14:46:34.014825 | controller |
2026-03-19 14:46:34.014955 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 14:46:34.015092 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.079)       0:01:10.544 ********
2026-03-19 14:46:34.094625 | controller | skipping: [instance] => (item=compute-0 - tenant)
2026-03-19 14:46:34.094899 | controller | skipping: [instance] => (item=controller-0 - tenant)
2026-03-19 14:46:34.095138 | controller | skipping: [instance] => (item=crc-0 - tenant)
2026-03-19 14:46:34.095257 | controller | skipping: [instance]
2026-03-19 14:46:34.095398 | controller |
2026-03-19 14:46:34.095520 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 14:46:34.095641 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.080)       0:01:10.625 ********
2026-03-19 14:46:34.171321 | controller | skipping: [instance] => (item=compute-0 - external)
2026-03-19 14:46:34.171652 | controller | skipping: [instance] => (item=controller-0 - external)
2026-03-19 14:46:34.171896 | controller | skipping: [instance] => (item=crc-0 - external)
2026-03-19 14:46:34.172039 | controller | skipping: [instance]
2026-03-19 14:46:34.172187 | controller |
2026-03-19 14:46:34.172346 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 14:46:34.172501 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.076)       0:01:10.701 ********
2026-03-19 14:46:34.248571 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2026-03-19 14:46:34.248841 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2026-03-19 14:46:34.249093 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2026-03-19 14:46:34.249325 | controller | skipping: [instance]
2026-03-19 14:46:34.249508 | controller |
2026-03-19 14:46:34.249629 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-19 14:46:34.249744 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.077)       0:01:10.779 ********
2026-03-19 14:46:34.382022 | controller | ok: [instance] => (item=compute-0 - public)
2026-03-19 14:46:34.382316 | controller | ok: [instance] => (item=controller-0 - public)
2026-03-19 14:46:34.382612 | controller | ok: [instance] => (item=crc-0 - public)
2026-03-19 14:46:34.382749 | controller |
2026-03-19 14:46:34.382879 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2026-03-19 14:46:34.383014 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.133)       0:01:10.912 ********
2026-03-19 14:46:34.486192 | controller |
2026-03-19 14:46:34.486516 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2026-03-19 14:46:34.486767 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.104)       0:01:11.016 ********
2026-03-19 14:46:34.525122 | controller | ok: [instance]
2026-03-19 14:46:34.525422 | controller |
2026-03-19 14:46:34.525674 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2026-03-19 14:46:34.525908 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.038)       0:01:11.055 ********
2026-03-19 14:46:34.624122 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:9c:c1:6c', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-03-19 14:46:34.624269 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:64:ad:33', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-03-19 14:46:34.624423 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:1f:ee:92', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-03-19 14:46:34.624551 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:e1:11:65', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-03-19 14:46:34.624678 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:fe:6b:b3', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-03-19 14:46:34.624798 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:36:57:22', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-03-19 14:46:34.624907 | controller |
2026-03-19 14:46:34.625023 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2026-03-19 14:46:34.625148 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.099)       0:01:11.154 ********
2026-03-19 14:46:34.675569 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2026-03-19 14:46:34.675847 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2026-03-19 14:46:34.676096 | controller |
2026-03-19 14:46:34.676280 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-03-19 14:46:34.676418 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.051)       0:01:11.206 ********
2026-03-19 14:46:34.859367 | controller | ok: [instance]
2026-03-19 14:46:34.885684 | controller |
2026-03-19 14:46:34.885704 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-03-19 14:46:34.885712 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.183)       0:01:11.389 ********
2026-03-19 14:46:34.885721 | controller | ok: [instance]
2026-03-19 14:46:35.071411 | controller |
2026-03-19 14:46:35.071446 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-03-19 14:46:35.071455 | controller | Thursday 19 March 2026  14:46:34 +0000 (0:00:00.026)       0:01:11.416 ********
2026-03-19 14:46:35.071465 | controller | ok: [instance]
2026-03-19 14:46:35.071491 | controller |
2026-03-19 14:46:35.071499 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-03-19 14:46:35.071585 | controller | Thursday 19 March 2026  14:46:35 +0000 (0:00:00.185)       0:01:11.601 ********
2026-03-19 14:46:35.135670 | controller | ok: [instance]
2026-03-19 14:46:35.200522 | controller |
2026-03-19 14:46:35.200554 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2026-03-19 14:46:35.200564 | controller | Thursday 19 March 2026  14:46:35 +0000 (0:00:00.062)       0:01:11.664 ********
2026-03-19 14:46:35.200576 | controller | ok: [instance]
2026-03-19 14:46:35.386474 | controller |
2026-03-19 14:46:35.386508 | controller | TASK [dnsmasq : Compute entry] *************************************************
2026-03-19 14:46:35.386518 | controller | Thursday 19 March 2026  14:46:35 +0000 (0:00:00.066)       0:01:11.730 ********
2026-03-19 14:46:35.386530 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:9c:c1:6c', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-03-19 14:46:35.386560 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:64:ad:33', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-03-19 14:46:35.386567 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:1f:ee:92', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-03-19 14:46:35.386574 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:e1:11:65', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-03-19 14:46:35.386580 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:fe:6b:b3', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-03-19 14:46:35.386587 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:36:57:22', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-03-19 14:46:35.386593 | controller |
2026-03-19 14:46:35.386602 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2026-03-19 14:46:35.386628 | controller | Thursday 19 March 2026  14:46:35 +0000 (0:00:00.185)       0:01:11.916 ********
2026-03-19 14:46:35.428407 | controller | ok: [instance]
2026-03-19 14:46:37.503500 | controller |
2026-03-19 14:46:37.503540 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2026-03-19 14:46:37.503549 | controller | Thursday 19 March 2026  14:46:35 +0000 (0:00:00.042)       0:01:11.958 ********
2026-03-19 14:46:37.503560 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:9c:c1:6c', 'entry': 'set:compute,52:54:00:9c:c1:6c,192.168.140.100,compute-0', 'state': 'present'})
2026-03-19 14:46:37.503584 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:64:ad:33', 'entry': 'set:controller,52:54:01:64:ad:33,192.168.140.9,controller-0', 'state': 'present'})
2026-03-19 14:46:37.503590 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:1f:ee:92', 'entry': 'set:ocp,52:54:02:1f:ee:92,192.168.140.10,crc-0', 'state': 'present'})
2026-03-19 14:46:37.503596 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:e1:11:65', 'entry': 'set:compute,52:54:00:e1:11:65,192.168.101.100,compute-0', 'state': 'present'})
2026-03-19 14:46:37.503601 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:fe:6b:b3', 'entry': 'set:controller,52:54:01:fe:6b:b3,192.168.101.9,controller-0', 'state': 'present'})
2026-03-19 14:46:37.503607 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:36:57:22', 'entry': 'set:ocp,52:54:02:36:57:22,192.168.101.10,crc-0', 'state': 'present'})
2026-03-19 14:46:37.503614 | controller |
2026-03-19 14:46:37.503634 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2026-03-19 14:46:37.503774 | controller | Thursday 19 March 2026  14:46:37 +0000 (0:00:02.074)       0:01:14.033 ********
2026-03-19 14:46:37.526749 | controller | skipping: [instance]
2026-03-19 14:46:37.740320 | controller |
2026-03-19 14:46:37.740357 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2026-03-19 14:46:37.740370 | controller | Thursday 19 March 2026  14:46:37 +0000 (0:00:00.023)       0:01:14.057 ********
2026-03-19 14:46:37.740379 | controller | ok: [instance] => (item=compute-0)
2026-03-19 14:46:37.856822 | controller | ok: [instance] => (item=controller-0)
2026-03-19 14:46:37.856844 | controller | ok: [instance] => (item=crc-0)
2026-03-19 14:46:37.856853 | controller |
2026-03-19 14:46:37.856860 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2026-03-19 14:46:37.856867 | controller | Thursday 19 March 2026  14:46:37 +0000 (0:00:00.213)       0:01:14.270 ********
2026-03-19 14:46:37.856877 | controller |
2026-03-19 14:46:37.900147 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-19 14:46:37.900167 | controller | Thursday 19 March 2026  14:46:37 +0000 (0:00:00.116)       0:01:14.387 ********
2026-03-19 14:46:37.900179 | controller | ok: [instance]
2026-03-19 14:46:38.100535 | controller |
2026-03-19 14:46:38.100596 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-19 14:46:38.100611 | controller | Thursday 19 March 2026  14:46:37 +0000 (0:00:00.043)       0:01:14.430 ********
2026-03-19 14:46:38.100630 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 14:46:38.100661 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 14:46:38.100672 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-19 14:46:38.100683 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-19 14:46:38.100693 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-19 14:46:38.100707 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-19 14:46:38.100756 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-19 14:46:38.100782 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 14:46:38.100841 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 14:46:38.101682 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-19 14:46:41.259435 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 14:46:41.259467 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 14:46:41.259475 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-19 14:46:41.259481 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-19 14:46:41.259487 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-19 14:46:41.259493 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-19 14:46:41.259498 | controller |
2026-03-19 14:46:41.259504 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-19 14:46:41.259510 | controller | Thursday 19 March 2026  14:46:38 +0000 (0:00:00.200)       0:01:14.630 ********
2026-03-19 14:46:41.259520 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 14:46:41.260280 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 14:46:41.260294 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-19 14:46:41.260301 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-19 14:46:41.260306 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-19 14:46:41.260312 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-19 14:46:41.260317 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-19 14:46:41.260323 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 14:46:41.260328 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 14:46:41.260353 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-19 14:46:41.260366 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 14:46:41.260371 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 14:46:41.260377 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-19 14:46:41.260385 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-19 14:46:41.611485 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-19 14:46:41.611518 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-19 14:46:41.611528 | controller |
2026-03-19 14:46:41.611537 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-19 14:46:41.611544 | controller | Thursday 19 March 2026  14:46:41 +0000 (0:00:03.156)       0:01:17.787 ********
2026-03-19 14:46:41.611557 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 14:46:41.611695 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-19 14:46:41.611717 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-19 14:46:41.611727 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-19 14:46:41.611734 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-19 14:46:41.611741 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-19 14:46:41.611748 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-19 14:46:41.611755 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 14:46:41.611762 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 14:46:41.611774 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-19 14:46:41.611871 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 14:46:41.611885 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-19 14:46:41.611977 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-19 14:46:41.612093 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-19 14:46:41.612192 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-19 14:46:41.612309 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-19 14:46:41.612444 | controller |
2026-03-19 14:46:41.612548 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] ****************
2026-03-19 14:46:41.612651 | controller | Thursday 19 March 2026  14:46:41 +0000 (0:00:00.353)       0:01:18.141 ********
2026-03-19 14:46:41.632684 | controller | ok: [instance]
2026-03-19 14:46:41.632905 | controller |
2026-03-19 14:46:41.633117 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] **************
2026-03-19 14:46:41.633325 | controller | Thursday 19 March 2026  14:46:41 +0000 (0:00:00.021)       0:01:18.163 ********
2026-03-19 14:46:41.678738 | controller | skipping: [instance] => (item=compute)
2026-03-19 14:46:41.678843 | controller | skipping: [instance] => (item=controller)
2026-03-19 14:46:41.678952 | controller | skipping: [instance] => (item=crc)
2026-03-19 14:46:41.679071 | controller | skipping: [instance]
2026-03-19 14:46:41.679176 | controller |
2026-03-19 14:46:41.679273 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] *******
2026-03-19 14:46:41.679396 | controller | Thursday 19 March 2026  14:46:41 +0000 (0:00:00.046)       0:01:18.209 ********
2026-03-19 14:46:41.712954 | controller | skipping: [instance]
2026-03-19 14:46:41.713066 | controller |
2026-03-19 14:46:41.713192 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2026-03-19 14:46:41.713358 | controller | Thursday 19 March 2026  14:46:41 +0000 (0:00:00.034)       0:01:18.243 ********
2026-03-19 14:46:42.092421 | controller | changed: [instance]
2026-03-19 14:46:42.092472 | controller |
2026-03-19 14:46:42.092483 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2026-03-19 14:46:42.092836 | controller | Thursday 19 March 2026  14:46:42 +0000 (0:00:00.368)       0:01:18.612 ********
2026-03-19 14:46:42.720627 | controller |
2026-03-19 14:46:42.720655 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-03-19 14:46:42.720663 | controller | Thursday 19 March 2026  14:46:42 +0000 (0:00:00.010)       0:01:18.623 ********
2026-03-19 14:46:42.720674 | controller | changed: [instance]
2026-03-19 14:46:43.075006 | controller |
2026-03-19 14:46:43.075034 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-19 14:46:43.075042 | controller | Thursday 19 March 2026  14:46:42 +0000 (0:00:00.627)       0:01:19.250 ********
2026-03-19 14:46:43.075061 | controller | changed: [instance]
2026-03-19 14:46:43.421454 | controller |
2026-03-19 14:46:43.421494 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2026-03-19 14:46:43.421505 | controller | Thursday 19 March 2026  14:46:43 +0000 (0:00:00.354)       0:01:19.605 ********
2026-03-19 14:46:43.421517 | controller | changed: [instance]
2026-03-19 14:46:43.421560 | controller |
2026-03-19 14:46:43.421570 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2026-03-19 14:46:43.421580 | controller | Thursday 19 March 2026  14:46:43 +0000 (0:00:00.346)       0:01:19.951 ********
2026-03-19 14:46:43.780065 | controller | changed: [instance]
2026-03-19 14:46:44.151108 | controller |
2026-03-19 14:46:44.151139 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2026-03-19 14:46:44.151148 | controller | Thursday 19 March 2026  14:46:43 +0000 (0:00:00.358)       0:01:20.310 ********
2026-03-19 14:46:44.151158 | controller | changed: [instance]
2026-03-19 14:46:44.185870 | controller |
2026-03-19 14:46:44.185901 | controller | TASK [Build utility records dataset] *******************************************
2026-03-19 14:46:44.185914 | controller | Thursday 19 March 2026  14:46:44 +0000 (0:00:00.370)       0:01:20.681 ********
2026-03-19 14:46:44.185935 | controller |
2026-03-19 14:46:44.312489 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-19 14:46:44.312533 | controller | Thursday 19 March 2026  14:46:44 +0000 (0:00:00.034)       0:01:20.716 ********
2026-03-19 14:46:44.312546 | controller | ok: [instance]
2026-03-19 14:46:44.439492 | controller |
2026-03-19 14:46:44.439525 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-19 14:46:44.439545 | controller | Thursday 19 March 2026  14:46:44 +0000 (0:00:00.126)       0:01:20.842 ********
2026-03-19 14:46:44.439627 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-19 14:46:44.439660 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 14:46:44.439670 | controller |
2026-03-19 14:46:44.439765 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-19 14:46:44.439786 | controller | Thursday 19 March 2026  14:46:44 +0000 (0:00:00.127)       0:01:20.970 ********
2026-03-19 14:46:44.949080 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-19 14:46:45.256531 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 14:46:45.256571 | controller |
2026-03-19 14:46:45.256581 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-19 14:46:45.256588 | controller | Thursday 19 March 2026  14:46:44 +0000 (0:00:00.509)       0:01:21.479 ********
2026-03-19 14:46:45.256601 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-19 14:46:45.256633 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-19 14:46:45.256641 | controller |
2026-03-19 14:46:45.256650 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-03-19 14:46:45.256677 | controller | Thursday 19 March 2026  14:46:45 +0000 (0:00:00.296)       0:01:21.776 ********
2026-03-19 14:46:45.256990 | controller |
2026-03-19 14:46:45.736472 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-19 14:46:45.736505 | controller | Thursday 19 March 2026  14:46:45 +0000 (0:00:00.010)       0:01:21.786 ********
2026-03-19 14:46:45.736518 | controller | changed: [instance]
2026-03-19 14:46:45.736546 | controller |
2026-03-19 14:46:45.736731 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-19 14:46:46.087812 | controller | Thursday 19 March 2026  14:46:45 +0000 (0:00:00.480)       0:01:22.267 ********
2026-03-19 14:46:46.087848 | controller | changed: [instance]
2026-03-19 14:46:46.121164 | controller |
2026-03-19 14:46:46.121186 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2026-03-19 14:46:46.121196 | controller | Thursday 19 March 2026  14:46:46 +0000 (0:00:00.351)       0:01:22.618 ********
2026-03-19 14:46:46.121209 | controller | skipping: [instance]
2026-03-19 14:46:46.196490 | controller |
2026-03-19 14:46:46.196522 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2026-03-19 14:46:46.196532 | controller | Thursday 19 March 2026  14:46:46 +0000 (0:00:00.033)       0:01:22.651 ********
2026-03-19 14:46:46.196543 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2026-03-19 14:46:46.384310 | controller |
2026-03-19 14:46:46.384351 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2026-03-19 14:46:46.384363 | controller | Thursday 19 March 2026  14:46:46 +0000 (0:00:00.075)       0:01:22.726 ********
2026-03-19 14:46:46.384374 | controller | ok: [instance]
2026-03-19 14:46:46.405487 | controller |
2026-03-19 14:46:46.405522 | controller | TASK [Deploy CRC if needed] ****************************************************
2026-03-19 14:46:46.405533 | controller | Thursday 19 March 2026  14:46:46 +0000 (0:00:00.187)       0:01:22.914 ********
2026-03-19 14:46:46.405545 | controller | skipping: [instance]
2026-03-19 14:46:46.405578 | controller |
2026-03-19 14:46:46.405588 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2026-03-19 14:46:46.405707 | controller | Thursday 19 March 2026  14:46:46 +0000 (0:00:00.021)       0:01:22.936 ********
2026-03-19 14:46:46.763787 | controller | ok: [instance]
2026-03-19 14:46:46.994842 | controller |
2026-03-19 14:46:46.994862 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2026-03-19 14:46:46.994870 | controller | Thursday 19 March 2026  14:46:46 +0000 (0:00:00.358)       0:01:23.294 ********
2026-03-19 14:46:46.994878 | controller | ok: [instance]
2026-03-19 14:46:47.213039 | controller |
2026-03-19 14:46:47.213069 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2026-03-19 14:46:47.213078 | controller | Thursday 19 March 2026  14:46:46 +0000 (0:00:00.231)       0:01:23.525 ********
2026-03-19 14:46:47.213087 | controller | ok: [instance]
2026-03-19 14:46:47.432041 | controller |
2026-03-19 14:46:47.432073 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2026-03-19 14:46:47.432082 | controller | Thursday 19 March 2026  14:46:47 +0000 (0:00:00.218)       0:01:23.743 ********
2026-03-19 14:46:47.432091 | controller | ok: [instance]
2026-03-19 14:46:47.651444 | controller |
2026-03-19 14:46:47.651480 | controller | TASK [rhol_crc : Destroy default network] **************************************
2026-03-19 14:46:47.651493 | controller | Thursday 19 March 2026  14:46:47 +0000 (0:00:00.219)       0:01:23.962 ********
2026-03-19 14:46:47.651505 | controller | ok: [instance]
2026-03-19 14:46:47.651512 | controller |
2026-03-19 14:46:47.651517 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-19 14:46:47.651525 | controller | Thursday 19 March 2026  14:46:47 +0000 (0:00:00.219)       0:01:24.181 ********
2026-03-19 14:46:47.692117 | controller |
2026-03-19 14:46:47.888581 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-03-19 14:46:47.888604 | controller | Thursday 19 March 2026  14:46:47 +0000 (0:00:00.040)       0:01:24.222 ********
2026-03-19 14:46:47.888615 | controller | ok: [instance]
2026-03-19 14:46:47.911982 | controller |
2026-03-19 14:46:47.912005 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-03-19 14:46:47.912012 | controller | Thursday 19 March 2026  14:46:47 +0000 (0:00:00.196)       0:01:24.419 ********
2026-03-19 14:46:47.912022 | controller | ok: [instance]
2026-03-19 14:46:47.937795 | controller |
2026-03-19 14:46:47.937820 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-03-19 14:46:47.937829 | controller | Thursday 19 March 2026  14:46:47 +0000 (0:00:00.023)       0:01:24.442 ********
2026-03-19 14:46:47.937841 | controller | skipping: [instance]
2026-03-19 14:46:48.233029 | controller |
2026-03-19 14:46:48.233083 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2026-03-19 14:46:48.233092 | controller | Thursday 19 March 2026  14:46:47 +0000 (0:00:00.025)       0:01:24.468 ********
2026-03-19 14:46:48.233102 | controller | ok: [instance]
2026-03-19 14:46:48.458300 | controller |
2026-03-19 14:46:48.458354 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2026-03-19 14:46:48.458366 | controller | Thursday 19 March 2026  14:46:48 +0000 (0:00:00.295)       0:01:24.763 ********
2026-03-19 14:46:48.458377 | controller | ok: [instance]
2026-03-19 14:46:48.634096 | controller |
2026-03-19 14:46:48.634120 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2026-03-19 14:46:48.634128 | controller | Thursday 19 March 2026  14:46:48 +0000 (0:00:00.225)       0:01:24.988 ********
2026-03-19 14:46:48.634138 | controller | ok: [instance]
2026-03-19 14:46:48.691504 | controller |
2026-03-19 14:46:48.691548 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2026-03-19 14:46:48.691558 | controller | Thursday 19 March 2026  14:46:48 +0000 (0:00:00.175)       0:01:25.164 ********
2026-03-19 14:46:48.691571 | controller |
2026-03-19 14:46:48.691579 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-19 14:46:48.691587 | controller | Thursday 19 March 2026  14:46:48 +0000 (0:00:00.057)       0:01:25.222 ********
2026-03-19 14:46:48.738212 | controller | ok: [instance] => changed=false
2026-03-19 14:46:48.924839 | controller |   msg: All assertions passed
2026-03-19 14:46:48.924860 | controller |
2026-03-19 14:46:48.924868 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-19 14:46:48.924875 | controller | Thursday 19 March 2026  14:46:48 +0000 (0:00:00.046)       0:01:25.268 ********
2026-03-19 14:46:48.924891 | controller | ok: [instance]
2026-03-19 14:46:49.115682 | controller |
2026-03-19 14:46:49.115701 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-19 14:46:49.115709 | controller | Thursday 19 March 2026  14:46:48 +0000 (0:00:00.186)       0:01:25.455 ********
2026-03-19 14:46:49.115717 | controller | ok: [instance]
2026-03-19 14:46:49.140289 | controller |
2026-03-19 14:46:49.140307 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-19 14:46:49.140315 | controller | Thursday 19 March 2026  14:46:49 +0000 (0:00:00.190)       0:01:25.646 ********
2026-03-19 14:46:49.140324 | controller | ok: [instance] => changed=false
2026-03-19 14:46:49.322915 | controller |   msg: All assertions passed
2026-03-19 14:46:49.322934 | controller |
2026-03-19 14:46:49.322941 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-19 14:46:49.322948 | controller | Thursday 19 March 2026  14:46:49 +0000 (0:00:00.023)       0:01:25.670 ********
2026-03-19 14:46:49.322957 | controller | ok: [instance]
2026-03-19 14:46:49.495492 | controller |
2026-03-19 14:46:49.495541 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-19 14:46:49.495552 | controller | Thursday 19 March 2026  14:46:49 +0000 (0:00:00.182)       0:01:25.853 ********
2026-03-19 14:46:49.495565 | controller | ok: [instance]
2026-03-19 14:46:49.495595 | controller |
2026-03-19 14:46:49.495605 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-19 14:46:49.495651 | controller | Thursday 19 March 2026  14:46:49 +0000 (0:00:00.172)       0:01:26.025 ********
2026-03-19 14:46:49.541506 | controller | ok: [instance]
2026-03-19 14:46:49.541604 | controller |
2026-03-19 14:46:49.541624 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2026-03-19 14:46:49.541634 | controller | Thursday 19 March 2026  14:46:49 +0000 (0:00:00.045)       0:01:26.071 ********
2026-03-19 14:46:49.915117 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2026-03-19 14:46:49.934460 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2026-03-19 14:46:49.934501 | controller |
2026-03-19 14:46:49.934511 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2026-03-19 14:46:49.934519 | controller | Thursday 19 March 2026  14:46:49 +0000 (0:00:00.373)       0:01:26.445 ********
2026-03-19 14:46:49.934533 | controller | skipping: [instance]
2026-03-19 14:46:49.934568 | controller |
2026-03-19 14:46:49.934597 | controller | TASK [Load the architecture local kustomize patches] ***************************
2026-03-19 14:46:49.934770 | controller | Thursday 19 March 2026  14:46:49 +0000 (0:00:00.019)       0:01:26.465 ********
2026-03-19 14:46:49.960323 | controller | skipping: [instance]
2026-03-19 14:46:50.122567 | controller |
2026-03-19 14:46:50.122585 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2026-03-19 14:46:50.122592 | controller | Thursday 19 March 2026  14:46:49 +0000 (0:00:00.025)       0:01:26.490 ********
2026-03-19 14:46:50.122602 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2026-03-19 14:46:50.146585 | controller |
2026-03-19 14:46:50.146636 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2026-03-19 14:46:50.146651 | controller | Thursday 19 March 2026  14:46:50 +0000 (0:00:00.162)       0:01:26.652 ********
2026-03-19 14:46:50.146669 | controller | skipping: [instance]
2026-03-19 14:46:50.146714 | controller |
2026-03-19 14:46:50.146729 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2026-03-19 14:46:50.553935 | controller | Thursday 19 March 2026  14:46:50 +0000 (0:00:00.024)       0:01:26.676 ********
2026-03-19 14:46:50.553969 | controller | changed: [instance]
2026-03-19 14:46:51.030046 | controller |
2026-03-19 14:46:51.030093 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2026-03-19 14:46:51.030102 | controller | Thursday 19 March 2026  14:46:50 +0000 (0:00:00.407)       0:01:27.084 ********
2026-03-19 14:46:51.030112 | controller | changed: [instance]
2026-03-19 14:46:51.447716 | controller |
2026-03-19 14:46:51.447740 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2026-03-19 14:46:51.447749 | controller | Thursday 19 March 2026  14:46:51 +0000 (0:00:00.464)       0:01:27.548 ********
2026-03-19 14:46:51.447760 | controller |
2026-03-19 14:46:51.447766 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-19 14:46:51.447771 | controller | Thursday 19 March 2026  14:46:51 +0000 (0:00:00.011)       0:01:27.560 ********
2026-03-19 14:46:51.447780 | controller | changed: [instance]
2026-03-19 14:46:52.090567 | controller |
2026-03-19 14:46:52.090594 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-03-19 14:46:52.090603 | controller | Thursday 19 March 2026  14:46:51 +0000 (0:00:00.417)       0:01:27.977 ********
2026-03-19 14:46:52.090612 | controller | changed: [instance]
2026-03-19 14:46:52.124195 | controller |
2026-03-19 14:46:52.124212 | controller | TASK [Deploy virtualbmc] *******************************************************
2026-03-19 14:46:52.124219 | controller | Thursday 19 March 2026  14:46:52 +0000 (0:00:00.642)       0:01:28.620 ********
2026-03-19 14:46:52.124227 | controller | skipping: [instance]
2026-03-19 14:46:52.157421 | controller |
2026-03-19 14:46:52.157454 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2026-03-19 14:46:52.157463 | controller | Thursday 19 March 2026  14:46:52 +0000 (0:00:00.033)       0:01:28.654 ********
2026-03-19 14:46:52.157473 | controller | skipping: [instance]
2026-03-19 14:46:52.157498 | controller |
2026-03-19 14:46:52.157506 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2026-03-19 14:46:52.157616 | controller | Thursday 19 March 2026  14:46:52 +0000 (0:00:00.033)       0:01:28.688 ********
2026-03-19 14:46:52.701254 | controller | changed: [instance] => (item=workload)
2026-03-19 14:46:53.112450 | controller | changed: [instance] => (item=reproducer-inventory)
2026-03-19 14:46:53.112489 | controller | ok: [instance] => (item=volumes)
2026-03-19 14:46:53.112499 | controller |
2026-03-19 14:46:53.112507 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2026-03-19 14:46:53.112514 | controller | Thursday 19 March 2026  14:46:52 +0000 (0:00:00.543)       0:01:29.231 ********
2026-03-19 14:46:53.112527 | controller | changed: [instance] => (item=workload)
2026-03-19 14:46:53.138149 | controller | changed: [instance] => (item=volumes)
2026-03-19 14:46:53.138179 | controller |
2026-03-19 14:46:53.138186 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2026-03-19 14:46:53.138192 | controller | Thursday 19 March 2026  14:46:53 +0000 (0:00:00.411)       0:01:29.642 ********
2026-03-19 14:46:53.138201 | controller | skipping: [instance]
2026-03-19 14:46:54.185206 | controller |
2026-03-19 14:46:54.185236 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2026-03-19 14:46:54.185247 | controller | Thursday 19 March 2026  14:46:53 +0000 (0:00:00.026)       0:01:29.668 ********
2026-03-19 14:46:54.185257 | controller | changed: [instance] => (item=compute)
2026-03-19 14:46:54.216950 | controller | changed: [instance] => (item=controller)
2026-03-19 14:46:54.216972 | controller | changed: [instance] => (item=crc)
2026-03-19 14:46:54.216981 | controller |
2026-03-19 14:46:54.216988 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2026-03-19 14:46:54.216995 | controller | Thursday 19 March 2026  14:46:54 +0000 (0:00:01.046)       0:01:30.715 ********
2026-03-19 14:46:54.217006 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance
2026-03-19 14:46:54.397045 | controller |
2026-03-19 14:46:54.397085 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] *****************
2026-03-19 14:46:54.397095 | controller | Thursday 19 March 2026  14:46:54 +0000 (0:00:00.032)       0:01:30.747 ********
2026-03-19 14:46:54.397106 | controller | ok: [instance]
2026-03-19 14:46:54.417459 | controller |
2026-03-19 14:46:54.417497 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] *************
2026-03-19 14:46:54.417508 | controller | Thursday 19 March 2026  14:46:54 +0000 (0:00:00.180)       0:01:30.927 ********
2026-03-19 14:46:54.417521 | controller | skipping: [instance]
2026-03-19 14:46:54.777459 | controller |
2026-03-19 14:46:54.777490 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] ***
2026-03-19 14:46:54.777500 | controller | Thursday 19 March 2026  14:46:54 +0000 (0:00:00.020)       0:01:30.947 ********
2026-03-19 14:46:54.777519 | controller | changed: [instance]
2026-03-19 14:46:54.777553 | controller |
2026-03-19 14:46:54.777563 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] *********************
2026-03-19 14:46:54.777680 | controller | Thursday 19 March 2026  14:46:54 +0000 (0:00:00.360)       0:01:31.308 ********
2026-03-19 14:46:54.797940 | controller | skipping: [instance]
2026-03-19 14:46:54.818458 | controller |
2026-03-19 14:46:54.818509 | controller | TASK [libvirt_manager : Write merged all-group.yml] ****************************
2026-03-19 14:46:54.818519 | controller | Thursday 19 March 2026  14:46:54 +0000 (0:00:00.020)       0:01:31.328 ********
2026-03-19 14:46:54.818533 | controller | skipping: [instance]
2026-03-19 14:46:54.857695 | controller |
2026-03-19 14:46:54.857728 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2026-03-19 14:46:54.857738 | controller | Thursday 19 March 2026  14:46:54 +0000 (0:00:00.020)       0:01:31.349 ********
2026-03-19 14:46:54.857751 | controller | skipping: [instance]
2026-03-19 14:46:54.857761 | controller |
2026-03-19 14:46:54.857919 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2026-03-19 14:46:54.858000 | controller | Thursday 19 March 2026  14:46:54 +0000 (0:00:00.039)       0:01:31.388 ********
2026-03-19 14:46:54.926707 | controller | skipping: [instance] => (item=crc)
2026-03-19 14:46:54.926840 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2026-03-19 14:46:54.926933 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2026-03-19 14:46:54.927039 | controller |
2026-03-19 14:46:54.927163 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-03-19 14:46:54.927261 | controller | Thursday 19 March 2026  14:46:54 +0000 (0:00:00.068)       0:01:31.457 ********
2026-03-19 14:46:55.134227 | controller | changed: [instance]
2026-03-19 14:46:55.134413 | controller |
2026-03-19 14:46:55.134542 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-03-19 14:46:55.134656 | controller | Thursday 19 March 2026  14:46:55 +0000 (0:00:00.207)       0:01:31.664 ********
2026-03-19 14:46:55.314185 | controller | ok: [instance]
2026-03-19 14:46:55.314307 | controller |
2026-03-19 14:46:55.314469 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-03-19 14:46:55.314619 | controller | Thursday 19 March 2026  14:46:55 +0000 (0:00:00.179)       0:01:31.844 ********
2026-03-19 14:47:27.425499 | controller | changed: [instance]
2026-03-19 14:47:27.621789 | controller |
2026-03-19 14:47:27.621834 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-03-19 14:47:27.621844 | controller | Thursday 19 March 2026  14:47:27 +0000 (0:00:32.109)       0:02:03.954 ********
2026-03-19 14:47:27.621856 | controller | ok: [instance]
2026-03-19 14:47:27.664510 | controller |
2026-03-19 14:47:27.664566 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-03-19 14:47:27.664577 | controller | Thursday 19 March 2026  14:47:27 +0000 (0:00:00.197)       0:02:04.152 ********
2026-03-19 14:47:27.664594 | controller | ok: [instance] => changed=false
2026-03-19 14:47:27.889792 | controller |   msg: All assertions passed
2026-03-19 14:47:27.889841 | controller |
2026-03-19 14:47:27.889850 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-03-19 14:47:27.889857 | controller | Thursday 19 March 2026  14:47:27 +0000 (0:00:00.042)       0:02:04.194 ********
2026-03-19 14:47:27.889869 | controller | changed: [instance]
2026-03-19 14:47:28.099202 | controller |
2026-03-19 14:47:28.099236 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-03-19 14:47:28.099245 | controller | Thursday 19 March 2026  14:47:27 +0000 (0:00:00.225)       0:02:04.419 ********
2026-03-19 14:47:28.099263 | controller | ok: [instance]
2026-03-19 14:47:28.301023 | controller |
2026-03-19 14:47:28.301049 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-03-19 14:47:28.301057 | controller | Thursday 19 March 2026  14:47:28 +0000 (0:00:00.209)       0:02:04.629 ********
2026-03-19 14:47:28.301066 | controller | ok: [instance]
2026-03-19 14:47:28.325101 | controller |
2026-03-19 14:47:28.325138 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-03-19 14:47:28.325146 | controller | Thursday 19 March 2026  14:47:28 +0000 (0:00:00.201)       0:02:04.831 ********
2026-03-19 14:47:28.325157 | controller | skipping: [instance]
2026-03-19 14:47:28.525990 | controller |
2026-03-19 14:47:28.526017 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-03-19 14:47:28.526025 | controller | Thursday 19 March 2026  14:47:28 +0000 (0:00:00.023)       0:02:04.855 ********
2026-03-19 14:47:28.526034 | controller | ok: [instance]
2026-03-19 14:47:28.570148 | controller |
2026-03-19 14:47:28.570182 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-03-19 14:47:28.570196 | controller | Thursday 19 March 2026  14:47:28 +0000 (0:00:00.201)       0:02:05.056 ********
2026-03-19 14:47:28.570213 | controller | ok: [instance] => changed=false
2026-03-19 14:47:28.780397 | controller |   msg: All assertions passed
2026-03-19 14:47:28.780417 | controller |
2026-03-19 14:47:28.780424 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-03-19 14:47:28.780431 | controller | Thursday 19 March 2026  14:47:28 +0000 (0:00:00.043)       0:02:05.100 ********
2026-03-19 14:47:28.780440 | controller | ok: [instance]
2026-03-19 14:47:28.968305 | controller |
2026-03-19 14:47:28.968326 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2026-03-19 14:47:28.968351 | controller | Thursday 19 March 2026  14:47:28 +0000 (0:00:00.210)       0:02:05.310 ********
2026-03-19 14:47:28.968363 | controller | ok: [instance]
2026-03-19 14:47:29.345005 | controller |
2026-03-19 14:47:29.345041 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2026-03-19 14:47:29.345050 | controller | Thursday 19 March 2026  14:47:28 +0000 (0:00:00.187)       0:02:05.498 ********
2026-03-19 14:47:29.345062 | controller | changed: [instance]
2026-03-19 14:47:29.530411 | controller |
2026-03-19 14:47:29.530439 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2026-03-19 14:47:29.530448 | controller | Thursday 19 March 2026  14:47:29 +0000 (0:00:00.376)       0:02:05.875 ********
2026-03-19 14:47:29.530459 | controller | ok: [instance]
2026-03-19 14:47:29.714426 | controller |
2026-03-19 14:47:29.714463 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2026-03-19 14:47:29.714473 | controller | Thursday 19 March 2026  14:47:29 +0000 (0:00:00.185)       0:02:06.060 ********
2026-03-19 14:47:29.714484 | controller | ok: [instance]
2026-03-19 14:47:29.714513 | controller |
2026-03-19 14:47:29.714520 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2026-03-19 14:47:29.714528 | controller | Thursday 19 March 2026  14:47:29 +0000 (0:00:00.183)       0:02:06.244 ********
2026-03-19 14:47:30.133980 | controller | changed: [instance]
2026-03-19 14:47:30.157235 | controller |
2026-03-19 14:47:30.157253 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2026-03-19 14:47:30.157261 | controller | Thursday 19 March 2026  14:47:30 +0000 (0:00:00.419)       0:02:06.663 ********
2026-03-19 14:47:30.157270 | controller | ok: [instance]
2026-03-19 14:47:30.398472 | controller |
2026-03-19 14:47:30.398529 | controller | TASK [libvirt_manager : List existing networks] ********************************
2026-03-19 14:47:30.398540 | controller | Thursday 19 March 2026  14:47:30 +0000 (0:00:00.024)       0:02:06.687 ********
2026-03-19 14:47:30.398555 | controller | ok: [instance]
2026-03-19 14:47:30.901408 | controller |
2026-03-19 14:47:30.901464 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2026-03-19 14:47:30.901473 | controller | Thursday 19 March 2026  14:47:30 +0000 (0:00:00.240)       0:02:06.928 ********
2026-03-19 14:47:30.901487 | controller | ok: [instance]
2026-03-19 14:47:31.026478 | controller |
2026-03-19 14:47:31.026540 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2026-03-19 14:47:31.026552 | controller | Thursday 19 March 2026  14:47:30 +0000 (0:00:00.502)       0:02:07.431 ********
2026-03-19 14:47:31.026568 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-19 14:47:31.293697 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-19 14:47:31.293760 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-19 14:47:31.293773 | controller |
2026-03-19 14:47:31.293782 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2026-03-19 14:47:31.293791 | controller | Thursday 19 March 2026  14:47:31 +0000 (0:00:00.125)       0:02:07.556 ********
2026-03-19 14:47:31.293808 | controller | changed: [instance]
2026-03-19 14:47:31.518472 | controller |
2026-03-19 14:47:31.518526 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2026-03-19 14:47:31.518543 | controller | Thursday 19 March 2026  14:47:31 +0000 (0:00:00.267)       0:02:07.823 ********
2026-03-19 14:47:31.518558 | controller | changed: [instance]
2026-03-19 14:47:31.823457 | controller |
2026-03-19 14:47:31.823480 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2026-03-19 14:47:31.823490 | controller | Thursday 19 March 2026  14:47:31 +0000 (0:00:00.224)       0:02:08.048 ********
2026-03-19 14:47:31.823500 | controller | changed: [instance]
2026-03-19 14:47:31.823539 | controller |
2026-03-19 14:47:31.823547 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2026-03-19 14:47:31.823557 | controller | Thursday 19 March 2026  14:47:31 +0000 (0:00:00.305)       0:02:08.353 ********
2026-03-19 14:47:31.855954 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-19 14:47:31.905359 | controller |
2026-03-19 14:47:31.905378 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-19 14:47:31.905386 | controller | Thursday 19 March 2026  14:47:31 +0000 (0:00:00.032)       0:02:08.386 ********
2026-03-19 14:47:31.905395 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-19 14:47:32.145469 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-19 14:47:32.145527 | controller |
2026-03-19 14:47:32.145538 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 14:47:32.145547 | controller | Thursday 19 March 2026  14:47:31 +0000 (0:00:00.049)       0:02:08.435 ********
2026-03-19 14:47:32.145561 | controller | ok: [instance]
2026-03-19 14:47:32.191477 | controller |
2026-03-19 14:47:32.191499 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 14:47:32.191509 | controller | Thursday 19 March 2026  14:47:32 +0000 (0:00:00.240)       0:02:08.675 ********
2026-03-19 14:47:32.191520 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:47:32.191599 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 14:47:32.191625 | controller |
2026-03-19 14:47:32.191633 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 14:47:32.191644 | controller | Thursday 19 March 2026  14:47:32 +0000 (0:00:00.045)       0:02:08.721 ********
2026-03-19 14:47:32.432663 | controller | ok: [instance]
2026-03-19 14:47:32.635245 | controller |
2026-03-19 14:47:32.635278 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 14:47:32.635287 | controller | Thursday 19 March 2026  14:47:32 +0000 (0:00:00.241)       0:02:08.962 ********
2026-03-19 14:47:32.635297 | controller | ok: [instance]
2026-03-19 14:47:32.963949 | controller |
2026-03-19 14:47:32.964017 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2026-03-19 14:47:32.964026 | controller | Thursday 19 March 2026  14:47:32 +0000 (0:00:00.202)       0:02:09.165 ********
2026-03-19 14:47:32.964041 | controller | changed: [instance]
2026-03-19 14:47:33.205467 | controller |
2026-03-19 14:47:33.205530 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 14:47:33.205541 | controller | Thursday 19 March 2026  14:47:32 +0000 (0:00:00.327)       0:02:09.493 ********
2026-03-19 14:47:33.205565 | controller | ok: [instance]
2026-03-19 14:47:33.254570 | controller |
2026-03-19 14:47:33.254627 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 14:47:33.254639 | controller | Thursday 19 March 2026  14:47:33 +0000 (0:00:00.241)       0:02:09.735 ********
2026-03-19 14:47:33.254654 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:47:33.254693 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 14:47:33.254704 | controller |
2026-03-19 14:47:33.254832 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 14:47:33.254873 | controller | Thursday 19 March 2026  14:47:33 +0000 (0:00:00.049)       0:02:09.784 ********
2026-03-19 14:47:33.497967 | controller | ok: [instance]
2026-03-19 14:47:33.708979 | controller |
2026-03-19 14:47:33.709011 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 14:47:33.709019 | controller | Thursday 19 March 2026  14:47:33 +0000 (0:00:00.243)       0:02:10.028 ********
2026-03-19 14:47:33.709029 | controller | ok: [instance]
2026-03-19 14:47:34.012365 | controller |
2026-03-19 14:47:34.012404 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2026-03-19 14:47:34.012414 | controller | Thursday 19 March 2026  14:47:33 +0000 (0:00:00.211)       0:02:10.239 ********
2026-03-19 14:47:34.012426 | controller | changed: [instance]
2026-03-19 14:47:34.037352 | controller |
2026-03-19 14:47:34.037373 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2026-03-19 14:47:34.037382 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.302)       0:02:10.542 ********
2026-03-19 14:47:34.037393 | controller | skipping: [instance]
2026-03-19 14:47:34.069964 | controller |
2026-03-19 14:47:34.069980 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2026-03-19 14:47:34.069987 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.025)       0:02:10.567 ********
2026-03-19 14:47:34.070001 | controller | skipping: [instance]
2026-03-19 14:47:34.112496 | controller |
2026-03-19 14:47:34.112544 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2026-03-19 14:47:34.112556 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.032)       0:02:10.600 ********
2026-03-19 14:47:34.112569 | controller | skipping: [instance]
2026-03-19 14:47:34.112603 | controller |
2026-03-19 14:47:34.112613 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2026-03-19 14:47:34.112716 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.042)       0:02:10.642 ********
2026-03-19 14:47:34.142903 | controller | skipping: [instance]
2026-03-19 14:47:34.373071 | controller |
2026-03-19 14:47:34.373142 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-19 14:47:34.373150 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.030)       0:02:10.673 ********
2026-03-19 14:47:34.373163 | controller | changed: [instance]
2026-03-19 14:47:34.415831 | controller |
2026-03-19 14:47:34.415869 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-19 14:47:34.415878 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.229)       0:02:10.902 ********
2026-03-19 14:47:34.415892 | controller | ok: [instance]
2026-03-19 14:47:34.475561 | controller |
2026-03-19 14:47:34.475621 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-19 14:47:34.475632 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.043)       0:02:10.946 ********
2026-03-19 14:47:34.475653 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-03-19 14:47:34.705150 | controller |
2026-03-19 14:47:34.705208 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-03-19 14:47:34.705218 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.059)       0:02:11.005 ********
2026-03-19 14:47:34.705232 | controller | ok: [instance]
2026-03-19 14:47:34.774057 | controller |
2026-03-19 14:47:34.774120 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-03-19 14:47:34.774130 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.229)       0:02:11.235 ********
2026-03-19 14:47:34.774144 | controller | ok: [instance]
2026-03-19 14:47:34.825793 | controller |
2026-03-19 14:47:34.825810 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-03-19 14:47:34.825818 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.069)       0:02:11.304 ********
2026-03-19 14:47:34.825826 | controller | ok: [instance]
2026-03-19 14:47:34.875096 | controller |
2026-03-19 14:47:34.875119 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-03-19 14:47:34.875129 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.051)       0:02:11.356 ********
2026-03-19 14:47:34.875140 | controller | skipping: [instance]
2026-03-19 14:47:34.923498 | controller |
2026-03-19 14:47:34.923521 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-03-19 14:47:34.923529 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.049)       0:02:11.405 ********
2026-03-19 14:47:34.923539 | controller | skipping: [instance]
2026-03-19 14:47:34.987507 | controller |
2026-03-19 14:47:34.987566 | controller | TASK [Call the config_drive role] **********************************************
2026-03-19 14:47:34.987577 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.048)       0:02:11.453 ********
2026-03-19 14:47:34.987592 | controller |
2026-03-19 14:47:35.431254 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-03-19 14:47:35.431321 | controller | Thursday 19 March 2026  14:47:34 +0000 (0:00:00.064)       0:02:11.517 ********
2026-03-19 14:47:35.431353 | controller | ok: [instance] => (item=artifacts)
2026-03-19 14:47:36.765429 | controller | ok: [instance] => (item=logs)
2026-03-19 14:47:36.765472 | controller |
2026-03-19 14:47:36.765480 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-03-19 14:47:36.765486 | controller | Thursday 19 March 2026  14:47:35 +0000 (0:00:00.443)       0:02:11.960 ********
2026-03-19 14:47:36.765497 | controller | ok: [instance]
2026-03-19 14:47:36.765531 | controller |
2026-03-19 14:47:36.765540 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-03-19 14:47:36.765566 | controller | Thursday 19 March 2026  14:47:36 +0000 (0:00:01.334)       0:02:13.295 ********
2026-03-19 14:47:36.997315 | controller | changed: [instance]
2026-03-19 14:47:37.436056 | controller |
2026-03-19 14:47:37.436135 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-03-19 14:47:37.436145 | controller | Thursday 19 March 2026  14:47:36 +0000 (0:00:00.231)       0:02:13.527 ********
2026-03-19 14:47:37.436158 | controller | changed: [instance]
2026-03-19 14:47:37.819544 | controller |
2026-03-19 14:47:37.819596 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-03-19 14:47:37.819618 | controller | Thursday 19 March 2026  14:47:37 +0000 (0:00:00.438)       0:02:13.965 ********
2026-03-19 14:47:37.819635 | controller | changed: [instance]
2026-03-19 14:47:37.866160 | controller |
2026-03-19 14:47:37.866229 | controller | TASK [config_drive : Generate network-data] ************************************
2026-03-19 14:47:37.866239 | controller | Thursday 19 March 2026  14:47:37 +0000 (0:00:00.383)       0:02:14.349 ********
2026-03-19 14:47:37.866253 | controller | skipping: [instance]
2026-03-19 14:47:38.073941 | controller |
2026-03-19 14:47:38.073964 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-03-19 14:47:38.073972 | controller | Thursday 19 March 2026  14:47:37 +0000 (0:00:00.047)       0:02:14.396 ********
2026-03-19 14:47:38.073981 | controller | ok: [instance]
2026-03-19 14:47:38.121235 | controller |
2026-03-19 14:47:38.121266 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-03-19 14:47:38.121279 | controller | Thursday 19 March 2026  14:47:38 +0000 (0:00:00.208)       0:02:14.604 ********
2026-03-19 14:47:38.121294 | controller | skipping: [instance]
2026-03-19 14:47:38.367994 | controller |
2026-03-19 14:47:38.368017 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-03-19 14:47:38.368025 | controller | Thursday 19 March 2026  14:47:38 +0000 (0:00:00.046)       0:02:14.651 ********
2026-03-19 14:47:38.368034 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2026-03-19 14:47:38.659511 | controller | changed: [instance]
2026-03-19 14:47:38.659569 | controller |
2026-03-19 14:47:38.659583 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-19 14:47:38.659602 | controller | Thursday 19 March 2026  14:47:38 +0000 (0:00:00.247)       0:02:14.898 ********
2026-03-19 14:47:38.659620 | controller | changed: [instance]
2026-03-19 14:47:38.709192 | controller |
2026-03-19 14:47:38.709230 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-19 14:47:38.709240 | controller | Thursday 19 March 2026  14:47:38 +0000 (0:00:00.291)       0:02:15.189 ********
2026-03-19 14:47:38.709252 | controller | skipping: [instance]
2026-03-19 14:47:38.740899 | controller |
2026-03-19 14:47:38.740916 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ********************
2026-03-19 14:47:38.740924 | controller | Thursday 19 March 2026  14:47:38 +0000 (0:00:00.049)       0:02:15.239 ********
2026-03-19 14:47:38.740932 | controller | skipping: [instance]
2026-03-19 14:47:39.003466 | controller |
2026-03-19 14:47:39.003507 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2026-03-19 14:47:39.003516 | controller | Thursday 19 March 2026  14:47:38 +0000 (0:00:00.031)       0:02:15.271 ********
2026-03-19 14:47:39.003528 | controller | changed: [instance]
2026-03-19 14:47:39.239934 | controller |
2026-03-19 14:47:39.239961 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2026-03-19 14:47:39.239969 | controller | Thursday 19 March 2026  14:47:39 +0000 (0:00:00.261)       0:02:15.533 ********
2026-03-19 14:47:39.239981 | controller | changed: [instance]
2026-03-19 14:47:39.563577 | controller |
2026-03-19 14:47:39.563644 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2026-03-19 14:47:39.563655 | controller | Thursday 19 March 2026  14:47:39 +0000 (0:00:00.236)       0:02:15.769 ********
2026-03-19 14:47:39.563670 | controller | changed: [instance]
2026-03-19 14:47:39.600143 | controller |
2026-03-19 14:47:39.600174 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2026-03-19 14:47:39.600182 | controller | Thursday 19 March 2026  14:47:39 +0000 (0:00:00.323)       0:02:16.093 ********
2026-03-19 14:47:39.600195 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-19 14:47:39.649522 | controller |
2026-03-19 14:47:39.649581 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-19 14:47:39.649597 | controller | Thursday 19 March 2026  14:47:39 +0000 (0:00:00.037)       0:02:16.130 ********
2026-03-19 14:47:39.649617 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-19 14:47:39.896813 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-19 14:47:39.896851 | controller |
2026-03-19 14:47:39.896860 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 14:47:39.896867 | controller | Thursday 19 March 2026  14:47:39 +0000 (0:00:00.049)       0:02:16.179 ********
2026-03-19 14:47:39.896879 | controller | ok: [instance]
2026-03-19 14:47:39.944004 | controller |
2026-03-19 14:47:39.944022 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 14:47:39.944029 | controller | Thursday 19 March 2026  14:47:39 +0000 (0:00:00.247)       0:02:16.427 ********
2026-03-19 14:47:39.944037 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:47:40.196508 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 14:47:40.196547 | controller |
2026-03-19 14:47:40.196558 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 14:47:40.196572 | controller | Thursday 19 March 2026  14:47:39 +0000 (0:00:00.047)       0:02:16.474 ********
2026-03-19 14:47:40.196585 | controller | ok: [instance]
2026-03-19 14:47:40.400393 | controller |
2026-03-19 14:47:40.400411 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 14:47:40.400418 | controller | Thursday 19 March 2026  14:47:40 +0000 (0:00:00.252)       0:02:16.726 ********
2026-03-19 14:47:40.400426 | controller | ok: [instance]
2026-03-19 14:47:40.400803 | controller |
2026-03-19 14:47:40.701465 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2026-03-19 14:47:40.701540 | controller | Thursday 19 March 2026  14:47:40 +0000 (0:00:00.204)       0:02:16.930 ********
2026-03-19 14:47:40.701558 | controller | changed: [instance]
2026-03-19 14:47:40.952103 | controller |
2026-03-19 14:47:40.952163 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 14:47:40.952172 | controller | Thursday 19 March 2026  14:47:40 +0000 (0:00:00.300)       0:02:17.231 ********
2026-03-19 14:47:40.952185 | controller | ok: [instance]
2026-03-19 14:47:41.000550 | controller |
2026-03-19 14:47:41.000602 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 14:47:41.000613 | controller | Thursday 19 March 2026  14:47:40 +0000 (0:00:00.250)       0:02:17.481 ********
2026-03-19 14:47:41.000630 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:47:41.246601 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 14:47:41.246667 | controller |
2026-03-19 14:47:41.246683 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 14:47:41.246695 | controller | Thursday 19 March 2026  14:47:40 +0000 (0:00:00.048)       0:02:17.530 ********
2026-03-19 14:47:41.246714 | controller | ok: [instance]
2026-03-19 14:47:41.476408 | controller |
2026-03-19 14:47:41.476456 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 14:47:41.476471 | controller | Thursday 19 March 2026  14:47:41 +0000 (0:00:00.246)       0:02:17.776 ********
2026-03-19 14:47:41.476490 | controller | ok: [instance]
2026-03-19 14:47:41.795419 | controller |
2026-03-19 14:47:41.795448 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2026-03-19 14:47:41.795456 | controller | Thursday 19 March 2026  14:47:41 +0000 (0:00:00.229)       0:02:18.006 ********
2026-03-19 14:47:41.795467 | controller | changed: [instance]
2026-03-19 14:47:41.795504 | controller |
2026-03-19 14:47:41.795733 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2026-03-19 14:47:41.820588 | controller | Thursday 19 March 2026  14:47:41 +0000 (0:00:00.319)       0:02:18.325 ********
2026-03-19 14:47:41.820637 | controller | skipping: [instance]
2026-03-19 14:47:41.820679 | controller |
2026-03-19 14:47:41.820692 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2026-03-19 14:47:41.820708 | controller | Thursday 19 March 2026  14:47:41 +0000 (0:00:00.025)       0:02:18.350 ********
2026-03-19 14:47:41.853531 | controller | skipping: [instance]
2026-03-19 14:47:41.885522 | controller |
2026-03-19 14:47:41.885551 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2026-03-19 14:47:41.885561 | controller | Thursday 19 March 2026  14:47:41 +0000 (0:00:00.032)       0:02:18.383 ********
2026-03-19 14:47:41.885573 | controller | skipping: [instance]
2026-03-19 14:47:41.885600 | controller |
2026-03-19 14:47:41.885608 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2026-03-19 14:47:41.885618 | controller | Thursday 19 March 2026  14:47:41 +0000 (0:00:00.032)       0:02:18.415 ********
2026-03-19 14:47:41.915960 | controller | skipping: [instance]
2026-03-19 14:47:42.139802 | controller |
2026-03-19 14:47:42.139827 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-19 14:47:42.139835 | controller | Thursday 19 March 2026  14:47:41 +0000 (0:00:00.030)       0:02:18.446 ********
2026-03-19 14:47:42.139847 | controller | changed: [instance]
2026-03-19 14:47:42.181230 | controller |
2026-03-19 14:47:42.181252 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-19 14:47:42.181260 | controller | Thursday 19 March 2026  14:47:42 +0000 (0:00:00.223)       0:02:18.669 ********
2026-03-19 14:47:42.181269 | controller | ok: [instance]
2026-03-19 14:47:42.237324 | controller |
2026-03-19 14:47:42.237367 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-19 14:47:42.237376 | controller | Thursday 19 March 2026  14:47:42 +0000 (0:00:00.041)       0:02:18.711 ********
2026-03-19 14:47:42.237389 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-03-19 14:47:42.448477 | controller |
2026-03-19 14:47:42.448514 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-03-19 14:47:42.448529 | controller | Thursday 19 March 2026  14:47:42 +0000 (0:00:00.056)       0:02:18.767 ********
2026-03-19 14:47:42.448546 | controller | ok: [instance]
2026-03-19 14:47:42.514641 | controller |
2026-03-19 14:47:42.514729 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-03-19 14:47:42.514740 | controller | Thursday 19 March 2026  14:47:42 +0000 (0:00:00.210)       0:02:18.978 ********
2026-03-19 14:47:42.514756 | controller | ok: [instance]
2026-03-19 14:47:42.566197 | controller |
2026-03-19 14:47:42.566227 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-03-19 14:47:42.566237 | controller | Thursday 19 March 2026  14:47:42 +0000 (0:00:00.066)       0:02:19.044 ********
2026-03-19 14:47:42.566249 | controller | ok: [instance]
2026-03-19 14:47:42.613256 | controller |
2026-03-19 14:47:42.613280 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-03-19 14:47:42.613290 | controller | Thursday 19 March 2026  14:47:42 +0000 (0:00:00.051)       0:02:19.096 ********
2026-03-19 14:47:42.613302 | controller | skipping: [instance]
2026-03-19 14:47:42.660071 | controller |
2026-03-19 14:47:42.660103 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-03-19 14:47:42.660110 | controller | Thursday 19 March 2026  14:47:42 +0000 (0:00:00.047)       0:02:19.143 ********
2026-03-19 14:47:42.660119 | controller | skipping: [instance]
2026-03-19 14:47:42.722275 | controller |
2026-03-19 14:47:42.722292 | controller | TASK [Call the config_drive role] **********************************************
2026-03-19 14:47:42.722299 | controller | Thursday 19 March 2026  14:47:42 +0000 (0:00:00.046)       0:02:19.190 ********
2026-03-19 14:47:42.722308 | controller |
2026-03-19 14:47:43.150155 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-03-19 14:47:43.150210 | controller | Thursday 19 March 2026  14:47:42 +0000 (0:00:00.062)       0:02:19.252 ********
2026-03-19 14:47:43.150224 | controller | ok: [instance] => (item=artifacts)
2026-03-19 14:47:44.451969 | controller | ok: [instance] => (item=logs)
2026-03-19 14:47:44.452032 | controller |
2026-03-19 14:47:44.452042 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-03-19 14:47:44.452049 | controller | Thursday 19 March 2026  14:47:43 +0000 (0:00:00.427)       0:02:19.679 ********
2026-03-19 14:47:44.452062 | controller | ok: [instance]
2026-03-19 14:47:44.677689 | controller |
2026-03-19 14:47:44.677715 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-03-19 14:47:44.677722 | controller | Thursday 19 March 2026  14:47:44 +0000 (0:00:01.301)       0:02:20.981 ********
2026-03-19 14:47:44.677733 | controller | changed: [instance]
2026-03-19 14:47:45.063265 | controller |
2026-03-19 14:47:45.063290 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-03-19 14:47:45.063298 | controller | Thursday 19 March 2026  14:47:44 +0000 (0:00:00.226)       0:02:21.208 ********
2026-03-19 14:47:45.063307 | controller | changed: [instance]
2026-03-19 14:47:45.456124 | controller |
2026-03-19 14:47:45.456188 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-03-19 14:47:45.456197 | controller | Thursday 19 March 2026  14:47:45 +0000 (0:00:00.385)       0:02:21.593 ********
2026-03-19 14:47:45.456210 | controller | changed: [instance]
2026-03-19 14:47:45.502878 | controller |
2026-03-19 14:47:45.502904 | controller | TASK [config_drive : Generate network-data] ************************************
2026-03-19 14:47:45.502912 | controller | Thursday 19 March 2026  14:47:45 +0000 (0:00:00.392)       0:02:21.986 ********
2026-03-19 14:47:45.502923 | controller | skipping: [instance]
2026-03-19 14:47:45.715259 | controller |
2026-03-19 14:47:45.715313 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-03-19 14:47:45.715322 | controller | Thursday 19 March 2026  14:47:45 +0000 (0:00:00.047)       0:02:22.033 ********
2026-03-19 14:47:45.715350 | controller | ok: [instance]
2026-03-19 14:47:45.759311 | controller |
2026-03-19 14:47:45.759353 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-03-19 14:47:45.759367 | controller | Thursday 19 March 2026  14:47:45 +0000 (0:00:00.211)       0:02:22.245 ********
2026-03-19 14:47:45.759379 | controller | skipping: [instance]
2026-03-19 14:47:46.004970 | controller |
2026-03-19 14:47:46.004991 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-03-19 14:47:46.005009 | controller | Thursday 19 March 2026  14:47:45 +0000 (0:00:00.044)       0:02:22.289 ********
2026-03-19 14:47:46.005019 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2026-03-19 14:47:46.348213 | controller | changed: [instance]
2026-03-19 14:47:46.348273 | controller |
2026-03-19 14:47:46.348284 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-19 14:47:46.348293 | controller | Thursday 19 March 2026  14:47:46 +0000 (0:00:00.245)       0:02:22.535 ********
2026-03-19 14:47:46.348311 | controller | changed: [instance]
2026-03-19 14:47:46.400137 | controller |
2026-03-19 14:47:46.400177 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-19 14:47:46.400186 | controller | Thursday 19 March 2026  14:47:46 +0000 (0:00:00.342)       0:02:22.877 ********
2026-03-19 14:47:46.400198 | controller | skipping: [instance]
2026-03-19 14:47:46.435580 | controller |
2026-03-19 14:47:46.435620 | controller | TASK [libvirt_manager : Configure boot order for controller-0] *****************
2026-03-19 14:47:46.435630 | controller | Thursday 19 March 2026  14:47:46 +0000 (0:00:00.052)       0:02:22.930 ********
2026-03-19 14:47:46.435642 | controller | skipping: [instance]
2026-03-19 14:47:46.699505 | controller |
2026-03-19 14:47:46.699564 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2026-03-19 14:47:46.699574 | controller | Thursday 19 March 2026  14:47:46 +0000 (0:00:00.035)       0:02:22.965 ********
2026-03-19 14:47:46.699589 | controller | changed: [instance]
2026-03-19 14:47:46.928436 | controller |
2026-03-19 14:47:46.928484 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2026-03-19 14:47:46.928492 | controller | Thursday 19 March 2026  14:47:46 +0000 (0:00:00.263)       0:02:23.229 ********
2026-03-19 14:47:46.928503 | controller | changed: [instance]
2026-03-19 14:47:46.928638 | controller |
2026-03-19 14:47:46.928669 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2026-03-19 14:47:46.928683 | controller | Thursday 19 March 2026  14:47:46 +0000 (0:00:00.229)       0:02:23.458 ********
2026-03-19 14:47:47.233546 | controller | changed: [instance]
2026-03-19 14:47:47.233732 | controller |
2026-03-19 14:47:47.233800 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2026-03-19 14:47:47.233817 | controller | Thursday 19 March 2026  14:47:47 +0000 (0:00:00.304)       0:02:23.763 ********
2026-03-19 14:47:47.263517 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-19 14:47:47.263602 | controller |
2026-03-19 14:47:47.263977 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-19 14:47:47.310504 | controller | Thursday 19 March 2026  14:47:47 +0000 (0:00:00.030)       0:02:23.793 ********
2026-03-19 14:47:47.310562 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-19 14:47:47.310600 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-19 14:47:47.310610 | controller |
2026-03-19 14:47:47.310805 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 14:47:47.548190 | controller | Thursday 19 March 2026  14:47:47 +0000 (0:00:00.047)       0:02:23.841 ********
2026-03-19 14:47:47.548232 | controller | ok: [instance]
2026-03-19 14:47:47.596143 | controller |
2026-03-19 14:47:47.596163 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 14:47:47.596173 | controller | Thursday 19 March 2026  14:47:47 +0000 (0:00:00.237)       0:02:24.078 ********
2026-03-19 14:47:47.596184 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:47:47.839478 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 14:47:47.839533 | controller |
2026-03-19 14:47:47.839545 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 14:47:47.839555 | controller | Thursday 19 March 2026  14:47:47 +0000 (0:00:00.048)       0:02:24.126 ********
2026-03-19 14:47:47.839576 | controller | ok: [instance]
2026-03-19 14:47:47.839613 | controller |
2026-03-19 14:47:47.839625 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 14:47:48.040443 | controller | Thursday 19 March 2026  14:47:47 +0000 (0:00:00.243)       0:02:24.369 ********
2026-03-19 14:47:48.040496 | controller | ok: [instance]
2026-03-19 14:47:48.333803 | controller |
2026-03-19 14:47:48.333848 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2026-03-19 14:47:48.333857 | controller | Thursday 19 March 2026  14:47:48 +0000 (0:00:00.201)       0:02:24.570 ********
2026-03-19 14:47:48.333868 | controller | changed: [instance]
2026-03-19 14:47:48.568899 | controller |
2026-03-19 14:47:48.568944 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-19 14:47:48.568953 | controller | Thursday 19 March 2026  14:47:48 +0000 (0:00:00.293)       0:02:24.864 ********
2026-03-19 14:47:48.568965 | controller | ok: [instance]
2026-03-19 14:47:48.616012 | controller |
2026-03-19 14:47:48.616029 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-19 14:47:48.616036 | controller | Thursday 19 March 2026  14:47:48 +0000 (0:00:00.234)       0:02:25.099 ********
2026-03-19 14:47:48.616044 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-19 14:47:48.855023 | controller | ok: [instance] => (item=cifmw-public)
2026-03-19 14:47:48.855105 | controller |
2026-03-19 14:47:48.855115 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-19 14:47:48.855123 | controller | Thursday 19 March 2026  14:47:48 +0000 (0:00:00.047)       0:02:25.146 ********
2026-03-19 14:47:48.855136 | controller | ok: [instance]
2026-03-19 14:47:49.072070 | controller |
2026-03-19 14:47:49.072129 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-19 14:47:49.072143 | controller | Thursday 19 March 2026  14:47:48 +0000 (0:00:00.238)       0:02:25.384 ********
2026-03-19 14:47:49.072155 | controller | ok: [instance]
2026-03-19 14:47:49.375474 | controller |
2026-03-19 14:47:49.375508 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2026-03-19 14:47:49.375518 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.217)       0:02:25.602 ********
2026-03-19 14:47:49.375530 | controller | changed: [instance]
2026-03-19 14:47:49.375562 | controller |
2026-03-19 14:47:49.375572 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2026-03-19 14:47:49.375599 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.303)       0:02:25.905 ********
2026-03-19 14:47:49.397445 | controller | skipping: [instance]
2026-03-19 14:47:49.397550 | controller |
2026-03-19 14:47:49.397581 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2026-03-19 14:47:49.397595 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.022)       0:02:25.927 ********
2026-03-19 14:47:49.428067 | controller | skipping: [instance]
2026-03-19 14:47:49.455779 | controller |
2026-03-19 14:47:49.455798 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2026-03-19 14:47:49.455806 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.030)       0:02:25.958 ********
2026-03-19 14:47:49.455815 | controller | skipping: [instance]
2026-03-19 14:47:49.483920 | controller |
2026-03-19 14:47:49.483939 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2026-03-19 14:47:49.483947 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.027)       0:02:25.986 ********
2026-03-19 14:47:49.483956 | controller | skipping: [instance]
2026-03-19 14:47:49.710355 | controller |
2026-03-19 14:47:49.710386 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-19 14:47:49.710394 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.028)       0:02:26.014 ********
2026-03-19 14:47:49.710404 | controller | changed: [instance]
2026-03-19 14:47:49.748774 | controller |
2026-03-19 14:47:49.748804 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-19 14:47:49.748813 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.226)       0:02:26.240 ********
2026-03-19 14:47:49.748824 | controller | ok: [instance]
2026-03-19 14:47:49.777971 | controller |
2026-03-19 14:47:49.777995 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-19 14:47:49.778009 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.038)       0:02:26.279 ********
2026-03-19 14:47:49.778021 | controller | skipping: [instance]
2026-03-19 14:47:49.806882 | controller |
2026-03-19 14:47:49.806906 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-19 14:47:49.806914 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.029)       0:02:26.308 ********
2026-03-19 14:47:49.806924 | controller | skipping: [instance]
2026-03-19 14:47:49.854210 | controller |
2026-03-19 14:47:49.854235 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-19 14:47:49.854245 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.028)       0:02:26.337 ********
2026-03-19 14:47:49.854256 | controller | skipping: [instance]
2026-03-19 14:47:49.881293 | controller |
2026-03-19 14:47:49.881317 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************
2026-03-19 14:47:49.881326 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.047)       0:02:26.384 ********
2026-03-19 14:47:49.881357 | controller | skipping: [instance]
2026-03-19 14:47:49.945167 | controller |
2026-03-19 14:47:49.945186 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2026-03-19 14:47:49.945194 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.027)       0:02:26.411 ********
2026-03-19 14:47:49.945202 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2026-03-19 14:47:50.188467 | controller |
2026-03-19 14:47:50.188507 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2026-03-19 14:47:50.188519 | controller | Thursday 19 March 2026  14:47:49 +0000 (0:00:00.063)       0:02:26.475 ********
2026-03-19 14:47:50.188533 | controller | ok: [instance] => (item=crc)
2026-03-19 14:47:52.262262 | controller |
2026-03-19 14:47:52.262297 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2026-03-19 14:47:52.262305 | controller | Thursday 19 March 2026  14:47:50 +0000 (0:00:00.243)       0:02:26.718 ********
2026-03-19 14:47:52.262315 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-19 14:47:52.826317 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-19 14:47:52.826367 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-19 14:47:52.826376 | controller |
2026-03-19 14:47:52.826382 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-19 14:47:52.826388 | controller | Thursday 19 March 2026  14:47:52 +0000 (0:00:02.073)       0:02:28.792 ********
2026-03-19 14:47:52.826401 | controller | changed: [instance]
2026-03-19 14:47:53.313008 | controller |
2026-03-19 14:47:53.313041 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-19 14:47:53.313050 | controller | Thursday 19 March 2026  14:47:52 +0000 (0:00:00.564)       0:02:29.356 ********
2026-03-19 14:47:53.313060 | controller | changed: [instance]
2026-03-19 14:47:53.829830 | controller |
2026-03-19 14:47:53.829864 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-19 14:47:53.829872 | controller | Thursday 19 March 2026  14:47:53 +0000 (0:00:00.486)       0:02:29.843 ********
2026-03-19 14:47:53.829882 | controller | changed: [instance]
2026-03-19 14:47:54.632045 | controller |
2026-03-19 14:47:54.632076 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2026-03-19 14:47:54.632096 | controller | Thursday 19 March 2026  14:47:53 +0000 (0:00:00.516)       0:02:30.359 ********
2026-03-19 14:47:54.632107 | controller | changed: [instance] => (item=compute-0.utility)
2026-03-19 14:48:17.770376 | controller | changed: [instance] => (item=controller-0.utility)
2026-03-19 14:48:17.770408 | controller | changed: [instance] => (item=crc-0.utility)
2026-03-19 14:48:17.770416 | controller |
2026-03-19 14:48:17.770422 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2026-03-19 14:48:17.770433 | controller | Thursday 19 March 2026  14:47:54 +0000 (0:00:00.801)       0:02:31.161 ********
2026-03-19 14:48:17.770444 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2026-03-19 14:48:17.887687 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2026-03-19 14:48:17.887742 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2026-03-19 14:48:17.887751 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2026-03-19 14:48:17.887756 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2026-03-19 14:48:17.887762 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left).
2026-03-19 14:48:17.887767 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left).
2026-03-19 14:48:17.887773 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j952626589620.22894', 'results_file': '/home/zuul/.ansible_async/j952626589620.22894', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2026-03-19 14:48:17.887786 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j553930485737.22911', 'results_file': '/home/zuul/.ansible_async/j553930485737.22911', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2026-03-19 14:48:17.887791 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j104145645213.22928', 'results_file': '/home/zuul/.ansible_async/j104145645213.22928', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2026-03-19 14:48:17.887797 | controller |
2026-03-19 14:48:17.887803 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2026-03-19 14:48:17.887809 | controller | Thursday 19 March 2026  14:48:17 +0000 (0:00:23.137)       0:02:54.299 ********
2026-03-19 14:48:17.887821 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-19 14:48:17.887839 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-19 14:48:17.887845 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-19 14:48:17.887852 | controller |
2026-03-19 14:48:17.887921 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-19 14:48:17.887930 | controller | Thursday 19 March 2026  14:48:17 +0000 (0:00:00.118)       0:02:54.417 ********
2026-03-19 14:48:17.917999 | controller | skipping: [instance]
2026-03-19 14:48:18.056221 | controller |
2026-03-19 14:48:18.056253 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2026-03-19 14:48:18.056272 | controller | Thursday 19 March 2026  14:48:17 +0000 (0:00:00.030)       0:02:54.448 ********
2026-03-19 14:48:18.056282 | controller |
2026-03-19 14:48:18.146444 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-19 14:48:18.146470 | controller | Thursday 19 March 2026  14:48:18 +0000 (0:00:00.138)       0:02:54.586 ********
2026-03-19 14:48:18.146497 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-03-19 14:48:18.397610 | controller |
2026-03-19 14:48:18.397640 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-19 14:48:18.397658 | controller | Thursday 19 March 2026  14:48:18 +0000 (0:00:00.089)       0:02:54.676 ********
2026-03-19 14:48:18.397668 | controller | changed: [instance]
2026-03-19 14:48:18.621367 | controller |
2026-03-19 14:48:18.621397 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-19 14:48:18.621404 | controller | Thursday 19 March 2026  14:48:18 +0000 (0:00:00.251)       0:02:54.927 ********
2026-03-19 14:48:18.621415 | controller | changed: [instance]
2026-03-19 14:48:19.036471 | controller |
2026-03-19 14:48:19.036518 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2026-03-19 14:48:19.036527 | controller | Thursday 19 March 2026  14:48:18 +0000 (0:00:00.223)       0:02:55.151 ********
2026-03-19 14:48:19.036537 | controller | changed: [instance]
2026-03-19 14:48:19.066851 | controller |
2026-03-19 14:48:19.066873 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2026-03-19 14:48:19.066881 | controller | Thursday 19 March 2026  14:48:19 +0000 (0:00:00.414)       0:02:55.566 ********
2026-03-19 14:48:19.066890 | controller | skipping: [instance]
2026-03-19 14:48:19.107228 | controller |
2026-03-19 14:48:19.107252 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-19 14:48:19.107260 | controller | Thursday 19 March 2026  14:48:19 +0000 (0:00:00.030)       0:02:55.597 ********
2026-03-19 14:48:19.107269 | controller | skipping: [instance]
2026-03-19 14:48:19.157555 | controller |
2026-03-19 14:48:19.157573 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2026-03-19 14:48:19.157581 | controller | Thursday 19 March 2026  14:48:19 +0000 (0:00:00.040)       0:02:55.637 ********
2026-03-19 14:48:19.157590 | controller | skipping: [instance]
2026-03-19 14:48:19.214094 | controller |
2026-03-19 14:48:19.214125 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2026-03-19 14:48:19.214133 | controller | Thursday 19 March 2026  14:48:19 +0000 (0:00:00.050)       0:02:55.687 ********
2026-03-19 14:48:19.214142 | controller | skipping: [instance]
2026-03-19 14:48:19.243594 | controller |
2026-03-19 14:48:19.243615 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-19 14:48:19.243623 | controller | Thursday 19 March 2026  14:48:19 +0000 (0:00:00.056)       0:02:55.744 ********
2026-03-19 14:48:19.243631 | controller | skipping: [instance]
2026-03-19 14:48:19.284353 | controller |
2026-03-19 14:48:19.284374 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2026-03-19 14:48:19.284382 | controller | Thursday 19 March 2026  14:48:19 +0000 (0:00:00.029)       0:02:55.774 ********
2026-03-19 14:48:19.284391 | controller |
2026-03-19 14:48:19.375087 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-19 14:48:19.375119 | controller | Thursday 19 March 2026  14:48:19 +0000 (0:00:00.040)       0:02:55.814 ********
2026-03-19 14:48:19.375135 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-03-19 14:48:19.635622 | controller |
2026-03-19 14:48:19.635659 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-19 14:48:19.635668 | controller | Thursday 19 March 2026  14:48:19 +0000 (0:00:00.090)       0:02:55.905 ********
2026-03-19 14:48:19.635678 | controller | ok: [instance]
2026-03-19 14:48:19.876056 | controller |
2026-03-19 14:48:19.876091 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-19 14:48:19.876110 | controller | Thursday 19 March 2026  14:48:19 +0000 (0:00:00.259)       0:02:56.165 ********
2026-03-19 14:48:19.876121 | controller | ok: [instance]
2026-03-19 14:48:20.317197 | controller |
2026-03-19 14:48:20.317241 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2026-03-19 14:48:20.317249 | controller | Thursday 19 March 2026  14:48:19 +0000 (0:00:00.240)       0:02:56.406 ********
2026-03-19 14:48:20.317269 | controller | changed: [instance]
2026-03-19 14:48:20.350327 | controller |
2026-03-19 14:48:20.350384 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2026-03-19 14:48:20.350394 | controller | Thursday 19 March 2026  14:48:20 +0000 (0:00:00.440)       0:02:56.847 ********
2026-03-19 14:48:20.350405 | controller | skipping: [instance]
2026-03-19 14:48:20.350758 | controller |
2026-03-19 14:48:20.384222 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-19 14:48:20.384263 | controller | Thursday 19 March 2026  14:48:20 +0000 (0:00:00.033)       0:02:56.880 ********
2026-03-19 14:48:20.384277 | controller | skipping: [instance]
2026-03-19 14:48:22.131817 | controller |
2026-03-19 14:48:22.131857 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2026-03-19 14:48:22.131865 | controller | Thursday 19 March 2026  14:48:20 +0000 (0:00:00.033)       0:02:56.914 ********
2026-03-19 14:48:22.131875 | controller | changed: [instance -> controller-0.instance]
2026-03-19 14:48:23.397546 | controller |
2026-03-19 14:48:23.397581 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2026-03-19 14:48:23.397588 | controller | Thursday 19 March 2026  14:48:22 +0000 (0:00:01.747)       0:02:58.661 ********
2026-03-19 14:48:23.397598 | controller | changed: [instance -> controller-0.instance]
2026-03-19 14:48:23.444199 | controller |
2026-03-19 14:48:23.444229 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-19 14:48:23.444253 | controller | Thursday 19 March 2026  14:48:23 +0000 (0:00:01.265)       0:02:59.927 ********
2026-03-19 14:48:23.444264 | controller |
2026-03-19 14:48:23.695909 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-03-19 14:48:23.695943 | controller | Thursday 19 March 2026  14:48:23 +0000 (0:00:00.047)       0:02:59.974 ********
2026-03-19 14:48:23.695955 | controller | ok: [instance]
2026-03-19 14:48:23.732587 | controller |
2026-03-19 14:48:23.732652 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-03-19 14:48:23.732663 | controller | Thursday 19 March 2026  14:48:23 +0000 (0:00:00.251)       0:03:00.225 ********
2026-03-19 14:48:23.732678 | controller | ok: [instance]
2026-03-19 14:48:23.769705 | controller |
2026-03-19 14:48:23.769737 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-03-19 14:48:23.769753 | controller | Thursday 19 March 2026  14:48:23 +0000 (0:00:00.036)       0:03:00.262 ********
2026-03-19 14:48:23.769765 | controller | skipping: [instance]
2026-03-19 14:48:23.769785 | controller |
2026-03-19 14:48:23.769878 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2026-03-19 14:48:23.769963 | controller | Thursday 19 March 2026  14:48:23 +0000 (0:00:00.037)       0:03:00.300 ********
2026-03-19 14:48:23.821474 | controller |
2026-03-19 14:48:23.821531 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-19 14:48:23.821640 | controller | Thursday 19 March 2026  14:48:23 +0000 (0:00:00.051)       0:03:00.352 ********
2026-03-19 14:48:23.909043 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2026-03-19 14:48:23.909214 | controller |
2026-03-19 14:48:23.909320 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-19 14:48:23.909458 | controller | Thursday 19 March 2026  14:48:23 +0000 (0:00:00.087)       0:03:00.439 ********
2026-03-19 14:48:24.163145 | controller | ok: [instance]
2026-03-19 14:48:24.163221 | controller |
2026-03-19 14:48:24.163316 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-19 14:48:24.163449 | controller | Thursday 19 March 2026  14:48:24 +0000 (0:00:00.252)       0:03:00.691 ********
2026-03-19 14:48:24.405910 | controller | ok: [instance]
2026-03-19 14:48:24.835490 | controller |
2026-03-19 14:48:24.835529 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2026-03-19 14:48:24.835542 | controller | Thursday 19 March 2026  14:48:24 +0000 (0:00:00.244)       0:03:00.935 ********
2026-03-19 14:48:24.835552 | controller | changed: [instance]
2026-03-19 14:48:25.727646 | controller |
2026-03-19 14:48:25.727686 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2026-03-19 14:48:25.727694 | controller | Thursday 19 March 2026  14:48:24 +0000 (0:00:00.429)       0:03:01.365 ********
2026-03-19 14:48:25.727705 | controller | changed: [instance]
2026-03-19 14:48:25.767688 | controller |
2026-03-19 14:48:25.767714 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-19 14:48:25.767723 | controller | Thursday 19 March 2026  14:48:25 +0000 (0:00:00.891)       0:03:02.257 ********
2026-03-19 14:48:25.767732 | controller | skipping: [instance]
2026-03-19 14:48:25.825594 | controller |
2026-03-19 14:48:25.825631 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2026-03-19 14:48:25.825640 | controller | Thursday 19 March 2026  14:48:25 +0000 (0:00:00.040)       0:03:02.297 ********
2026-03-19 14:48:25.825650 | controller | skipping: [instance]
2026-03-19 14:48:25.884802 | controller |
2026-03-19 14:48:25.884837 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2026-03-19 14:48:25.884845 | controller | Thursday 19 March 2026  14:48:25 +0000 (0:00:00.057)       0:03:02.355 ********
2026-03-19 14:48:25.884855 | controller | skipping: [instance]
2026-03-19 14:48:25.940018 | controller |
2026-03-19 14:48:25.940045 | controller | TASK [Create VBMC entity] ******************************************************
2026-03-19 14:48:25.940053 | controller | Thursday 19 March 2026  14:48:25 +0000 (0:00:00.059)       0:03:02.414 ********
2026-03-19 14:48:25.940063 | controller | skipping: [instance] => (item=compute-0)
2026-03-19 14:48:26.219074 | controller | skipping: [instance] => (item=controller-0)
2026-03-19 14:48:26.219125 | controller | skipping: [instance] => (item=crc-0)
2026-03-19 14:48:26.219133 | controller | skipping: [instance]
2026-03-19 14:48:26.219139 | controller |
2026-03-19 14:48:26.219145 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2026-03-19 14:48:26.219151 | controller | Thursday 19 March 2026  14:48:25 +0000 (0:00:00.055)       0:03:02.470 ********
2026-03-19 14:48:26.219162 | controller | ok: [instance]
2026-03-19 14:48:26.625788 | controller |
2026-03-19 14:48:26.625820 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2026-03-19 14:48:26.625829 | controller | Thursday 19 March 2026  14:48:26 +0000 (0:00:00.278)       0:03:02.748 ********
2026-03-19 14:48:26.625839 | controller | changed: [instance]
2026-03-19 14:48:26.668070 | controller |
2026-03-19 14:48:26.668093 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2026-03-19 14:48:26.668100 | controller | Thursday 19 March 2026  14:48:26 +0000 (0:00:00.406)       0:03:03.155 ********
2026-03-19 14:48:26.668121 | controller | skipping: [instance]
2026-03-19 14:48:26.713468 | controller |
2026-03-19 14:48:26.713488 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2026-03-19 14:48:26.713496 | controller | Thursday 19 March 2026  14:48:26 +0000 (0:00:00.042)       0:03:03.198 ********
2026-03-19 14:48:26.713505 | controller | skipping: [instance]
2026-03-19 14:48:26.756647 | controller |
2026-03-19 14:48:26.756666 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2026-03-19 14:48:26.756674 | controller | Thursday 19 March 2026  14:48:26 +0000 (0:00:00.045)       0:03:03.243 ********
2026-03-19 14:48:26.756683 | controller | skipping: [instance]
2026-03-19 14:48:27.615548 | controller |
2026-03-19 14:48:27.615607 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2026-03-19 14:48:27.615617 | controller | Thursday 19 March 2026  14:48:26 +0000 (0:00:00.043)       0:03:03.286 ********
2026-03-19 14:48:27.615629 | controller | changed: [instance]
2026-03-19 14:48:28.491255 | controller |
2026-03-19 14:48:28.491310 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2026-03-19 14:48:28.491319 | controller | Thursday 19 March 2026  14:48:27 +0000 (0:00:00.857)       0:03:04.144 ********
2026-03-19 14:48:28.491345 | controller | changed: [instance]
2026-03-19 14:48:28.547627 | controller |
2026-03-19 14:48:28.547670 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2026-03-19 14:48:28.547694 | controller | Thursday 19 March 2026  14:48:28 +0000 (0:00:00.875)       0:03:05.020 ********
2026-03-19 14:48:28.547708 | controller | skipping: [instance]
2026-03-19 14:48:28.629995 | controller |
2026-03-19 14:48:28.630026 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2026-03-19 14:48:28.630033 | controller | Thursday 19 March 2026  14:48:28 +0000 (0:00:00.056)       0:03:05.077 ********
2026-03-19 14:48:28.630042 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2026-03-19 14:48:28.695440 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2026-03-19 14:48:28.695460 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2026-03-19 14:48:28.695467 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2026-03-19 14:48:28.695473 | controller |
2026-03-19 14:48:28.695478 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2026-03-19 14:48:28.695484 | controller | Thursday 19 March 2026  14:48:28 +0000 (0:00:00.082)       0:03:05.160 ********
2026-03-19 14:48:28.695492 | controller | skipping: [instance]
2026-03-19 14:48:28.740669 | controller |
2026-03-19 14:48:28.740694 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2026-03-19 14:48:28.740702 | controller | Thursday 19 March 2026  14:48:28 +0000 (0:00:00.061)       0:03:05.221 ********
2026-03-19 14:48:28.740710 | controller | skipping: [instance]
2026-03-19 14:48:28.740825 | controller |
2026-03-19 14:48:28.740834 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2026-03-19 14:48:28.740842 | controller | Thursday 19 March 2026  14:48:28 +0000 (0:00:00.049)       0:03:05.270 ********
2026-03-19 14:48:28.791833 | controller | skipping: [instance]
2026-03-19 14:48:28.840673 | controller |
2026-03-19 14:48:28.840695 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2026-03-19 14:48:28.840702 | controller | Thursday 19 March 2026  14:48:28 +0000 (0:00:00.045)       0:03:05.316 ********
2026-03-19 14:48:28.840712 | controller | skipping: [instance]
2026-03-19 14:48:29.602704 | controller |
2026-03-19 14:48:29.602756 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2026-03-19 14:48:29.602766 | controller | Thursday 19 March 2026  14:48:28 +0000 (0:00:00.053)       0:03:05.370 ********
2026-03-19 14:48:29.602779 | controller | changed: [instance]
2026-03-19 14:48:29.653060 | controller |
2026-03-19 14:48:29.653104 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2026-03-19 14:48:29.653126 | controller | Thursday 19 March 2026  14:48:29 +0000 (0:00:00.761)       0:03:06.132 ********
2026-03-19 14:48:29.653139 | controller | skipping: [instance]
2026-03-19 14:48:29.693806 | controller |
2026-03-19 14:48:29.693831 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2026-03-19 14:48:29.693840 | controller | Thursday 19 March 2026  14:48:29 +0000 (0:00:00.050)       0:03:06.183 ********
2026-03-19 14:48:29.693850 | controller | skipping: [instance]
2026-03-19 14:48:29.736887 | controller |
2026-03-19 14:48:29.736911 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2026-03-19 14:48:29.736920 | controller | Thursday 19 March 2026  14:48:29 +0000 (0:00:00.040)       0:03:06.223 ********
2026-03-19 14:48:29.736929 | controller | skipping: [instance]
2026-03-19 14:48:29.782559 | controller |
2026-03-19 14:48:29.782582 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-19 14:48:29.782591 | controller | Thursday 19 March 2026  14:48:29 +0000 (0:00:00.043)       0:03:06.267 ********
2026-03-19 14:48:29.782600 | controller | skipping: [instance]
2026-03-19 14:48:29.827366 | controller |
2026-03-19 14:48:29.827394 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-19 14:48:29.827403 | controller | Thursday 19 March 2026  14:48:29 +0000 (0:00:00.045)       0:03:06.312 ********
2026-03-19 14:48:29.827414 | controller | skipping: [instance]
2026-03-19 14:48:29.873010 | controller |
2026-03-19 14:48:29.873039 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-19 14:48:29.873047 | controller | Thursday 19 March 2026  14:48:29 +0000 (0:00:00.044)       0:03:06.357 ********
2026-03-19 14:48:29.873057 | controller | skipping: [instance]
2026-03-19 14:48:29.916004 | controller |
2026-03-19 14:48:29.916030 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-19 14:48:29.916038 | controller | Thursday 19 March 2026  14:48:29 +0000 (0:00:00.045)       0:03:06.403 ********
2026-03-19 14:48:29.916048 | controller | skipping: [instance]
2026-03-19 14:48:29.959566 | controller |
2026-03-19 14:48:29.959590 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-19 14:48:29.959599 | controller | Thursday 19 March 2026  14:48:29 +0000 (0:00:00.043)       0:03:06.446 ********
2026-03-19 14:48:29.959609 | controller | skipping: [instance]
2026-03-19 14:48:30.010411 | controller |
2026-03-19 14:48:30.010434 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-19 14:48:30.010443 | controller | Thursday 19 March 2026  14:48:29 +0000 (0:00:00.043)       0:03:06.489 ********
2026-03-19 14:48:30.010462 | controller | skipping: [instance]
2026-03-19 14:48:30.068385 | controller |
2026-03-19 14:48:30.068406 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-19 14:48:30.068414 | controller | Thursday 19 March 2026  14:48:30 +0000 (0:00:00.050)       0:03:06.540 ********
2026-03-19 14:48:30.068423 | controller | skipping: [instance]
2026-03-19 14:48:30.114038 | controller |
2026-03-19 14:48:30.114105 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2026-03-19 14:48:30.114128 | controller | Thursday 19 March 2026  14:48:30 +0000 (0:00:00.058)       0:03:06.598 ********
2026-03-19 14:48:30.114143 | controller | skipping: [instance]
2026-03-19 14:48:30.114169 | controller |
2026-03-19 14:48:30.114177 | controller | TASK [reproducer : Configure Controller node] **********************************
2026-03-19 14:48:30.348940 | controller | Thursday 19 March 2026  14:48:30 +0000 (0:00:00.045)       0:03:06.644 ********
2026-03-19 14:48:30.349008 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2026-03-19 14:48:30.349032 | controller |
2026-03-19 14:48:30.349069 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-03-19 14:48:30.349175 | controller | Thursday 19 March 2026  14:48:30 +0000 (0:00:00.234)       0:03:06.878 ********
2026-03-19 14:48:31.965910 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-03-19 14:48:31.965993 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-03-19 14:48:31.966103 | controller |
2026-03-19 14:48:31.966134 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-03-19 14:48:31.966371 | controller | Thursday 19 March 2026  14:48:31 +0000 (0:00:01.616)       0:03:08.495 ********
2026-03-19 14:48:31.992371 | controller | skipping: [instance]
2026-03-19 14:48:32.740194 | controller |
2026-03-19 14:48:32.740249 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-19 14:48:32.740260 | controller | Thursday 19 March 2026  14:48:31 +0000 (0:00:00.027)       0:03:08.522 ********
2026-03-19 14:48:32.740272 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:32.783618 | controller |
2026-03-19 14:48:32.783695 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-19 14:48:32.783710 | controller | Thursday 19 March 2026  14:48:32 +0000 (0:00:00.746)       0:03:09.269 ********
2026-03-19 14:48:32.783731 | controller | skipping: [instance]
2026-03-19 14:48:32.828814 | controller |
2026-03-19 14:48:32.828860 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-19 14:48:32.828870 | controller | Thursday 19 March 2026  14:48:32 +0000 (0:00:00.044)       0:03:09.314 ********
2026-03-19 14:48:32.828882 | controller | skipping: [instance]
2026-03-19 14:48:32.870733 | controller |
2026-03-19 14:48:32.870783 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-19 14:48:32.870793 | controller | Thursday 19 March 2026  14:48:32 +0000 (0:00:00.044)       0:03:09.358 ********
2026-03-19 14:48:32.870810 | controller | skipping: [instance]
2026-03-19 14:48:32.922161 | controller |
2026-03-19 14:48:32.922198 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-19 14:48:32.922212 | controller | Thursday 19 March 2026  14:48:32 +0000 (0:00:00.042)       0:03:09.401 ********
2026-03-19 14:48:32.922228 | controller | skipping: [instance]
2026-03-19 14:48:32.963183 | controller |
2026-03-19 14:48:32.963219 | controller | TASK [reproducer : Get rhos-release] *******************************************
2026-03-19 14:48:32.963233 | controller | Thursday 19 March 2026  14:48:32 +0000 (0:00:00.050)       0:03:09.452 ********
2026-03-19 14:48:32.963249 | controller | skipping: [instance]
2026-03-19 14:48:33.006705 | controller |
2026-03-19 14:48:33.006739 | controller | TASK [reproducer : Install repos] **********************************************
2026-03-19 14:48:33.006753 | controller | Thursday 19 March 2026  14:48:32 +0000 (0:00:00.041)       0:03:09.493 ********
2026-03-19 14:48:33.006769 | controller | skipping: [instance]
2026-03-19 14:48:33.007012 | controller |
2026-03-19 14:48:33.007276 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2026-03-19 14:48:33.007549 | controller | Thursday 19 March 2026  14:48:33 +0000 (0:00:00.044)       0:03:09.537 ********
2026-03-19 14:48:33.046641 | controller | skipping: [instance]
2026-03-19 14:48:33.046788 | controller |
2026-03-19 14:48:33.046911 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2026-03-19 14:48:33.047028 | controller | Thursday 19 March 2026  14:48:33 +0000 (0:00:00.039)       0:03:09.577 ********
2026-03-19 14:48:33.088877 | controller | skipping: [instance]
2026-03-19 14:48:33.089156 | controller |
2026-03-19 14:48:33.089470 | controller | TASK [reproducer : Install some tools] *****************************************
2026-03-19 14:48:33.089750 | controller | Thursday 19 March 2026  14:48:33 +0000 (0:00:00.042)       0:03:09.619 ********
2026-03-19 14:48:34.286556 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:34.286626 | controller |
2026-03-19 14:48:34.286637 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2026-03-19 14:48:34.286761 | controller | Thursday 19 March 2026  14:48:34 +0000 (0:00:01.196)       0:03:10.816 ********
2026-03-19 14:48:35.471236 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:35.471319 | controller |
2026-03-19 14:48:35.471348 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2026-03-19 14:48:35.471387 | controller | Thursday 19 March 2026  14:48:35 +0000 (0:00:01.184)       0:03:12.000 ********
2026-03-19 14:48:36.159984 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:36.160053 | controller |
2026-03-19 14:48:36.160306 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2026-03-19 14:48:37.302269 | controller | Thursday 19 March 2026  14:48:36 +0000 (0:00:00.689)       0:03:12.690 ********
2026-03-19 14:48:37.302309 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:38.513948 | controller |
2026-03-19 14:48:38.513984 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2026-03-19 14:48:38.514000 | controller | Thursday 19 March 2026  14:48:37 +0000 (0:00:01.141)       0:03:13.831 ********
2026-03-19 14:48:38.514012 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-03-19 14:48:38.514031 | controller | skipping: [instance] => (item=compute-0)
2026-03-19 14:48:38.514458 | controller | skipping: [instance] => (item=controller-0)
2026-03-19 14:48:38.514517 | controller | skipping: [instance] => (item=crc-0)
2026-03-19 14:48:38.514527 | controller |
2026-03-19 14:48:38.514535 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2026-03-19 14:48:38.514596 | controller | Thursday 19 March 2026  14:48:38 +0000 (0:00:01.212)       0:03:15.044 ********
2026-03-19 14:48:39.294540 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-03-19 14:48:39.294631 | controller | skipping: [instance] => (item=compute-0)
2026-03-19 14:48:39.294645 | controller | skipping: [instance] => (item=controller-0)
2026-03-19 14:48:39.294656 | controller | skipping: [instance] => (item=crc-0)
2026-03-19 14:48:39.294701 | controller |
2026-03-19 14:48:39.294713 | controller | TASK [reproducer : Inject SSH configuration] ***********************************
2026-03-19 14:48:39.294744 | controller | Thursday 19 March 2026  14:48:39 +0000 (0:00:00.780)       0:03:15.824 ********
2026-03-19 14:48:41.355273 | controller | skipping: [instance] => (item=instance)
2026-03-19 14:48:41.355360 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
2026-03-19 14:48:41.355477 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-03-19 14:48:41.355488 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
2026-03-19 14:48:41.355562 | controller |
2026-03-19 14:48:41.355652 | controller | TASK [reproducer : Create kube directory] **************************************
2026-03-19 14:48:41.355736 | controller | Thursday 19 March 2026  14:48:41 +0000 (0:00:02.060)       0:03:17.884 ********
2026-03-19 14:48:41.982418 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:43.215265 | controller |
2026-03-19 14:48:43.215319 | controller | TASK [reproducer : Inject kubeconfig content] **********************************
2026-03-19 14:48:43.215328 | controller | Thursday 19 March 2026  14:48:41 +0000 (0:00:00.627)       0:03:18.512 ********
2026-03-19 14:48:43.215360 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:44.345085 | controller |
2026-03-19 14:48:44.345132 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************
2026-03-19 14:48:44.345141 | controller | Thursday 19 March 2026  14:48:43 +0000 (0:00:01.232)       0:03:19.744 ********
2026-03-19 14:48:44.345153 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:44.383482 | controller |
2026-03-19 14:48:44.383501 | controller | TASK [reproducer : Inject devscripts private key if set] ***********************
2026-03-19 14:48:44.383509 | controller | Thursday 19 March 2026  14:48:44 +0000 (0:00:01.130)       0:03:20.875 ********
2026-03-19 14:48:44.383520 | controller | skipping: [instance]
2026-03-19 14:48:45.045296 | controller |
2026-03-19 14:48:45.045353 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ******************************
2026-03-19 14:48:45.045366 | controller | Thursday 19 March 2026  14:48:44 +0000 (0:00:00.038)       0:03:20.913 ********
2026-03-19 14:48:45.045378 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:45.718208 | controller |
2026-03-19 14:48:45.718256 | controller | TASK [manage_secrets : Ensure directory tree exist] ****************************
2026-03-19 14:48:45.718266 | controller | Thursday 19 March 2026  14:48:45 +0000 (0:00:00.661)       0:03:21.575 ********
2026-03-19 14:48:45.718280 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:45.765379 | controller |
2026-03-19 14:48:45.765402 | controller | TASK [manage_secrets : Assert we get needed data] ******************************
2026-03-19 14:48:45.765412 | controller | Thursday 19 March 2026  14:48:45 +0000 (0:00:00.672)       0:03:22.247 ********
2026-03-19 14:48:45.765423 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:45.840279 | controller |
2026-03-19 14:48:45.840305 | controller | TASK [manage_secrets : Push reproducer secrets] ********************************
2026-03-19 14:48:45.840315 | controller | Thursday 19 March 2026  14:48:45 +0000 (0:00:00.047)       0:03:22.295 ********
2026-03-19 14:48:45.840328 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
2026-03-19 14:48:45.902111 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
2026-03-19 14:48:45.902143 | controller |
2026-03-19 14:48:45.902151 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-03-19 14:48:45.902157 | controller | Thursday 19 March 2026  14:48:45 +0000 (0:00:00.074)       0:03:22.370 ********
2026-03-19 14:48:45.902175 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 14:48:45.970360 | controller |   _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
2026-03-19 14:48:45.970394 | controller |
2026-03-19 14:48:45.970402 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-03-19 14:48:45.970408 | controller | Thursday 19 March 2026  14:48:45 +0000 (0:00:00.062)       0:03:22.432 ********
2026-03-19 14:48:45.970418 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 14:48:46.033997 | controller |   _secret_file: ''
2026-03-19 14:48:46.034032 | controller |
2026-03-19 14:48:46.034040 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-03-19 14:48:46.034048 | controller | Thursday 19 March 2026  14:48:45 +0000 (0:00:00.067)       0:03:22.500 ********
2026-03-19 14:48:46.034059 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 14:48:46.095010 | controller |   _secret_content: my-default-location-place
2026-03-19 14:48:46.095038 | controller |
2026-03-19 14:48:46.095046 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-03-19 14:48:46.095052 | controller | Thursday 19 March 2026  14:48:46 +0000 (0:00:00.063)       0:03:22.563 ********
2026-03-19 14:48:46.095062 | controller | skipping: [instance]
2026-03-19 14:48:46.160460 | controller |
2026-03-19 14:48:46.160483 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-03-19 14:48:46.160491 | controller | Thursday 19 March 2026  14:48:46 +0000 (0:00:00.061)       0:03:22.625 ********
2026-03-19 14:48:46.160501 | controller | skipping: [instance]
2026-03-19 14:48:46.219812 | controller |
2026-03-19 14:48:46.219839 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-03-19 14:48:46.219847 | controller | Thursday 19 March 2026  14:48:46 +0000 (0:00:00.065)       0:03:22.690 ********
2026-03-19 14:48:46.219858 | controller | skipping: [instance]
2026-03-19 14:48:47.303930 | controller |
2026-03-19 14:48:47.303986 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-03-19 14:48:47.303996 | controller | Thursday 19 March 2026  14:48:46 +0000 (0:00:00.058)       0:03:22.749 ********
2026-03-19 14:48:47.304009 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:47.370835 | controller |
2026-03-19 14:48:47.370854 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-03-19 14:48:47.370861 | controller | Thursday 19 March 2026  14:48:47 +0000 (0:00:01.083)       0:03:23.833 ********
2026-03-19 14:48:47.370870 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 14:48:47.429024 | controller |   _secret_dest: /home/zuul/ipmi-things
2026-03-19 14:48:47.429063 | controller |
2026-03-19 14:48:47.429072 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-03-19 14:48:47.429080 | controller | Thursday 19 March 2026  14:48:47 +0000 (0:00:00.067)       0:03:23.901 ********
2026-03-19 14:48:47.429091 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 14:48:47.483530 | controller |   _secret_file: /tmp/ipmi-things
2026-03-19 14:48:47.483577 | controller |
2026-03-19 14:48:47.483586 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-03-19 14:48:47.483593 | controller | Thursday 19 March 2026  14:48:47 +0000 (0:00:00.058)       0:03:23.959 ********
2026-03-19 14:48:47.483604 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-19 14:48:47.483628 | controller |   _secret_content: ''
2026-03-19 14:48:47.483733 | controller |
2026-03-19 14:48:47.483744 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-03-19 14:48:47.483843 | controller | Thursday 19 March 2026  14:48:47 +0000 (0:00:00.054)       0:03:24.014 ********
2026-03-19 14:48:47.541692 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false
2026-03-19 14:48:48.215887 | controller |   msg: All assertions passed
2026-03-19 14:48:48.215942 | controller |
2026-03-19 14:48:48.215951 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-03-19 14:48:48.215958 | controller | Thursday 19 March 2026  14:48:47 +0000 (0:00:00.057)       0:03:24.071 ********
2026-03-19 14:48:48.215970 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:49.348468 | controller |
2026-03-19 14:48:49.348528 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-03-19 14:48:49.348544 | controller | Thursday 19 March 2026  14:48:48 +0000 (0:00:00.673)       0:03:24.745 ********
2026-03-19 14:48:49.348558 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:49.418937 | controller |
2026-03-19 14:48:49.418993 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-03-19 14:48:49.419004 | controller | Thursday 19 March 2026  14:48:49 +0000 (0:00:01.132)       0:03:25.878 ********
2026-03-19 14:48:49.419016 | controller | skipping: [instance]
2026-03-19 14:48:50.097413 | controller |
2026-03-19 14:48:50.097449 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
2026-03-19 14:48:50.097457 | controller | Thursday 19 March 2026  14:48:49 +0000 (0:00:00.070)       0:03:25.948 ********
2026-03-19 14:48:50.097468 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:48:50.097788 | controller |
2026-03-19 14:48:50.795268 | controller | TASK [reproducer : Check if async file is still available] *********************
2026-03-19 14:48:50.795344 | controller | Thursday 19 March 2026  14:48:50 +0000 (0:00:00.679)       0:03:26.627 ********
2026-03-19 14:48:50.795367 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:36.031940 | controller |
2026-03-19 14:49:36.031984 | controller | TASK [reproducer : Check package install status] *******************************
2026-03-19 14:49:36.031997 | controller | Thursday 19 March 2026  14:48:50 +0000 (0:00:00.693)       0:03:27.320 ********
2026-03-19 14:49:36.032009 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
2026-03-19 14:49:36.682066 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
2026-03-19 14:49:36.682108 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
2026-03-19 14:49:36.682116 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
2026-03-19 14:49:36.682122 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
2026-03-19 14:49:36.682127 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
2026-03-19 14:49:36.682133 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
2026-03-19 14:49:36.682138 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left).
2026-03-19 14:49:36.682144 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:36.682150 | controller |
2026-03-19 14:49:36.682155 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
2026-03-19 14:49:36.682161 | controller | Thursday 19 March 2026  14:49:36 +0000 (0:00:45.239)       0:04:12.560 ********
2026-03-19 14:49:36.682181 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:39.913157 | controller |
2026-03-19 14:49:39.913211 | controller | TASK [sushy_emulator : Install required packages] ******************************
2026-03-19 14:49:39.913220 | controller | Thursday 19 March 2026  14:49:36 +0000 (0:00:00.651)       0:04:13.211 ********
2026-03-19 14:49:39.913232 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:39.962191 | controller |
2026-03-19 14:49:39.962221 | controller | TASK [sushy_emulator : Get ingresses domain] ***********************************
2026-03-19 14:49:39.962229 | controller | Thursday 19 March 2026  14:49:39 +0000 (0:00:03.231)       0:04:16.443 ********
2026-03-19 14:49:39.962240 | controller | skipping: [instance]
2026-03-19 14:49:40.012729 | controller |
2026-03-19 14:49:40.012756 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] *********************
2026-03-19 14:49:40.012767 | controller | Thursday 19 March 2026  14:49:39 +0000 (0:00:00.049)       0:04:16.492 ********
2026-03-19 14:49:40.012779 | controller | skipping: [instance]
2026-03-19 14:49:40.699283 | controller |
2026-03-19 14:49:40.699322 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
2026-03-19 14:49:40.699347 | controller | Thursday 19 March 2026  14:49:40 +0000 (0:00:00.050)       0:04:16.542 ********
2026-03-19 14:49:40.699362 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:41.325581 | controller |
2026-03-19 14:49:41.325624 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ********************
2026-03-19 14:49:41.325641 | controller | Thursday 19 March 2026  14:49:40 +0000 (0:00:00.686)       0:04:17.229 ********
2026-03-19 14:49:41.325653 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:41.648163 | controller |
2026-03-19 14:49:41.648215 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
2026-03-19 14:49:41.648223 | controller | Thursday 19 March 2026  14:49:41 +0000 (0:00:00.626)       0:04:17.855 ********
2026-03-19 14:49:41.648234 | controller | changed: [instance]
2026-03-19 14:49:42.286596 | controller |
2026-03-19 14:49:42.286631 | controller | TASK [sushy_emulator : Run ssh-keyscan] ****************************************
2026-03-19 14:49:42.286640 | controller | Thursday 19 March 2026  14:49:41 +0000 (0:00:00.322)       0:04:18.178 ********
2026-03-19 14:49:42.286651 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:43.328111 | controller |
2026-03-19 14:49:43.328145 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************
2026-03-19 14:49:43.328153 | controller | Thursday 19 March 2026  14:49:42 +0000 (0:00:00.638)       0:04:18.816 ********
2026-03-19 14:49:43.328165 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:43.373763 | controller |
2026-03-19 14:49:43.373782 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-19 14:49:43.373790 | controller | Thursday 19 March 2026  14:49:43 +0000 (0:00:01.041)       0:04:19.858 ********
2026-03-19 14:49:43.373800 | controller | skipping: [instance]
2026-03-19 14:49:43.418849 | controller |
2026-03-19 14:49:43.418872 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-19 14:49:43.418879 | controller | Thursday 19 March 2026  14:49:43 +0000 (0:00:00.045)       0:04:19.904 ********
2026-03-19 14:49:43.418888 | controller | skipping: [instance]
2026-03-19 14:49:43.459614 | controller |
2026-03-19 14:49:43.459638 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-19 14:49:43.459647 | controller | Thursday 19 March 2026  14:49:43 +0000 (0:00:00.045)       0:04:19.949 ********
2026-03-19 14:49:43.459659 | controller | skipping: [instance]
2026-03-19 14:49:43.515109 | controller |
2026-03-19 14:49:43.515127 | controller | TASK [sushy_emulator : Generate list of filtered VMs] **************************
2026-03-19 14:49:43.515135 | controller | Thursday 19 March 2026  14:49:43 +0000 (0:00:00.039)       0:04:19.988 ********
2026-03-19 14:49:43.515149 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:43.551600 | controller |
2026-03-19 14:49:43.551619 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
2026-03-19 14:49:43.551626 | controller | Thursday 19 March 2026  14:49:43 +0000 (0:00:00.057)       0:04:20.045 ********
2026-03-19 14:49:43.551635 | controller | skipping: [instance]
2026-03-19 14:49:43.589107 | controller |
2026-03-19 14:49:43.589141 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
2026-03-19 14:49:43.589155 | controller | Thursday 19 March 2026  14:49:43 +0000 (0:00:00.036)       0:04:20.082 ********
2026-03-19 14:49:43.589170 | controller | skipping: [instance]
2026-03-19 14:49:43.625521 | controller |
2026-03-19 14:49:43.625547 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
2026-03-19 14:49:43.625557 | controller | Thursday 19 March 2026  14:49:43 +0000 (0:00:00.037)       0:04:20.119 ********
2026-03-19 14:49:43.625569 | controller | skipping: [instance]
2026-03-19 14:49:43.625745 | controller |
2026-03-19 14:49:43.625923 | controller | TASK [sushy_emulator : Generate htpasswd string] *******************************
2026-03-19 14:49:43.626091 | controller | Thursday 19 March 2026  14:49:43 +0000 (0:00:00.037)       0:04:20.156 ********
2026-03-19 14:49:44.223810 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:44.326097 | controller |
2026-03-19 14:49:44.326116 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] *********************
2026-03-19 14:49:44.326123 | controller | Thursday 19 March 2026  14:49:44 +0000 (0:00:00.597)       0:04:20.754 ********
2026-03-19 14:49:44.326137 | controller | skipping: [instance] => (item=secret)
2026-03-19 14:49:45.358634 | controller | skipping: [instance] => (item=configmap)
2026-03-19 14:49:45.358675 | controller | skipping: [instance] => (item=pod)
2026-03-19 14:49:45.358683 | controller | skipping: [instance] => (item=service)
2026-03-19 14:49:45.358689 | controller | skipping: [instance] => (item=route)
2026-03-19 14:49:45.358695 | controller | skipping: [instance]
2026-03-19 14:49:45.358701 | controller |
2026-03-19 14:49:45.358708 | controller | TASK [sushy_emulator : Write sushy emulator config] ****************************
2026-03-19 14:49:45.358714 | controller | Thursday 19 March 2026  14:49:44 +0000 (0:00:00.101)       0:04:20.855 ********
2026-03-19 14:49:45.358724 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:46.331965 | controller |
2026-03-19 14:49:46.332009 | controller | TASK [sushy_emulator : Write htpasswd string to file] **************************
2026-03-19 14:49:46.332017 | controller | Thursday 19 March 2026  14:49:45 +0000 (0:00:01.033)       0:04:21.888 ********
2026-03-19 14:49:46.332029 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:46.371381 | controller |
2026-03-19 14:49:46.371415 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
2026-03-19 14:49:46.371423 | controller | Thursday 19 March 2026  14:49:46 +0000 (0:00:00.973)       0:04:22.861 ********
2026-03-19 14:49:46.371435 | controller | skipping: [instance]
2026-03-19 14:49:46.410999 | controller |
2026-03-19 14:49:46.411032 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
2026-03-19 14:49:46.411040 | controller | Thursday 19 March 2026  14:49:46 +0000 (0:00:00.039)       0:04:22.901 ********
2026-03-19 14:49:46.411052 | controller | skipping: [instance]
2026-03-19 14:49:46.494406 | controller |
2026-03-19 14:49:46.494437 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
2026-03-19 14:49:46.494445 | controller | Thursday 19 March 2026  14:49:46 +0000 (0:00:00.039)       0:04:22.941 ********
2026-03-19 14:49:46.494456 | controller | skipping: [instance] => (item=secret)
2026-03-19 14:49:46.494767 | controller | skipping: [instance] => (item=configmap)
2026-03-19 14:49:46.494787 | controller | skipping: [instance] => (item=service)
2026-03-19 14:49:46.494794 | controller | skipping: [instance] => (item=route)
2026-03-19 14:49:46.494800 | controller | skipping: [instance]
2026-03-19 14:49:46.494806 | controller |
2026-03-19 14:49:46.494814 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
2026-03-19 14:49:46.494991 | controller | Thursday 19 March 2026  14:49:46 +0000 (0:00:00.082)       0:04:23.024 ********
2026-03-19 14:49:46.535801 | controller | skipping: [instance]
2026-03-19 14:49:48.197680 | controller |
2026-03-19 14:49:48.197716 | controller | TASK [podman : Ensure podman is installed] *************************************
2026-03-19 14:49:48.197724 | controller | Thursday 19 March 2026  14:49:46 +0000 (0:00:00.041)       0:04:23.066 ********
2026-03-19 14:49:48.197735 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:48.961737 | controller |
2026-03-19 14:49:48.961776 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] *********************
2026-03-19 14:49:48.961784 | controller | Thursday 19 March 2026  14:49:48 +0000 (0:00:01.661)       0:04:24.727 ********
2026-03-19 14:49:48.961795 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:49:49.011536 | controller |
2026-03-19 14:49:49.011564 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
2026-03-19 14:49:49.011571 | controller | Thursday 19 March 2026  14:49:48 +0000 (0:00:00.764)       0:04:25.491 ********
2026-03-19 14:49:49.011582 | controller | skipping: [instance]
2026-03-19 14:49:49.052040 | controller |
2026-03-19 14:49:49.052065 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
2026-03-19 14:49:49.052073 | controller | Thursday 19 March 2026  14:49:49 +0000 (0:00:00.049)       0:04:25.541 ********
2026-03-19 14:49:49.052083 | controller | skipping: [instance]
2026-03-19 14:49:49.098072 | controller |
2026-03-19 14:49:49.098096 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
2026-03-19 14:49:49.098109 | controller | Thursday 19 March 2026  14:49:49 +0000 (0:00:00.040)       0:04:25.582 ********
2026-03-19 14:49:49.098121 | controller | skipping: [instance]
2026-03-19 14:50:00.833903 | controller |
2026-03-19 14:50:00.833948 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
2026-03-19 14:50:00.833957 | controller | Thursday 19 March 2026  14:49:49 +0000 (0:00:00.045)       0:04:25.628 ********
2026-03-19 14:50:00.833968 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:02.469673 | controller |
2026-03-19 14:50:02.469711 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] **************
2026-03-19 14:50:02.469720 | controller | Thursday 19 March 2026  14:50:00 +0000 (0:00:11.735)       0:04:37.363 ********
2026-03-19 14:50:02.469731 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:03.663777 | controller |
2026-03-19 14:50:03.663816 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-03-19 14:50:03.663824 | controller | Thursday 19 March 2026  14:50:02 +0000 (0:00:01.635)       0:04:38.999 ********
2026-03-19 14:50:03.663835 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-03-19 14:50:03.705431 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-03-19 14:50:03.705463 | controller |
2026-03-19 14:50:03.705471 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] *************
2026-03-19 14:50:03.705476 | controller | Thursday 19 March 2026  14:50:03 +0000 (0:00:01.194)       0:04:40.193 ********
2026-03-19 14:50:03.705487 | controller | skipping: [instance]
2026-03-19 14:50:04.304850 | controller |
2026-03-19 14:50:04.304887 | controller | TASK [reproducer : Check if baremetal-info.yml exists] *************************
2026-03-19 14:50:04.304895 | controller | Thursday 19 March 2026  14:50:03 +0000 (0:00:00.041)       0:04:40.235 ********
2026-03-19 14:50:04.304906 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:04.345166 | controller |
2026-03-19 14:50:04.345206 | controller | TASK [reproducer : Get content of baremetal-info file] *************************
2026-03-19 14:50:04.345215 | controller | Thursday 19 March 2026  14:50:04 +0000 (0:00:00.599)       0:04:40.834 ********
2026-03-19 14:50:04.345225 | controller | skipping: [instance]
2026-03-19 14:50:04.393380 | controller |
2026-03-19 14:50:04.393408 | controller | TASK [reproducer : Interpret remote file content as yaml] **********************
2026-03-19 14:50:04.393416 | controller | Thursday 19 March 2026  14:50:04 +0000 (0:00:00.040)       0:04:40.875 ********
2026-03-19 14:50:04.393427 | controller | skipping: [instance]
2026-03-19 14:50:04.440914 | controller |
2026-03-19 14:50:04.440934 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-03-19 14:50:04.440943 | controller | Thursday 19 March 2026  14:50:04 +0000 (0:00:00.047)       0:04:40.923 ********
2026-03-19 14:50:04.440952 | controller | skipping: [instance]
2026-03-19 14:50:04.480263 | controller |
2026-03-19 14:50:04.480281 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-03-19 14:50:04.480290 | controller | Thursday 19 March 2026  14:50:04 +0000 (0:00:00.047)       0:04:40.971 ********
2026-03-19 14:50:04.480298 | controller | skipping: [instance]
2026-03-19 14:50:04.618971 | controller |
2026-03-19 14:50:04.618994 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
2026-03-19 14:50:04.619002 | controller | Thursday 19 March 2026  14:50:04 +0000 (0:00:00.039)       0:04:41.010 ********
2026-03-19 14:50:04.619013 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'})
2026-03-19 14:50:04.619446 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'})
2026-03-19 14:50:04.619569 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'})
2026-03-19 14:50:04.619591 | controller |
2026-03-19 14:50:04.619692 | controller | TASK [reproducer : Output baremetal info file] *********************************
2026-03-19 14:50:04.619703 | controller | Thursday 19 March 2026  14:50:04 +0000 (0:00:00.138)       0:04:41.149 ********
2026-03-19 14:50:05.718571 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:05.761901 | controller |
2026-03-19 14:50:05.761925 | controller | TASK [reproducer : Output ironic_nodes to file] ********************************
2026-03-19 14:50:05.761933 | controller | Thursday 19 March 2026  14:50:05 +0000 (0:00:01.099)       0:04:42.248 ********
2026-03-19 14:50:05.761943 | controller | skipping: [instance]
2026-03-19 14:50:05.762060 | controller |
2026-03-19 14:50:05.762070 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
2026-03-19 14:50:05.762079 | controller | Thursday 19 March 2026  14:50:05 +0000 (0:00:00.043)       0:04:42.292 ********
2026-03-19 14:50:05.904078 | controller |
2026-03-19 14:50:05.956635 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
2026-03-19 14:50:05.956664 | controller | Thursday 19 March 2026  14:50:05 +0000 (0:00:00.142)       0:04:42.434 ********
2026-03-19 14:50:05.956676 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:05.956730 | controller |
2026-03-19 14:50:05.956739 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-03-19 14:50:05.956747 | controller | Thursday 19 March 2026  14:50:05 +0000 (0:00:00.052)       0:04:42.486 ********
2026-03-19 14:50:06.000625 | controller | skipping: [instance]
2026-03-19 14:50:06.000910 | controller |
2026-03-19 14:50:06.040065 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-03-19 14:50:06.040085 | controller | Thursday 19 March 2026  14:50:05 +0000 (0:00:00.044)       0:04:42.531 ********
2026-03-19 14:50:06.040095 | controller | skipping: [instance]
2026-03-19 14:50:07.486145 | controller |
2026-03-19 14:50:07.486214 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
2026-03-19 14:50:07.486226 | controller | Thursday 19 March 2026  14:50:06 +0000 (0:00:00.039)       0:04:42.570 ********
2026-03-19 14:50:07.486249 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:15.656201 | controller |
2026-03-19 14:50:15.656271 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
2026-03-19 14:50:15.656281 | controller | Thursday 19 March 2026  14:50:07 +0000 (0:00:01.445)       0:04:44.016 ********
2026-03-19 14:50:15.656296 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1)
2026-03-19 14:50:15.656320 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b)
2026-03-19 14:50:15.656656 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282)
2026-03-19 14:50:15.656722 | controller |
2026-03-19 14:50:15.781846 | controller | TASK [sushy_emulator : Verify baremetal VM power status] ***********************
2026-03-19 14:50:15.781891 | controller | Thursday 19 March 2026  14:50:15 +0000 (0:00:08.169)       0:04:52.185 ********
2026-03-19 14:50:15.781905 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
2026-03-19 14:50:16.039750 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
2026-03-19 14:50:16.039787 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
2026-03-19 14:50:16.039795 | controller |
2026-03-19 14:50:16.039802 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
2026-03-19 14:50:16.039808 | controller | Thursday 19 March 2026  14:50:15 +0000 (0:00:00.126)       0:04:52.311 ********
2026-03-19 14:50:16.039818 | controller | ok: [instance -> localhost]
2026-03-19 14:50:18.049732 | controller |
2026-03-19 14:50:18.049771 | controller | TASK [reproducer : Sync local repositories to other hosts if present] **********
2026-03-19 14:50:18.049779 | controller | Thursday 19 March 2026  14:50:16 +0000 (0:00:00.258)       0:04:52.569 ********
2026-03-19 14:50:18.049790 | controller | changed: [instance -> localhost] => (item=controller-0)
2026-03-19 14:50:18.772450 | controller |
2026-03-19 14:50:18.772493 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
2026-03-19 14:50:18.772501 | controller | Thursday 19 March 2026  14:50:18 +0000 (0:00:02.009)       0:04:54.579 ********
2026-03-19 14:50:18.772513 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:19.632820 | controller |
2026-03-19 14:50:19.632853 | controller | TASK [reproducer : Install ansible dependencies] *******************************
2026-03-19 14:50:19.632860 | controller | Thursday 19 March 2026  14:50:18 +0000 (0:00:00.722)       0:04:55.301 ********
2026-03-19 14:50:19.632870 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:20.873590 | controller |
2026-03-19 14:50:20.873642 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
2026-03-19 14:50:20.873651 | controller | Thursday 19 March 2026  14:50:19 +0000 (0:00:00.860)       0:04:56.162 ********
2026-03-19 14:50:20.873663 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:20.873931 | controller |
2026-03-19 14:50:21.606524 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
2026-03-19 14:50:21.606579 | controller | Thursday 19 March 2026  14:50:20 +0000 (0:00:01.240)       0:04:57.403 ********
2026-03-19 14:50:21.606594 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:22.755743 | controller |
2026-03-19 14:50:22.755796 | controller | TASK [reproducer : Inject local environment parameters] ************************
2026-03-19 14:50:22.755805 | controller | Thursday 19 March 2026  14:50:21 +0000 (0:00:00.728)       0:04:58.131 ********
2026-03-19 14:50:22.755818 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:23.435210 | controller |
2026-03-19 14:50:23.435278 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
2026-03-19 14:50:23.435287 | controller | Thursday 19 March 2026  14:50:22 +0000 (0:00:01.153)       0:04:59.285 ********
2026-03-19 14:50:23.435301 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:24.144675 | controller |
2026-03-19 14:50:24.144720 | controller | TASK [reproducer : Get interfaces-info content] ********************************
2026-03-19 14:50:24.144729 | controller | Thursday 19 March 2026  14:50:23 +0000 (0:00:00.679)       0:04:59.964 ********
2026-03-19 14:50:24.144741 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:25.687376 | controller |
2026-03-19 14:50:25.687442 | controller | TASK [reproducer : Wait for OCP nodes to be ready] *****************************
2026-03-19 14:50:25.687451 | controller | Thursday 19 March 2026  14:50:24 +0000 (0:00:00.709)       0:05:00.674 ********
2026-03-19 14:50:25.687465 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-03-19 14:50:25.728734 | controller |
2026-03-19 14:50:25.728785 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-19 14:50:25.728795 | controller | Thursday 19 March 2026  14:50:25 +0000 (0:00:01.542)       0:05:02.216 ********
2026-03-19 14:50:25.728808 | controller | skipping: [instance]
2026-03-19 14:50:25.767756 | controller |
2026-03-19 14:50:25.767804 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-19 14:50:25.767813 | controller | Thursday 19 March 2026  14:50:25 +0000 (0:00:00.041)       0:05:02.258 ********
2026-03-19 14:50:25.767826 | controller | skipping: [instance]
2026-03-19 14:50:25.811157 | controller |
2026-03-19 14:50:25.811201 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-19 14:50:25.811210 | controller | Thursday 19 March 2026  14:50:25 +0000 (0:00:00.039)       0:05:02.297 ********
2026-03-19 14:50:25.811233 | controller | skipping: [instance]
2026-03-19 14:50:25.850414 | controller |
2026-03-19 14:50:25.850452 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-19 14:50:25.850461 | controller | Thursday 19 March 2026  14:50:25 +0000 (0:00:00.043)       0:05:02.341 ********
2026-03-19 14:50:25.850472 | controller | skipping: [instance]
2026-03-19 14:50:25.901735 | controller |
2026-03-19 14:50:25.901765 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-19 14:50:25.901773 | controller | Thursday 19 March 2026  14:50:25 +0000 (0:00:00.039)       0:05:02.380 ********
2026-03-19 14:50:25.901784 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:25.902074 | controller |
2026-03-19 14:50:26.017544 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-19 14:50:26.017569 | controller | Thursday 19 March 2026  14:50:25 +0000 (0:00:00.051)       0:05:02.432 ********
2026-03-19 14:50:26.017592 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
2026-03-19 14:50:26.070718 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={})
2026-03-19 14:50:26.070742 | controller |
2026-03-19 14:50:26.070749 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-19 14:50:26.070755 | controller | Thursday 19 March 2026  14:50:26 +0000 (0:00:00.115)       0:05:02.547 ********
2026-03-19 14:50:26.070765 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
2026-03-19 14:50:29.728153 | controller |
2026-03-19 14:50:29.728194 | controller | TASK [networking_mapper : Gather the facts] ************************************
2026-03-19 14:50:29.728203 | controller | Thursday 19 March 2026  14:50:26 +0000 (0:00:00.053)       0:05:02.601 ********
2026-03-19 14:50:29.728227 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-03-19 14:50:30.778762 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
2026-03-19 14:50:30.778796 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-03-19 14:50:30.778803 | controller |
2026-03-19 14:50:30.778810 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
2026-03-19 14:50:30.778815 | controller | Thursday 19 March 2026  14:50:29 +0000 (0:00:03.656)       0:05:06.257 ********
2026-03-19 14:50:30.778826 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:31.386579 | controller |
2026-03-19 14:50:31.386615 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-19 14:50:31.386622 | controller | Thursday 19 March 2026  14:50:30 +0000 (0:00:01.050)       0:05:07.308 ********
2026-03-19 14:50:31.386640 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:32.395173 | controller |
2026-03-19 14:50:32.395212 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-19 14:50:32.395230 | controller | Thursday 19 March 2026  14:50:31 +0000 (0:00:00.607)       0:05:07.916 ********
2026-03-19 14:50:32.395242 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:32.480997 | controller |
2026-03-19 14:50:32.481021 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-19 14:50:32.481029 | controller | Thursday 19 March 2026  14:50:32 +0000 (0:00:01.008)       0:05:08.925 ********
2026-03-19 14:50:32.481038 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:32.538929 | controller |
2026-03-19 14:50:32.538948 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-19 14:50:32.538955 | controller | Thursday 19 March 2026  14:50:32 +0000 (0:00:00.086)       0:05:09.011 ********
2026-03-19 14:50:32.538964 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:33.702653 | controller |
2026-03-19 14:50:33.702690 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-19 14:50:33.702698 | controller | Thursday 19 March 2026  14:50:32 +0000 (0:00:00.057)       0:05:09.069 ********
2026-03-19 14:50:33.702710 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:34.767350 | controller |
2026-03-19 14:50:34.767407 | controller | TASK [reproducer : Inject CRC ssh key] *****************************************
2026-03-19 14:50:34.767415 | controller | Thursday 19 March 2026  14:50:33 +0000 (0:00:01.163)       0:05:10.232 ********
2026-03-19 14:50:34.767431 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:34.767450 | controller |
2026-03-19 14:50:34.767456 | controller | TASK [reproducer : Ensure we have all dependencies installed] ******************
2026-03-19 14:50:34.767464 | controller | Thursday 19 March 2026  14:50:34 +0000 (0:00:01.064)       0:05:11.297 ********
2026-03-19 14:50:40.821135 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
2026-03-19 14:50:40.821200 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:40.821283 | controller |
2026-03-19 14:50:40.821563 | controller | TASK [Configure ntp service] ***************************************************
2026-03-19 14:50:41.050191 | controller | Thursday 19 March 2026  14:50:40 +0000 (0:00:06.051)       0:05:17.349 ********
2026-03-19 14:50:41.050248 | controller |
2026-03-19 14:50:42.120393 | controller | TASK [cifmw_ntp : Install chrony] **********************************************
2026-03-19 14:50:42.120430 | controller | Thursday 19 March 2026  14:50:41 +0000 (0:00:00.231)       0:05:17.580 ********
2026-03-19 14:50:42.120443 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:43.111715 | controller |
2026-03-19 14:50:43.111752 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] *************************
2026-03-19 14:50:43.111760 | controller | Thursday 19 March 2026  14:50:42 +0000 (0:00:01.070)       0:05:18.650 ********
2026-03-19 14:50:43.111777 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
2026-03-19 14:50:44.058069 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
2026-03-19 14:50:44.058104 | controller |
2026-03-19 14:50:44.058112 | controller | TASK [cifmw_ntp : Render chrony extra config file] *****************************
2026-03-19 14:50:44.058119 | controller | Thursday 19 March 2026  14:50:43 +0000 (0:00:00.990)       0:05:19.641 ********
2026-03-19 14:50:44.058130 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:44.769490 | controller |
2026-03-19 14:50:44.769530 | controller | TASK [cifmw_ntp : Enable chrony service] ***************************************
2026-03-19 14:50:44.769538 | controller | Thursday 19 March 2026  14:50:44 +0000 (0:00:00.946)       0:05:20.588 ********
2026-03-19 14:50:44.769550 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:44.911180 | controller |
2026-03-19 14:50:44.911219 | controller | TASK [reproducer : Configure CRC node if available] ****************************
2026-03-19 14:50:44.911238 | controller | Thursday 19 March 2026  14:50:44 +0000 (0:00:00.711)       0:05:21.299 ********
2026-03-19 14:50:44.911249 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
2026-03-19 14:50:45.381390 | controller |
2026-03-19 14:50:45.381429 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] ***
2026-03-19 14:50:45.381442 | controller | Thursday 19 March 2026  14:50:44 +0000 (0:00:00.142)       0:05:21.441 ********
2026-03-19 14:50:45.381453 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:45.381611 | controller |
2026-03-19 14:50:45.381821 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ********************
2026-03-19 14:50:45.381905 | controller | Thursday 19 March 2026  14:50:45 +0000 (0:00:00.470)       0:05:21.911 ********
2026-03-19 14:50:45.880451 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-03-19 14:50:46.499194 | controller |
2026-03-19 14:50:46.499250 | controller | TASK [reproducer : Configure local DNS for CRC pod] ****************************
2026-03-19 14:50:46.499260 | controller | Thursday 19 March 2026  14:50:45 +0000 (0:00:00.498)       0:05:22.410 ********
2026-03-19 14:50:46.499272 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-19 14:50:46.499294 | controller |
2026-03-19 14:50:46.499376 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
2026-03-19 14:50:46.499478 | controller | Thursday 19 March 2026  14:50:46 +0000 (0:00:00.619)       0:05:23.029 ********
2026-03-19 14:50:47.079036 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-19 14:50:47.079360 | controller |
2026-03-19 14:50:47.132718 | controller | TASK [Restart DNS in CRC VM] ***************************************************
2026-03-19 14:50:47.132758 | controller | Thursday 19 March 2026  14:50:47 +0000 (0:00:00.579)       0:05:23.609 ********
2026-03-19 14:50:47.132771 | controller |
2026-03-19 14:50:47.596734 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
2026-03-19 14:50:47.596782 | controller | Thursday 19 March 2026  14:50:47 +0000 (0:00:00.053)       0:05:23.663 ********
2026-03-19 14:50:47.596796 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-03-19 14:50:47.596814 | controller |
2026-03-19 14:50:47.596823 | controller | TASK [openshift_setup : Restart dnsmasq service if used] ***********************
2026-03-19 14:50:47.596895 | controller | Thursday 19 March 2026  14:50:47 +0000 (0:00:00.463)       0:05:24.126 ********
2026-03-19 14:50:48.346746 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-19 14:50:48.378361 | controller |
2026-03-19 14:50:48.378400 | controller | TASK [openshift_setup : Stop dnsmasq] ******************************************
2026-03-19 14:50:48.378409 | controller | Thursday 19 March 2026  14:50:48 +0000 (0:00:00.749)       0:05:24.876 ********
2026-03-19 14:50:48.378420 | controller | skipping: [instance]
2026-03-19 14:50:48.416710 | controller |
2026-03-19 14:50:48.416830 | controller | TASK [openshift_setup : Start dnsmasq] *****************************************
2026-03-19 14:50:48.416842 | controller | Thursday 19 March 2026  14:50:48 +0000 (0:00:00.032)       0:05:24.908 ********
2026-03-19 14:50:48.416854 | controller | skipping: [instance]
2026-03-19 14:50:48.417075 | controller |
2026-03-19 14:50:48.417091 | controller | TASK [reproducer : Remove entry from /etc/hosts] *******************************
2026-03-19 14:50:48.417474 | controller | Thursday 19 March 2026  14:50:48 +0000 (0:00:00.038)       0:05:24.946 ********
2026-03-19 14:50:48.647075 | controller | changed: [instance]
2026-03-19 14:50:48.720670 | controller |
2026-03-19 14:50:48.720690 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
2026-03-19 14:50:48.720699 | controller | Thursday 19 March 2026  14:50:48 +0000 (0:00:00.230)       0:05:25.177 ********
2026-03-19 14:50:48.720708 | controller | skipping: [instance] => (item=)
2026-03-19 14:50:48.753477 | controller |
2026-03-19 14:50:48.753496 | controller | TASK [dnsmasq : Assert we have needed address data] ****************************
2026-03-19 14:50:48.753508 | controller | Thursday 19 March 2026  14:50:48 +0000 (0:00:00.073)       0:05:25.251 ********
2026-03-19 14:50:48.753517 | controller | ok: [instance]
2026-03-19 14:50:48.824047 | controller |
2026-03-19 14:50:48.824072 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-19 14:50:48.824080 | controller | Thursday 19 March 2026  14:50:48 +0000 (0:00:00.032)       0:05:25.284 ********
2026-03-19 14:50:48.824090 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-03-19 14:50:49.075587 | controller |
2026-03-19 14:50:49.075703 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-19 14:50:49.075717 | controller | Thursday 19 March 2026  14:50:48 +0000 (0:00:00.070)       0:05:25.354 ********
2026-03-19 14:50:49.075730 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-03-19 14:50:49.076066 | controller |
2026-03-19 14:50:49.128479 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
2026-03-19 14:50:49.128500 | controller | Thursday 19 March 2026  14:50:49 +0000 (0:00:00.251)       0:05:25.605 ********
2026-03-19 14:50:49.128511 | controller |
2026-03-19 14:50:49.189218 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-19 14:50:49.189246 | controller | Thursday 19 March 2026  14:50:49 +0000 (0:00:00.053)       0:05:25.658 ********
2026-03-19 14:50:49.189258 | controller | ok: [instance]
2026-03-19 14:50:49.247841 | controller |
2026-03-19 14:50:49.247865 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-19 14:50:49.247874 | controller | Thursday 19 March 2026  14:50:49 +0000 (0:00:00.060)       0:05:25.719 ********
2026-03-19 14:50:49.247886 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-19 14:50:49.522625 | controller |
2026-03-19 14:50:49.522656 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-19 14:50:49.522664 | controller | Thursday 19 March 2026  14:50:49 +0000 (0:00:00.058)       0:05:25.778 ********
2026-03-19 14:50:49.522675 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-19 14:50:49.582768 | controller |
2026-03-19 14:50:49.582787 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-19 14:50:49.582794 | controller | Thursday 19 March 2026  14:50:49 +0000 (0:00:00.273)       0:05:26.052 ********
2026-03-19 14:50:49.582817 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-19 14:50:50.015693 | controller | skipping: [instance]
2026-03-19 14:50:50.015729 | controller |
2026-03-19 14:50:50.015737 | controller | TASK [reproducer : Ensure "testing" domain is "local"] *************************
2026-03-19 14:50:50.015744 | controller | Thursday 19 March 2026  14:50:49 +0000 (0:00:00.061)       0:05:26.113 ********
2026-03-19 14:50:50.015755 | controller | changed: [instance]
2026-03-19 14:50:50.728052 | controller |
2026-03-19 14:50:50.728095 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-03-19 14:50:50.728104 | controller | Thursday 19 March 2026  14:50:49 +0000 (0:00:00.416)       0:05:26.529 ********
2026-03-19 14:50:50.728110 | controller |
2026-03-19 14:50:50.728116 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
2026-03-19 14:50:50.728122 | controller | Thursday 19 March 2026  14:50:50 +0000 (0:00:00.015)       0:05:26.545 ********
2026-03-19 14:50:50.728133 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-19 14:50:51.123698 | controller |
2026-03-19 14:50:51.123732 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-19 14:50:51.123740 | controller | Thursday 19 March 2026  14:50:50 +0000 (0:00:00.712)       0:05:27.257 ********
2026-03-19 14:50:51.123751 | controller | changed: [instance]
2026-03-19 14:50:51.123889 | controller |
2026-03-19 14:50:51.123900 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
2026-03-19 14:50:51.123908 | controller | Thursday 19 March 2026  14:50:51 +0000 (0:00:00.396)       0:05:27.653 ********
2026-03-19 14:50:51.299462 | controller | skipping: [instance] => (item=controller-0)
2026-03-19 14:50:52.795915 | controller | skipping: [instance] => (item=crc-0)
2026-03-19 14:50:52.795957 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
2026-03-19 14:50:52.795966 | controller |
2026-03-19 14:50:52.795973 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
2026-03-19 14:50:52.795979 | controller | Thursday 19 March 2026  14:50:51 +0000 (0:00:00.175)       0:05:27.829 ********
2026-03-19 14:50:52.795990 | controller | changed: [instance -> compute-0(compute-0.instance)]
2026-03-19 14:50:52.796161 | controller |
2026-03-19 14:50:52.796305 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-03-19 14:50:52.796355 | controller | Thursday 19 March 2026  14:50:52 +0000 (0:00:01.496)       0:05:29.325 ********
2026-03-19 14:50:52.816411 | controller | skipping: [instance]
2026-03-19 14:50:53.337933 | controller |
2026-03-19 14:50:53.337980 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-19 14:50:53.337989 | controller | Thursday 19 March 2026  14:50:52 +0000 (0:00:00.021)       0:05:29.346 ********
2026-03-19 14:50:53.338002 | controller | ok: [instance -> compute-0(compute-0.instance)]
2026-03-19 14:50:53.338020 | controller |
2026-03-19 14:50:53.338028 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-19 14:50:53.338143 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.521)       0:05:29.868 ********
2026-03-19 14:50:53.377163 | controller | skipping: [instance]
2026-03-19 14:50:53.418584 | controller |
2026-03-19 14:50:53.418657 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-19 14:50:53.418667 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.039)       0:05:29.907 ********
2026-03-19 14:50:53.418681 | controller | skipping: [instance]
2026-03-19 14:50:53.418703 | controller |
2026-03-19 14:50:53.418711 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-19 14:50:53.460751 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.041)       0:05:29.949 ********
2026-03-19 14:50:53.460800 | controller | skipping: [instance]
2026-03-19 14:50:53.510283 | controller |
2026-03-19 14:50:53.510315 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-19 14:50:53.510323 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.042)       0:05:29.991 ********
2026-03-19 14:50:53.510355 | controller | skipping: [instance]
2026-03-19 14:50:53.550948 | controller |
2026-03-19 14:50:53.550973 | controller | TASK [reproducer : Get rhos-release and setup repos] ***************************
2026-03-19 14:50:53.550984 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.049)       0:05:30.040 ********
2026-03-19 14:50:53.550996 | controller | skipping: [instance]
2026-03-19 14:50:53.573459 | controller |
2026-03-19 14:50:53.573497 | controller | TASK [reproducer : Create repositories on computes] ****************************
2026-03-19 14:50:53.573508 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.040)       0:05:30.081 ********
2026-03-19 14:50:53.573524 | controller | skipping: [instance]
2026-03-19 14:50:53.605946 | controller |
2026-03-19 14:50:53.605980 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
2026-03-19 14:50:53.605991 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.022)       0:05:30.103 ********
2026-03-19 14:50:53.606007 | controller | skipping: [instance]
2026-03-19 14:50:53.649482 | controller |
2026-03-19 14:50:53.649509 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2026-03-19 14:50:53.649518 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.032)       0:05:30.136 ********
2026-03-19 14:50:53.649530 | controller | ok: [instance]
2026-03-19 14:50:53.649593 | controller |
2026-03-19 14:50:53.649742 | controller | TASK [reproducer : Push local code] ********************************************
2026-03-19 14:50:53.649843 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.043)       0:05:30.179 ********
2026-03-19 14:50:53.757843 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
2026-03-19 14:50:53.757954 | controller |
2026-03-19 14:50:53.758067 | controller | TASK [reproducer : Check if repository directories already exist] **************
2026-03-19 14:50:53.758178 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.108)       0:05:30.288 ********
2026-03-19 14:50:53.798564 | controller | skipping: [instance]
2026-03-19 14:50:53.798622 | controller |
2026-03-19 14:50:53.798749 | controller | TASK [reproducer : Ensure we are not in the job_id branch] *********************
2026-03-19 14:50:53.798846 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.040)       0:05:30.329 ********
2026-03-19 14:50:53.841318 | controller | skipping: [instance]
2026-03-19 14:50:53.841477 | controller |
2026-03-19 14:50:53.841623 | controller | TASK [reproducer : Fetch zuul.items repositories] ******************************
2026-03-19 14:50:53.841769 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.042)       0:05:30.372 ********
2026-03-19 14:50:53.888173 | controller | skipping: [instance]
2026-03-19 14:50:53.940309 | controller |
2026-03-19 14:50:53.940354 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
2026-03-19 14:50:53.940378 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.046)       0:05:30.418 ********
2026-03-19 14:50:53.940390 | controller | skipping: [instance]
2026-03-19 14:50:53.985116 | controller |
2026-03-19 14:50:53.985135 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
2026-03-19 14:50:53.985143 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.051)       0:05:30.470 ********
2026-03-19 14:50:53.985153 | controller | skipping: [instance]
2026-03-19 14:50:54.488993 | controller |
2026-03-19 14:50:54.489048 | controller | TASK [reproducer : Create target directories beforehand] ***********************
2026-03-19 14:50:54.489056 | controller | Thursday 19 March 2026  14:50:53 +0000 (0:00:00.045)       0:05:30.515 ********
2026-03-19 14:50:54.489076 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
2026-03-19 14:50:54.489084 | controller |
2026-03-19 14:50:54.489092 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2026-03-19 14:50:55.091465 | controller | Thursday 19 March 2026  14:50:54 +0000 (0:00:00.502)       0:05:31.018 ********
2026-03-19 14:50:55.091537 | controller | ok: [instance -> localhost] => (item=ci-framework)
2026-03-19 14:50:55.091588 | controller |
2026-03-19 14:50:55.091596 | controller | TASK [reproducer : Sync remote repositories] ***********************************
2026-03-19 14:50:55.091696 | controller | Thursday 19 March 2026  14:50:55 +0000 (0:00:00.603)       0:05:31.621 ********
2026-03-19 14:50:55.143485 | controller | skipping: [instance] => (item=ci-framework)
2026-03-19 14:50:55.143560 | controller | skipping: [instance]
2026-03-19 14:50:55.143572 | controller |
2026-03-19 14:50:55.143581 | controller | TASK [reproducer : Ensure default repositories are present] ********************
2026-03-19 14:50:55.143613 | controller | Thursday 19 March 2026  14:50:55 +0000 (0:00:00.051)       0:05:31.673 ********
2026-03-19 14:50:55.163701 | controller | fatal: [instance]: FAILED! =>
2026-03-19 14:50:55.171996 | controller |   msg: '[{''src'': ''{{ cifmw_repo_url }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_repo_relative }}''}, {''src'': ''{{ cifmw_install_yamls_src }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_installyamls_repos_relative }}''}, {''src'': ''{{ cifmw_architecture_repo_url }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_architecture_repo_relative }}''}]: ''cifmw_repo_url'' is undefined. ''cifmw_repo_url'' is undefined. [{''src'': ''{{ cifmw_repo_url }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_repo_relative }}''}, {''src'': ''{{ cifmw_install_yamls_src }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_installyamls_repos_relative }}''}, {''src'': ''{{ cifmw_architecture_repo_url }}'', ''dest'': ''{{ cifmw_reproducer_controller_user_dir }}/{{ cifmw_architecture_repo_relative }}''}]: ''cifmw_repo_url'' is undefined. ''cifmw_repo_url'' is undefined'
2026-03-19 14:50:55.172035 | controller |
2026-03-19 14:50:55.375657 | controller | TASK [Create dnsmasq dir] ******************************************************
2026-03-19 14:50:55.375689 | controller | Thursday 19 March 2026  14:50:55 +0000 (0:00:00.029)       0:05:31.702 ********
2026-03-19 14:50:55.375702 | controller | changed: [instance]
2026-03-19 14:50:55.626037 | controller |
2026-03-19 14:50:55.626095 | controller | TASK [Get journalctl in a file] ************************************************
2026-03-19 14:50:55.626105 | controller | Thursday 19 March 2026  14:50:55 +0000 (0:00:00.203)       0:05:31.905 ********
2026-03-19 14:50:55.626120 | controller | changed: [instance]
2026-03-19 14:50:56.034936 | controller |
2026-03-19 14:50:56.034987 | controller | TASK [Dump journalctl output] **************************************************
2026-03-19 14:50:56.034996 | controller | Thursday 19 March 2026  14:50:55 +0000 (0:00:00.250)       0:05:32.156 ********
2026-03-19 14:50:56.035010 | controller | changed: [instance]
2026-03-19 14:50:56.548915 | controller |
2026-03-19 14:50:56.548967 | controller | TASK [Copy all dnsmasq config] *************************************************
2026-03-19 14:50:56.548977 | controller | Thursday 19 March 2026  14:50:56 +0000 (0:00:00.409)       0:05:32.565 ********
2026-03-19 14:50:56.548990 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-03-19 14:50:56.787374 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2026-03-19 14:50:56.787414 | controller |
2026-03-19 14:50:56.787421 | controller | TASK [Create log directory] ****************************************************
2026-03-19 14:50:56.787428 | controller | Thursday 19 March 2026  14:50:56 +0000 (0:00:00.513)       0:05:33.078 ********
2026-03-19 14:50:56.787439 | controller | changed: [instance]
2026-03-19 14:50:57.780411 | controller |
2026-03-19 14:50:57.780461 | controller | TASK [Sync logs from controller-0] *********************************************
2026-03-19 14:50:57.780470 | controller | Thursday 19 March 2026  14:50:56 +0000 (0:00:00.238)       0:05:33.317 ********
2026-03-19 14:50:57.780482 | controller | changed: [instance]
2026-03-19 14:50:57.780526 | controller |
2026-03-19 14:50:57.780533 | controller | PLAY RECAP *********************************************************************
2026-03-19 14:50:57.780539 | controller | instance                   : ok=495  changed=186  unreachable=0    failed=1    skipped=182  rescued=0    ignored=0
2026-03-19 14:50:57.780545 | controller |
2026-03-19 14:50:57.780551 | controller | Thursday 19 March 2026  14:50:57 +0000 (0:00:00.990)       0:05:34.308 ********
2026-03-19 14:50:57.780556 | controller | ===============================================================================
2026-03-19 14:50:57.780562 | controller | reproducer : Check package install status ------------------------------ 45.24s
2026-03-19 14:50:57.780569 | controller | libvirt_manager : Download base image ---------------------------------- 32.11s
2026-03-19 14:50:57.780603 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.14s
2026-03-19 14:50:57.780612 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.74s
2026-03-19 14:50:57.780931 | controller | libvirt_manager : Install packages required for using KVM -------------- 10.07s
2026-03-19 14:50:57.782022 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 8.17s
2026-03-19 14:50:57.782113 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.05s
2026-03-19 14:50:57.782125 | controller | ci_nmstate : Install required packages on localhost --------------------- 4.90s
2026-03-19 14:50:57.782165 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.79s
2026-03-19 14:50:57.896809 | controller | networking_mapper : Gather the facts ------------------------------------ 3.66s
2026-03-19 14:50:57.896842 | controller | sushy_emulator : Install required packages ------------------------------ 3.23s
2026-03-19 14:50:57.896850 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.16s
2026-03-19 14:50:57.896856 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.07s
2026-03-19 14:50:57.896861 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s
2026-03-19 14:50:57.896885 | controller | reproducer : Inject SSH configuration ----------------------------------- 2.06s
2026-03-19 14:50:57.896891 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.01s
2026-03-19 14:50:57.896897 | controller | libvirt_manager : Inject private key on hosts controller-0 -------------- 1.75s
2026-03-19 14:50:57.896902 | controller | ci_nmstate : Apply the desidered state on instance ---------------------- 1.68s
2026-03-19 14:50:57.896916 | controller | ci_nmstate : Apply the desidered state on localhost --------------------- 1.67s
2026-03-19 14:50:57.896921 | controller | podman : Ensure podman is installed ------------------------------------- 1.66s
2026-03-19 14:50:57.896933 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml']
2026-03-19 14:50:57.897157 | controller | WARNING  An error occurred during the test sequence action: 'converge'. Cleaning up.
2026-03-19 14:50:57.904957 | controller | INFO     Running crc_layout > cleanup
2026-03-19 14:50:57.905344 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-19 14:50:57.912672 | controller | INFO     Running crc_layout > destroy
2026-03-19 14:50:57.912967 | controller | WARNING  Skipping, instances are delegated.
2026-03-19 14:50:57.913253 | controller | INFO     Pruning extra files from scenario ephemeral directory
2026-03-19 14:50:57.914791 | controller | INFO     Writing /tmp/report.html report.
2026-03-19 14:50:58.372770 | [controller] Waiting on logger
2026-03-19 14:51:03.548062 | [controller] Waiting on logger
2026-03-19 14:51:13.980610 | [controller] Waiting on logger
2026-03-19 14:51:24.411982 | [controller] Waiting on logger
2026-03-19 14:51:28.010305 | [Zuul] Log Stream did not terminate
2026-03-19 14:51:28.010547 | controller | ERROR
2026-03-19 14:51:28.010629 | controller | {
2026-03-19 14:51:28.010659 | controller |   "delta": "0:07:09.268881",
2026-03-19 14:51:28.010680 | controller |   "end": "2026-03-19 14:50:57.972998",
2026-03-19 14:51:28.010699 | controller |   "msg": "non-zero return code",
2026-03-19 14:51:28.010715 | controller |   "rc": 1,
2026-03-19 14:51:28.010731 | controller |   "start": "2026-03-19 14:43:48.704117"
2026-03-19 14:51:28.010746 | controller | }
failure
2026-03-19 14:51:28.061573 | 
2026-03-19 14:51:28.061625 | PLAY RECAP
2026-03-19 14:51:28.061664 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0
2026-03-19 14:51:28.061685 | 
2026-03-19 14:51:28.122697 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-03-19 14:51:28.123463 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-03-19 14:51:28.608348 | 
2026-03-19 14:51:28.608441 | PLAY [Run ci/playbooks/collect-logs.yml]
2026-03-19 14:51:28.628043 | 
2026-03-19 14:51:28.628114 | TASK [Filter out host if needed]
2026-03-19 14:51:28.636435 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2026-03-19 14:51:28.640784 | 
2026-03-19 14:51:28.640850 | TASK [Ensure file is present]
2026-03-19 14:51:29.066945 | controller | ok
2026-03-19 14:51:29.071914 | 
2026-03-19 14:51:29.071974 | TASK [Manage molecule report file]
2026-03-19 14:51:29.090673 | [controller] Waiting on logger
2026-03-19 14:51:38.464425 | [controller] Waiting on logger
2026-03-19 14:51:48.860364 | [controller] Waiting on logger
2026-03-19 14:51:59.291706 | [controller] Waiting on logger
2026-03-19 14:51:59.493357 | [Zuul] Log Stream did not terminate
2026-03-19 14:51:59.493529 | controller | changed
2026-03-19 14:51:59.498424 | 
2026-03-19 14:51:59.498487 | TASK [Check if we get ci-framework-data basedir]
2026-03-19 14:51:59.821499 | controller | ok
2026-03-19 14:51:59.826621 | 
2026-03-19 14:51:59.826682 | TASK [Create ci-framework-data log directory for zuul]
2026-03-19 14:52:00.218826 | controller | changed
2026-03-19 14:52:00.224421 | 
2026-03-19 14:52:00.224494 | TASK [Copy ci-framework interesting files]
2026-03-19 14:52:05.248923 | controller | changed
2026-03-19 14:52:05.254528 | 
2026-03-19 14:52:05.254595 | TASK [Get SELinux listing]
2026-03-19 14:52:08.379960 | [controller] Waiting on logger
2026-03-19 14:52:18.811775 | [controller] Waiting on logger
2026-03-19 14:52:29.243889 | [controller] Waiting on logger
2026-03-19 14:52:35.568898 | [Zuul] Log Stream did not terminate
2026-03-19 14:52:35.569076 | controller | changed
2026-03-19 14:52:35.575125 | 
2026-03-19 14:52:35.575194 | TASK [Generate log index]
2026-03-19 14:52:36.884966 | controller | changed
2026-03-19 14:52:36.889907 | 
2026-03-19 14:52:36.889969 | TASK [Get some env related data]
2026-03-19 14:52:36.910178 | [controller] Waiting on logger
2026-03-19 14:52:39.676043 | [controller] Waiting on logger
2026-03-19 14:52:42.013485 | controller | changed
2026-03-19 14:52:42.018754 | 
2026-03-19 14:52:42.018821 | TASK [Generate list of logs to collect in home directory]
2026-03-19 14:52:42.379839 | controller | ok: All paths examined
2026-03-19 14:52:42.384990 | 
2026-03-19 14:52:42.385046 | LOOP [Copy logs from home directory]
2026-03-19 14:52:43.039060 | controller | changed:
2026-03-19 14:52:43.039259 | controller | {
2026-03-19 14:52:43.039288 | controller |   "atime": 1772005405.932821,
2026-03-19 14:52:43.039330 | controller |   "ctime": 1772006396.9238591,
2026-03-19 14:52:43.039351 | controller |   "dev": 64513,
2026-03-19 14:52:43.039368 | controller |   "gid": 1000,
2026-03-19 14:52:43.039383 | controller |   "gr_name": "zuul",
2026-03-19 14:52:43.039402 | controller |   "inode": 2773,
2026-03-19 14:52:43.039418 | controller |   "isblk": false,
2026-03-19 14:52:43.039432 | controller |   "ischr": false,
2026-03-19 14:52:43.039447 | controller |   "isdir": false,
2026-03-19 14:52:43.039461 | controller |   "isfifo": false,
2026-03-19 14:52:43.039484 | controller |   "isgid": false,
2026-03-19 14:52:43.039501 | controller |   "islnk": false,
2026-03-19 14:52:43.039516 | controller |   "isreg": true,
2026-03-19 14:52:43.039531 | controller |   "issock": false,
2026-03-19 14:52:43.039546 | controller |   "isuid": false,
2026-03-19 14:52:43.039560 | controller |   "mode": "0644",
2026-03-19 14:52:43.039574 | controller |   "mtime": 1772006396.9238591,
2026-03-19 14:52:43.039588 | controller |   "nlink": 1,
2026-03-19 14:52:43.039604 | controller |   "path": "/home/zuul/crc-setup.log",
2026-03-19 14:52:43.039619 | controller |   "pw_name": "zuul",
2026-03-19 14:52:43.039632 | controller |   "rgrp": true,
2026-03-19 14:52:43.039646 | controller |   "roth": true,
2026-03-19 14:52:43.039659 | controller |   "rusr": true,
2026-03-19 14:52:43.039672 | controller |   "size": 4108,
2026-03-19 14:52:43.039685 | controller |   "uid": 1000,
2026-03-19 14:52:43.039698 | controller |   "wgrp": false,
2026-03-19 14:52:43.039712 | controller |   "woth": false,
2026-03-19 14:52:43.039735 | controller |   "wusr": true,
2026-03-19 14:52:43.039750 | controller |   "xgrp": false,
2026-03-19 14:52:43.039764 | controller |   "xoth": false,
2026-03-19 14:52:43.039777 | controller |   "xusr": false
2026-03-19 14:52:43.039790 | controller | }
2026-03-19 14:52:43.673772 | controller | changed:
2026-03-19 14:52:43.673850 | controller | {
2026-03-19 14:52:43.673873 | controller |   "atime": 1772006398.6759083,
2026-03-19 14:52:43.673891 | controller |   "ctime": 1772007098.5537844,
2026-03-19 14:52:43.673906 | controller |   "dev": 64513,
2026-03-19 14:52:43.673920 | controller |   "gid": 1000,
2026-03-19 14:52:43.673936 | controller |   "gr_name": "zuul",
2026-03-19 14:52:43.673950 | controller |   "inode": 359205,
2026-03-19 14:52:43.673963 | controller |   "isblk": false,
2026-03-19 14:52:43.673976 | controller |   "ischr": false,
2026-03-19 14:52:43.673989 | controller |   "isdir": false,
2026-03-19 14:52:43.674002 | controller |   "isfifo": false,
2026-03-19 14:52:43.674015 | controller |   "isgid": false,
2026-03-19 14:52:43.674027 | controller |   "islnk": false,
2026-03-19 14:52:43.674039 | controller |   "isreg": true,
2026-03-19 14:52:43.674052 | controller |   "issock": false,
2026-03-19 14:52:43.674065 | controller |   "isuid": false,
2026-03-19 14:52:43.674085 | controller |   "mode": "0644",
2026-03-19 14:52:43.674097 | controller |   "mtime": 1772007098.5537844,
2026-03-19 14:52:43.674109 | controller |   "nlink": 1,
2026-03-19 14:52:43.674121 | controller |   "path": "/home/zuul/crc-start.log",
2026-03-19 14:52:43.674133 | controller |   "pw_name": "zuul",
2026-03-19 14:52:43.674145 | controller |   "rgrp": true,
2026-03-19 14:52:43.674158 | controller |   "roth": true,
2026-03-19 14:52:43.674171 | controller |   "rusr": true,
2026-03-19 14:52:43.674186 | controller |   "size": 4654,
2026-03-19 14:52:43.674199 | controller |   "uid": 1000,
2026-03-19 14:52:43.674212 | controller |   "wgrp": false,
2026-03-19 14:52:43.674224 | controller |   "woth": false,
2026-03-19 14:52:43.674237 | controller |   "wusr": true,
2026-03-19 14:52:43.674249 | controller |   "xgrp": false,
2026-03-19 14:52:43.674261 | controller |   "xoth": false,
2026-03-19 14:52:43.674273 | controller |   "xusr": false
2026-03-19 14:52:43.674285 | controller | }
2026-03-19 14:52:44.313999 | controller | changed:
2026-03-19 14:52:44.314075 | controller | {
2026-03-19 14:52:44.314099 | controller |   "atime": 1773931409.911691,
2026-03-19 14:52:44.314117 | controller |   "ctime": 1773931426.2907965,
2026-03-19 14:52:44.314131 | controller |   "dev": 64513,
2026-03-19 14:52:44.314146 | controller |   "gid": 1000,
2026-03-19 14:52:44.314160 | controller |   "gr_name": "zuul",
2026-03-19 14:52:44.314178 | controller |   "inode": 1189160,
2026-03-19 14:52:44.314192 | controller |   "isblk": false,
2026-03-19 14:52:44.314205 | controller |   "ischr": false,
2026-03-19 14:52:44.314217 | controller |   "isdir": false,
2026-03-19 14:52:44.314228 | controller |   "isfifo": false,
2026-03-19 14:52:44.314243 | controller |   "isgid": false,
2026-03-19 14:52:44.314258 | controller |   "islnk": false,
2026-03-19 14:52:44.314272 | controller |   "isreg": true,
2026-03-19 14:52:44.314288 | controller |   "issock": false,
2026-03-19 14:52:44.314322 | controller |   "isuid": false,
2026-03-19 14:52:44.314338 | controller |   "mode": "0644",
2026-03-19 14:52:44.314351 | controller |   "mtime": 1773931426.2907965,
2026-03-19 14:52:44.314364 | controller |   "nlink": 1,
2026-03-19 14:52:44.314377 | controller |   "path": "/home/zuul/ansible.log",
2026-03-19 14:52:44.314389 | controller |   "pw_name": "zuul",
2026-03-19 14:52:44.314401 | controller |   "rgrp": true,
2026-03-19 14:52:44.314414 | controller |   "roth": true,
2026-03-19 14:52:44.314426 | controller |   "rusr": true,
2026-03-19 14:52:44.314438 | controller |   "size": 6749,
2026-03-19 14:52:44.314449 | controller |   "uid": 1000,
2026-03-19 14:52:44.314461 | controller |   "wgrp": false,
2026-03-19 14:52:44.314473 | controller |   "woth": false,
2026-03-19 14:52:44.314485 | controller |   "wusr": true,
2026-03-19 14:52:44.314497 | controller |   "xgrp": false,
2026-03-19 14:52:44.314508 | controller |   "xoth": false,
2026-03-19 14:52:44.314520 | controller |   "xusr": false
2026-03-19 14:52:44.314532 | controller | }
2026-03-19 14:52:44.322315 | 
2026-03-19 14:52:44.322376 | TASK [Copy crio stats log file]
2026-03-19 14:52:44.334944 | controller | skipping: Conditional result was False
2026-03-19 14:52:44.339528 | 
2026-03-19 14:52:44.339587 | TASK [Get SELinux related data]
2026-03-19 14:52:45.371823 | [controller] Waiting on logger
2026-03-19 14:52:56.252079 | [controller] Waiting on logger
2026-03-19 14:53:05.083700 | [controller] Waiting on logger
2026-03-19 14:53:10.189647 | controller | ERROR
2026-03-19 14:53:10.189827 | controller | {
2026-03-19 14:53:10.189858 | controller |   "delta": "0:00:00.012499",
2026-03-19 14:53:10.189879 | controller |   "end": "2026-03-19 14:52:44.658166",
2026-03-19 14:53:10.189896 | controller |   "msg": "non-zero return code",
2026-03-19 14:53:10.189911 | controller |   "rc": 1,
2026-03-19 14:53:10.189926 | controller |   "start": "2026-03-19 14:52:44.645667"
2026-03-19 14:53:10.189941 | controller | }
2026-03-19 14:53:10.189963 | controller | ERROR: Ignoring Errors
2026-03-19 14:53:10.194921 | 
2026-03-19 14:53:10.194992 | TASK [Create system configuration directory]
2026-03-19 14:53:10.700236 | controller | changed
2026-03-19 14:53:10.704638 | 
2026-03-19 14:53:10.704696 | TASK [Get some of the system configurations]
2026-03-19 14:53:10.723485 | [controller] Waiting on logger
2026-03-19 14:53:12.892431 | [controller] Waiting on logger
2026-03-19 14:53:29.376243 | [controller] Waiting on logger
2026-03-19 14:53:32.603820 | [controller] Waiting on logger
2026-03-19 14:53:41.218174 | [Zuul] Log Stream did not terminate
2026-03-19 14:53:41.218367 | controller | changed
2026-03-19 14:53:41.223070 | 
2026-03-19 14:53:41.223129 | TASK [Copy generated documentation if available]
2026-03-19 14:53:41.236197 | controller | skipping: Conditional result was False
2026-03-19 14:53:41.241366 | 
2026-03-19 14:53:41.241432 | TASK [Copy generated AsciiDoc documentation if available]
2026-03-19 14:53:41.253845 | controller | skipping: Conditional result was False
2026-03-19 14:53:41.258948 | 
2026-03-19 14:53:41.259010 | TASK [Compress logs bigger than 2MB]
2026-03-19 14:53:41.279051 | [controller] Waiting on logger
2026-03-19 14:53:51.099934 | [controller] Waiting on logger
2026-03-19 14:53:58.843949 | [controller] Waiting on logger
2026-03-19 14:54:09.723706 | [controller] Waiting on logger
2026-03-19 14:54:11.650432 | [Zuul] Log Stream did not terminate
2026-03-19 14:54:11.650682 | controller | changed
2026-03-19 14:54:11.655599 | 
2026-03-19 14:54:11.655661 | TASK [Copy files from workspace on node]
2026-03-19 14:54:11.673892 | controller | ok
2026-03-19 14:54:11.694902 | 
2026-03-19 14:54:11.694971 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-19 14:54:11.707687 | controller | skipping: Conditional result was False
2026-03-19 14:54:11.712852 | 
2026-03-19 14:54:11.712919 | TASK [fetch-output : Set log path for single node]
2026-03-19 14:54:11.739697 | controller | ok
2026-03-19 14:54:11.744210 | 
2026-03-19 14:54:11.744268 | LOOP [fetch-output : Ensure local output dirs]
2026-03-19 14:54:11.928172 | controller -> localhost | ok: "/var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/logs"
2026-03-19 14:54:11.928452 | controller -> localhost | changed: All items complete
2026-03-19 14:54:11.928486 | 
2026-03-19 14:54:12.105285 | controller -> localhost | changed: "/var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/artifacts"
2026-03-19 14:54:12.273524 | controller -> localhost | changed: "/var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/docs"
2026-03-19 14:54:12.285050 | 
2026-03-19 14:54:12.285144 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-19 14:54:13.021511 | controller | changed:
2026-03-19 14:54:13.021702 | controller | .d..t...... ./
2026-03-19 14:54:13.021735 | controller | >f+++++++++ README.html
2026-03-19 14:54:13.021758 | controller | >f+++++++++ ansible-execution.log
2026-03-19 14:54:13.021780 | controller | >f+++++++++ ansible.log
2026-03-19 14:54:13.021799 | controller | >f+++++++++ crc-setup.log
2026-03-19 14:54:13.021817 | controller | >f+++++++++ crc-start.log
2026-03-19 14:54:13.021834 | controller | >f+++++++++ dmesg.log
2026-03-19 14:54:13.021851 | controller | >f+++++++++ installed-pkgs.log
2026-03-19 14:54:13.021868 | controller | >f+++++++++ python.log
2026-03-19 14:54:13.021885 | controller | >f+++++++++ registries.conf
2026-03-19 14:54:13.021901 | controller | >f+++++++++ report.html
2026-03-19 14:54:13.021918 | controller | >f+++++++++ selinux-denials.log
2026-03-19 14:54:13.021935 | controller | >f+++++++++ selinux-listing.log
2026-03-19 14:54:13.021951 | controller | cd+++++++++ ci-framework-data/
2026-03-19 14:54:13.021968 | controller | cd+++++++++ ci-framework-data/artifacts/
2026-03-19 14:54:13.021985 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2026-03-19 14:54:13.022002 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2026-03-19 14:54:13.022019 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf
2026-03-19 14:54:13.022035 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2026-03-19 14:54:13.022051 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf
2026-03-19 14:54:13.022069 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2026-03-19 14:54:13.022086 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2026-03-19 14:54:13.022103 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2026-03-19 14:54:13.022119 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2026-03-19 14:54:13.022135 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2026-03-19 14:54:13.022150 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2026-03-19 14:54:13.022166 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2026-03-19 14:54:13.022182 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2026-03-19 14:54:13.022198 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:9c:c1:6c
2026-03-19 14:54:13.022214 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:64:ad:33
2026-03-19 14:54:13.022231 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:1f:ee:92
2026-03-19 14:54:13.022247 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:e1:11:65
2026-03-19 14:54:13.022268 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:fe:6b:b3
2026-03-19 14:54:13.022286 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:36:57:22
2026-03-19 14:54:13.022332 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2026-03-19 14:54:13.022352 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2026-03-19 14:54:13.022370 | controller | cd+++++++++ ci-framework-data/logs/
2026-03-19 14:54:13.022387 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2026-03-19 14:54:13.022403 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2026-03-19 14:54:13.022419 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2026-03-19 14:54:13.022435 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2026-03-19 14:54:13.022452 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml
2026-03-19 14:54:13.022469 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2026-03-19 14:54:13.022486 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/
2026-03-19 14:54:13.022502 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd
2026-03-19 14:54:13.022518 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf
2026-03-19 14:54:13.022533 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts
2026-03-19 14:54:13.022552 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2026-03-19 14:54:13.022569 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml
2026-03-19 14:54:13.022586 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2026-03-19 14:54:13.022602 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml
2026-03-19 14:54:13.022618 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml
2026-03-19 14:54:13.022635 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/
2026-03-19 14:54:13.022651 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt
2026-03-19 14:54:13.022679 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2026-03-19 14:54:13.022699 | controller | cd+++++++++ registries.conf.d/
2026-03-19 14:54:13.022716 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2026-03-19 14:54:13.022733 | controller | cd+++++++++ system-config/
2026-03-19 14:54:13.022749 | controller | cd+++++++++ system-config/libvirt/
2026-03-19 14:54:13.022765 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2026-03-19 14:54:13.022780 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2026-03-19 14:54:13.022796 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2026-03-19 14:54:13.022813 | controller | >f+++++++++ system-config/libvirt/network.conf
2026-03-19 14:54:13.022830 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2026-03-19 14:54:13.022847 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2026-03-19 14:54:13.022863 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2026-03-19 14:54:13.022879 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2026-03-19 14:54:13.022895 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2026-03-19 14:54:13.022920 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2026-03-19 14:54:13.022937 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2026-03-19 14:54:13.022954 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2026-03-19 14:54:13.022971 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2026-03-19 14:54:13.022987 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2026-03-19 14:54:13.023003 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2026-03-19 14:54:13.023019 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2026-03-19 14:54:13.541863 | controller | changed: .d..t...... ./
2026-03-19 14:54:14.053758 | controller | changed: .d..t...... ./
2026-03-19 14:54:14.070178 | 
2026-03-19 14:54:14.070247 | TASK [Return artifact to Zuul]
2026-03-19 14:54:14.098061 | controller | ok
2026-03-19 14:54:14.116463 | 
2026-03-19 14:54:14.116520 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2026-03-19 14:54:14.116616 | 
2026-03-19 14:54:14.116642 | PLAY RECAP
2026-03-19 14:54:14.116692 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2026-03-19 14:54:14.116715 | 
2026-03-19 14:54:14.185916 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-03-19 14:54:14.186625 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-19 14:54:14.649626 | 
2026-03-19 14:54:14.649732 | PLAY [all]
2026-03-19 14:54:14.666880 | 
2026-03-19 14:54:14.666948 | TASK [include_role : fetch-output]
2026-03-19 14:54:14.694926 | controller | ok
2026-03-19 14:54:14.710967 | 
2026-03-19 14:54:14.711052 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-19 14:54:14.754380 | controller | skipping: Conditional result was False
2026-03-19 14:54:14.759861 | 
2026-03-19 14:54:14.759933 | TASK [fetch-output : Set log path for single node]
2026-03-19 14:54:14.787709 | controller | ok
2026-03-19 14:54:14.792527 | 
2026-03-19 14:54:14.792598 | LOOP [fetch-output : Ensure local output dirs]
2026-03-19 14:54:15.100223 | controller -> localhost | ok: "/var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/logs"
2026-03-19 14:54:15.273307 | controller -> localhost | ok: "/var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/artifacts"
2026-03-19 14:54:15.444702 | controller -> localhost | ok: "/var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/docs"
2026-03-19 14:54:15.452438 | 
2026-03-19 14:54:15.452509 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-19 14:54:16.132265 | controller | ok
2026-03-19 14:54:16.132505 | controller | ok: All items complete
2026-03-19 14:54:16.132537 | 
2026-03-19 14:54:16.684231 | controller | ok
2026-03-19 14:54:17.235171 | controller | ok
2026-03-19 14:54:17.251125 | 
2026-03-19 14:54:17.251189 | TASK [include_role : fetch-output-openshift]
2026-03-19 14:54:17.263873 | controller | skipping: Conditional result was False
2026-03-19 14:54:17.268835 | 
2026-03-19 14:54:17.268895 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-19 14:54:17.582628 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006037
2026-03-19 14:54:17.764003 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.005717
2026-03-19 14:54:17.792214 | 
2026-03-19 14:54:17.792314 | PLAY [all]
2026-03-19 14:54:17.805445 | 
2026-03-19 14:54:17.805515 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-19 14:54:18.463125 | controller | changed
2026-03-19 14:54:18.483444 | 
2026-03-19 14:54:18.483493 | PLAY RECAP
2026-03-19 14:54:18.483533 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2026-03-19 14:54:18.483553 | 
2026-03-19 14:54:18.544631 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-19 14:54:18.545358 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2026-03-19 14:54:19.045995 | 
2026-03-19 14:54:19.046088 | PLAY [localhost]
2026-03-19 14:54:19.062426 | 
2026-03-19 14:54:19.062502 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-19 14:54:19.342841 | localhost | changed
2026-03-19 14:54:19.347381 | 
2026-03-19 14:54:19.347472 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-19 14:54:19.374239 | localhost | ok
2026-03-19 14:54:19.381983 | 
2026-03-19 14:54:19.382053 | TASK [add-fileserver : Create SSH private key tempfile]
2026-03-19 14:54:19.661448 | localhost | changed
2026-03-19 14:54:19.666888 | 
2026-03-19 14:54:19.666961 | TASK [add-fileserver : Create SSH private key from secret]
2026-03-19 14:54:20.179714 | localhost | changed
2026-03-19 14:54:20.184515 | 
2026-03-19 14:54:20.184590 | TASK [add-fileserver : Add fileserver ssh key]
2026-03-19 14:54:20.494773 | localhost | Identity added: /var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/tmp/ansible.l8hxutg3 (/var/lib/zuul/builds/10c803c4da0540928516934696bea169/work/tmp/ansible.l8hxutg3)
2026-03-19 14:54:20.494926 | localhost | ok: Runtime: 0:00:00.005928
2026-03-19 14:54:20.499057 | 
2026-03-19 14:54:20.499131 | TASK [add-fileserver : Remove SSH private key from disk]
2026-03-19 14:54:20.697925 | localhost | ok: Runtime: 0:00:00.004184
2026-03-19 14:54:20.702132 | 
2026-03-19 14:54:20.702209 | TASK [add-fileserver : Add fileserver to inventory]
2026-03-19 14:54:20.749285 | localhost | changed
2026-03-19 14:54:20.754121 | 
2026-03-19 14:54:20.754188 | TASK [add-fileserver : Add fileserver server to known hosts]
2026-03-19 14:54:21.054685 | localhost | changed
2026-03-19 14:54:21.073372 | 
2026-03-19 14:54:21.073438 | PLAY [localhost]
2026-03-19 14:54:21.084255 | 
2026-03-19 14:54:21.084369 | TASK [Generate bulk log download script]
2026-03-19 14:54:21.101969 | localhost | ok
2026-03-19 14:54:21.112225 | 
2026-03-19 14:54:21.112308 | TASK [local-log-download : Check API endpoint is defined]
2026-03-19 14:54:21.139280 | localhost | ok: All assertions passed
2026-03-19 14:54:21.144080 | 
2026-03-19 14:54:21.144199 | TASK [local-log-download : Create download script]
2026-03-19 14:54:21.473471 | localhost -> localhost | changed
2026-03-19 14:54:21.482057 | 
2026-03-19 14:54:21.482127 | TASK [Register quick-download link]
2026-03-19 14:54:21.499398 | localhost | ok
2026-03-19 14:54:21.531107 | 
2026-03-19 14:54:21.531179 | PLAY [logserver.rdoproject.org]
2026-03-19 14:54:21.540898 | 
2026-03-19 14:54:21.540959 | TASK [Set zuul-log-path fact]
2026-03-19 14:54:21.556654 | logserver.rdoproject.org | ok
2026-03-19 14:54:21.565006 | 
2026-03-19 14:54:21.565071 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-19 14:54:21.590958 | logserver.rdoproject.org | ok
2026-03-19 14:54:21.596037 | 
2026-03-19 14:54:21.596101 | TASK [upload-logs : Create log directories]
2026-03-19 14:54:23.600169 | logserver.rdoproject.org | changed
2026-03-19 14:54:23.603105 | 
2026-03-19 14:54:23.603169 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-19 14:54:23.809968 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004842
2026-03-19 14:54:23.814314 | 
2026-03-19 14:54:23.814380 | TASK [upload-logs : Upload logs to log server]
2026-03-19 14:54:25.323222 | logserver.rdoproject.org | Output suppressed because no_log was given
2026-03-19 14:54:25.325930 | 
2026-03-19 14:54:25.325993 | LOOP [upload-logs : Compress console log and json output]
2026-03-19 14:54:25.361580 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-19 14:54:25.369169 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-19 14:54:25.373258 | 
2026-03-19 14:54:25.373357 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-19 14:54:25.406894 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-19 14:54:25.407110 | 
2026-03-19 14:54:25.410206 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-19 14:54:25.420834 | 
2026-03-19 14:54:25.420919 | LOOP [upload-logs : Upload console log and json output]