2026-02-26 18:25:37.856629 | Job console starting...
2026-02-26 18:25:38.075171 | Updating repositories
2026-02-26 18:25:38.796908 | Preparing job workspace
2026-02-26 18:25:47.156999 | Running Ansible setup...
2026-02-26 18:25:50.605312 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-02-26 18:25:51.071188 | 
2026-02-26 18:25:51.071282 | PLAY [localhost]
2026-02-26 18:25:51.079060 | 
2026-02-26 18:25:51.079124 | TASK [Gathering Facts]
2026-02-26 18:25:51.824773 | localhost | ok
2026-02-26 18:25:51.836619 | 
2026-02-26 18:25:51.836694 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-02-26 18:25:52.133429 | localhost -> localhost | changed
2026-02-26 18:25:52.138341 | 
2026-02-26 18:25:52.138416 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-02-26 18:25:52.769928 | localhost -> localhost | changed
2026-02-26 18:25:52.777623 | 
2026-02-26 18:25:52.777707 | TASK [Setup log path fact]
2026-02-26 18:25:52.794278 | localhost | ok
2026-02-26 18:25:52.804673 | 
2026-02-26 18:25:52.804753 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-02-26 18:25:52.821961 | localhost | ok
2026-02-26 18:25:52.828620 | 
2026-02-26 18:25:52.828688 | TASK [emit-job-header : Print job information]
2026-02-26 18:25:52.855259 | # Job Information
2026-02-26 18:25:52.855381 | Ansible Version: 2.15.12
2026-02-26 18:25:52.855410 | Job: cifmw-molecule-reproducer
2026-02-26 18:25:52.855432 | Pipeline: github-check
2026-02-26 18:25:52.855450 | Executor: ibm-bm4-ze.softwarefactory-project.io
2026-02-26 18:25:52.855468 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3721
2026-02-26 18:25:52.855488 | Log URL (when completed): https://logserver.rdoproject.org/733/rdoproject.org/7339d894f0954257b6a2bfce67bd2072/
2026-02-26 18:25:52.855506 | Event ID: 69ff26c0-1340-11f1-8502-93518e074f93
2026-02-26 18:25:52.858894 | 
2026-02-26 18:25:52.858959 | LOOP [emit-job-header : Print node information]
2026-02-26 18:25:52.937127 | localhost | ok:
2026-02-26 18:25:52.937279 | localhost | # Node Information
2026-02-26 18:25:52.937327 | localhost | Inventory Hostname: controller
2026-02-26 18:25:52.937356 | localhost | Hostname: np0005631899
2026-02-26 18:25:52.937377 | localhost | Username: zuul
2026-02-26 18:25:52.937397 | localhost | Distro: CentOS 9
2026-02-26 18:25:52.937415 | localhost | Provider: ibm-bm4-nodepool
2026-02-26 18:25:52.937432 | localhost | Region: regionOne
2026-02-26 18:25:52.937448 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2026-02-26 18:25:52.937464 | localhost | Product Name: OpenStack Compute
2026-02-26 18:25:52.937481 | localhost | Interface IP: 192.168.26.106
2026-02-26 18:25:52.959698 | 
2026-02-26 18:25:52.959774 | PLAY [all]
2026-02-26 18:25:52.965475 | 
2026-02-26 18:25:52.965536 | TASK [Gather network facts]
2026-02-26 18:25:53.389910 | controller | ok
2026-02-26 18:25:53.402639 | 
2026-02-26 18:25:53.402700 | TASK [include_role : start-zuul-console]
2026-02-26 18:25:53.420260 | controller | ok
2026-02-26 18:25:53.430262 | 
2026-02-26 18:25:53.430339 | TASK [start-zuul-console : Start zuul_console daemon.]
2026-02-26 18:25:53.781963 | controller | ok
2026-02-26 18:25:53.789370 | 
2026-02-26 18:25:53.789428 | TASK [include_role : add-build-sshkey]
2026-02-26 18:25:53.806102 | controller | ok
2026-02-26 18:25:53.817237 | 
2026-02-26 18:25:53.817310 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-02-26 18:25:53.991785 | controller -> localhost | ok
2026-02-26 18:25:53.996744 | 
2026-02-26 18:25:53.996807 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-02-26 18:25:54.014365 | controller | ok
2026-02-26 18:25:54.025612 | controller | included: /var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-02-26 18:25:54.030507 | 
2026-02-26 18:25:54.030564 | TASK [add-build-sshkey : Create Temp SSH key]
2026-02-26 18:25:54.417495 | controller -> localhost | Generating public/private rsa key pair.
2026-02-26 18:25:54.417704 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/7339d894f0954257b6a2bfce67bd2072_id_rsa.
2026-02-26 18:25:54.417746 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/7339d894f0954257b6a2bfce67bd2072_id_rsa.pub.
2026-02-26 18:25:54.417769 | controller -> localhost | The key fingerprint is:
2026-02-26 18:25:54.417788 | controller -> localhost | SHA256:xzNuTd2vRAJwkUHAIBO7ozt7ZVDqdrbM2UswEYqvlpM zuul-build-sshkey
2026-02-26 18:25:54.417806 | controller -> localhost | The key's randomart image is:
2026-02-26 18:25:54.417823 | controller -> localhost | +---[RSA 3072]----+
2026-02-26 18:25:54.417840 | controller -> localhost | |    +.oooo=+     |
2026-02-26 18:25:54.417857 | controller -> localhost | |   . =...o.      |
2026-02-26 18:25:54.417874 | controller -> localhost | |  . oo.   .      |
2026-02-26 18:25:54.417891 | controller -> localhost | |   .o. . . . . . |
2026-02-26 18:25:54.417907 | controller -> localhost | |   .+.o S = o o .|
2026-02-26 18:25:54.417923 | controller -> localhost | |   =o.=o o = o  .|
2026-02-26 18:25:54.417939 | controller -> localhost | |  E. B +. o . . .|
2026-02-26 18:25:54.417956 | controller -> localhost | | ..o. =...   . . |
2026-02-26 18:25:54.417972 | controller -> localhost | |  o+    ..    .  |
2026-02-26 18:25:54.417988 | controller -> localhost | +----[SHA256]-----+
2026-02-26 18:25:54.418028 | controller -> localhost | ok: Runtime: 0:00:00.091495
2026-02-26 18:25:54.423326 | 
2026-02-26 18:25:54.423386 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-02-26 18:25:54.454721 | controller | ok
2026-02-26 18:25:54.492785 | controller | included: /var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-02-26 18:25:54.501253 | 
2026-02-26 18:25:54.501342 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-02-26 18:25:54.514736 | controller | skipping: Conditional result was False
2026-02-26 18:25:54.520112 | 
2026-02-26 18:25:54.520179 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-02-26 18:25:54.986056 | controller | changed
2026-02-26 18:25:54.990555 | 
2026-02-26 18:25:54.990616 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-02-26 18:25:55.271864 | controller | ok
2026-02-26 18:25:55.276582 | 
2026-02-26 18:25:55.276648 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-02-26 18:25:56.418747 | controller | changed
2026-02-26 18:25:56.423819 | 
2026-02-26 18:25:56.423883 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-02-26 18:25:57.532031 | controller | changed
2026-02-26 18:25:57.536732 | 
2026-02-26 18:25:57.536797 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-02-26 18:25:57.549954 | controller | skipping: Conditional result was False
2026-02-26 18:25:57.555428 | 
2026-02-26 18:25:57.555492 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-02-26 18:25:57.832276 | controller -> localhost | changed
2026-02-26 18:25:57.840808 | 
2026-02-26 18:25:57.840868 | TASK [add-build-sshkey : Add back temp key]
2026-02-26 18:25:58.047029 | controller -> localhost | Identity added: /var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/7339d894f0954257b6a2bfce67bd2072_id_rsa (zuul-build-sshkey)
2026-02-26 18:25:58.047354 | controller -> localhost | ok: Runtime: 0:00:00.006898
2026-02-26 18:25:58.052526 | 
2026-02-26 18:25:58.052587 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-02-26 18:25:58.406946 | controller | ok
2026-02-26 18:25:58.411004 | 
2026-02-26 18:25:58.411069 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-02-26 18:25:58.434665 | controller | skipping: Conditional result was False
2026-02-26 18:25:58.442909 | 
2026-02-26 18:25:58.442968 | TASK [include_role : validate-host]
2026-02-26 18:25:58.460131 | controller | ok
2026-02-26 18:25:58.476806 | 
2026-02-26 18:25:58.476870 | TASK [validate-host : Define zuul_info_dir fact]
2026-02-26 18:25:58.504352 | controller | ok
2026-02-26 18:25:58.508365 | 
2026-02-26 18:25:58.508424 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2026-02-26 18:25:58.693549 | controller -> localhost | ok
2026-02-26 18:25:58.698773 | 
2026-02-26 18:25:58.698836 | TASK [validate-host : Collect information about the host]
2026-02-26 18:25:59.401205 | controller | ok
2026-02-26 18:25:59.407986 | 
2026-02-26 18:25:59.408043 | TASK [validate-host : Sanitize hostname]
2026-02-26 18:25:59.445234 | controller | ok
2026-02-26 18:25:59.449432 | 
2026-02-26 18:25:59.449492 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2026-02-26 18:25:59.798872 | controller -> localhost | changed
2026-02-26 18:25:59.804056 | 
2026-02-26 18:25:59.804132 | TASK [validate-host : Collect information about zuul worker]
2026-02-26 18:26:00.198059 | controller | ok
2026-02-26 18:26:00.202115 | 
2026-02-26 18:26:00.202181 | TASK [validate-host : Write out all zuul information for each host]
2026-02-26 18:26:00.529103 | controller -> localhost | changed
2026-02-26 18:26:00.537605 | 
2026-02-26 18:26:00.537684 | TASK [include_role : prepare-workspace-openshift]
2026-02-26 18:26:00.551241 | controller | skipping: Conditional result was False
2026-02-26 18:26:00.556139 | 
2026-02-26 18:26:00.556203 | TASK [include_role : remove-zuul-sshkey]
2026-02-26 18:26:00.569823 | controller | skipping: Conditional result was False
2026-02-26 18:26:00.574596 | 
2026-02-26 18:26:00.574661 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-02-26 18:26:00.828254 | controller | ok: "logs"
2026-02-26 18:26:00.828585 | controller | ok: All items complete
2026-02-26 18:26:00.828617 | 
2026-02-26 18:26:01.058385 | controller | ok: "artifacts"
2026-02-26 18:26:01.288577 | controller | ok: "docs"
2026-02-26 18:26:01.294346 | 
2026-02-26 18:26:01.294448 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-02-26 18:26:01.550999 | controller | changed: "logs"
2026-02-26 18:26:01.785128 | controller | changed: "artifacts"
2026-02-26 18:26:02.019266 | controller | changed: "docs"
2026-02-26 18:26:02.048634 | 
2026-02-26 18:26:02.048734 | PLAY RECAP
2026-02-26 18:26:02.048781 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-02-26 18:26:02.048808 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-02-26 18:26:02.048827 | 
2026-02-26 18:26:02.118145 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-02-26 18:26:02.119138 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-02-26 18:26:02.609922 | 
2026-02-26 18:26:02.610016 | PLAY [all]
2026-02-26 18:26:02.628011 | 
2026-02-26 18:26:02.628080 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-02-26 18:26:02.676470 | controller | ok
2026-02-26 18:26:02.680945 | 
2026-02-26 18:26:02.681020 | TASK [mirror-info-fork : Create /etc/ci]
2026-02-26 18:26:03.075449 | controller | changed
2026-02-26 18:26:03.080615 | 
2026-02-26 18:26:03.080685 | TASK [mirror-info-fork : Install ci_mirror script]
2026-02-26 18:26:04.346586 | controller | changed
2026-02-26 18:26:04.356873 | 
2026-02-26 18:26:04.356959 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2026-02-26 18:26:04.792900 | controller | changed:
2026-02-26 18:26:04.793070 | controller | {
2026-02-26 18:26:04.793100 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2026-02-26 18:26:04.793130 | controller | }
2026-02-26 18:26:05.081375 | controller | changed:
2026-02-26 18:26:05.081459 | controller | {
2026-02-26 18:26:05.081488 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2026-02-26 18:26:05.081510 | controller | }
2026-02-26 18:26:05.363108 | controller | changed:
2026-02-26 18:26:05.363254 | controller | {
2026-02-26 18:26:05.363473 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2026-02-26 18:26:05.363506 | controller | }
2026-02-26 18:26:05.655666 | controller | changed:
2026-02-26 18:26:05.655753 | controller | {
2026-02-26 18:26:05.655778 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2026-02-26 18:26:05.655798 | controller | }
2026-02-26 18:26:05.940352 | controller | changed:
2026-02-26 18:26:05.940422 | controller | {
2026-02-26 18:26:05.940453 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2026-02-26 18:26:05.940475 | controller | }
2026-02-26 18:26:06.222457 | controller | changed:
2026-02-26 18:26:06.222510 | controller | {
2026-02-26 18:26:06.222533 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2026-02-26 18:26:06.222552 | controller | }
2026-02-26 18:26:06.505065 | controller | changed:
2026-02-26 18:26:06.505153 | controller | {
2026-02-26 18:26:06.505179 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2026-02-26 18:26:06.505199 | controller | }
2026-02-26 18:26:06.793784 | controller | changed:
2026-02-26 18:26:06.793904 | controller | {
2026-02-26 18:26:06.793936 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2026-02-26 18:26:06.793958 | controller | }
2026-02-26 18:26:07.084516 | controller | changed:
2026-02-26 18:26:07.084573 | controller | {
2026-02-26 18:26:07.084599 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2026-02-26 18:26:07.084620 | controller | }
2026-02-26 18:26:07.403182 | controller | changed:
2026-02-26 18:26:07.403267 | controller | {
2026-02-26 18:26:07.403309 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2026-02-26 18:26:07.403361 | controller | }
2026-02-26 18:26:07.677239 | controller | changed:
2026-02-26 18:26:07.677344 | controller | {
2026-02-26 18:26:07.677371 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2026-02-26 18:26:07.677391 | controller | }
2026-02-26 18:26:07.960470 | controller | changed:
2026-02-26 18:26:07.960559 | controller | {
2026-02-26 18:26:07.960592 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2026-02-26 18:26:07.960618 | controller | }
2026-02-26 18:26:08.247476 | controller | changed:
2026-02-26 18:26:08.247631 | controller | {
2026-02-26 18:26:08.247659 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com"
2026-02-26 18:26:08.247678 | controller | }
2026-02-26 18:26:08.556035 | controller | changed:
2026-02-26 18:26:08.556106 | controller | {
2026-02-26 18:26:08.556132 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2026-02-26 18:26:08.556151 | controller | }
2026-02-26 18:26:08.846212 | controller | changed:
2026-02-26 18:26:08.846267 | controller | {
2026-02-26 18:26:08.846291 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2026-02-26 18:26:08.846332 | controller | }
2026-02-26 18:26:09.147265 | controller | changed:
2026-02-26 18:26:09.147384 | controller | {
2026-02-26 18:26:09.147413 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2026-02-26 18:26:09.147432 | controller | }
2026-02-26 18:26:09.438860 | controller | changed:
2026-02-26 18:26:09.438910 | controller | {
2026-02-26 18:26:09.438934 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2026-02-26 18:26:09.438953 | controller | }
2026-02-26 18:26:09.729808 | controller | changed:
2026-02-26 18:26:09.729855 | controller | {
2026-02-26 18:26:09.729878 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2026-02-26 18:26:09.729905 | controller | }
2026-02-26 18:26:10.035626 | controller | changed:
2026-02-26 18:26:10.035672 | controller | {
2026-02-26 18:26:10.035695 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2026-02-26 18:26:10.035725 | controller | }
2026-02-26 18:26:10.335731 | controller | changed:
2026-02-26 18:26:10.335782 | controller | {
2026-02-26 18:26:10.335806 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2026-02-26 18:26:10.335826 | controller | }
2026-02-26 18:26:10.633920 | controller | changed:
2026-02-26 18:26:10.633970 | controller | {
2026-02-26 18:26:10.633994 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2026-02-26 18:26:10.634012 | controller | }
2026-02-26 18:26:10.925143 | controller | changed:
2026-02-26 18:26:10.925194 | controller | {
2026-02-26 18:26:10.925219 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2026-02-26 18:26:10.925238 | controller | }
2026-02-26 18:26:11.222542 | controller | changed:
2026-02-26 18:26:11.222590 | controller | {
2026-02-26 18:26:11.222614 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2026-02-26 18:26:11.222634 | controller | }
2026-02-26 18:26:11.513440 | controller | changed:
2026-02-26 18:26:11.513538 | controller | {
2026-02-26 18:26:11.513568 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2026-02-26 18:26:11.513588 | controller | }
2026-02-26 18:26:11.827101 | controller | changed:
2026-02-26 18:26:11.827149 | controller | {
2026-02-26 18:26:11.827175 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2026-02-26 18:26:11.827196 | controller | }
2026-02-26 18:26:12.111026 | controller | changed:
2026-02-26 18:26:12.111073 | controller | {
2026-02-26 18:26:12.111096 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2026-02-26 18:26:12.111114 | controller | }
2026-02-26 18:26:12.126047 | 
2026-02-26 18:26:12.126108 | TASK [Set timezone to UTC]
2026-02-26 18:26:12.600431 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2026-02-26 18:26:12.604938 | 
2026-02-26 18:26:12.604999 | TASK [Create nodepool directory]
2026-02-26 18:26:12.867777 | controller | changed
2026-02-26 18:26:12.873144 | 
2026-02-26 18:26:12.873216 | TASK [Create nodepool sub_nodes file]
2026-02-26 18:26:13.816399 | controller | changed
2026-02-26 18:26:13.820810 | 
2026-02-26 18:26:13.820874 | TASK [Create nodepool sub_nodes_private file]
2026-02-26 18:26:14.763313 | controller | changed
2026-02-26 18:26:14.767749 | 
2026-02-26 18:26:14.767816 | LOOP [Populate nodepool sub_nodes file]
2026-02-26 18:26:14.796432 | 
2026-02-26 18:26:14.796550 | LOOP [Populate nodepool sub_nodes_private file]
2026-02-26 18:26:14.824936 | 
2026-02-26 18:26:14.825055 | TASK [Create nodepool primary file]
2026-02-26 18:26:14.848569 | controller | skipping: Conditional result was False
2026-02-26 18:26:14.853464 | 
2026-02-26 18:26:14.853531 | TASK [Create nodepool node_private for this node]
2026-02-26 18:26:15.859793 | controller | changed
2026-02-26 18:26:15.864534 | 
2026-02-26 18:26:15.864594 | LOOP [Copy ssh keys to nodepool directory]
2026-02-26 18:26:16.226072 | controller | ok: Item: id_rsa Runtime: 0:00:00.003891
2026-02-26 18:26:16.226270 | 
2026-02-26 18:26:16.450974 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.006317
2026-02-26 18:26:16.464954 | 
2026-02-26 18:26:16.465036 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2026-02-26 18:26:17.453503 | controller | changed
2026-02-26 18:26:17.457741 | 
2026-02-26 18:26:17.457798 | TASK [Validate sudoers config after edits]
2026-02-26 18:26:17.736488 | controller | /etc/sudoers: parsed OK
2026-02-26 18:26:17.736547 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2026-02-26 18:26:17.736556 | controller | /etc/sudoers.d/zuul: parsed OK
2026-02-26 18:26:17.736562 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2026-02-26 18:26:17.981223 | controller | ok: Runtime: 0:00:00.007028
2026-02-26 18:26:17.985889 | 
2026-02-26 18:26:17.985947 | TASK [Show the environment passed in to job shell scripts]
2026-02-26 18:26:18.256256 | controller | SHELL=/bin/bash
2026-02-26 18:26:18.256314 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2026-02-26 18:26:18.256324 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2026-02-26 18:26:18.256331 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/78/3678/e0573c53557b6e057f6f6711b832528f0b93cdec^openstack-k8s-operators/ci-framework:main:refs/changes/21/3721/f1734a884405cfe9e44f25b914cceab628d22140
2026-02-26 18:26:18.256398 | controller | PWD=/home/zuul
2026-02-26 18:26:18.256408 | controller | ZUUL_PIPELINE=github-check
2026-02-26 18:26:18.256414 | controller | LOGNAME=zuul
2026-02-26 18:26:18.256419 | controller | XDG_SESSION_TYPE=tty
2026-02-26 18:26:18.256424 | controller | _=/usr/bin/env
2026-02-26 18:26:18.256429 | controller | MOTD_SHOWN=pam
2026-02-26 18:26:18.256434 | controller | HOME=/home/zuul
2026-02-26 18:26:18.256439 | controller | LANG=en_US.UTF-8
2026-02-26 18:26:18.256443 | controller | SSH_CONNECTION=192.168.26.12 58636 192.168.26.106 22
2026-02-26 18:26:18.256449 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2026-02-26 18:26:18.256455 | controller | ZUUL_CHANGE_IDS=3678,e0573c53557b6e057f6f6711b832528f0b93cdec 3721,f1734a884405cfe9e44f25b914cceab628d22140
2026-02-26 18:26:18.256460 | controller | WORKSPACE=/home/zuul/workspace
2026-02-26 18:26:18.256465 | controller | XDG_SESSION_CLASS=user
2026-02-26 18:26:18.256471 | controller | SELINUX_ROLE_REQUESTED=
2026-02-26 18:26:18.256475 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2026-02-26 18:26:18.256480 | controller | USER=zuul
2026-02-26 18:26:18.256485 | controller | ZUUL_VOTING=True
2026-02-26 18:26:18.256490 | controller | BUILD_TIMEOUT=5400000
2026-02-26 18:26:18.256495 | controller | SELINUX_USE_CURRENT_RANGE=
2026-02-26 18:26:18.256499 | controller | SHLVL=1
2026-02-26 18:26:18.256504 | controller | ZUUL_PATCHSET=f1734a884405cfe9e44f25b914cceab628d22140
2026-02-26 18:26:18.256509 | controller | XDG_SESSION_ID=1
2026-02-26 18:26:18.256514 | controller | ZUUL_BRANCH=main
2026-02-26 18:26:18.256519 | controller | XDG_RUNTIME_DIR=/run/user/1000
2026-02-26 18:26:18.256524 | controller | SSH_CLIENT=192.168.26.12 58636 22
2026-02-26 18:26:18.256529 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2026-02-26 18:26:18.256534 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2026-02-26 18:26:18.256542 | controller | which_declare=declare -f
2026-02-26 18:26:18.256548 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2026-02-26 18:26:18.256553 | controller | SELINUX_LEVEL_REQUESTED=
2026-02-26 18:26:18.256558 | controller | ZUUL_CHANGE=3721
2026-02-26 18:26:18.256563 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2026-02-26 18:26:18.256568 | controller | ZUUL_UUID=7339d894f0954257b6a2bfce67bd2072
2026-02-26 18:26:18.256573 | controller | BASH_FUNC_which%%=() {  ( alias;
2026-02-26 18:26:18.256578 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2026-02-26 18:26:18.256583 | controller | }
2026-02-26 18:26:18.510034 | controller | ok: Runtime: 0:00:00.007146
2026-02-26 18:26:18.514935 | 
2026-02-26 18:26:18.514992 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2026-02-26 18:26:18.528520 | controller | skipping: Conditional result was False
2026-02-26 18:26:18.533397 | 
2026-02-26 18:26:18.533456 | TASK [Symlink /home/zuul-worker/workspace]
2026-02-26 18:26:19.080168 | controller | skipping: Conditional result was False
2026-02-26 18:26:19.086004 | 
2026-02-26 18:26:19.086094 | TASK [Ensure legacy workspace directory]
2026-02-26 18:26:19.326780 | controller | changed
2026-02-26 18:26:19.343707 | 
2026-02-26 18:26:19.343771 | PLAY RECAP
2026-02-26 18:26:19.343815 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-02-26 18:26:19.343836 | 
2026-02-26 18:26:19.410842 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-02-26 18:26:19.411603 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-02-26 18:26:19.881183 | 
2026-02-26 18:26:19.881280 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2026-02-26 18:26:19.899539 | 
2026-02-26 18:26:19.899607 | TASK [Create zuul-output directory]
2026-02-26 18:26:20.264352 | controller | changed
2026-02-26 18:26:20.269198 | 
2026-02-26 18:26:20.269274 | TASK [Slurp Zuul inventory test]
2026-02-26 18:26:20.525338 | controller -> localhost | ok
2026-02-26 18:26:20.531451 | 
2026-02-26 18:26:20.531530 | TASK [Save zuul inventory]
2026-02-26 18:26:21.735666 | controller | changed
2026-02-26 18:26:21.740621 | 
2026-02-26 18:26:21.740684 | TASK [Save zuul vars without the change_message]
2026-02-26 18:26:22.822030 | controller | changed
2026-02-26 18:26:22.838664 | 
2026-02-26 18:26:22.838740 | PLAY RECAP
2026-02-26 18:26:22.838783 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-02-26 18:26:22.838804 | 
2026-02-26 18:26:22.903461 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-02-26 18:26:22.904108 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-02-26 18:26:23.428991 | 
2026-02-26 18:26:23.429086 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2026-02-26 18:26:23.448927 | 
2026-02-26 18:26:23.449000 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2026-02-26 18:26:23.467109 | controller | ok
2026-02-26 18:26:23.483569 | 
2026-02-26 18:26:23.483653 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-02-26 18:26:23.507134 | controller | skipping: Conditional result was False
2026-02-26 18:26:23.512622 | 
2026-02-26 18:26:23.512683 | TASK [mirror-info-fork : Create /etc/ci]
2026-02-26 18:26:23.874699 | controller | ok
2026-02-26 18:26:23.879790 | 
2026-02-26 18:26:23.879857 | TASK [mirror-info-fork : Install ci_mirror script]
2026-02-26 18:26:24.823803 | controller | ok
2026-02-26 18:26:24.832665 | 
2026-02-26 18:26:24.832734 | TASK [Prepare workspace]
2026-02-26 18:26:24.849969 | controller | ok
2026-02-26 18:26:24.865224 | 
2026-02-26 18:26:24.865288 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-02-26 18:26:25.209702 | controller | ok
2026-02-26 18:26:25.215085 | 
2026-02-26 18:26:25.215148 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-02-26 18:26:27.466775 | controller | Output suppressed because no_log was given
2026-02-26 18:26:27.475561 | 
2026-02-26 18:26:27.475633 | LOOP [Create zuul-output directory]
2026-02-26 18:26:27.722035 | controller | changed: "/home/zuul/ci-framework-data/logs"
2026-02-26 18:26:27.934227 | controller | ok: "/home/zuul/zuul-output/logs"
2026-02-26 18:26:27.941216 | 
2026-02-26 18:26:27.941354 | TASK [Install required packages]
2026-02-26 18:26:44.433305 | controller | ok: Nothing to do
2026-02-26 18:26:44.438062 | 
2026-02-26 18:26:44.438126 | TASK [Install venv]
2026-02-26 18:27:42.626093 | controller | changed
2026-02-26 18:27:42.648945 | 
2026-02-26 18:27:42.649006 | PLAY RECAP
2026-02-26 18:27:42.649047 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-02-26 18:27:42.649068 | 
2026-02-26 18:27:42.722555 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-02-26 18:27:42.723324 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-02-26 18:27:43.194912 | 
2026-02-26 18:27:43.195008 | PLAY [Run ci/playbooks/molecule-test.yml]
2026-02-26 18:27:43.214435 | 
2026-02-26 18:27:43.214508 | TASK [Gather required facts]
2026-02-26 18:27:43.739956 | controller | ok
2026-02-26 18:27:43.744774 | 
2026-02-26 18:27:43.744845 | TASK [Load environment var if instructed to]
2026-02-26 18:27:43.768603 | controller | skipping: Conditional result was False
2026-02-26 18:27:43.773638 | 
2026-02-26 18:27:43.773700 | TASK [Ensure group_vars dir exists]
2026-02-26 18:27:44.138149 | controller | ok
2026-02-26 18:27:44.143103 | 
2026-02-26 18:27:44.143168 | TASK [Print related variables]
2026-02-26 18:27:44.171510 | controller | ok:
2026-02-26 18:27:44.171620 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml
2026-02-26 18:27:44.171649 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer
2026-02-26 18:27:44.176102 | 
2026-02-26 18:27:44.176161 | TASK [Run molecule]
2026-02-26 18:27:45.139682 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2026-02-26 18:27:45.401814 | controller | INFO     Performing prerun with role_name_check=0...
2026-02-26 18:28:02.632557 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.632959 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.633323 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.633736 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.634178 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+5dafb92b was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+5dafb92b (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.634588 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.634975 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.635363 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.635753 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.636158 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.636550 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.636928 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.637327 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.637722 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.638126 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-02-26 18:28:02.647617 | controller | INFO     Running crc_layout > prepare
2026-02-26 18:28:03.284527 | controller |
2026-02-26 18:28:03.284768 | controller | PLAY [Prepare] *****************************************************************
2026-02-26 18:28:03.284889 | controller |
2026-02-26 18:28:03.285096 | controller | TASK [Gathering Facts] *********************************************************
2026-02-26 18:28:03.285237 | controller | Thursday 26 February 2026  18:28:03 +0000 (0:00:00.018)       0:00:00.018 *****
2026-02-26 18:28:04.097441 | controller | ok: [instance]
2026-02-26 18:28:04.097487 | controller |
2026-02-26 18:28:04.097606 | controller | TASK [Create custom basedir] ***************************************************
2026-02-26 18:28:04.097697 | controller | Thursday 26 February 2026  18:28:04 +0000 (0:00:00.813)       0:00:00.831 *****
2026-02-26 18:28:04.402742 | controller | changed: [instance]
2026-02-26 18:28:04.402786 | controller |
2026-02-26 18:28:04.402973 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2026-02-26 18:28:04.403080 | controller | Thursday 26 February 2026  18:28:04 +0000 (0:00:00.305)       0:00:01.137 *****
2026-02-26 18:28:04.422275 | controller | skipping: [instance]
2026-02-26 18:28:04.422339 | controller |
2026-02-26 18:28:04.422482 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2026-02-26 18:28:04.422579 | controller | Thursday 26 February 2026  18:28:04 +0000 (0:00:00.019)       0:00:01.156 *****
2026-02-26 18:28:04.464492 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2026-02-26 18:28:04.464575 | controller |
2026-02-26 18:28:04.464729 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2026-02-26 18:28:04.464814 | controller | Thursday 26 February 2026  18:28:04 +0000 (0:00:00.041)       0:00:01.198 *****
2026-02-26 18:28:04.754622 | controller | ok: [instance]
2026-02-26 18:28:04.754672 | controller |
2026-02-26 18:28:04.754771 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2026-02-26 18:28:04.754867 | controller | Thursday 26 February 2026  18:28:04 +0000 (0:00:00.290)       0:00:01.489 *****
2026-02-26 18:28:04.966560 | controller | ok: [instance]
2026-02-26 18:28:04.966909 | controller |
2026-02-26 18:28:05.625028 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2026-02-26 18:28:05.625069 | controller | Thursday 26 February 2026  18:28:04 +0000 (0:00:00.211)       0:00:01.700 *****
2026-02-26 18:28:05.625083 | controller | ok: [instance] => (item=ubi-9-appstream)
2026-02-26 18:28:05.625152 | controller | ok: [instance] => (item=ubi-9-baseos)
2026-02-26 18:28:05.625274 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2026-02-26 18:28:05.625388 | controller |
2026-02-26 18:28:05.625508 | controller | TASK [Deploy repo-setup] *******************************************************
2026-02-26 18:28:05.625596 | controller | Thursday 26 February 2026  18:28:05 +0000 (0:00:00.658)       0:00:02.359 *****
2026-02-26 18:28:05.682865 | controller |
2026-02-26 18:28:05.682962 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-02-26 18:28:05.683096 | controller | Thursday 26 February 2026  18:28:05 +0000 (0:00:00.058)       0:00:02.417 *****
2026-02-26 18:28:06.182049 | controller | changed: [instance] => (item=tmp)
2026-02-26 18:28:06.182096 | controller | changed: [instance] => (item=artifacts/repositories)
2026-02-26 18:28:06.182235 | controller | changed: [instance] => (item=venv/repo_setup)
2026-02-26 18:28:06.182318 | controller |
2026-02-26 18:28:06.182428 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-02-26 18:28:06.182552 | controller | Thursday 26 February 2026  18:28:06 +0000 (0:00:00.498)       0:00:02.916 *****
2026-02-26 18:28:07.011224 | controller | ok: [instance]
2026-02-26 18:28:07.011262 | controller |
2026-02-26 18:28:07.011375 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-02-26 18:28:07.011460 | controller | Thursday 26 February 2026  18:28:07 +0000 (0:00:00.829)       0:00:03.745 *****
2026-02-26 18:28:08.278561 | controller | changed: [instance]
2026-02-26 18:28:15.577758 | controller |
2026-02-26 18:28:15.577801 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-02-26 18:28:15.577809 | controller | Thursday 26 February 2026  18:28:08 +0000 (0:00:01.266)       0:00:05.012 *****
2026-02-26 18:28:15.577820 | controller | changed: [instance]
2026-02-26 18:28:16.250400 | controller |
2026-02-26 18:28:16.250437 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-02-26 18:28:16.250445 | controller | Thursday 26 February 2026  18:28:15 +0000 (0:00:07.299)       0:00:12.311 *****
2026-02-26 18:28:16.250455 | controller | changed: [instance]
2026-02-26 18:28:16.273033 | controller |
2026-02-26 18:28:16.273087 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-02-26 18:28:16.273099 | controller | Thursday 26 February 2026  18:28:16 +0000 (0:00:00.672)       0:00:12.984 *****
2026-02-26 18:28:16.273114 | controller | skipping: [instance]
2026-02-26 18:28:16.273162 | controller |
2026-02-26 18:28:16.273192 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-02-26 18:28:17.072003 | controller | Thursday 26 February 2026  18:28:16 +0000 (0:00:00.023)       0:00:13.007 *****
2026-02-26 18:28:17.072044 | controller | changed: [instance]
2026-02-26 18:28:17.108790 | controller |
2026-02-26 18:28:17.108815 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-02-26 18:28:17.108824 | controller | Thursday 26 February 2026  18:28:17 +0000 (0:00:00.798)       0:00:13.805 *****
2026-02-26 18:28:17.108835 | controller | skipping: [instance]
2026-02-26 18:28:17.149052 | controller |
2026-02-26 18:28:17.149093 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-02-26 18:28:17.149103 | controller | Thursday 26 February 2026  18:28:17 +0000 (0:00:00.037)       0:00:13.843 *****
2026-02-26 18:28:17.149116 | controller | skipping: [instance]
2026-02-26 18:28:17.149147 | controller |
2026-02-26 18:28:17.149340 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-02-26 18:28:17.186041 | controller | Thursday 26 February 2026  18:28:17 +0000 (0:00:00.040)       0:00:13.883 *****
2026-02-26 18:28:17.186079 | controller | skipping: [instance]
2026-02-26 18:28:17.186155 | controller |
2026-02-26 18:28:17.186177 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-02-26 18:28:17.186189 | controller | Thursday 26 February 2026  18:28:17 +0000 (0:00:00.037)       0:00:13.920 *****
2026-02-26 18:28:17.714891 | controller | changed: [instance]
2026-02-26 18:28:18.142019 | controller |
2026-02-26 18:28:18.142056 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-02-26 18:28:18.142064 | controller | Thursday 26 February 2026  18:28:17 +0000 (0:00:00.528)       0:00:14.448 *****
2026-02-26 18:28:18.142077 | controller | changed: [instance]
2026-02-26 18:28:18.142099 | controller |
2026-02-26 18:28:18.142264 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-02-26 18:28:18.174439 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.427)       0:00:14.876 *****
2026-02-26 18:28:18.174465 | controller | skipping: [instance]
2026-02-26 18:28:18.205504 | controller |
2026-02-26 18:28:18.205523 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-02-26 18:28:18.205531 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.032)       0:00:14.908 *****
2026-02-26 18:28:18.205544 | controller | skipping: [instance]
2026-02-26 18:28:18.236014 | controller |
2026-02-26 18:28:18.236051 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-02-26 18:28:18.236064 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.031)       0:00:14.939 *****
2026-02-26 18:28:18.236081 | controller | skipping: [instance]
2026-02-26 18:28:18.292078 | controller |
2026-02-26 18:28:18.292107 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-02-26 18:28:18.292116 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.030)       0:00:14.970 *****
2026-02-26 18:28:18.292126 | controller | ok: [instance]
2026-02-26 18:28:18.292312 | controller |
2026-02-26 18:28:18.292331 | controller | TASK [repo_setup : Create download directory] **********************************
2026-02-26 18:28:18.320798 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.056)       0:00:15.026 *****
2026-02-26 18:28:18.320825 | controller | skipping: [instance]
2026-02-26 18:28:18.348049 | controller |
2026-02-26 18:28:18.348074 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-02-26 18:28:18.348083 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.028)       0:00:15.055 *****
2026-02-26 18:28:18.348100 | controller | skipping: [instance]
2026-02-26 18:28:18.375295 | controller |
2026-02-26 18:28:18.375335 | controller | TASK [Download the RPM] ********************************************************
2026-02-26 18:28:18.375371 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.027)       0:00:15.082 *****
2026-02-26 18:28:18.375391 | controller | skipping: [instance]
2026-02-26 18:28:18.375510 | controller |
2026-02-26 18:28:18.375719 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-02-26 18:28:18.375787 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.027)       0:00:15.109 *****
2026-02-26 18:28:18.403718 | controller | skipping: [instance]
2026-02-26 18:28:18.403874 | controller |
2026-02-26 18:28:18.403965 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-02-26 18:28:18.404097 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.028)       0:00:15.138 *****
2026-02-26 18:28:18.432167 | controller | skipping: [instance]
2026-02-26 18:28:18.432281 | controller |
2026-02-26 18:28:18.432473 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-02-26 18:28:18.432572 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.028)       0:00:15.166 *****
2026-02-26 18:28:18.461376 | controller | skipping: [instance]
2026-02-26 18:28:18.461605 | controller |
2026-02-26 18:28:18.461801 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-02-26 18:28:18.461870 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.028)       0:00:15.195 *****
2026-02-26 18:28:18.487587 | controller | skipping: [instance]
2026-02-26 18:28:18.487697 | controller |
2026-02-26 18:28:18.487856 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-02-26 18:28:18.487920 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.026)       0:00:15.222 *****
2026-02-26 18:28:18.665175 | controller | ok: [instance]
2026-02-26 18:28:18.665221 | controller |
2026-02-26 18:28:18.665386 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-02-26 18:28:18.665459 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.177)       0:00:15.399 *****
2026-02-26 18:28:18.872053 | controller | changed: [instance]
2026-02-26 18:28:18.872091 | controller |
2026-02-26 18:28:18.872101 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-02-26 18:28:18.872112 | controller | Thursday 26 February 2026  18:28:18 +0000 (0:00:00.206)       0:00:15.606 *****
2026-02-26 18:28:19.092667 | controller | changed: [instance]
2026-02-26 18:28:19.116062 | controller |
2026-02-26 18:28:19.116093 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-02-26 18:28:19.116102 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.220)       0:00:15.826 *****
2026-02-26 18:28:19.116113 | controller | skipping: [instance]
2026-02-26 18:28:19.116281 | controller |
2026-02-26 18:28:19.116301 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-02-26 18:28:19.138354 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.023)       0:00:15.850 *****
2026-02-26 18:28:19.138384 | controller | skipping: [instance]
2026-02-26 18:28:19.160682 | controller |
2026-02-26 18:28:19.160699 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-02-26 18:28:19.160707 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.022)       0:00:15.872 *****
2026-02-26 18:28:19.160717 | controller | skipping: [instance]
2026-02-26 18:28:19.184664 | controller |
2026-02-26 18:28:19.184686 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-02-26 18:28:19.184695 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.022)       0:00:15.895 *****
2026-02-26 18:28:19.184706 | controller | skipping: [instance]
2026-02-26 18:28:19.207050 | controller |
2026-02-26 18:28:19.207070 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-02-26 18:28:19.207086 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.023)       0:00:15.919 *****
2026-02-26 18:28:19.207142 | controller | skipping: [instance]
2026-02-26 18:28:19.228903 | controller |
2026-02-26 18:28:19.228917 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-02-26 18:28:19.228924 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.022)       0:00:15.941 *****
2026-02-26 18:28:19.228935 | controller | skipping: [instance]
2026-02-26 18:28:19.246572 | controller |
2026-02-26 18:28:19.246589 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-02-26 18:28:19.246596 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.021)       0:00:15.963 *****
2026-02-26 18:28:19.246606 | controller | skipping: [instance]
2026-02-26 18:28:19.246747 | controller |
2026-02-26 18:28:19.246897 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-02-26 18:28:19.247071 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.017)       0:00:15.981 *****
2026-02-26 18:28:19.275626 | controller | skipping: [instance]
2026-02-26 18:28:19.275777 | controller |
2026-02-26 18:28:19.275925 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-02-26 18:28:19.276104 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.029)       0:00:16.010 *****
2026-02-26 18:28:19.292469 | controller | skipping: [instance]
2026-02-26 18:28:19.292615 | controller |
2026-02-26 18:28:19.292768 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-02-26 18:28:19.292912 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.016)       0:00:16.027 *****
2026-02-26 18:28:19.313664 | controller | skipping: [instance]
2026-02-26 18:28:19.313876 | controller |
2026-02-26 18:28:19.314166 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2026-02-26 18:28:19.314391 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.021)       0:00:16.048 *****
2026-02-26 18:28:19.342880 | controller | skipping: [instance]
2026-02-26 18:28:19.343071 | controller |
2026-02-26 18:28:19.343231 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2026-02-26 18:28:19.343390 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.029)       0:00:16.077 *****
2026-02-26 18:28:19.372924 | controller | skipping: [instance]
2026-02-26 18:28:19.373122 | controller |
2026-02-26 18:28:19.373281 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2026-02-26 18:28:19.373447 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.030)       0:00:16.107 *****
2026-02-26 18:28:19.402073 | controller | skipping: [instance]
2026-02-26 18:28:19.402227 | controller |
2026-02-26 18:28:19.402363 | controller | TASK [test_deps : Install additional packages] *********************************
2026-02-26 18:28:19.402490 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.028)       0:00:16.136 *****
2026-02-26 18:28:19.434203 | controller | skipping: [instance]
2026-02-26 18:28:19.434380 | controller |
2026-02-26 18:28:19.434537 | controller | TASK [test_deps : Install selinux python libs] *********************************
2026-02-26 18:28:19.434660 | controller | Thursday 26 February 2026  18:28:19 +0000 (0:00:00.032)       0:00:16.168 *****
2026-02-26 18:29:04.774063 | controller | ok: [instance]
2026-02-26 18:29:04.774127 | controller |
2026-02-26 18:29:04.774138 | controller | TASK [test_deps : Install python yaml libs] ************************************
2026-02-26 18:29:04.774287 | controller | Thursday 26 February 2026  18:29:04 +0000 (0:00:45.339)       0:01:01.508 *****
2026-02-26 18:29:05.959870 | controller | ok: [instance]
2026-02-26 18:29:05.993101 | controller |
2026-02-26 18:29:05.993127 | controller | TASK [test_deps : Install extra packages] **************************************
2026-02-26 18:29:05.993138 | controller | Thursday 26 February 2026  18:29:05 +0000 (0:00:01.185)       0:01:02.694 *****
2026-02-26 18:29:05.993150 | controller | skipping: [instance]
2026-02-26 18:29:06.031799 | controller |
2026-02-26 18:29:06.031815 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-02-26 18:29:06.031823 | controller | Thursday 26 February 2026  18:29:05 +0000 (0:00:00.033)       0:01:02.727 *****
2026-02-26 18:29:06.031832 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2026-02-26 18:29:06.052072 | controller |
2026-02-26 18:29:06.052116 | controller | TASK [ci_setup : List packages to install] *************************************
2026-02-26 18:29:06.052135 | controller | Thursday 26 February 2026  18:29:06 +0000 (0:00:00.038)       0:01:02.766 *****
2026-02-26 18:29:06.052150 | controller | ok: [instance] =>
2026-02-26 18:29:06.052185 | controller |   cifmw_ci_setup_packages:
2026-02-26 18:29:06.052193 | controller |   - bash-completion
2026-02-26 18:29:06.052201 | controller |   - ca-certificates
2026-02-26 18:29:06.052208 | controller |   - git-core
2026-02-26 18:29:06.052215 | controller |   - make
2026-02-26 18:29:06.052223 | controller |   - tar
2026-02-26 18:29:06.052231 | controller |   - tmux
2026-02-26 18:29:06.052238 | controller |   - python3-pip
2026-02-26 18:29:06.052245 | controller |
2026-02-26 18:29:06.052255 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-02-26 18:29:15.493840 | controller | Thursday 26 February 2026  18:29:06 +0000 (0:00:00.019)       0:01:02.785 *****
2026-02-26 18:29:15.493879 | controller | changed: [instance]
2026-02-26 18:29:15.493899 | controller |
2026-02-26 18:29:15.493908 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-02-26 18:29:15.494006 | controller | Thursday 26 February 2026  18:29:15 +0000 (0:00:09.442)       0:01:12.228 *****
2026-02-26 18:29:16.120261 | controller | ok: [instance]
2026-02-26 18:29:16.120375 | controller |
2026-02-26 18:29:16.120403 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-02-26 18:29:16.120415 | controller | Thursday 26 February 2026  18:29:16 +0000 (0:00:00.626)       0:01:12.854 *****
2026-02-26 18:29:16.340573 | controller | changed: [instance]
2026-02-26 18:29:16.340617 | controller |
2026-02-26 18:29:16.340627 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-02-26 18:29:16.340726 | controller | Thursday 26 February 2026  18:29:16 +0000 (0:00:00.220)       0:01:13.074 *****
2026-02-26 18:29:22.279356 | controller | changed: [instance]
2026-02-26 18:29:22.337622 | controller |
2026-02-26 18:29:22.337655 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-02-26 18:29:22.337664 | controller | Thursday 26 February 2026  18:29:22 +0000 (0:00:05.938)       0:01:19.013 *****
2026-02-26 18:29:22.337676 | controller | ok: [instance]
2026-02-26 18:29:22.610003 | controller |
2026-02-26 18:29:22.610038 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-02-26 18:29:22.610047 | controller | Thursday 26 February 2026  18:29:22 +0000 (0:00:00.058)       0:01:19.071 *****
2026-02-26 18:29:22.610058 | controller | changed: [instance]
2026-02-26 18:29:22.877633 | controller |
2026-02-26 18:29:22.877666 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-02-26 18:29:22.877674 | controller | Thursday 26 February 2026  18:29:22 +0000 (0:00:00.272)       0:01:19.343 *****
2026-02-26 18:29:22.877684 | controller | changed: [instance]
2026-02-26 18:29:22.900876 | controller |
2026-02-26 18:29:22.900897 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-02-26 18:29:22.900906 | controller | Thursday 26 February 2026  18:29:22 +0000 (0:00:00.267)       0:01:19.611 *****
2026-02-26 18:29:22.900916 | controller | skipping: [instance]
2026-02-26 18:29:22.922129 | controller |
2026-02-26 18:29:22.922180 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-02-26 18:29:22.922196 | controller | Thursday 26 February 2026  18:29:22 +0000 (0:00:00.023)       0:01:19.635 *****
2026-02-26 18:29:22.922214 | controller | skipping: [instance]
2026-02-26 18:29:22.922285 | controller |
2026-02-26 18:29:22.922303 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-02-26 18:29:22.943392 | controller | Thursday 26 February 2026  18:29:22 +0000 (0:00:00.021)       0:01:19.656 *****
2026-02-26 18:29:22.943415 | controller | skipping: [instance]
2026-02-26 18:29:22.963130 | controller |
2026-02-26 18:29:22.963163 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-02-26 18:29:22.963175 | controller | Thursday 26 February 2026  18:29:22 +0000 (0:00:00.021)       0:01:19.677 *****
2026-02-26 18:29:22.963190 | controller | skipping: [instance]
2026-02-26 18:29:22.963399 | controller |
2026-02-26 18:29:22.963419 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-02-26 18:29:22.984584 | controller | Thursday 26 February 2026  18:29:22 +0000 (0:00:00.019)       0:01:19.697 *****
2026-02-26 18:29:22.984608 | controller | skipping: [instance]
2026-02-26 18:29:23.010077 | controller |
2026-02-26 18:29:23.010116 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-02-26 18:29:23.010131 | controller | Thursday 26 February 2026  18:29:22 +0000 (0:00:00.021)       0:01:19.718 *****
2026-02-26 18:29:23.010147 | controller | skipping: [instance]
2026-02-26 18:29:23.953175 | controller |
2026-02-26 18:29:23.953262 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-02-26 18:29:23.953271 | controller | Thursday 26 February 2026  18:29:23 +0000 (0:00:00.025)       0:01:19.744 *****
2026-02-26 18:29:23.953289 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2026-02-26 18:29:23.953324 | controller | changed: [instance] => (item=/opt/basedir/logs)
2026-02-26 18:29:23.953332 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2026-02-26 18:29:23.953338 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2026-02-26 18:29:23.953345 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2026-02-26 18:29:23.953495 | controller |
2026-02-26 18:29:23.953545 | controller | TASK [Create secret file] ******************************************************
2026-02-26 18:29:23.953563 | controller | Thursday 26 February 2026  18:29:23 +0000 (0:00:00.942)       0:01:20.687 *****
2026-02-26 18:29:24.282068 | controller | changed: [instance]
2026-02-26 18:29:24.282133 | controller |
2026-02-26 18:29:24.282142 | controller | PLAY RECAP *********************************************************************
2026-02-26 18:29:24.282151 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2026-02-26 18:29:24.283956 | controller |
2026-02-26 18:29:24.283997 | controller | Thursday 26 February 2026  18:29:24 +0000 (0:00:00.328)       0:01:21.016 *****
2026-02-26 18:29:24.360785 | controller | ===============================================================================
2026-02-26 18:29:24.360812 | controller | test_deps : Install selinux python libs -------------------------------- 45.34s
2026-02-26 18:29:24.360820 | controller | ci_setup : Install needed packages -------------------------------------- 9.44s
2026-02-26 18:29:24.360826 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.30s
2026-02-26 18:29:24.360831 | controller | ci_setup : Install openshift client ------------------------------------- 5.94s
2026-02-26 18:29:24.360837 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.27s
2026-02-26 18:29:24.360843 | controller | test_deps : Install python yaml libs ------------------------------------ 1.19s
2026-02-26 18:29:24.360848 | controller | ci_setup : Manage directories ------------------------------------------- 0.94s
2026-02-26 18:29:24.360853 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.83s
2026-02-26 18:29:24.360858 | controller | Gathering Facts --------------------------------------------------------- 0.81s
2026-02-26 18:29:24.360864 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.80s
2026-02-26 18:29:24.360869 | controller | repo_setup : Install repo-setup package --------------------------------- 0.67s
2026-02-26 18:29:24.360874 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.66s
2026-02-26 18:29:24.360879 | controller | ci_setup : Gather version of openshift client --------------------------- 0.63s
2026-02-26 18:29:24.360885 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s
2026-02-26 18:29:24.360890 | controller | repo_setup : Ensure directories are present ----------------------------- 0.50s
2026-02-26 18:29:24.360895 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s
2026-02-26 18:29:24.360900 | controller | Create secret file ------------------------------------------------------ 0.33s
2026-02-26 18:29:24.360905 | controller | Create custom basedir --------------------------------------------------- 0.31s
2026-02-26 18:29:24.360910 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.29s
2026-02-26 18:29:24.360921 | controller | ci_setup : Create completion file --------------------------------------- 0.27s
2026-02-26 18:29:24.360931 | controller | INFO     Running crc_layout > converge
2026-02-26 18:29:24.908753 | controller |
2026-02-26 18:29:24.908991 | controller | PLAY [Converge] ****************************************************************
2026-02-26 18:29:24.909123 | controller |
2026-02-26 18:29:24.909248 | controller | TASK [Gathering Facts] *********************************************************
2026-02-26 18:29:24.909368 | controller | Thursday 26 February 2026  18:29:24 +0000 (0:00:00.024)       0:00:00.024 *****
2026-02-26 18:29:25.708822 | controller | ok: [instance]
2026-02-26 18:29:25.730378 | controller |
2026-02-26 18:29:25.730398 | controller | TASK [Load networking definition from scenario file] ***************************
2026-02-26 18:29:25.730408 | controller | Thursday 26 February 2026  18:29:25 +0000 (0:00:00.799)       0:00:00.824 *****
2026-02-26 18:29:25.730418 | controller | ok: [instance]
2026-02-26 18:29:27.259595 | controller |
2026-02-26 18:29:27.259627 | controller | TASK [discover_latest_image : Get latest image] ********************************
2026-02-26 18:29:27.259635 | controller | Thursday 26 February 2026  18:29:25 +0000 (0:00:00.021)       0:00:00.846 *****
2026-02-26 18:29:27.259645 | controller | changed: [instance]
2026-02-26 18:29:27.286343 | controller |
2026-02-26 18:29:27.286363 | controller | TASK [discover_latest_image : Export facts accordingly] ************************
2026-02-26 18:29:27.286377 | controller | Thursday 26 February 2026  18:29:27 +0000 (0:00:01.529)       0:00:02.375 *****
2026-02-26 18:29:27.286386 | controller | ok: [instance]
2026-02-26 18:29:27.306981 | controller |
2026-02-26 18:29:27.307002 | controller | TASK [reproducer : Load CI job environment] ************************************
2026-02-26 18:29:27.307011 | controller | Thursday 26 February 2026  18:29:27 +0000 (0:00:00.026)       0:00:02.402 *****
2026-02-26 18:29:27.307021 | controller | skipping: [instance]
2026-02-26 18:29:27.358095 | controller |
2026-02-26 18:29:27.358127 | controller | TASK [Build final libvirt layout] **********************************************
2026-02-26 18:29:27.358140 | controller | Thursday 26 February 2026  18:29:27 +0000 (0:00:00.020)       0:00:02.422 *****
2026-02-26 18:29:27.358155 | controller |
2026-02-26 18:29:27.358406 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2026-02-26 18:29:27.434528 | controller | Thursday 26 February 2026  18:29:27 +0000 (0:00:00.051)       0:00:02.474 *****
2026-02-26 18:29:27.434552 | controller | ok: [instance]
2026-02-26 18:29:27.497082 | controller |
2026-02-26 18:29:27.497113 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2026-02-26 18:29:27.497123 | controller | Thursday 26 February 2026  18:29:27 +0000 (0:00:00.076)       0:00:02.550 *****
2026-02-26 18:29:27.497133 | controller | skipping: [instance]
2026-02-26 18:29:27.522155 | controller |
2026-02-26 18:29:27.522182 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2026-02-26 18:29:27.522192 | controller | Thursday 26 February 2026  18:29:27 +0000 (0:00:00.062)       0:00:02.612 *****
2026-02-26 18:29:27.522204 | controller | ok: [instance]
2026-02-26 18:29:27.522282 | controller |
2026-02-26 18:29:27.522464 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2026-02-26 18:29:27.522571 | controller | Thursday 26 February 2026  18:29:27 +0000 (0:00:00.025)       0:00:02.638 *****
2026-02-26 18:29:27.548505 | controller | ok: [instance] => changed=false
2026-02-26 18:29:27.548612 | controller |   msg: All assertions passed
2026-02-26 18:29:27.548781 | controller |
2026-02-26 18:29:27.548829 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2026-02-26 18:29:27.548960 | controller | Thursday 26 February 2026  18:29:27 +0000 (0:00:00.026)       0:00:02.664 *****
2026-02-26 18:29:27.590052 | controller | ok: [instance]
2026-02-26 18:29:27.590211 | controller |
2026-02-26 18:29:27.590367 | controller | TASK [reproducer : Ensure directories are present] *****************************
2026-02-26 18:29:27.590472 | controller | Thursday 26 February 2026  18:29:27 +0000 (0:00:00.041)       0:00:02.706 *****
2026-02-26 18:29:28.010061 | controller | ok: [instance] => (item=artifacts)
2026-02-26 18:29:28.010118 | controller | ok: [instance] => (item=logs)
2026-02-26 18:29:28.010128 | controller |
2026-02-26 18:29:28.010138 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2026-02-26 18:29:28.010232 | controller | Thursday 26 February 2026  18:29:28 +0000 (0:00:00.419)       0:00:03.125 *****
2026-02-26 18:29:28.081000 | controller |
2026-02-26 18:29:28.264053 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2026-02-26 18:29:28.264088 | controller | Thursday 26 February 2026  18:29:28 +0000 (0:00:00.070)       0:00:03.196 *****
2026-02-26 18:29:28.264104 | controller | ok: [instance]
2026-02-26 18:29:28.536452 | controller |
2026-02-26 18:29:28.536482 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2026-02-26 18:29:28.536491 | controller | Thursday 26 February 2026  18:29:28 +0000 (0:00:00.183)       0:00:03.379 *****
2026-02-26 18:29:28.536501 | controller | changed: [instance]
2026-02-26 18:29:28.806828 | controller |
2026-02-26 18:29:28.806860 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2026-02-26 18:29:28.806868 | controller | Thursday 26 February 2026  18:29:28 +0000 (0:00:00.272)       0:00:03.652 *****
2026-02-26 18:29:28.806877 | controller | ok: [instance]
2026-02-26 18:29:28.833630 | controller |
2026-02-26 18:29:28.833648 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2026-02-26 18:29:28.833656 | controller | Thursday 26 February 2026  18:29:28 +0000 (0:00:00.270)       0:00:03.922 *****
2026-02-26 18:29:28.833666 | controller | skipping: [instance]
2026-02-26 18:29:28.850142 | controller |
2026-02-26 18:29:28.850189 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2026-02-26 18:29:28.850203 | controller | Thursday 26 February 2026  18:29:28 +0000 (0:00:00.027)       0:00:03.949 *****
2026-02-26 18:29:28.850221 | controller | skipping: [instance]
2026-02-26 18:29:28.870064 | controller |
2026-02-26 18:29:28.870089 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2026-02-26 18:29:28.870098 | controller | Thursday 26 February 2026  18:29:28 +0000 (0:00:00.016)       0:00:03.966 *****
2026-02-26 18:29:28.870109 | controller | ok: [instance]
2026-02-26 18:29:28.870163 | controller |
2026-02-26 18:29:28.870180 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2026-02-26 18:29:28.870198 | controller | Thursday 26 February 2026  18:29:28 +0000 (0:00:00.019)       0:00:03.986 *****
2026-02-26 18:29:28.896995 | controller | skipping: [instance]
2026-02-26 18:29:38.443688 | controller |
2026-02-26 18:29:38.443736 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2026-02-26 18:29:38.443745 | controller | Thursday 26 February 2026  18:29:28 +0000 (0:00:00.026)       0:00:04.012 *****
2026-02-26 18:29:38.443756 | controller | changed: [instance]
2026-02-26 18:29:38.443776 | controller |
2026-02-26 18:29:38.443831 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2026-02-26 18:29:38.443960 | controller | Thursday 26 February 2026  18:29:38 +0000 (0:00:09.546)       0:00:13.559 *****
2026-02-26 18:29:38.648608 | controller | changed: [instance]
2026-02-26 18:29:38.648637 | controller |
2026-02-26 18:29:38.648645 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2026-02-26 18:29:38.648661 | controller | Thursday 26 February 2026  18:29:38 +0000 (0:00:00.204)       0:00:13.764 *****
2026-02-26 18:29:39.129582 | controller | changed: [instance]
2026-02-26 18:29:39.690914 | controller |
2026-02-26 18:29:39.690958 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2026-02-26 18:29:39.690968 | controller | Thursday 26 February 2026  18:29:39 +0000 (0:00:00.480)       0:00:14.245 *****
2026-02-26 18:29:39.690978 | controller | changed: [instance]
2026-02-26 18:29:39.877122 | controller |
2026-02-26 18:29:39.877160 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2026-02-26 18:29:39.877170 | controller | Thursday 26 February 2026  18:29:39 +0000 (0:00:00.561)       0:00:14.806 *****
2026-02-26 18:29:39.877182 | controller | ok: [instance]
2026-02-26 18:29:40.504036 | controller |
2026-02-26 18:29:40.504075 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2026-02-26 18:29:40.504083 | controller | Thursday 26 February 2026  18:29:39 +0000 (0:00:00.186)       0:00:14.992 *****
2026-02-26 18:29:40.504095 | controller | ok: [instance]
2026-02-26 18:29:41.214057 | controller |
2026-02-26 18:29:41.214098 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2026-02-26 18:29:41.214117 | controller | Thursday 26 February 2026  18:29:40 +0000 (0:00:00.626)       0:00:15.619 *****
2026-02-26 18:29:41.214130 | controller | changed: [instance]
2026-02-26 18:29:41.214160 | controller |
2026-02-26 18:29:41.214170 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2026-02-26 18:29:41.214196 | controller | Thursday 26 February 2026  18:29:41 +0000 (0:00:00.709)       0:00:16.329 *****
2026-02-26 18:29:41.295084 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2026-02-26 18:29:41.295129 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2026-02-26 18:29:41.295138 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2026-02-26 18:29:41.295145 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2026-02-26 18:29:41.295151 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2026-02-26 18:29:41.295157 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2026-02-26 18:29:41.295163 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2026-02-26 18:29:41.295171 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2026-02-26 18:29:41.295422 | controller |
2026-02-26 18:29:41.595804 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2026-02-26 18:29:41.595832 | controller | Thursday 26 February 2026  18:29:41 +0000 (0:00:00.080)       0:00:16.410 *****
2026-02-26 18:29:41.595843 | controller | ok: [instance]
2026-02-26 18:29:41.906260 | controller |
2026-02-26 18:29:41.906294 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2026-02-26 18:29:41.906302 | controller | Thursday 26 February 2026  18:29:41 +0000 (0:00:00.301)       0:00:16.711 *****
2026-02-26 18:29:41.906312 | controller | ok: [instance]
2026-02-26 18:29:42.206520 | controller |
2026-02-26 18:29:42.206545 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2026-02-26 18:29:42.206553 | controller | Thursday 26 February 2026  18:29:41 +0000 (0:00:00.310)       0:00:17.021 *****
2026-02-26 18:29:42.206562 | controller | ok: [instance]
2026-02-26 18:29:42.508105 | controller |
2026-02-26 18:29:42.508145 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2026-02-26 18:29:42.508159 | controller | Thursday 26 February 2026  18:29:42 +0000 (0:00:00.300)       0:00:17.322 *****
2026-02-26 18:29:42.508176 | controller | ok: [instance]
2026-02-26 18:29:42.508219 | controller |
2026-02-26 18:29:42.508234 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2026-02-26 18:29:42.508246 | controller | Thursday 26 February 2026  18:29:42 +0000 (0:00:00.301)       0:00:17.624 *****
2026-02-26 18:29:42.810159 | controller | ok: [instance]
2026-02-26 18:29:43.114077 | controller |
2026-02-26 18:29:43.114123 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2026-02-26 18:29:43.114134 | controller | Thursday 26 February 2026  18:29:42 +0000 (0:00:00.301)       0:00:17.925 *****
2026-02-26 18:29:43.114149 | controller | ok: [instance]
2026-02-26 18:29:43.114171 | controller |
2026-02-26 18:29:43.114179 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2026-02-26 18:29:43.114189 | controller | Thursday 26 February 2026  18:29:43 +0000 (0:00:00.303)       0:00:18.229 *****
2026-02-26 18:29:43.422034 | controller | ok: [instance]
2026-02-26 18:29:43.422501 | controller |
2026-02-26 18:29:43.720364 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2026-02-26 18:29:43.720385 | controller | Thursday 26 February 2026  18:29:43 +0000 (0:00:00.308)       0:00:18.537 *****
2026-02-26 18:29:43.720401 | controller | ok: [instance]
2026-02-26 18:29:44.022905 | controller |
2026-02-26 18:29:44.022940 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2026-02-26 18:29:44.022989 | controller | Thursday 26 February 2026  18:29:43 +0000 (0:00:00.298)       0:00:18.836 *****
2026-02-26 18:29:44.023001 | controller | ok: [instance]
2026-02-26 18:29:44.321032 | controller |
2026-02-26 18:29:44.321068 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2026-02-26 18:29:44.321076 | controller | Thursday 26 February 2026  18:29:44 +0000 (0:00:00.302)       0:00:19.138 *****
2026-02-26 18:29:44.321086 | controller | ok: [instance]
2026-02-26 18:29:44.321112 | controller |
2026-02-26 18:29:44.321526 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2026-02-26 18:29:44.630464 | controller | Thursday 26 February 2026  18:29:44 +0000 (0:00:00.298)       0:00:19.437 *****
2026-02-26 18:29:44.630489 | controller | ok: [instance]
2026-02-26 18:29:44.933935 | controller |
2026-02-26 18:29:44.933980 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2026-02-26 18:29:44.933988 | controller | Thursday 26 February 2026  18:29:44 +0000 (0:00:00.309)       0:00:19.746 *****
2026-02-26 18:29:44.933997 | controller | ok: [instance]
2026-02-26 18:29:45.234646 | controller |
2026-02-26 18:29:45.234670 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2026-02-26 18:29:45.234680 | controller | Thursday 26 February 2026  18:29:44 +0000 (0:00:00.303)       0:00:20.049 *****
2026-02-26 18:29:45.234691 | controller | ok: [instance]
2026-02-26 18:29:45.538890 | controller |
2026-02-26 18:29:45.538922 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2026-02-26 18:29:45.538930 | controller | Thursday 26 February 2026  18:29:45 +0000 (0:00:00.300)       0:00:20.350 *****
2026-02-26 18:29:45.538939 | controller | ok: [instance]
2026-02-26 18:29:45.837525 | controller |
2026-02-26 18:29:45.837569 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2026-02-26 18:29:45.837578 | controller | Thursday 26 February 2026  18:29:45 +0000 (0:00:00.304)       0:00:20.654 *****
2026-02-26 18:29:45.837590 | controller | ok: [instance]
2026-02-26 18:29:46.134005 | controller |
2026-02-26 18:29:46.134029 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2026-02-26 18:29:46.134036 | controller | Thursday 26 February 2026  18:29:45 +0000 (0:00:00.298)       0:00:20.953 *****
2026-02-26 18:29:46.134046 | controller | ok: [instance]
2026-02-26 18:29:46.134064 | controller |
2026-02-26 18:29:46.134075 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2026-02-26 18:29:46.134082 | controller | Thursday 26 February 2026  18:29:46 +0000 (0:00:00.296)       0:00:21.249 *****
2026-02-26 18:29:46.431604 | controller | ok: [instance]
2026-02-26 18:29:46.730516 | controller |
2026-02-26 18:29:46.730546 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2026-02-26 18:29:46.730554 | controller | Thursday 26 February 2026  18:29:46 +0000 (0:00:00.297)       0:00:21.547 *****
2026-02-26 18:29:46.730563 | controller | ok: [instance]
2026-02-26 18:29:47.041434 | controller |
2026-02-26 18:29:47.041468 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2026-02-26 18:29:47.041478 | controller | Thursday 26 February 2026  18:29:46 +0000 (0:00:00.299)       0:00:21.846 *****
2026-02-26 18:29:47.041490 | controller | ok: [instance]
2026-02-26 18:29:47.342440 | controller |
2026-02-26 18:29:47.342462 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2026-02-26 18:29:47.342470 | controller | Thursday 26 February 2026  18:29:47 +0000 (0:00:00.310)       0:00:22.157 *****
2026-02-26 18:29:47.342480 | controller | ok: [instance]
2026-02-26 18:29:47.640382 | controller |
2026-02-26 18:29:47.640401 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2026-02-26 18:29:47.640408 | controller | Thursday 26 February 2026  18:29:47 +0000 (0:00:00.301)       0:00:22.458 *****
2026-02-26 18:29:47.640417 | controller | ok: [instance]
2026-02-26 18:29:47.935044 | controller |
2026-02-26 18:29:47.935080 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2026-02-26 18:29:47.935088 | controller | Thursday 26 February 2026  18:29:47 +0000 (0:00:00.297)       0:00:22.756 *****
2026-02-26 18:29:47.935104 | controller | ok: [instance]
2026-02-26 18:29:47.935128 | controller |
2026-02-26 18:29:47.935135 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2026-02-26 18:29:47.935231 | controller | Thursday 26 February 2026  18:29:47 +0000 (0:00:00.294)       0:00:23.051 *****
2026-02-26 18:29:48.235792 | controller | ok: [instance]
2026-02-26 18:29:48.530314 | controller |
2026-02-26 18:29:48.530343 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2026-02-26 18:29:48.530354 | controller | Thursday 26 February 2026  18:29:48 +0000 (0:00:00.300)       0:00:23.351 *****
2026-02-26 18:29:48.530366 | controller | ok: [instance]
2026-02-26 18:29:48.550734 | controller |
2026-02-26 18:29:48.550751 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2026-02-26 18:29:48.550758 | controller | Thursday 26 February 2026  18:29:48 +0000 (0:00:00.294)       0:00:23.646 *****
2026-02-26 18:29:48.550766 | controller | skipping: [instance]
2026-02-26 18:29:48.811373 | controller |
2026-02-26 18:29:48.811399 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2026-02-26 18:29:48.811406 | controller | Thursday 26 February 2026  18:29:48 +0000 (0:00:00.020)       0:00:23.666 *****
2026-02-26 18:29:48.811416 | controller | ok: [instance]
2026-02-26 18:29:49.170488 | controller |
2026-02-26 18:29:49.170530 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2026-02-26 18:29:49.170538 | controller | Thursday 26 February 2026  18:29:48 +0000 (0:00:00.260)       0:00:23.927 *****
2026-02-26 18:29:49.170548 | controller | ok: [instance]
2026-02-26 18:29:49.462495 | controller |
2026-02-26 18:29:49.462532 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2026-02-26 18:29:49.462540 | controller | Thursday 26 February 2026  18:29:49 +0000 (0:00:00.359)       0:00:24.286 *****
2026-02-26 18:29:49.462551 | controller | changed: [instance]
2026-02-26 18:29:49.731320 | controller |
2026-02-26 18:29:49.731350 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2026-02-26 18:29:49.731358 | controller | Thursday 26 February 2026  18:29:49 +0000 (0:00:00.292)       0:00:24.578 *****
2026-02-26 18:29:49.731368 | controller | [WARNING]: Reset is not implemented for this connection
2026-02-26 18:29:49.741081 | controller | changed: [instance]
2026-02-26 18:29:49.741554 | controller |
2026-02-26 18:29:49.741574 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2026-02-26 18:29:49.741587 | controller | Thursday 26 February 2026  18:29:49 +0000 (0:00:00.263)       0:00:24.841 *****
2026-02-26 18:29:49.810076 | controller |
2026-02-26 18:29:49.810103 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2026-02-26 18:29:49.810112 | controller | Thursday 26 February 2026  18:29:49 +0000 (0:00:00.015)       0:00:24.857 *****
2026-02-26 18:29:49.810125 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2026-02-26 18:29:49.810237 | controller |
2026-02-26 18:29:49.810259 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2026-02-26 18:29:49.810272 | controller | Thursday 26 February 2026  18:29:49 +0000 (0:00:00.068)       0:00:24.926 *****
2026-02-26 18:29:49.849106 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2026-02-26 18:29:49.849202 | controller |
2026-02-26 18:29:49.849219 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-02-26 18:29:49.849228 | controller | Thursday 26 February 2026  18:29:49 +0000 (0:00:00.039)       0:00:24.965 *****
2026-02-26 18:29:49.895626 | controller | ok: [instance] => (item=compute)
2026-02-26 18:29:49.970393 | controller | ok: [instance] => (item=controller)
2026-02-26 18:29:49.970411 | controller | ok: [instance] => (item=crc)
2026-02-26 18:29:49.970418 | controller |
2026-02-26 18:29:49.970424 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-02-26 18:29:49.970430 | controller | Thursday 26 February 2026  18:29:49 +0000 (0:00:00.046)       0:00:25.011 *****
2026-02-26 18:29:49.970439 | controller | ok: [instance]
2026-02-26 18:29:50.011053 | controller |
2026-02-26 18:29:50.011083 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-02-26 18:29:50.011100 | controller | Thursday 26 February 2026  18:29:49 +0000 (0:00:00.075)       0:00:25.086 *****
2026-02-26 18:29:50.011112 | controller | ok: [instance] => changed=false
2026-02-26 18:29:50.051114 | controller |   msg: All assertions passed
2026-02-26 18:29:50.051140 | controller |
2026-02-26 18:29:50.051149 | controller | TASK [Ensure we get latest OCP config] *****************************************
2026-02-26 18:29:50.051155 | controller | Thursday 26 February 2026  18:29:50 +0000 (0:00:00.040)       0:00:25.127 *****
2026-02-26 18:29:50.051165 | controller |
2026-02-26 18:29:50.127264 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2026-02-26 18:29:50.127296 | controller | Thursday 26 February 2026  18:29:50 +0000 (0:00:00.039)       0:00:25.166 *****
2026-02-26 18:29:50.127317 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2026-02-26 18:29:50.127535 | controller | ok: [instance] => (item={})
2026-02-26 18:29:50.127665 | controller |
2026-02-26 18:29:50.127796 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2026-02-26 18:29:50.127924 | controller | Thursday 26 February 2026  18:29:50 +0000 (0:00:00.076)       0:00:25.243 *****
2026-02-26 18:29:50.145285 | controller | skipping: [instance]
2026-02-26 18:29:50.145548 | controller |
2026-02-26 18:29:50.145687 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2026-02-26 18:29:50.145828 | controller | Thursday 26 February 2026  18:29:50 +0000 (0:00:00.018)       0:00:25.261 *****
2026-02-26 18:29:50.354080 | controller | ok: [instance]
2026-02-26 18:29:50.354133 | controller |
2026-02-26 18:29:50.354329 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2026-02-26 18:29:50.676861 | controller | Thursday 26 February 2026  18:29:50 +0000 (0:00:00.208)       0:00:25.469 *****
2026-02-26 18:29:50.676895 | controller | changed: [instance]
2026-02-26 18:29:51.382024 | controller |
2026-02-26 18:29:51.382064 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2026-02-26 18:29:51.382073 | controller | Thursday 26 February 2026  18:29:50 +0000 (0:00:00.322)       0:00:25.792 *****
2026-02-26 18:29:51.382086 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2026-02-26 18:29:51.382114 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2026-02-26 18:29:51.382120 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2026-02-26 18:29:51.382126 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2026-02-26 18:29:51.382133 | controller |
2026-02-26 18:29:51.382323 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2026-02-26 18:29:51.407528 | controller | Thursday 26 February 2026  18:29:51 +0000 (0:00:00.705)       0:00:26.497 *****
2026-02-26 18:29:51.407554 | controller | skipping: [instance]
2026-02-26 18:29:51.758785 | controller |
2026-02-26 18:29:51.758813 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2026-02-26 18:29:51.758821 | controller | Thursday 26 February 2026  18:29:51 +0000 (0:00:00.025)       0:00:26.523 *****
2026-02-26 18:29:51.758831 | controller | changed: [instance]
2026-02-26 18:29:52.170475 | controller |
2026-02-26 18:29:52.170518 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2026-02-26 18:29:52.170527 | controller | Thursday 26 February 2026  18:29:51 +0000 (0:00:00.342)       0:00:26.865 *****
2026-02-26 18:29:52.170532 | controller |
2026-02-26 18:29:52.170538 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-02-26 18:29:52.170543 | controller | Thursday 26 February 2026  18:29:51 +0000 (0:00:00.008)       0:00:26.874 *****
2026-02-26 18:29:52.170560 | controller | changed: [instance]
2026-02-26 18:29:52.170580 | controller |
2026-02-26 18:29:52.170605 | controller | TASK [Ensure no default networks exists] ***************************************
2026-02-26 18:29:52.170764 | controller | Thursday 26 February 2026  18:29:52 +0000 (0:00:00.412)       0:00:27.286 *****
2026-02-26 18:29:52.244088 | controller |
2026-02-26 18:29:52.244146 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2026-02-26 18:29:52.244297 | controller | Thursday 26 February 2026  18:29:52 +0000 (0:00:00.073)       0:00:27.359 *****
2026-02-26 18:29:53.439145 | controller | ok: [instance]
2026-02-26 18:29:53.439225 | controller |
2026-02-26 18:29:53.439244 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2026-02-26 18:29:53.439311 | controller | Thursday 26 February 2026  18:29:53 +0000 (0:00:01.194)       0:00:28.554 *****
2026-02-26 18:29:53.663182 | controller | ok: [instance]
2026-02-26 18:29:53.663214 | controller |
2026-02-26 18:29:53.663223 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2026-02-26 18:29:53.663232 | controller | Thursday 26 February 2026  18:29:53 +0000 (0:00:00.223)       0:00:28.778 *****
2026-02-26 18:29:54.159427 | controller | ok: [instance]
2026-02-26 18:29:54.377048 | controller |
2026-02-26 18:29:54.377102 | controller | TASK [libvirt_manager : Removing default] **************************************
2026-02-26 18:29:54.377117 | controller | Thursday 26 February 2026  18:29:54 +0000 (0:00:00.496)       0:00:29.275 *****
2026-02-26 18:29:54.377137 | controller | ok: [instance]
2026-02-26 18:29:54.377190 | controller |
2026-02-26 18:29:54.377384 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2026-02-26 18:29:55.541777 | controller | Thursday 26 February 2026  18:29:54 +0000 (0:00:00.217)       0:00:29.493 *****
2026-02-26 18:29:55.541813 | controller | ok: [instance]
2026-02-26 18:29:55.834568 | controller |
2026-02-26 18:29:55.834604 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2026-02-26 18:29:55.834612 | controller | Thursday 26 February 2026  18:29:55 +0000 (0:00:01.164)       0:00:30.657 *****
2026-02-26 18:29:55.834622 | controller | ok: [instance]
2026-02-26 18:29:56.125040 | controller |
2026-02-26 18:29:56.125073 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2026-02-26 18:29:56.125092 | controller | Thursday 26 February 2026  18:29:55 +0000 (0:00:00.292)       0:00:30.950 *****
2026-02-26 18:29:56.125104 | controller | changed: [instance]
2026-02-26 18:29:56.125235 | controller |
2026-02-26 18:29:56.125261 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2026-02-26 18:29:56.408341 | controller | Thursday 26 February 2026  18:29:56 +0000 (0:00:00.290)       0:00:31.240 *****
2026-02-26 18:29:56.408376 | controller | changed: [instance]
2026-02-26 18:29:58.954568 | controller |
2026-02-26 18:29:58.954604 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2026-02-26 18:29:58.954612 | controller | Thursday 26 February 2026  18:29:56 +0000 (0:00:00.283)       0:00:31.524 *****
2026-02-26 18:29:58.954623 | controller | changed: [instance] => (item=arptables)
2026-02-26 18:29:59.274068 | controller | changed: [instance] => (item=iptables)
2026-02-26 18:29:59.274105 | controller | changed: [instance] => (item=ip6tables)
2026-02-26 18:29:59.274114 | controller |
2026-02-26 18:29:59.274122 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2026-02-26 18:29:59.274129 | controller | Thursday 26 February 2026  18:29:58 +0000 (0:00:02.545)       0:00:34.070 *****
2026-02-26 18:29:59.274141 | controller | ok: [instance]
2026-02-26 18:29:59.274171 | controller |
2026-02-26 18:29:59.274181 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2026-02-26 18:29:59.358021 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.319)       0:00:34.389 *****
2026-02-26 18:29:59.358058 | controller | ok: [instance]
2026-02-26 18:29:59.358256 | controller |
2026-02-26 18:29:59.358294 | controller | TASK [Ensure the required network configurations are applied] ******************
2026-02-26 18:29:59.398438 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.084)       0:00:34.474 *****
2026-02-26 18:29:59.398475 | controller |
2026-02-26 18:29:59.419806 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2026-02-26 18:29:59.419831 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.040)       0:00:34.514 *****
2026-02-26 18:29:59.419843 | controller | skipping: [instance]
2026-02-26 18:29:59.440087 | controller |
2026-02-26 18:29:59.440118 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2026-02-26 18:29:59.440127 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.021)       0:00:34.535 *****
2026-02-26 18:29:59.440139 | controller | skipping: [instance]
2026-02-26 18:29:59.461098 | controller |
2026-02-26 18:29:59.461129 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-02-26 18:29:59.461138 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.020)       0:00:34.555 *****
2026-02-26 18:29:59.461148 | controller | skipping: [instance]
2026-02-26 18:29:59.461174 | controller |
2026-02-26 18:29:59.461187 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2026-02-26 18:29:59.461255 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.021)       0:00:34.577 *****
2026-02-26 18:29:59.485598 | controller | skipping: [instance]
2026-02-26 18:29:59.519989 | controller |
2026-02-26 18:29:59.520020 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2026-02-26 18:29:59.520029 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.024)       0:00:34.601 *****
2026-02-26 18:29:59.520040 | controller | ok: [instance]
2026-02-26 18:29:59.520129 | controller |
2026-02-26 18:29:59.520256 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2026-02-26 18:29:59.520359 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.034)       0:00:34.636 *****
2026-02-26 18:29:59.552589 | controller | skipping: [instance]
2026-02-26 18:29:59.552736 | controller |
2026-02-26 18:29:59.552889 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2026-02-26 18:29:59.553052 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.032)       0:00:34.668 *****
2026-02-26 18:29:59.573467 | controller | skipping: [instance]
2026-02-26 18:29:59.573608 | controller |
2026-02-26 18:29:59.573743 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2026-02-26 18:29:59.573868 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.021)       0:00:34.689 *****
2026-02-26 18:29:59.624410 | controller | ok: [instance]
2026-02-26 18:29:59.624560 | controller |
2026-02-26 18:29:59.624667 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2026-02-26 18:29:59.624772 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.050)       0:00:34.740 *****
2026-02-26 18:29:59.643838 | controller | skipping: [instance]
2026-02-26 18:29:59.644001 | controller |
2026-02-26 18:29:59.644144 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2026-02-26 18:29:59.644278 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.019)       0:00:34.760 *****
2026-02-26 18:29:59.689219 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2026-02-26 18:29:59.689358 | controller |
2026-02-26 18:29:59.689507 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-02-26 18:29:59.689627 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.045)       0:00:34.805 *****
2026-02-26 18:29:59.995118 | controller | ok: [instance -> localhost]
2026-02-26 18:30:05.122645 | controller |
2026-02-26 18:30:05.122680 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2026-02-26 18:30:05.122690 | controller | Thursday 26 February 2026  18:29:59 +0000 (0:00:00.305)       0:00:35.110 *****
2026-02-26 18:30:05.122702 | controller | changed: [instance -> localhost]
2026-02-26 18:30:05.334962 | controller |
2026-02-26 18:30:05.334988 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-02-26 18:30:05.334998 | controller | Thursday 26 February 2026  18:30:05 +0000 (0:00:05.127)       0:00:40.238 *****
2026-02-26 18:30:05.335010 | controller | changed: [instance]
2026-02-26 18:30:05.722509 | controller |
2026-02-26 18:30:05.722540 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2026-02-26 18:30:05.722549 | controller | Thursday 26 February 2026  18:30:05 +0000 (0:00:00.212)       0:00:40.450 *****
2026-02-26 18:30:05.722567 | controller | changed: [instance]
2026-02-26 18:30:07.336622 | controller |
2026-02-26 18:30:07.336656 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2026-02-26 18:30:07.336666 | controller | Thursday 26 February 2026  18:30:05 +0000 (0:00:00.387)       0:00:40.838 *****
2026-02-26 18:30:07.336677 | controller | changed: [instance -> localhost]
2026-02-26 18:30:07.683452 | controller |
2026-02-26 18:30:07.683481 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2026-02-26 18:30:07.683489 | controller | Thursday 26 February 2026  18:30:07 +0000 (0:00:01.613)       0:00:42.451 *****
2026-02-26 18:30:07.683499 | controller | changed: [instance]
2026-02-26 18:30:07.716900 | controller |
2026-02-26 18:30:07.716917 | controller | TASK [reproducer : Select right domain] ****************************************
2026-02-26 18:30:07.716924 | controller | Thursday 26 February 2026  18:30:07 +0000 (0:00:00.347)       0:00:42.799 *****
2026-02-26 18:30:07.716932 | controller | ok: [instance]
2026-02-26 18:30:07.825255 | controller |
2026-02-26 18:30:07.825289 | controller | TASK [Create the virtual networks] *********************************************
2026-02-26 18:30:07.825303 | controller | Thursday 26 February 2026  18:30:07 +0000 (0:00:00.033)       0:00:42.832 *****
2026-02-26 18:30:07.825319 | controller |
2026-02-26 18:30:07.844122 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2026-02-26 18:30:07.844210 | controller | Thursday 26 February 2026  18:30:07 +0000 (0:00:00.108)       0:00:42.941 *****
2026-02-26 18:30:07.844239 | controller | ok: [instance]
2026-02-26 18:30:08.028140 | controller |
2026-02-26 18:30:08.028190 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2026-02-26 18:30:08.028201 | controller | Thursday 26 February 2026  18:30:07 +0000 (0:00:00.018)       0:00:42.959 *****
2026-02-26 18:30:08.028214 | controller | ok: [instance]
2026-02-26 18:30:08.056107 | controller |
2026-02-26 18:30:08.056152 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2026-02-26 18:30:08.056167 | controller | Thursday 26 February 2026  18:30:08 +0000 (0:00:00.183)       0:00:43.143 *****
2026-02-26 18:30:08.056184 | controller | skipping: [instance]
2026-02-26 18:30:08.056231 | controller |
2026-02-26 18:30:08.056245 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2026-02-26 18:30:08.056286 | controller | Thursday 26 February 2026  18:30:08 +0000 (0:00:00.028)       0:00:43.172 *****
2026-02-26 18:30:08.085117 | controller | skipping: [instance]
2026-02-26 18:30:08.085186 | controller |
2026-02-26 18:30:08.085204 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2026-02-26 18:30:08.085341 | controller | Thursday 26 February 2026  18:30:08 +0000 (0:00:00.028)       0:00:43.201 *****
2026-02-26 18:30:08.136163 | controller | ok: [instance]
2026-02-26 18:30:08.136327 | controller |
2026-02-26 18:30:08.136364 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2026-02-26 18:30:08.136383 | controller | Thursday 26 February 2026  18:30:08 +0000 (0:00:00.050)       0:00:43.251 *****
2026-02-26 18:30:08.279872 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2026-02-26 18:30:08.311886 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2026-02-26 18:30:08.311923 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2026-02-26 18:30:08.311930 | controller |
2026-02-26 18:30:08.311936 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2026-02-26 18:30:08.311941 | controller | Thursday 26 February 2026  18:30:08 +0000 (0:00:00.143)       0:00:43.395 *****
2026-02-26 18:30:08.311983 | controller | skipping: [instance]
2026-02-26 18:30:08.636647 | controller |
2026-02-26 18:30:08.636682 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2026-02-26 18:30:08.636690 | controller | Thursday 26 February 2026  18:30:08 +0000 (0:00:00.032)       0:00:43.427 *****
2026-02-26 18:30:08.636700 | controller | changed: [instance]
2026-02-26 18:30:08.722193 | controller |
2026-02-26 18:30:08.722276 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2026-02-26 18:30:08.722288 | controller | Thursday 26 February 2026  18:30:08 +0000 (0:00:00.324)       0:00:43.752 *****
2026-02-26 18:30:08.722325 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes)
2026-02-26 18:30:08.722367 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers)
2026-02-26 18:30:08.722379 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps)
2026-02-26 18:30:08.722698 | controller |
2026-02-26 18:30:08.722730 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-02-26 18:30:08.774144 | controller | Thursday 26 February 2026  18:30:08 +0000 (0:00:00.085)       0:00:43.837 *****
2026-02-26 18:30:08.774190 | controller | changed: [instance]
2026-02-26 18:30:08.774246 | controller |
2026-02-26 18:30:08.774261 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-02-26 18:30:08.774384 | controller | Thursday 26 February 2026  18:30:08 +0000 (0:00:00.052)       0:00:43.890 *****
2026-02-26 18:30:09.064337 | controller | changed: [instance]
2026-02-26 18:30:09.288381 | controller |
2026-02-26 18:30:09.288425 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-02-26 18:30:09.288433 | controller | Thursday 26 February 2026  18:30:09 +0000 (0:00:00.289)       0:00:44.179 *****
2026-02-26 18:30:09.288443 | controller | changed: [instance]
2026-02-26 18:30:09.340872 | controller |
2026-02-26 18:30:09.340896 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-02-26 18:30:09.340904 | controller | Thursday 26 February 2026  18:30:09 +0000 (0:00:00.224)       0:00:44.404 *****
2026-02-26 18:30:09.340913 | controller | changed: [instance]
2026-02-26 18:30:09.554113 | controller |
2026-02-26 18:30:09.554148 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-02-26 18:30:09.554158 | controller | Thursday 26 February 2026  18:30:09 +0000 (0:00:00.052)       0:00:44.456 *****
2026-02-26 18:30:09.554170 | controller | changed: [instance]
2026-02-26 18:30:09.778738 | controller |
2026-02-26 18:30:09.778773 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-02-26 18:30:09.778781 | controller | Thursday 26 February 2026  18:30:09 +0000 (0:00:00.212)       0:00:44.669 *****
2026-02-26 18:30:09.778790 | controller | changed: [instance]
2026-02-26 18:30:09.831775 | controller |
2026-02-26 18:30:09.831795 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-02-26 18:30:09.831803 | controller | Thursday 26 February 2026  18:30:09 +0000 (0:00:00.224)       0:00:44.894 *****
2026-02-26 18:30:09.831812 | controller | changed: [instance]
2026-02-26 18:30:10.054039 | controller |
2026-02-26 18:30:10.054073 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-02-26 18:30:10.054081 | controller | Thursday 26 February 2026  18:30:09 +0000 (0:00:00.053)       0:00:44.947 *****
2026-02-26 18:30:10.054091 | controller | changed: [instance]
2026-02-26 18:30:10.054191 | controller |
2026-02-26 18:30:10.054209 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-02-26 18:30:10.054219 | controller | Thursday 26 February 2026  18:30:10 +0000 (0:00:00.221)       0:00:45.169 *****
2026-02-26 18:30:10.295428 | controller | changed: [instance]
2026-02-26 18:30:10.513042 | controller |
2026-02-26 18:30:10.513075 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ********************
2026-02-26 18:30:10.513083 | controller | Thursday 26 February 2026  18:30:10 +0000 (0:00:00.241)       0:00:45.411 *****
2026-02-26 18:30:10.513093 | controller | ok: [instance]
2026-02-26 18:30:10.513116 | controller |
2026-02-26 18:30:10.513272 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ******************
2026-02-26 18:30:11.036104 | controller | Thursday 26 February 2026  18:30:10 +0000 (0:00:00.217)       0:00:45.628 *****
2026-02-26 18:30:11.036179 | controller | changed: [instance]
2026-02-26 18:30:11.036189 | controller |
2026-02-26 18:30:11.036197 | controller | TASK [libvirt_manager : Remove ini file after conversion] **********************
2026-02-26 18:30:11.235418 | controller | Thursday 26 February 2026  18:30:11 +0000 (0:00:00.523)       0:00:46.152 *****
2026-02-26 18:30:11.235458 | controller | changed: [instance]
2026-02-26 18:30:11.262649 | controller |
2026-02-26 18:30:11.262666 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-02-26 18:30:11.262673 | controller | Thursday 26 February 2026  18:30:11 +0000 (0:00:00.198)       0:00:46.351 *****
2026-02-26 18:30:11.262681 | controller | skipping: [instance]
2026-02-26 18:30:11.294537 | controller |
2026-02-26 18:30:11.294554 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-02-26 18:30:11.294569 | controller | Thursday 26 February 2026  18:30:11 +0000 (0:00:00.027)       0:00:46.378 *****
2026-02-26 18:30:11.294578 | controller | skipping: [instance]
2026-02-26 18:30:11.322132 | controller |
2026-02-26 18:30:11.322178 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-02-26 18:30:11.322189 | controller | Thursday 26 February 2026  18:30:11 +0000 (0:00:00.031)       0:00:46.410 *****
2026-02-26 18:30:11.322202 | controller | skipping: [instance]
2026-02-26 18:30:11.322238 | controller |
2026-02-26 18:30:11.322247 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-02-26 18:30:11.322443 | controller | Thursday 26 February 2026  18:30:11 +0000 (0:00:00.027)       0:00:46.437 *****
2026-02-26 18:30:11.348079 | controller | skipping: [instance]
2026-02-26 18:30:11.348148 | controller |
2026-02-26 18:30:11.348485 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-02-26 18:30:11.367150 | controller | Thursday 26 February 2026  18:30:11 +0000 (0:00:00.026)       0:00:46.463 *****
2026-02-26 18:30:11.367187 | controller | ok: [instance]
2026-02-26 18:30:11.367459 | controller |
2026-02-26 18:30:11.367675 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-02-26 18:30:11.367801 | controller | Thursday 26 February 2026  18:30:11 +0000 (0:00:00.019)       0:00:46.483 *****
2026-02-26 18:30:11.448540 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-02-26 18:30:11.448816 | controller |
2026-02-26 18:30:11.449122 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-02-26 18:30:11.449367 | controller | Thursday 26 February 2026  18:30:11 +0000 (0:00:00.081)       0:00:46.564 *****
2026-02-26 18:30:11.473755 | controller | skipping: [instance]
2026-02-26 18:30:11.473889 | controller |
2026-02-26 18:30:11.474040 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-02-26 18:30:11.474164 | controller | Thursday 26 February 2026  18:30:11 +0000 (0:00:00.025)       0:00:46.590 *****
2026-02-26 18:30:11.700429 | controller | changed: [instance]
2026-02-26 18:30:12.123693 | controller |
2026-02-26 18:30:12.123726 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-02-26 18:30:12.123735 | controller | Thursday 26 February 2026  18:30:11 +0000 (0:00:00.226)       0:00:46.816 *****
2026-02-26 18:30:12.123745 | controller | changed: [instance]
2026-02-26 18:30:12.184264 | controller |
2026-02-26 18:30:12.184335 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-02-26 18:30:12.184350 | controller | Thursday 26 February 2026  18:30:12 +0000 (0:00:00.423)       0:00:47.239 *****
2026-02-26 18:30:12.184369 | controller | ok: [instance]
2026-02-26 18:30:12.184419 | controller |
2026-02-26 18:30:12.184431 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-02-26 18:30:12.184445 | controller | Thursday 26 February 2026  18:30:12 +0000 (0:00:00.060)       0:00:47.300 *****
2026-02-26 18:30:12.224683 | controller | ok: [instance]
2026-02-26 18:30:12.224759 | controller |
2026-02-26 18:30:12.224875 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-02-26 18:30:12.225180 | controller | Thursday 26 February 2026  18:30:12 +0000 (0:00:00.040)       0:00:47.340 *****
2026-02-26 18:30:12.611939 | controller | changed: [instance]
2026-02-26 18:30:12.696929 | controller |
2026-02-26 18:30:12.696995 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2026-02-26 18:30:12.697011 | controller | Thursday 26 February 2026  18:30:12 +0000 (0:00:00.386)       0:00:47.727 *****
2026-02-26 18:30:12.697031 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2026-02-26 18:30:12.746832 | controller |
2026-02-26 18:30:12.746848 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2026-02-26 18:30:12.746856 | controller | Thursday 26 February 2026  18:30:12 +0000 (0:00:00.084)       0:00:47.812 *****
2026-02-26 18:30:12.746864 | controller | ok: [instance] => (item=public)
2026-02-26 18:30:13.253195 | controller | ok: [instance] => (item=osp_trunk)
2026-02-26 18:30:13.253256 | controller |
2026-02-26 18:30:13.253271 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2026-02-26 18:30:13.253282 | controller | Thursday 26 February 2026  18:30:12 +0000 (0:00:00.049)       0:00:47.862 *****
2026-02-26 18:30:13.253300 | controller | changed: [instance] => (item=cifmw-public)
2026-02-26 18:30:13.898647 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:30:13.898681 | controller |
2026-02-26 18:30:13.898689 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2026-02-26 18:30:13.898695 | controller | Thursday 26 February 2026  18:30:13 +0000 (0:00:00.506)       0:00:48.368 *****
2026-02-26 18:30:13.898705 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 18:30:14.339563 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:30:14.339592 | controller |
2026-02-26 18:30:14.339600 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2026-02-26 18:30:14.339607 | controller | Thursday 26 February 2026  18:30:13 +0000 (0:00:00.645)       0:00:49.014 *****
2026-02-26 18:30:14.339623 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 18:30:14.802164 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:30:14.802212 | controller |
2026-02-26 18:30:14.802226 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2026-02-26 18:30:14.802237 | controller | Thursday 26 February 2026  18:30:14 +0000 (0:00:00.441)       0:00:49.455 *****
2026-02-26 18:30:14.802253 | controller | changed: [instance] => (item=cifmw-public)
2026-02-26 18:30:14.866140 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:30:14.866176 | controller |
2026-02-26 18:30:14.866185 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2026-02-26 18:30:14.866193 | controller | Thursday 26 February 2026  18:30:14 +0000 (0:00:00.462)       0:00:49.917 *****
2026-02-26 18:30:14.866205 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2026-02-26 18:30:15.060584 | controller |
2026-02-26 18:30:15.060617 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2026-02-26 18:30:15.060625 | controller | Thursday 26 February 2026  18:30:14 +0000 (0:00:00.064)       0:00:49.981 *****
2026-02-26 18:30:15.060635 | controller | ok: [instance]
2026-02-26 18:30:15.445180 | controller |
2026-02-26 18:30:15.445252 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2026-02-26 18:30:15.445267 | controller | Thursday 26 February 2026  18:30:15 +0000 (0:00:00.194)       0:00:50.176 *****
2026-02-26 18:30:15.445287 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 18:30:15.518114 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:30:15.518175 | controller |
2026-02-26 18:30:15.518187 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2026-02-26 18:30:15.518195 | controller | Thursday 26 February 2026  18:30:15 +0000 (0:00:00.384)       0:00:50.560 *****
2026-02-26 18:30:15.518209 | controller |
2026-02-26 18:30:15.518240 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-02-26 18:30:15.518333 | controller | Thursday 26 February 2026  18:30:15 +0000 (0:00:00.073)       0:00:50.634 *****
2026-02-26 18:30:15.569798 | controller | skipping: [instance]
2026-02-26 18:30:16.911035 | controller |
2026-02-26 18:30:16.911074 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2026-02-26 18:30:16.911082 | controller | Thursday 26 February 2026  18:30:15 +0000 (0:00:00.051)       0:00:50.685 *****
2026-02-26 18:30:16.911093 | controller | ok: [instance]
2026-02-26 18:30:17.119117 | controller |
2026-02-26 18:30:17.119161 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-02-26 18:30:17.119172 | controller | Thursday 26 February 2026  18:30:16 +0000 (0:00:01.340)       0:00:52.026 *****
2026-02-26 18:30:17.119186 | controller | ok: [instance]
2026-02-26 18:30:17.119220 | controller |
2026-02-26 18:30:17.119231 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2026-02-26 18:30:17.119260 | controller | Thursday 26 February 2026  18:30:17 +0000 (0:00:00.208)       0:00:52.234 *****
2026-02-26 18:30:17.488077 | controller | changed: [instance]
2026-02-26 18:30:19.147116 | controller |
2026-02-26 18:30:19.147159 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2026-02-26 18:30:19.147170 | controller | Thursday 26 February 2026  18:30:17 +0000 (0:00:00.368)       0:00:52.603 *****
2026-02-26 18:30:19.147183 | controller | changed: [instance]
2026-02-26 18:30:19.147214 | controller |
2026-02-26 18:30:19.147227 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2026-02-26 18:30:19.147318 | controller | Thursday 26 February 2026  18:30:19 +0000 (0:00:01.659)       0:00:54.262 *****
2026-02-26 18:30:19.501608 | controller | changed: [instance]
2026-02-26 18:30:19.539092 | controller |
2026-02-26 18:30:19.539121 | controller | TASK [Create extra network configuration] **************************************
2026-02-26 18:30:19.539132 | controller | Thursday 26 February 2026  18:30:19 +0000 (0:00:00.354)       0:00:54.617 *****
2026-02-26 18:30:19.539143 | controller | skipping: [instance]
2026-02-26 18:30:19.572112 | controller |
2026-02-26 18:30:19.572132 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2026-02-26 18:30:19.572141 | controller | Thursday 26 February 2026  18:30:19 +0000 (0:00:00.037)       0:00:54.654 *****
2026-02-26 18:30:19.572151 | controller | skipping: [instance]
2026-02-26 18:30:19.572214 | controller |
2026-02-26 18:30:19.572229 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2026-02-26 18:30:19.572239 | controller | Thursday 26 February 2026  18:30:19 +0000 (0:00:00.032)       0:00:54.687 *****
2026-02-26 18:30:20.035167 | controller | ok: [instance]
2026-02-26 18:30:20.180155 | controller |
2026-02-26 18:30:20.180209 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2026-02-26 18:30:20.180224 | controller | Thursday 26 February 2026  18:30:20 +0000 (0:00:00.463)       0:00:55.150 *****
2026-02-26 18:30:20.180243 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 18:30:21.388530 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:30:21.388557 | controller |
2026-02-26 18:30:21.388565 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2026-02-26 18:30:21.388577 | controller | Thursday 26 February 2026  18:30:20 +0000 (0:00:00.144)       0:00:55.295 *****
2026-02-26 18:30:21.388586 | controller | ok: [instance]
2026-02-26 18:30:25.019553 | controller |
2026-02-26 18:30:25.019585 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2026-02-26 18:30:25.019593 | controller | Thursday 26 February 2026  18:30:21 +0000 (0:00:01.208)       0:00:56.503 *****
2026-02-26 18:30:25.019603 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2026-02-26 18:30:25.225632 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2026-02-26 18:30:25.225662 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2026-02-26 18:30:25.225670 | controller |
2026-02-26 18:30:25.225676 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2026-02-26 18:30:25.225681 | controller | Thursday 26 February 2026  18:30:25 +0000 (0:00:03.631)       0:01:00.134 *****
2026-02-26 18:30:25.225690 | controller | changed: [instance]
2026-02-26 18:30:25.579494 | controller |
2026-02-26 18:30:25.579526 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2026-02-26 18:30:25.579534 | controller | Thursday 26 February 2026  18:30:25 +0000 (0:00:00.206)       0:01:00.341 *****
2026-02-26 18:30:25.579544 | controller | changed: [instance]
2026-02-26 18:30:25.950055 | controller |
2026-02-26 18:30:25.950091 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2026-02-26 18:30:25.950101 | controller | Thursday 26 February 2026  18:30:25 +0000 (0:00:00.353)       0:01:00.695 *****
2026-02-26 18:30:25.950114 | controller | changed: [instance]
2026-02-26 18:30:25.982747 | controller |
2026-02-26 18:30:25.982797 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2026-02-26 18:30:25.982811 | controller | Thursday 26 February 2026  18:30:25 +0000 (0:00:00.370)       0:01:01.065 *****
2026-02-26 18:30:25.982827 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2026-02-26 18:30:26.384574 | controller |
2026-02-26 18:30:26.384608 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2026-02-26 18:30:26.384615 | controller | Thursday 26 February 2026  18:30:25 +0000 (0:00:00.032)       0:01:01.098 *****
2026-02-26 18:30:26.384625 | controller | changed: [instance]
2026-02-26 18:30:26.405826 | controller |
2026-02-26 18:30:26.405843 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2026-02-26 18:30:26.405849 | controller | Thursday 26 February 2026  18:30:26 +0000 (0:00:00.401)       0:01:01.500 *****
2026-02-26 18:30:26.405857 | controller | skipping: [instance]
2026-02-26 18:30:26.439845 | controller |
2026-02-26 18:30:26.439874 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2026-02-26 18:30:26.439887 | controller | Thursday 26 February 2026  18:30:26 +0000 (0:00:00.021)       0:01:01.521 *****
2026-02-26 18:30:26.439901 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2026-02-26 18:30:26.799202 | controller |
2026-02-26 18:30:26.799228 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2026-02-26 18:30:26.799236 | controller | Thursday 26 February 2026  18:30:26 +0000 (0:00:00.033)       0:01:01.555 *****
2026-02-26 18:30:26.799245 | controller | changed: [instance]
2026-02-26 18:30:26.820040 | controller |
2026-02-26 18:30:26.820076 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2026-02-26 18:30:26.820086 | controller | Thursday 26 February 2026  18:30:26 +0000 (0:00:00.359)       0:01:01.915 *****
2026-02-26 18:30:26.820103 | controller | skipping: [instance]
2026-02-26 18:30:26.820187 | controller |
2026-02-26 18:30:26.820206 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2026-02-26 18:30:26.820219 | controller | Thursday 26 February 2026  18:30:26 +0000 (0:00:00.021)       0:01:01.936 *****
2026-02-26 18:30:27.026034 | controller | ok: [instance] => (item=127.0.0.2)
2026-02-26 18:30:27.026087 | controller |
2026-02-26 18:30:27.026330 | controller | TASK [dnsmasq : Enable and start service] **************************************
2026-02-26 18:30:27.695010 | controller | Thursday 26 February 2026  18:30:27 +0000 (0:00:00.205)       0:01:02.142 *****
2026-02-26 18:30:27.695050 | controller | changed: [instance]
2026-02-26 18:30:27.715086 | controller |
2026-02-26 18:30:27.715121 | controller | TASK [dnsmasq : Stop service] **************************************************
2026-02-26 18:30:27.715131 | controller | Thursday 26 February 2026  18:30:27 +0000 (0:00:00.668)       0:01:02.810 *****
2026-02-26 18:30:27.715143 | controller | skipping: [instance]
2026-02-26 18:30:27.715171 | controller |
2026-02-26 18:30:27.715180 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2026-02-26 18:30:27.715278 | controller | Thursday 26 February 2026  18:30:27 +0000 (0:00:00.020)       0:01:02.831 *****
2026-02-26 18:30:27.734887 | controller | skipping: [instance]
2026-02-26 18:30:27.766847 | controller |
2026-02-26 18:30:27.766863 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2026-02-26 18:30:27.766870 | controller | Thursday 26 February 2026  18:30:27 +0000 (0:00:00.019)       0:01:02.850 *****
2026-02-26 18:30:27.766884 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-02-26 18:30:27.877874 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2026-02-26 18:30:27.877900 | controller | skipping: [instance]
2026-02-26 18:30:27.877907 | controller |
2026-02-26 18:30:27.877912 | controller | TASK [Create dnsmasq networks] *************************************************
2026-02-26 18:30:27.877917 | controller | Thursday 26 February 2026  18:30:27 +0000 (0:00:00.031)       0:01:02.882 *****
2026-02-26 18:30:27.877925 | controller |
2026-02-26 18:30:27.907979 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-02-26 18:30:27.907997 | controller | Thursday 26 February 2026  18:30:27 +0000 (0:00:00.111)       0:01:02.993 *****
2026-02-26 18:30:27.908008 | controller | ok: [instance] => changed=false
2026-02-26 18:30:27.944545 | controller |   msg: All assertions passed
2026-02-26 18:30:27.944577 | controller |
2026-02-26 18:30:27.944591 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-02-26 18:30:27.944601 | controller | Thursday 26 February 2026  18:30:27 +0000 (0:00:00.029)       0:01:03.023 *****
2026-02-26 18:30:27.944616 | controller | ok: [instance] => changed=false
2026-02-26 18:30:27.944863 | controller |   msg: All assertions passed
2026-02-26 18:30:27.945146 | controller |
2026-02-26 18:30:27.945403 | controller | TASK [dnsmasq : Create network] ************************************************
2026-02-26 18:30:27.945592 | controller | Thursday 26 February 2026  18:30:27 +0000 (0:00:00.037)       0:01:03.060 *****
2026-02-26 18:30:28.365544 | controller | changed: [instance]
2026-02-26 18:30:28.384875 | controller |
2026-02-26 18:30:28.384889 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-02-26 18:30:28.384897 | controller | Thursday 26 February 2026  18:30:28 +0000 (0:00:00.420)       0:01:03.481 *****
2026-02-26 18:30:28.384905 | controller | skipping: [instance]
2026-02-26 18:30:28.409865 | controller |
2026-02-26 18:30:28.409883 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-02-26 18:30:28.409891 | controller | Thursday 26 February 2026  18:30:28 +0000 (0:00:00.019)       0:01:03.500 *****
2026-02-26 18:30:28.409899 | controller | skipping: [instance]
2026-02-26 18:30:28.441493 | controller |
2026-02-26 18:30:28.441541 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-02-26 18:30:28.441556 | controller | Thursday 26 February 2026  18:30:28 +0000 (0:00:00.024)       0:01:03.525 *****
2026-02-26 18:30:28.441574 | controller | ok: [instance] => changed=false
2026-02-26 18:30:28.441617 | controller |   msg: All assertions passed
2026-02-26 18:30:28.441628 | controller |
2026-02-26 18:30:28.441641 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-02-26 18:30:28.478068 | controller | Thursday 26 February 2026  18:30:28 +0000 (0:00:00.031)       0:01:03.557 *****
2026-02-26 18:30:28.478098 | controller | ok: [instance] => changed=false
2026-02-26 18:30:28.908808 | controller |   msg: All assertions passed
2026-02-26 18:30:28.908836 | controller |
2026-02-26 18:30:28.908844 | controller | TASK [dnsmasq : Create network] ************************************************
2026-02-26 18:30:28.908850 | controller | Thursday 26 February 2026  18:30:28 +0000 (0:00:00.036)       0:01:03.593 *****
2026-02-26 18:30:28.908860 | controller | changed: [instance]
2026-02-26 18:30:28.928426 | controller |
2026-02-26 18:30:28.928450 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-02-26 18:30:28.928460 | controller | Thursday 26 February 2026  18:30:28 +0000 (0:00:00.430)       0:01:04.024 *****
2026-02-26 18:30:28.928471 | controller | skipping: [instance]
2026-02-26 18:30:28.952916 | controller |
2026-02-26 18:30:28.952934 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-02-26 18:30:28.952941 | controller | Thursday 26 February 2026  18:30:28 +0000 (0:00:00.019)       0:01:04.044 *****
2026-02-26 18:30:28.952968 | controller | skipping: [instance]
2026-02-26 18:30:28.983724 | controller |
2026-02-26 18:30:28.983746 | controller | TASK [Deploy radvd for IPv6 router advertisements] *****************************
2026-02-26 18:30:28.983755 | controller | Thursday 26 February 2026  18:30:28 +0000 (0:00:00.024)       0:01:04.068 *****
2026-02-26 18:30:28.983766 | controller | skipping: [instance]
2026-02-26 18:30:29.486546 | controller |
2026-02-26 18:30:29.486690 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2026-02-26 18:30:29.486700 | controller | Thursday 26 February 2026  18:30:28 +0000 (0:00:00.030)       0:01:04.099 *****
2026-02-26 18:30:29.486711 | controller | changed: [instance] => (item=cifmw-public)
2026-02-26 18:30:29.522002 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:30:29.522033 | controller |
2026-02-26 18:30:29.522040 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-02-26 18:30:29.522046 | controller | Thursday 26 February 2026  18:30:29 +0000 (0:00:00.501)       0:01:04.600 *****
2026-02-26 18:30:29.522056 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2026-02-26 18:30:29.834337 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2026-02-26 18:30:29.834369 | controller |
2026-02-26 18:30:29.834377 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-02-26 18:30:29.834383 | controller | Thursday 26 February 2026  18:30:29 +0000 (0:00:00.036)       0:01:04.637 *****
2026-02-26 18:30:29.834394 | controller | ok: [instance]
2026-02-26 18:30:29.868712 | controller |
2026-02-26 18:30:29.868740 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-02-26 18:30:29.868757 | controller | Thursday 26 February 2026  18:30:29 +0000 (0:00:00.312)       0:01:04.949 *****
2026-02-26 18:30:29.868769 | controller | ok: [instance]
2026-02-26 18:30:30.062778 | controller |
2026-02-26 18:30:30.062801 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-02-26 18:30:30.062809 | controller | Thursday 26 February 2026  18:30:29 +0000 (0:00:00.034)       0:01:04.984 *****
2026-02-26 18:30:30.062818 | controller | ok: [instance]
2026-02-26 18:30:30.096779 | controller |
2026-02-26 18:30:30.096800 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-02-26 18:30:30.096808 | controller | Thursday 26 February 2026  18:30:30 +0000 (0:00:00.194)       0:01:05.178 *****
2026-02-26 18:30:30.096819 | controller | ok: [instance]
2026-02-26 18:30:30.426617 | controller |
2026-02-26 18:30:30.426649 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2026-02-26 18:30:30.426657 | controller | Thursday 26 February 2026  18:30:30 +0000 (0:00:00.034)       0:01:05.212 *****
2026-02-26 18:30:30.426667 | controller | changed: [instance]
2026-02-26 18:30:30.751011 | controller |
2026-02-26 18:30:30.751040 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2026-02-26 18:30:30.751051 | controller | Thursday 26 February 2026  18:30:30 +0000 (0:00:00.329)       0:01:05.542 *****
2026-02-26 18:30:30.751061 | controller | changed: [instance]
2026-02-26 18:30:31.072416 | controller |
2026-02-26 18:30:31.072435 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2026-02-26 18:30:31.072441 | controller | Thursday 26 February 2026  18:30:30 +0000 (0:00:00.324)       0:01:05.866 *****
2026-02-26 18:30:31.072449 | controller | changed: [instance]
2026-02-26 18:30:31.162381 | controller |
2026-02-26 18:30:31.162401 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2026-02-26 18:30:31.162409 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.321)       0:01:06.188 *****
2026-02-26 18:30:31.162420 | controller | ok: [instance]
2026-02-26 18:30:31.487346 | controller |
2026-02-26 18:30:31.487368 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2026-02-26 18:30:31.487376 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.089)       0:01:06.278 *****
2026-02-26 18:30:31.487385 | controller | changed: [instance]
2026-02-26 18:30:31.512135 | controller |
2026-02-26 18:30:31.512173 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-02-26 18:30:31.512182 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.324)       0:01:06.603 *****
2026-02-26 18:30:31.512194 | controller | skipping: [instance]
2026-02-26 18:30:31.535889 | controller |
2026-02-26 18:30:31.535909 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-02-26 18:30:31.535916 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.024)       0:01:06.627 *****
2026-02-26 18:30:31.535925 | controller | skipping: [instance]
2026-02-26 18:30:31.560658 | controller |
2026-02-26 18:30:31.560678 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-02-26 18:30:31.560687 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.023)       0:01:06.651 *****
2026-02-26 18:30:31.560697 | controller | skipping: [instance]
2026-02-26 18:30:31.586503 | controller |
2026-02-26 18:30:31.586520 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-02-26 18:30:31.586528 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.024)       0:01:06.676 *****
2026-02-26 18:30:31.586536 | controller | skipping: [instance]
2026-02-26 18:30:31.605932 | controller |
2026-02-26 18:30:31.605965 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-02-26 18:30:31.605974 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.025)       0:01:06.701 *****
2026-02-26 18:30:31.605983 | controller | ok: [instance]
2026-02-26 18:30:31.693959 | controller |
2026-02-26 18:30:31.693981 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-02-26 18:30:31.693989 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.019)       0:01:06.721 *****
2026-02-26 18:30:31.694000 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-02-26 18:30:31.712041 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2026-02-26 18:30:31.712089 | controller |
2026-02-26 18:30:31.712099 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-02-26 18:30:31.712107 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.087)       0:01:06.809 *****
2026-02-26 18:30:31.712120 | controller | skipping: [instance]
2026-02-26 18:30:31.909533 | controller |
2026-02-26 18:30:31.909573 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-02-26 18:30:31.909581 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.018)       0:01:06.827 *****
2026-02-26 18:30:31.909598 | controller | ok: [instance]
2026-02-26 18:30:32.290233 | controller |
2026-02-26 18:30:32.290263 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-02-26 18:30:32.290283 | controller | Thursday 26 February 2026  18:30:31 +0000 (0:00:00.197)       0:01:07.025 *****
2026-02-26 18:30:32.290293 | controller | changed: [instance]
2026-02-26 18:30:32.349645 | controller |
2026-02-26 18:30:32.349667 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-02-26 18:30:32.349677 | controller | Thursday 26 February 2026  18:30:32 +0000 (0:00:00.380)       0:01:07.405 *****
2026-02-26 18:30:32.349687 | controller | ok: [instance]
2026-02-26 18:30:32.381031 | controller |
2026-02-26 18:30:32.381051 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-02-26 18:30:32.381060 | controller | Thursday 26 February 2026  18:30:32 +0000 (0:00:00.059)       0:01:07.465 *****
2026-02-26 18:30:32.381071 | controller | ok: [instance]
2026-02-26 18:30:32.381099 | controller |
2026-02-26 18:30:32.381347 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-02-26 18:30:32.820021 | controller | Thursday 26 February 2026  18:30:32 +0000 (0:00:00.031)       0:01:07.497 *****
2026-02-26 18:30:32.820057 | controller | changed: [instance]
2026-02-26 18:30:32.851319 | controller |
2026-02-26 18:30:32.851337 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2026-02-26 18:30:32.851345 | controller | Thursday 26 February 2026  18:30:32 +0000 (0:00:00.438)       0:01:07.935 *****
2026-02-26 18:30:32.851356 | controller | ok: [instance]
2026-02-26 18:30:32.872162 | controller |
2026-02-26 18:30:32.872196 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2026-02-26 18:30:32.872205 | controller | Thursday 26 February 2026  18:30:32 +0000 (0:00:00.031)       0:01:07.967 *****
2026-02-26 18:30:32.872215 | controller | ok: [instance]
2026-02-26 18:30:32.893075 | controller |
2026-02-26 18:30:32.893101 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2026-02-26 18:30:32.893111 | controller | Thursday 26 February 2026  18:30:32 +0000 (0:00:00.020)       0:01:07.987 *****
2026-02-26 18:30:32.893122 | controller | ok: [instance]
2026-02-26 18:30:32.893141 | controller |
2026-02-26 18:30:32.893148 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2026-02-26 18:30:32.893162 | controller | Thursday 26 February 2026  18:30:32 +0000 (0:00:00.021)       0:01:08.009 *****
2026-02-26 18:30:32.970140 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2026-02-26 18:30:32.970821 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2026-02-26 18:30:32.970836 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2026-02-26 18:30:32.970847 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2026-02-26 18:30:33.109134 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2026-02-26 18:30:33.109175 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2026-02-26 18:30:33.109184 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2026-02-26 18:30:33.109191 | controller |
2026-02-26 18:30:33.109199 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 18:30:33.109207 | controller | Thursday 26 February 2026  18:30:32 +0000 (0:00:00.076)       0:01:08.085 *****
2026-02-26 18:30:33.109219 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2026-02-26 18:30:33.109250 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2026-02-26 18:30:33.109260 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2026-02-26 18:30:33.109302 | controller |
2026-02-26 18:30:33.109403 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 18:30:33.109546 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.139)       0:01:08.225 *****
2026-02-26 18:30:33.194179 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2026-02-26 18:30:33.194425 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2026-02-26 18:30:33.194627 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2026-02-26 18:30:33.194805 | controller | skipping: [instance]
2026-02-26 18:30:33.194904 | controller |
2026-02-26 18:30:33.195034 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 18:30:33.195141 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.084)       0:01:08.310 *****
2026-02-26 18:30:33.280383 | controller | skipping: [instance] => (item=compute-0 - storage)
2026-02-26 18:30:33.280513 | controller | skipping: [instance] => (item=controller-0 - storage)
2026-02-26 18:30:33.280622 | controller | skipping: [instance] => (item=crc-0 - storage)
2026-02-26 18:30:33.280731 | controller | skipping: [instance]
2026-02-26 18:30:33.280830 | controller |
2026-02-26 18:30:33.280936 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 18:30:33.281081 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.086)       0:01:08.396 *****
2026-02-26 18:30:33.363202 | controller | skipping: [instance] => (item=compute-0 - tenant)
2026-02-26 18:30:33.363341 | controller | skipping: [instance] => (item=controller-0 - tenant)
2026-02-26 18:30:33.363453 | controller | skipping: [instance] => (item=crc-0 - tenant)
2026-02-26 18:30:33.363569 | controller | skipping: [instance]
2026-02-26 18:30:33.363669 | controller |
2026-02-26 18:30:33.363766 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 18:30:33.363869 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.082)       0:01:08.479 *****
2026-02-26 18:30:33.445152 | controller | skipping: [instance] => (item=compute-0 - external)
2026-02-26 18:30:33.445276 | controller | skipping: [instance] => (item=controller-0 - external)
2026-02-26 18:30:33.445403 | controller | skipping: [instance] => (item=crc-0 - external)
2026-02-26 18:30:33.445512 | controller | skipping: [instance]
2026-02-26 18:30:33.445611 | controller |
2026-02-26 18:30:33.445707 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 18:30:33.445812 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.081)       0:01:08.561 *****
2026-02-26 18:30:33.525648 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2026-02-26 18:30:33.525741 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2026-02-26 18:30:33.525877 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2026-02-26 18:30:33.525960 | controller | skipping: [instance]
2026-02-26 18:30:33.526068 | controller |
2026-02-26 18:30:33.526173 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-02-26 18:30:33.526273 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.080)       0:01:08.641 *****
2026-02-26 18:30:33.659964 | controller | ok: [instance] => (item=compute-0 - public)
2026-02-26 18:30:33.660066 | controller | ok: [instance] => (item=controller-0 - public)
2026-02-26 18:30:33.660168 | controller | ok: [instance] => (item=crc-0 - public)
2026-02-26 18:30:33.660272 | controller |
2026-02-26 18:30:33.660382 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2026-02-26 18:30:33.660487 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.134)       0:01:08.776 *****
2026-02-26 18:30:33.772218 | controller |
2026-02-26 18:30:33.772477 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2026-02-26 18:30:33.772683 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.112)       0:01:08.888 *****
2026-02-26 18:30:33.810101 | controller | ok: [instance]
2026-02-26 18:30:33.810367 | controller |
2026-02-26 18:30:33.810579 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2026-02-26 18:30:33.810777 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.037)       0:01:08.926 *****
2026-02-26 18:30:33.906761 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:a3:75:ee', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-02-26 18:30:33.907097 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:fd:75:f8', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-02-26 18:30:33.907311 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:8b:35:6e', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-02-26 18:30:33.907393 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:3e:ec:8b', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-02-26 18:30:33.907520 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:1c:31:f9', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-02-26 18:30:33.907621 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:2d:ee:47', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-02-26 18:30:33.907705 | controller |
2026-02-26 18:30:33.907823 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2026-02-26 18:30:33.907926 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.096)       0:01:09.022 *****
2026-02-26 18:30:33.958316 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2026-02-26 18:30:33.958513 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2026-02-26 18:30:33.958592 | controller |
2026-02-26 18:30:33.958706 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-02-26 18:30:33.958808 | controller | Thursday 26 February 2026  18:30:33 +0000 (0:00:00.051)       0:01:09.074 *****
2026-02-26 18:30:34.135826 | controller | ok: [instance]
2026-02-26 18:30:34.160088 | controller |
2026-02-26 18:30:34.160109 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-02-26 18:30:34.160119 | controller | Thursday 26 February 2026  18:30:34 +0000 (0:00:00.177)       0:01:09.251 *****
2026-02-26 18:30:34.160129 | controller | ok: [instance]
2026-02-26 18:30:34.332557 | controller |
2026-02-26 18:30:34.332577 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-02-26 18:30:34.332586 | controller | Thursday 26 February 2026  18:30:34 +0000 (0:00:00.024)       0:01:09.275 *****
2026-02-26 18:30:34.332595 | controller | ok: [instance]
2026-02-26 18:30:34.355490 | controller |
2026-02-26 18:30:34.355512 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-02-26 18:30:34.355521 | controller | Thursday 26 February 2026  18:30:34 +0000 (0:00:00.172)       0:01:09.448 *****
2026-02-26 18:30:34.355532 | controller | ok: [instance]
2026-02-26 18:30:34.373518 | controller |
2026-02-26 18:30:34.373538 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2026-02-26 18:30:34.373546 | controller | Thursday 26 February 2026  18:30:34 +0000 (0:00:00.022)       0:01:09.471 *****
2026-02-26 18:30:34.373556 | controller | ok: [instance]
2026-02-26 18:30:34.550052 | controller |
2026-02-26 18:30:34.550082 | controller | TASK [dnsmasq : Compute entry] *************************************************
2026-02-26 18:30:34.550090 | controller | Thursday 26 February 2026  18:30:34 +0000 (0:00:00.018)       0:01:09.489 *****
2026-02-26 18:30:34.550100 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:a3:75:ee', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-02-26 18:30:34.550123 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:fd:75:f8', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-02-26 18:30:34.550129 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:8b:35:6e', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-02-26 18:30:34.550135 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:3e:ec:8b', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-02-26 18:30:34.550140 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:1c:31:f9', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-02-26 18:30:34.550145 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:2d:ee:47', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-02-26 18:30:34.550151 | controller |
2026-02-26 18:30:34.550158 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2026-02-26 18:30:34.550231 | controller | Thursday 26 February 2026  18:30:34 +0000 (0:00:00.176)       0:01:09.665 *****
2026-02-26 18:30:34.586736 | controller | ok: [instance]
2026-02-26 18:30:36.555988 | controller |
2026-02-26 18:30:36.556020 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2026-02-26 18:30:36.556028 | controller | Thursday 26 February 2026  18:30:34 +0000 (0:00:00.036)       0:01:09.702 *****
2026-02-26 18:30:36.556047 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:a3:75:ee', 'entry': 'set:compute,52:54:00:a3:75:ee,192.168.140.100,compute-0', 'state': 'present'})
2026-02-26 18:30:36.578575 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:fd:75:f8', 'entry': 'set:controller,52:54:01:fd:75:f8,192.168.140.9,controller-0', 'state': 'present'})
2026-02-26 18:30:36.578592 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:8b:35:6e', 'entry': 'set:ocp,52:54:02:8b:35:6e,192.168.140.10,crc-0', 'state': 'present'})
2026-02-26 18:30:36.578599 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:3e:ec:8b', 'entry': 'set:compute,52:54:00:3e:ec:8b,192.168.101.100,compute-0', 'state': 'present'})
2026-02-26 18:30:36.578605 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:1c:31:f9', 'entry': 'set:controller,52:54:01:1c:31:f9,192.168.101.9,controller-0', 'state': 'present'})
2026-02-26 18:30:36.578610 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:2d:ee:47', 'entry': 'set:ocp,52:54:02:2d:ee:47,192.168.101.10,crc-0', 'state': 'present'})
2026-02-26 18:30:36.578616 | controller |
2026-02-26 18:30:36.578621 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2026-02-26 18:30:36.578631 | controller | Thursday 26 February 2026  18:30:36 +0000 (0:00:01.968)       0:01:11.671 *****
2026-02-26 18:30:36.578639 | controller | skipping: [instance]
2026-02-26 18:30:36.789174 | controller |
2026-02-26 18:30:36.789221 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2026-02-26 18:30:36.789236 | controller | Thursday 26 February 2026  18:30:36 +0000 (0:00:00.023)       0:01:11.694 *****
2026-02-26 18:30:36.789270 | controller | ok: [instance] => (item=compute-0)
2026-02-26 18:30:36.906729 | controller | ok: [instance] => (item=controller-0)
2026-02-26 18:30:36.906757 | controller | ok: [instance] => (item=crc-0)
2026-02-26 18:30:36.906765 | controller |
2026-02-26 18:30:36.906772 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2026-02-26 18:30:36.906778 | controller | Thursday 26 February 2026  18:30:36 +0000 (0:00:00.209)       0:01:11.904 *****
2026-02-26 18:30:36.906787 | controller |
2026-02-26 18:30:36.972719 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-02-26 18:30:36.972754 | controller | Thursday 26 February 2026  18:30:36 +0000 (0:00:00.118)       0:01:12.022 *****
2026-02-26 18:30:36.972775 | controller | ok: [instance]
2026-02-26 18:30:37.168084 | controller |
2026-02-26 18:30:37.168106 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-02-26 18:30:37.168115 | controller | Thursday 26 February 2026  18:30:36 +0000 (0:00:00.065)       0:01:12.088 *****
2026-02-26 18:30:37.168126 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 18:30:37.168153 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 18:30:37.168160 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-02-26 18:30:37.168167 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-02-26 18:30:37.168173 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-02-26 18:30:37.168185 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-02-26 18:30:37.168191 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-02-26 18:30:37.168200 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 18:30:37.168207 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 18:30:37.168213 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-02-26 18:30:37.168219 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 18:30:37.168228 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 18:30:37.168262 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-02-26 18:30:37.168783 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-02-26 18:30:40.123064 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-02-26 18:30:40.123106 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-02-26 18:30:40.123115 | controller |
2026-02-26 18:30:40.123123 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-02-26 18:30:40.123131 | controller | Thursday 26 February 2026  18:30:37 +0000 (0:00:00.194)       0:01:12.283 *****
2026-02-26 18:30:40.123143 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 18:30:40.123172 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 18:30:40.123185 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-02-26 18:30:40.123194 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-02-26 18:30:40.124036 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-02-26 18:30:40.124482 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-02-26 18:30:40.124511 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-02-26 18:30:40.124519 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 18:30:40.124525 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 18:30:40.124531 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-02-26 18:30:40.124536 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 18:30:40.124542 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 18:30:40.124547 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-02-26 18:30:40.124552 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-02-26 18:30:40.124562 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-02-26 18:30:40.470065 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-02-26 18:30:40.470093 | controller |
2026-02-26 18:30:40.470101 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-02-26 18:30:40.470107 | controller | Thursday 26 February 2026  18:30:40 +0000 (0:00:02.955)       0:01:15.238 *****
2026-02-26 18:30:40.470117 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 18:30:40.470142 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-02-26 18:30:40.470153 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-02-26 18:30:40.470161 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-02-26 18:30:40.470183 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-02-26 18:30:40.471426 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-02-26 18:30:40.490571 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-02-26 18:30:40.490589 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 18:30:40.490597 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 18:30:40.490603 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-02-26 18:30:40.490609 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 18:30:40.490614 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-02-26 18:30:40.490619 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-02-26 18:30:40.490625 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-02-26 18:30:40.490630 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-02-26 18:30:40.490636 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-02-26 18:30:40.490645 | controller |
2026-02-26 18:30:40.490651 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] ****************
2026-02-26 18:30:40.490657 | controller | Thursday 26 February 2026  18:30:40 +0000 (0:00:00.346)       0:01:15.585 *****
2026-02-26 18:30:40.490666 | controller | ok: [instance]
2026-02-26 18:30:40.535033 | controller |
2026-02-26 18:30:40.535056 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] **************
2026-02-26 18:30:40.535064 | controller | Thursday 26 February 2026  18:30:40 +0000 (0:00:00.020)       0:01:15.606 *****
2026-02-26 18:30:40.535073 | controller | skipping: [instance] => (item=compute)
2026-02-26 18:30:40.535097 | controller | skipping: [instance] => (item=controller)
2026-02-26 18:30:40.535104 | controller | skipping: [instance] => (item=crc)
2026-02-26 18:30:40.535109 | controller | skipping: [instance]
2026-02-26 18:30:40.535117 | controller |
2026-02-26 18:30:40.535357 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] *******
2026-02-26 18:30:40.565566 | controller | Thursday 26 February 2026  18:30:40 +0000 (0:00:00.044)       0:01:15.650 *****
2026-02-26 18:30:40.565592 | controller | skipping: [instance]
2026-02-26 18:30:40.928044 | controller |
2026-02-26 18:30:40.928075 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2026-02-26 18:30:40.928084 | controller | Thursday 26 February 2026  18:30:40 +0000 (0:00:00.030)       0:01:15.681 *****
2026-02-26 18:30:40.928100 | controller | changed: [instance]
2026-02-26 18:30:40.928134 | controller |
2026-02-26 18:30:40.928144 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2026-02-26 18:30:40.928524 | controller | Thursday 26 February 2026  18:30:40 +0000 (0:00:00.352)       0:01:16.033 *****
2026-02-26 18:30:41.545239 | controller |
2026-02-26 18:30:41.545274 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-02-26 18:30:41.545284 | controller | Thursday 26 February 2026  18:30:40 +0000 (0:00:00.010)       0:01:16.043 *****
2026-02-26 18:30:41.545297 | controller | changed: [instance]
2026-02-26 18:30:41.886882 | controller |
2026-02-26 18:30:41.886920 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-02-26 18:30:41.886930 | controller | Thursday 26 February 2026  18:30:41 +0000 (0:00:00.616)       0:01:16.660 *****
2026-02-26 18:30:41.886965 | controller | changed: [instance]
2026-02-26 18:30:42.221597 | controller |
2026-02-26 18:30:42.221623 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2026-02-26 18:30:42.221631 | controller | Thursday 26 February 2026  18:30:41 +0000 (0:00:00.341)       0:01:17.002 *****
2026-02-26 18:30:42.221640 | controller | changed: [instance]
2026-02-26 18:30:42.567836 | controller |
2026-02-26 18:30:42.567859 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2026-02-26 18:30:42.567867 | controller | Thursday 26 February 2026  18:30:42 +0000 (0:00:00.335)       0:01:17.337 *****
2026-02-26 18:30:42.567876 | controller | changed: [instance]
2026-02-26 18:30:42.928450 | controller |
2026-02-26 18:30:42.928480 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2026-02-26 18:30:42.928488 | controller | Thursday 26 February 2026  18:30:42 +0000 (0:00:00.346)       0:01:17.683 *****
2026-02-26 18:30:42.928499 | controller | changed: [instance]
2026-02-26 18:30:42.960934 | controller |
2026-02-26 18:30:42.960977 | controller | TASK [Build utility records dataset] *******************************************
2026-02-26 18:30:42.960985 | controller | Thursday 26 February 2026  18:30:42 +0000 (0:00:00.360)       0:01:18.044 *****
2026-02-26 18:30:42.960995 | controller |
2026-02-26 18:30:43.049800 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-02-26 18:30:43.049825 | controller | Thursday 26 February 2026  18:30:42 +0000 (0:00:00.032)       0:01:18.076 *****
2026-02-26 18:30:43.049836 | controller | ok: [instance]
2026-02-26 18:30:43.143101 | controller |
2026-02-26 18:30:43.143138 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-02-26 18:30:43.143147 | controller | Thursday 26 February 2026  18:30:43 +0000 (0:00:00.088)       0:01:18.165 *****
2026-02-26 18:30:43.143165 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-02-26 18:30:43.585032 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 18:30:43.585067 | controller |
2026-02-26 18:30:43.585077 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-02-26 18:30:43.585084 | controller | Thursday 26 February 2026  18:30:43 +0000 (0:00:00.093)       0:01:18.258 *****
2026-02-26 18:30:43.585096 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-02-26 18:30:43.870092 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 18:30:43.870125 | controller |
2026-02-26 18:30:43.870135 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-02-26 18:30:43.870142 | controller | Thursday 26 February 2026  18:30:43 +0000 (0:00:00.441)       0:01:18.700 *****
2026-02-26 18:30:43.870154 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-02-26 18:30:43.870184 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-02-26 18:30:43.870215 | controller |
2026-02-26 18:30:43.870596 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-02-26 18:30:43.870614 | controller | Thursday 26 February 2026  18:30:43 +0000 (0:00:00.274)       0:01:18.975 *****
2026-02-26 18:30:44.321134 | controller |
2026-02-26 18:30:44.321166 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-02-26 18:30:44.321174 | controller | Thursday 26 February 2026  18:30:43 +0000 (0:00:00.010)       0:01:18.985 *****
2026-02-26 18:30:44.321185 | controller | changed: [instance]
2026-02-26 18:30:44.668610 | controller |
2026-02-26 18:30:44.668638 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-02-26 18:30:44.668646 | controller | Thursday 26 February 2026  18:30:44 +0000 (0:00:00.450)       0:01:19.436 *****
2026-02-26 18:30:44.668656 | controller | changed: [instance]
2026-02-26 18:30:44.700582 | controller |
2026-02-26 18:30:44.700598 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2026-02-26 18:30:44.700605 | controller | Thursday 26 February 2026  18:30:44 +0000 (0:00:00.347)       0:01:19.784 *****
2026-02-26 18:30:44.700613 | controller | skipping: [instance]
2026-02-26 18:30:44.778801 | controller |
2026-02-26 18:30:44.778817 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2026-02-26 18:30:44.778824 | controller | Thursday 26 February 2026  18:30:44 +0000 (0:00:00.032)       0:01:19.816 *****
2026-02-26 18:30:44.778832 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2026-02-26 18:30:44.954384 | controller |
2026-02-26 18:30:44.954412 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2026-02-26 18:30:44.954419 | controller | Thursday 26 February 2026  18:30:44 +0000 (0:00:00.077)       0:01:19.894 *****
2026-02-26 18:30:44.954428 | controller | ok: [instance]
2026-02-26 18:30:44.973073 | controller |
2026-02-26 18:30:44.973103 | controller | TASK [Deploy CRC if needed] ****************************************************
2026-02-26 18:30:44.973116 | controller | Thursday 26 February 2026  18:30:44 +0000 (0:00:00.175)       0:01:20.070 *****
2026-02-26 18:30:44.973130 | controller | skipping: [instance]
2026-02-26 18:30:44.973170 | controller |
2026-02-26 18:30:44.973183 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2026-02-26 18:30:44.973342 | controller | Thursday 26 February 2026  18:30:44 +0000 (0:00:00.018)       0:01:20.089 *****
2026-02-26 18:30:45.307840 | controller | ok: [instance]
2026-02-26 18:30:45.529062 | controller |
2026-02-26 18:30:45.529100 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2026-02-26 18:30:45.529110 | controller | Thursday 26 February 2026  18:30:45 +0000 (0:00:00.334)       0:01:20.423 *****
2026-02-26 18:30:45.529123 | controller | ok: [instance]
2026-02-26 18:30:45.529161 | controller |
2026-02-26 18:30:45.529171 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2026-02-26 18:30:45.529266 | controller | Thursday 26 February 2026  18:30:45 +0000 (0:00:00.221)       0:01:20.645 *****
2026-02-26 18:30:45.741070 | controller | ok: [instance]
2026-02-26 18:30:45.741129 | controller |
2026-02-26 18:30:45.741141 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2026-02-26 18:30:45.741221 | controller | Thursday 26 February 2026  18:30:45 +0000 (0:00:00.212)       0:01:20.857 *****
2026-02-26 18:30:45.949923 | controller | ok: [instance]
2026-02-26 18:30:46.162731 | controller |
2026-02-26 18:30:46.162757 | controller | TASK [rhol_crc : Destroy default network] **************************************
2026-02-26 18:30:46.162767 | controller | Thursday 26 February 2026  18:30:45 +0000 (0:00:00.208)       0:01:21.065 *****
2026-02-26 18:30:46.162780 | controller | ok: [instance]
2026-02-26 18:30:46.201185 | controller |
2026-02-26 18:30:46.201254 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-02-26 18:30:46.201268 | controller | Thursday 26 February 2026  18:30:46 +0000 (0:00:00.212)       0:01:21.278 *****
2026-02-26 18:30:46.201284 | controller |
2026-02-26 18:30:46.201312 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-02-26 18:30:46.201332 | controller | Thursday 26 February 2026  18:30:46 +0000 (0:00:00.038)       0:01:21.317 *****
2026-02-26 18:30:46.389234 | controller | ok: [instance]
2026-02-26 18:30:46.389279 | controller |
2026-02-26 18:30:46.389445 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-02-26 18:30:46.410513 | controller | Thursday 26 February 2026  18:30:46 +0000 (0:00:00.187)       0:01:21.505 *****
2026-02-26 18:30:46.410533 | controller | ok: [instance]
2026-02-26 18:30:46.434084 | controller |
2026-02-26 18:30:46.434124 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-02-26 18:30:46.434135 | controller | Thursday 26 February 2026  18:30:46 +0000 (0:00:00.021)       0:01:21.526 *****
2026-02-26 18:30:46.434148 | controller | skipping: [instance]
2026-02-26 18:30:46.434183 | controller |
2026-02-26 18:30:46.434210 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2026-02-26 18:30:46.434328 | controller | Thursday 26 February 2026  18:30:46 +0000 (0:00:00.023)       0:01:21.550 *****
2026-02-26 18:30:46.673579 | controller | ok: [instance]
2026-02-26 18:30:46.885821 | controller |
2026-02-26 18:30:46.885844 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2026-02-26 18:30:46.885852 | controller | Thursday 26 February 2026  18:30:46 +0000 (0:00:00.239)       0:01:21.789 *****
2026-02-26 18:30:46.885861 | controller | ok: [instance]
2026-02-26 18:30:47.048997 | controller |
2026-02-26 18:30:47.049016 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2026-02-26 18:30:47.049023 | controller | Thursday 26 February 2026  18:30:46 +0000 (0:00:00.211)       0:01:22.001 *****
2026-02-26 18:30:47.049031 | controller | ok: [instance]
2026-02-26 18:30:47.049346 | controller |
2026-02-26 18:30:47.105099 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2026-02-26 18:30:47.105119 | controller | Thursday 26 February 2026  18:30:47 +0000 (0:00:00.163)       0:01:22.165 *****
2026-02-26 18:30:47.105131 | controller |
2026-02-26 18:30:47.145727 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-02-26 18:30:47.145746 | controller | Thursday 26 February 2026  18:30:47 +0000 (0:00:00.055)       0:01:22.220 *****
2026-02-26 18:30:47.145758 | controller | ok: [instance] => changed=false
2026-02-26 18:30:47.319437 | controller |   msg: All assertions passed
2026-02-26 18:30:47.319467 | controller |
2026-02-26 18:30:47.319475 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-02-26 18:30:47.319481 | controller | Thursday 26 February 2026  18:30:47 +0000 (0:00:00.040)       0:01:22.261 *****
2026-02-26 18:30:47.319491 | controller | ok: [instance]
2026-02-26 18:30:47.498053 | controller |
2026-02-26 18:30:47.498079 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-02-26 18:30:47.498088 | controller | Thursday 26 February 2026  18:30:47 +0000 (0:00:00.173)       0:01:22.435 *****
2026-02-26 18:30:47.498099 | controller | ok: [instance]
2026-02-26 18:30:47.498126 | controller |
2026-02-26 18:30:47.498135 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-02-26 18:30:47.498158 | controller | Thursday 26 February 2026  18:30:47 +0000 (0:00:00.178)       0:01:22.614 *****
2026-02-26 18:30:47.521078 | controller | ok: [instance] => changed=false
2026-02-26 18:30:47.521126 | controller |   msg: All assertions passed
2026-02-26 18:30:47.521134 | controller |
2026-02-26 18:30:47.521140 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-02-26 18:30:47.521147 | controller | Thursday 26 February 2026  18:30:47 +0000 (0:00:00.022)       0:01:22.636 *****
2026-02-26 18:30:47.693876 | controller | ok: [instance]
2026-02-26 18:30:47.856972 | controller |
2026-02-26 18:30:47.856991 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-02-26 18:30:47.856998 | controller | Thursday 26 February 2026  18:30:47 +0000 (0:00:00.173)       0:01:22.809 *****
2026-02-26 18:30:47.857006 | controller | ok: [instance]
2026-02-26 18:30:47.900429 | controller |
2026-02-26 18:30:47.900448 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-02-26 18:30:47.900457 | controller | Thursday 26 February 2026  18:30:47 +0000 (0:00:00.163)       0:01:22.972 *****
2026-02-26 18:30:47.900466 | controller | ok: [instance]
2026-02-26 18:30:48.266662 | controller |
2026-02-26 18:30:48.266689 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2026-02-26 18:30:48.266697 | controller | Thursday 26 February 2026  18:30:47 +0000 (0:00:00.043)       0:01:23.016 *****
2026-02-26 18:30:48.266707 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2026-02-26 18:30:48.286757 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2026-02-26 18:30:48.286780 | controller |
2026-02-26 18:30:48.286789 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2026-02-26 18:30:48.286797 | controller | Thursday 26 February 2026  18:30:48 +0000 (0:00:00.365)       0:01:23.382 *****
2026-02-26 18:30:48.286808 | controller | skipping: [instance]
2026-02-26 18:30:48.310728 | controller |
2026-02-26 18:30:48.310745 | controller | TASK [Load the architecture local kustomize patches] ***************************
2026-02-26 18:30:48.310755 | controller | Thursday 26 February 2026  18:30:48 +0000 (0:00:00.020)       0:01:23.402 *****
2026-02-26 18:30:48.310763 | controller | skipping: [instance]
2026-02-26 18:30:48.431036 | controller |
2026-02-26 18:30:48.431069 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2026-02-26 18:30:48.431082 | controller | Thursday 26 February 2026  18:30:48 +0000 (0:00:00.024)       0:01:23.426 *****
2026-02-26 18:30:48.431098 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2026-02-26 18:30:48.431552 | controller |
2026-02-26 18:30:48.431582 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2026-02-26 18:30:48.455160 | controller | Thursday 26 February 2026  18:30:48 +0000 (0:00:00.120)       0:01:23.546 *****
2026-02-26 18:30:48.455217 | controller | skipping: [instance]
2026-02-26 18:30:48.852567 | controller |
2026-02-26 18:30:48.852589 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2026-02-26 18:30:48.852596 | controller | Thursday 26 February 2026  18:30:48 +0000 (0:00:00.023)       0:01:23.570 *****
2026-02-26 18:30:48.852605 | controller | changed: [instance]
2026-02-26 18:30:49.348029 | controller |
2026-02-26 18:30:49.348072 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2026-02-26 18:30:49.348081 | controller | Thursday 26 February 2026  18:30:48 +0000 (0:00:00.397)       0:01:23.968 *****
2026-02-26 18:30:49.348091 | controller | changed: [instance]
2026-02-26 18:30:49.348111 | controller |
2026-02-26 18:30:49.348606 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2026-02-26 18:30:49.765038 | controller | Thursday 26 February 2026  18:30:49 +0000 (0:00:00.484)       0:01:24.452 *****
2026-02-26 18:30:49.765067 | controller |
2026-02-26 18:30:49.765075 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-02-26 18:30:49.765081 | controller | Thursday 26 February 2026  18:30:49 +0000 (0:00:00.011)       0:01:24.463 *****
2026-02-26 18:30:49.765090 | controller | changed: [instance]
2026-02-26 18:30:49.765122 | controller |
2026-02-26 18:30:49.765131 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-02-26 18:30:49.765249 | controller | Thursday 26 February 2026  18:30:49 +0000 (0:00:00.416)       0:01:24.880 *****
2026-02-26 18:30:50.376777 | controller | changed: [instance]
2026-02-26 18:30:50.409027 | controller |
2026-02-26 18:30:50.409059 | controller | TASK [Deploy virtualbmc] *******************************************************
2026-02-26 18:30:50.409068 | controller | Thursday 26 February 2026  18:30:50 +0000 (0:00:00.611)       0:01:25.492 *****
2026-02-26 18:30:50.409078 | controller | skipping: [instance]
2026-02-26 18:30:50.441681 | controller |
2026-02-26 18:30:50.441707 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2026-02-26 18:30:50.441715 | controller | Thursday 26 February 2026  18:30:50 +0000 (0:00:00.032)       0:01:25.524 *****
2026-02-26 18:30:50.441725 | controller | skipping: [instance]
2026-02-26 18:30:50.963026 | controller |
2026-02-26 18:30:50.963059 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2026-02-26 18:30:50.963067 | controller | Thursday 26 February 2026  18:30:50 +0000 (0:00:00.032)       0:01:25.557 *****
2026-02-26 18:30:50.963077 | controller | changed: [instance] => (item=workload)
2026-02-26 18:30:50.963136 | controller | changed: [instance] => (item=reproducer-inventory)
2026-02-26 18:30:50.963184 | controller | ok: [instance] => (item=volumes)
2026-02-26 18:30:50.963197 | controller |
2026-02-26 18:30:50.963204 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2026-02-26 18:30:50.963214 | controller | Thursday 26 February 2026  18:30:50 +0000 (0:00:00.520)       0:01:26.078 *****
2026-02-26 18:30:51.350709 | controller | changed: [instance] => (item=workload)
2026-02-26 18:30:51.375026 | controller | changed: [instance] => (item=volumes)
2026-02-26 18:30:51.375059 | controller |
2026-02-26 18:30:51.375067 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2026-02-26 18:30:51.375073 | controller | Thursday 26 February 2026  18:30:51 +0000 (0:00:00.387)       0:01:26.466 *****
2026-02-26 18:30:51.375083 | controller | skipping: [instance]
2026-02-26 18:30:52.393302 | controller |
2026-02-26 18:30:52.393338 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2026-02-26 18:30:52.393346 | controller | Thursday 26 February 2026  18:30:51 +0000 (0:00:00.024)       0:01:26.491 *****
2026-02-26 18:30:52.393357 | controller | changed: [instance] => (item=compute)
2026-02-26 18:30:52.423769 | controller | changed: [instance] => (item=controller)
2026-02-26 18:30:52.423801 | controller | changed: [instance] => (item=crc)
2026-02-26 18:30:52.423815 | controller |
2026-02-26 18:30:52.423826 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2026-02-26 18:30:52.423837 | controller | Thursday 26 February 2026  18:30:52 +0000 (0:00:01.017)       0:01:27.508 *****
2026-02-26 18:30:52.423852 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance
2026-02-26 18:30:52.594695 | controller |
2026-02-26 18:30:52.594715 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] *****************
2026-02-26 18:30:52.594722 | controller | Thursday 26 February 2026  18:30:52 +0000 (0:00:00.030)       0:01:27.539 *****
2026-02-26 18:30:52.594731 | controller | ok: [instance]
2026-02-26 18:30:52.615424 | controller |
2026-02-26 18:30:52.615442 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] *************
2026-02-26 18:30:52.615450 | controller | Thursday 26 February 2026  18:30:52 +0000 (0:00:00.171)       0:01:27.710 *****
2026-02-26 18:30:52.615458 | controller | skipping: [instance]
2026-02-26 18:30:52.963076 | controller |
2026-02-26 18:30:52.963101 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] ***
2026-02-26 18:30:52.963109 | controller | Thursday 26 February 2026  18:30:52 +0000 (0:00:00.020)       0:01:27.731 *****
2026-02-26 18:30:52.963119 | controller | changed: [instance]
2026-02-26 18:30:52.983466 | controller |
2026-02-26 18:30:52.983484 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] *********************
2026-02-26 18:30:52.983492 | controller | Thursday 26 February 2026  18:30:52 +0000 (0:00:00.347)       0:01:28.078 *****
2026-02-26 18:30:52.983502 | controller | skipping: [instance]
2026-02-26 18:30:53.003069 | controller |
2026-02-26 18:30:53.003103 | controller | TASK [libvirt_manager : Write merged all-group.yml] ****************************
2026-02-26 18:30:53.003113 | controller | Thursday 26 February 2026  18:30:52 +0000 (0:00:00.020)       0:01:28.099 *****
2026-02-26 18:30:53.003125 | controller | skipping: [instance]
2026-02-26 18:30:53.039110 | controller |
2026-02-26 18:30:53.039138 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2026-02-26 18:30:53.039147 | controller | Thursday 26 February 2026  18:30:53 +0000 (0:00:00.019)       0:01:28.119 *****
2026-02-26 18:30:53.039175 | controller | skipping: [instance]
2026-02-26 18:30:53.039405 | controller |
2026-02-26 18:30:53.039425 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2026-02-26 18:30:53.103065 | controller | Thursday 26 February 2026  18:30:53 +0000 (0:00:00.035)       0:01:28.154 *****
2026-02-26 18:30:53.103092 | controller | skipping: [instance] => (item=crc)
2026-02-26 18:30:53.103606 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2026-02-26 18:30:53.103626 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2026-02-26 18:30:53.309425 | controller |
2026-02-26 18:30:53.309460 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-02-26 18:30:53.309475 | controller | Thursday 26 February 2026  18:30:53 +0000 (0:00:00.063)       0:01:28.218 *****
2026-02-26 18:30:53.309491 | controller | changed: [instance]
2026-02-26 18:30:53.484408 | controller |
2026-02-26 18:30:53.484429 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-02-26 18:30:53.484438 | controller | Thursday 26 February 2026  18:30:53 +0000 (0:00:00.205)       0:01:28.424 *****
2026-02-26 18:30:53.484448 | controller | ok: [instance]
2026-02-26 18:31:22.902002 | controller |
2026-02-26 18:31:22.902039 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-02-26 18:31:22.902047 | controller | Thursday 26 February 2026  18:30:53 +0000 (0:00:00.175)       0:01:28.599 *****
2026-02-26 18:31:22.902056 | controller | changed: [instance]
2026-02-26 18:31:23.115979 | controller |
2026-02-26 18:31:23.115999 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-02-26 18:31:23.116007 | controller | Thursday 26 February 2026  18:31:22 +0000 (0:00:29.417)       0:01:58.017 *****
2026-02-26 18:31:23.116016 | controller | ok: [instance]
2026-02-26 18:31:23.157791 | controller |
2026-02-26 18:31:23.157809 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-02-26 18:31:23.157817 | controller | Thursday 26 February 2026  18:31:23 +0000 (0:00:00.214)       0:01:58.231 *****
2026-02-26 18:31:23.157826 | controller | ok: [instance] => changed=false
2026-02-26 18:31:23.386991 | controller |   msg: All assertions passed
2026-02-26 18:31:23.387011 | controller |
2026-02-26 18:31:23.387020 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-02-26 18:31:23.387027 | controller | Thursday 26 February 2026  18:31:23 +0000 (0:00:00.041)       0:01:58.273 *****
2026-02-26 18:31:23.387037 | controller | changed: [instance]
2026-02-26 18:31:23.613105 | controller |
2026-02-26 18:31:23.613146 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-02-26 18:31:23.613156 | controller | Thursday 26 February 2026  18:31:23 +0000 (0:00:00.229)       0:01:58.502 *****
2026-02-26 18:31:23.613168 | controller | ok: [instance]
2026-02-26 18:31:23.613199 | controller |
2026-02-26 18:31:23.613347 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-02-26 18:31:23.822109 | controller | Thursday 26 February 2026  18:31:23 +0000 (0:00:00.225)       0:01:58.728 *****
2026-02-26 18:31:23.822150 | controller | ok: [instance]
2026-02-26 18:31:23.822312 | controller |
2026-02-26 18:31:23.822340 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-02-26 18:31:23.822359 | controller | Thursday 26 February 2026  18:31:23 +0000 (0:00:00.208)       0:01:58.937 *****
2026-02-26 18:31:23.847634 | controller | skipping: [instance]
2026-02-26 18:31:24.045958 | controller |
2026-02-26 18:31:24.045977 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-02-26 18:31:24.045987 | controller | Thursday 26 February 2026  18:31:23 +0000 (0:00:00.025)       0:01:58.963 *****
2026-02-26 18:31:24.045996 | controller | ok: [instance]
2026-02-26 18:31:24.088433 | controller |
2026-02-26 18:31:24.088450 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-02-26 18:31:24.088456 | controller | Thursday 26 February 2026  18:31:24 +0000 (0:00:00.198)       0:01:59.161 *****
2026-02-26 18:31:24.088465 | controller | ok: [instance] => changed=false
2026-02-26 18:31:24.315332 | controller |   msg: All assertions passed
2026-02-26 18:31:24.315351 | controller |
2026-02-26 18:31:24.315358 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-02-26 18:31:24.315363 | controller | Thursday 26 February 2026  18:31:24 +0000 (0:00:00.042)       0:01:59.204 *****
2026-02-26 18:31:24.315372 | controller | ok: [instance]
2026-02-26 18:31:24.503336 | controller |
2026-02-26 18:31:24.503354 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2026-02-26 18:31:24.503361 | controller | Thursday 26 February 2026  18:31:24 +0000 (0:00:00.226)       0:01:59.431 *****
2026-02-26 18:31:24.503370 | controller | ok: [instance]
2026-02-26 18:31:24.898457 | controller |
2026-02-26 18:31:24.898477 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2026-02-26 18:31:24.898490 | controller | Thursday 26 February 2026  18:31:24 +0000 (0:00:00.188)       0:01:59.619 *****
2026-02-26 18:31:24.898499 | controller | changed: [instance]
2026-02-26 18:31:25.082562 | controller |
2026-02-26 18:31:25.082583 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2026-02-26 18:31:25.082591 | controller | Thursday 26 February 2026  18:31:24 +0000 (0:00:00.395)       0:02:00.014 *****
2026-02-26 18:31:25.082599 | controller | ok: [instance]
2026-02-26 18:31:25.264089 | controller |
2026-02-26 18:31:25.264132 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2026-02-26 18:31:25.264142 | controller | Thursday 26 February 2026  18:31:25 +0000 (0:00:00.184)       0:02:00.198 *****
2026-02-26 18:31:25.264154 | controller | ok: [instance]
2026-02-26 18:31:25.671275 | controller |
2026-02-26 18:31:25.671320 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2026-02-26 18:31:25.671331 | controller | Thursday 26 February 2026  18:31:25 +0000 (0:00:00.181)       0:02:00.379 *****
2026-02-26 18:31:25.671344 | controller | changed: [instance]
2026-02-26 18:31:25.671368 | controller |
2026-02-26 18:31:25.671431 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2026-02-26 18:31:25.671529 | controller | Thursday 26 February 2026  18:31:25 +0000 (0:00:00.407)       0:02:00.787 *****
2026-02-26 18:31:25.694323 | controller | ok: [instance]
2026-02-26 18:31:25.694406 | controller |
2026-02-26 18:31:25.694499 | controller | TASK [libvirt_manager : List existing networks] ********************************
2026-02-26 18:31:25.694593 | controller | Thursday 26 February 2026  18:31:25 +0000 (0:00:00.023)       0:02:00.810 *****
2026-02-26 18:31:25.924297 | controller | ok: [instance]
2026-02-26 18:31:25.924379 | controller |
2026-02-26 18:31:25.924473 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2026-02-26 18:31:25.924565 | controller | Thursday 26 February 2026  18:31:25 +0000 (0:00:00.229)       0:02:01.040 *****
2026-02-26 18:31:26.454136 | controller | ok: [instance]
2026-02-26 18:31:26.454429 | controller |
2026-02-26 18:31:26.454467 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2026-02-26 18:31:26.586098 | controller | Thursday 26 February 2026  18:31:26 +0000 (0:00:00.529)       0:02:01.569 *****
2026-02-26 18:31:26.586130 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-02-26 18:31:26.586140 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-02-26 18:31:26.586148 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-02-26 18:31:26.586155 | controller |
2026-02-26 18:31:26.586161 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2026-02-26 18:31:26.586170 | controller | Thursday 26 February 2026  18:31:26 +0000 (0:00:00.131)       0:02:01.701 *****
2026-02-26 18:31:26.866980 | controller | changed: [instance]
2026-02-26 18:31:27.104911 | controller |
2026-02-26 18:31:27.104935 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2026-02-26 18:31:27.104969 | controller | Thursday 26 February 2026  18:31:26 +0000 (0:00:00.281)       0:02:01.982 *****
2026-02-26 18:31:27.104984 | controller | changed: [instance]
2026-02-26 18:31:27.452540 | controller |
2026-02-26 18:31:27.452559 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2026-02-26 18:31:27.452566 | controller | Thursday 26 February 2026  18:31:27 +0000 (0:00:00.237)       0:02:02.220 *****
2026-02-26 18:31:27.452574 | controller | changed: [instance]
2026-02-26 18:31:27.483771 | controller |
2026-02-26 18:31:27.483797 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2026-02-26 18:31:27.483807 | controller | Thursday 26 February 2026  18:31:27 +0000 (0:00:00.347)       0:02:02.568 *****
2026-02-26 18:31:27.483819 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-02-26 18:31:27.529843 | controller |
2026-02-26 18:31:27.529860 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-02-26 18:31:27.529871 | controller | Thursday 26 February 2026  18:31:27 +0000 (0:00:00.031)       0:02:02.599 *****
2026-02-26 18:31:27.529879 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-02-26 18:31:27.785973 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-02-26 18:31:27.785995 | controller |
2026-02-26 18:31:27.786002 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 18:31:27.786008 | controller | Thursday 26 February 2026  18:31:27 +0000 (0:00:00.045)       0:02:02.645 *****
2026-02-26 18:31:27.786016 | controller | ok: [instance]
2026-02-26 18:31:27.844149 | controller |
2026-02-26 18:31:27.844190 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 18:31:27.844200 | controller | Thursday 26 February 2026  18:31:27 +0000 (0:00:00.256)       0:02:02.901 *****
2026-02-26 18:31:27.844213 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 18:31:28.103045 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:31:28.103093 | controller |
2026-02-26 18:31:28.103101 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 18:31:28.103107 | controller | Thursday 26 February 2026  18:31:27 +0000 (0:00:00.057)       0:02:02.959 *****
2026-02-26 18:31:28.103118 | controller | ok: [instance]
2026-02-26 18:31:28.103144 | controller |
2026-02-26 18:31:28.103165 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 18:31:28.103307 | controller | Thursday 26 February 2026  18:31:28 +0000 (0:00:00.259)       0:02:03.218 *****
2026-02-26 18:31:28.316022 | controller | ok: [instance]
2026-02-26 18:31:28.316310 | controller |
2026-02-26 18:31:28.316347 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2026-02-26 18:31:29.640211 | controller | Thursday 26 February 2026  18:31:28 +0000 (0:00:00.212)       0:02:03.431 *****
2026-02-26 18:31:29.640248 | controller | changed: [instance]
2026-02-26 18:31:29.880891 | controller |
2026-02-26 18:31:29.880913 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 18:31:29.880921 | controller | Thursday 26 February 2026  18:31:29 +0000 (0:00:01.323)       0:02:04.755 *****
2026-02-26 18:31:29.880931 | controller | ok: [instance]
2026-02-26 18:31:29.928003 | controller |
2026-02-26 18:31:29.928023 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 18:31:29.928031 | controller | Thursday 26 February 2026  18:31:29 +0000 (0:00:00.240)       0:02:04.996 *****
2026-02-26 18:31:29.928039 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 18:31:29.928244 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:31:29.928256 | controller |
2026-02-26 18:31:29.928264 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 18:31:30.180718 | controller | Thursday 26 February 2026  18:31:29 +0000 (0:00:00.047)       0:02:05.043 *****
2026-02-26 18:31:30.180738 | controller | ok: [instance]
2026-02-26 18:31:30.399873 | controller |
2026-02-26 18:31:30.399894 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 18:31:30.399901 | controller | Thursday 26 February 2026  18:31:30 +0000 (0:00:00.252)       0:02:05.296 *****
2026-02-26 18:31:30.399910 | controller | ok: [instance]
2026-02-26 18:31:30.699407 | controller |
2026-02-26 18:31:30.699430 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2026-02-26 18:31:30.699438 | controller | Thursday 26 February 2026  18:31:30 +0000 (0:00:00.219)       0:02:05.515 *****
2026-02-26 18:31:30.699448 | controller | changed: [instance]
2026-02-26 18:31:30.726998 | controller |
2026-02-26 18:31:30.727019 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2026-02-26 18:31:30.727027 | controller | Thursday 26 February 2026  18:31:30 +0000 (0:00:00.299)       0:02:05.815 *****
2026-02-26 18:31:30.727037 | controller | skipping: [instance]
2026-02-26 18:31:30.727370 | controller |
2026-02-26 18:31:30.763718 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2026-02-26 18:31:30.763738 | controller | Thursday 26 February 2026  18:31:30 +0000 (0:00:00.027)       0:02:05.843 *****
2026-02-26 18:31:30.763750 | controller | skipping: [instance]
2026-02-26 18:31:30.801904 | controller |
2026-02-26 18:31:30.801920 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2026-02-26 18:31:30.801927 | controller | Thursday 26 February 2026  18:31:30 +0000 (0:00:00.036)       0:02:05.879 *****
2026-02-26 18:31:30.801935 | controller | skipping: [instance]
2026-02-26 18:31:30.834683 | controller |
2026-02-26 18:31:30.834703 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2026-02-26 18:31:30.834711 | controller | Thursday 26 February 2026  18:31:30 +0000 (0:00:00.038)       0:02:05.917 *****
2026-02-26 18:31:30.834721 | controller | skipping: [instance]
2026-02-26 18:31:31.071304 | controller |
2026-02-26 18:31:31.071325 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-02-26 18:31:31.071337 | controller | Thursday 26 February 2026  18:31:30 +0000 (0:00:00.032)       0:02:05.950 *****
2026-02-26 18:31:31.071346 | controller | changed: [instance]
2026-02-26 18:31:31.122653 | controller |
2026-02-26 18:31:31.122685 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-02-26 18:31:31.122698 | controller | Thursday 26 February 2026  18:31:31 +0000 (0:00:00.236)       0:02:06.187 *****
2026-02-26 18:31:31.122714 | controller | ok: [instance]
2026-02-26 18:31:31.188308 | controller |
2026-02-26 18:31:31.188325 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-02-26 18:31:31.188331 | controller | Thursday 26 February 2026  18:31:31 +0000 (0:00:00.050)       0:02:06.238 *****
2026-02-26 18:31:31.188343 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-02-26 18:31:31.404548 | controller |
2026-02-26 18:31:31.404570 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-02-26 18:31:31.404579 | controller | Thursday 26 February 2026  18:31:31 +0000 (0:00:00.066)       0:02:06.304 *****
2026-02-26 18:31:31.404590 | controller | ok: [instance]
2026-02-26 18:31:31.476348 | controller |
2026-02-26 18:31:31.476364 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-02-26 18:31:31.476372 | controller | Thursday 26 February 2026  18:31:31 +0000 (0:00:00.216)       0:02:06.520 *****
2026-02-26 18:31:31.476380 | controller | ok: [instance]
2026-02-26 18:31:31.531154 | controller |
2026-02-26 18:31:31.531203 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-02-26 18:31:31.531217 | controller | Thursday 26 February 2026  18:31:31 +0000 (0:00:00.071)       0:02:06.592 *****
2026-02-26 18:31:31.531236 | controller | ok: [instance]
2026-02-26 18:31:31.584908 | controller |
2026-02-26 18:31:31.584985 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-02-26 18:31:31.585006 | controller | Thursday 26 February 2026  18:31:31 +0000 (0:00:00.055)       0:02:06.647 *****
2026-02-26 18:31:31.585025 | controller | skipping: [instance]
2026-02-26 18:31:31.644030 | controller |
2026-02-26 18:31:31.644048 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-02-26 18:31:31.644068 | controller | Thursday 26 February 2026  18:31:31 +0000 (0:00:00.053)       0:02:06.700 *****
2026-02-26 18:31:31.644077 | controller | skipping: [instance]
2026-02-26 18:31:31.644215 | controller |
2026-02-26 18:31:31.644351 | controller | TASK [Call the config_drive role] **********************************************
2026-02-26 18:31:31.644486 | controller | Thursday 26 February 2026  18:31:31 +0000 (0:00:00.059)       0:02:06.760 *****
2026-02-26 18:31:31.713882 | controller |
2026-02-26 18:31:31.714070 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-02-26 18:31:31.714212 | controller | Thursday 26 February 2026  18:31:31 +0000 (0:00:00.069)       0:02:06.830 *****
2026-02-26 18:31:32.135993 | controller | ok: [instance] => (item=artifacts)
2026-02-26 18:31:33.363618 | controller | ok: [instance] => (item=logs)
2026-02-26 18:31:33.363647 | controller |
2026-02-26 18:31:33.363654 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-02-26 18:31:33.363664 | controller | Thursday 26 February 2026  18:31:32 +0000 (0:00:00.421)       0:02:07.251 *****
2026-02-26 18:31:33.363673 | controller | ok: [instance]
2026-02-26 18:31:33.607455 | controller |
2026-02-26 18:31:33.607486 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-02-26 18:31:33.607494 | controller | Thursday 26 February 2026  18:31:33 +0000 (0:00:01.227)       0:02:08.479 *****
2026-02-26 18:31:33.607504 | controller | changed: [instance]
2026-02-26 18:31:34.002872 | controller |
2026-02-26 18:31:34.002907 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-02-26 18:31:34.002915 | controller | Thursday 26 February 2026  18:31:33 +0000 (0:00:00.243)       0:02:08.723 *****
2026-02-26 18:31:34.002925 | controller | changed: [instance]
2026-02-26 18:31:34.411851 | controller |
2026-02-26 18:31:34.411886 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-02-26 18:31:34.411894 | controller | Thursday 26 February 2026  18:31:34 +0000 (0:00:00.395)       0:02:09.118 *****
2026-02-26 18:31:34.411904 | controller | changed: [instance]
2026-02-26 18:31:34.463402 | controller |
2026-02-26 18:31:34.463428 | controller | TASK [config_drive : Generate network-data] ************************************
2026-02-26 18:31:34.463438 | controller | Thursday 26 February 2026  18:31:34 +0000 (0:00:00.408)       0:02:09.527 *****
2026-02-26 18:31:34.463449 | controller | skipping: [instance]
2026-02-26 18:31:34.665517 | controller |
2026-02-26 18:31:34.665541 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-02-26 18:31:34.665548 | controller | Thursday 26 February 2026  18:31:34 +0000 (0:00:00.051)       0:02:09.579 *****
2026-02-26 18:31:34.665560 | controller | ok: [instance]
2026-02-26 18:31:34.721671 | controller |
2026-02-26 18:31:34.721701 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-02-26 18:31:34.721714 | controller | Thursday 26 February 2026  18:31:34 +0000 (0:00:00.202)       0:02:09.781 *****
2026-02-26 18:31:34.721728 | controller | skipping: [instance]
2026-02-26 18:31:34.995848 | controller |
2026-02-26 18:31:34.995868 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-02-26 18:31:34.995876 | controller | Thursday 26 February 2026  18:31:34 +0000 (0:00:00.055)       0:02:09.837 *****
2026-02-26 18:31:34.995884 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2026-02-26 18:31:35.286070 | controller | changed: [instance]
2026-02-26 18:31:35.286107 | controller |
2026-02-26 18:31:35.286117 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-02-26 18:31:35.286124 | controller | Thursday 26 February 2026  18:31:34 +0000 (0:00:00.274)       0:02:10.111 *****
2026-02-26 18:31:35.286136 | controller | changed: [instance]
2026-02-26 18:31:35.286143 | controller |
2026-02-26 18:31:35.286149 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-02-26 18:31:35.286158 | controller | Thursday 26 February 2026  18:31:35 +0000 (0:00:00.290)       0:02:10.401 *****
2026-02-26 18:31:35.337400 | controller | skipping: [instance]
2026-02-26 18:31:35.367698 | controller |
2026-02-26 18:31:35.367718 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ********************
2026-02-26 18:31:35.367727 | controller | Thursday 26 February 2026  18:31:35 +0000 (0:00:00.051)       0:02:10.453 *****
2026-02-26 18:31:35.367737 | controller | skipping: [instance]
2026-02-26 18:31:35.644461 | controller |
2026-02-26 18:31:35.644483 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2026-02-26 18:31:35.644491 | controller | Thursday 26 February 2026  18:31:35 +0000 (0:00:00.030)       0:02:10.483 *****
2026-02-26 18:31:35.644501 | controller | changed: [instance]
2026-02-26 18:31:35.882390 | controller |
2026-02-26 18:31:35.882420 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2026-02-26 18:31:35.882428 | controller | Thursday 26 February 2026  18:31:35 +0000 (0:00:00.276)       0:02:10.760 *****
2026-02-26 18:31:35.882438 | controller | changed: [instance]
2026-02-26 18:31:36.222649 | controller |
2026-02-26 18:31:36.222685 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2026-02-26 18:31:36.222693 | controller | Thursday 26 February 2026  18:31:35 +0000 (0:00:00.237)       0:02:10.997 *****
2026-02-26 18:31:36.222709 | controller | changed: [instance]
2026-02-26 18:31:36.256103 | controller |
2026-02-26 18:31:36.256128 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2026-02-26 18:31:36.256137 | controller | Thursday 26 February 2026  18:31:36 +0000 (0:00:00.340)       0:02:11.338 *****
2026-02-26 18:31:36.256148 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-02-26 18:31:36.357791 | controller |
2026-02-26 18:31:36.357813 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-02-26 18:31:36.357821 | controller | Thursday 26 February 2026  18:31:36 +0000 (0:00:00.033)       0:02:11.371 *****
2026-02-26 18:31:36.357832 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-02-26 18:31:36.585519 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-02-26 18:31:36.585541 | controller |
2026-02-26 18:31:36.585549 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 18:31:36.585555 | controller | Thursday 26 February 2026  18:31:36 +0000 (0:00:00.101)       0:02:11.473 *****
2026-02-26 18:31:36.585564 | controller | ok: [instance]
2026-02-26 18:31:36.632821 | controller |
2026-02-26 18:31:36.632843 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 18:31:36.632850 | controller | Thursday 26 February 2026  18:31:36 +0000 (0:00:00.227)       0:02:11.701 *****
2026-02-26 18:31:36.632859 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 18:31:36.863502 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:31:36.863528 | controller |
2026-02-26 18:31:36.863538 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 18:31:36.863546 | controller | Thursday 26 February 2026  18:31:36 +0000 (0:00:00.047)       0:02:11.748 *****
2026-02-26 18:31:36.863556 | controller | ok: [instance]
2026-02-26 18:31:37.079826 | controller |
2026-02-26 18:31:37.079859 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 18:31:37.079867 | controller | Thursday 26 February 2026  18:31:36 +0000 (0:00:00.230)       0:02:11.979 *****
2026-02-26 18:31:37.079878 | controller | ok: [instance]
2026-02-26 18:31:37.384088 | controller |
2026-02-26 18:31:37.384124 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2026-02-26 18:31:37.384133 | controller | Thursday 26 February 2026  18:31:37 +0000 (0:00:00.216)       0:02:12.195 *****
2026-02-26 18:31:37.384155 | controller | changed: [instance]
2026-02-26 18:31:37.384174 | controller |
2026-02-26 18:31:37.384182 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 18:31:37.384302 | controller | Thursday 26 February 2026  18:31:37 +0000 (0:00:00.304)       0:02:12.500 *****
2026-02-26 18:31:37.635941 | controller | ok: [instance]
2026-02-26 18:31:37.687595 | controller |
2026-02-26 18:31:37.687618 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 18:31:37.687629 | controller | Thursday 26 February 2026  18:31:37 +0000 (0:00:00.251)       0:02:12.751 *****
2026-02-26 18:31:37.687640 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 18:31:37.925400 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:31:37.925421 | controller |
2026-02-26 18:31:37.925430 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 18:31:37.925436 | controller | Thursday 26 February 2026  18:31:37 +0000 (0:00:00.051)       0:02:12.803 *****
2026-02-26 18:31:37.925446 | controller | ok: [instance]
2026-02-26 18:31:38.142141 | controller |
2026-02-26 18:31:38.142212 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 18:31:38.142227 | controller | Thursday 26 February 2026  18:31:37 +0000 (0:00:00.238)       0:02:13.041 *****
2026-02-26 18:31:38.142247 | controller | ok: [instance]
2026-02-26 18:31:38.450559 | controller |
2026-02-26 18:31:38.450587 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2026-02-26 18:31:38.450597 | controller | Thursday 26 February 2026  18:31:38 +0000 (0:00:00.216)       0:02:13.257 *****
2026-02-26 18:31:38.450611 | controller | changed: [instance]
2026-02-26 18:31:38.474007 | controller |
2026-02-26 18:31:38.474026 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2026-02-26 18:31:38.474046 | controller | Thursday 26 February 2026  18:31:38 +0000 (0:00:00.308)       0:02:13.566 *****
2026-02-26 18:31:38.474055 | controller | skipping: [instance]
2026-02-26 18:31:38.504837 | controller |
2026-02-26 18:31:38.504857 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2026-02-26 18:31:38.504866 | controller | Thursday 26 February 2026  18:31:38 +0000 (0:00:00.023)       0:02:13.589 *****
2026-02-26 18:31:38.504876 | controller | skipping: [instance]
2026-02-26 18:31:38.544596 | controller |
2026-02-26 18:31:38.544613 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2026-02-26 18:31:38.544620 | controller | Thursday 26 February 2026  18:31:38 +0000 (0:00:00.030)       0:02:13.620 *****
2026-02-26 18:31:38.544628 | controller | skipping: [instance]
2026-02-26 18:31:38.573682 | controller |
2026-02-26 18:31:38.573702 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2026-02-26 18:31:38.573710 | controller | Thursday 26 February 2026  18:31:38 +0000 (0:00:00.039)       0:02:13.660 *****
2026-02-26 18:31:38.573720 | controller | skipping: [instance]
2026-02-26 18:31:38.817046 | controller |
2026-02-26 18:31:38.817086 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-02-26 18:31:38.817093 | controller | Thursday 26 February 2026  18:31:38 +0000 (0:00:00.029)       0:02:13.689 *****
2026-02-26 18:31:38.817104 | controller | changed: [instance]
2026-02-26 18:31:38.817129 | controller |
2026-02-26 18:31:38.817338 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-02-26 18:31:38.858432 | controller | Thursday 26 February 2026  18:31:38 +0000 (0:00:00.243)       0:02:13.932 *****
2026-02-26 18:31:38.858457 | controller | ok: [instance]
2026-02-26 18:31:38.923619 | controller |
2026-02-26 18:31:38.923639 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-02-26 18:31:38.923648 | controller | Thursday 26 February 2026  18:31:38 +0000 (0:00:00.041)       0:02:13.974 *****
2026-02-26 18:31:38.923658 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-02-26 18:31:39.138074 | controller |
2026-02-26 18:31:39.138112 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-02-26 18:31:39.138122 | controller | Thursday 26 February 2026  18:31:38 +0000 (0:00:00.065)       0:02:14.039 *****
2026-02-26 18:31:39.138135 | controller | ok: [instance]
2026-02-26 18:31:39.138167 | controller |
2026-02-26 18:31:39.138176 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-02-26 18:31:39.138185 | controller | Thursday 26 February 2026  18:31:39 +0000 (0:00:00.214)       0:02:14.253 *****
2026-02-26 18:31:39.202530 | controller | ok: [instance]
2026-02-26 18:31:39.202658 | controller |
2026-02-26 18:31:39.202786 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-02-26 18:31:39.203007 | controller | Thursday 26 February 2026  18:31:39 +0000 (0:00:00.064)       0:02:14.318 *****
2026-02-26 18:31:39.264010 | controller | ok: [instance]
2026-02-26 18:31:39.264156 | controller |
2026-02-26 18:31:39.264286 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-02-26 18:31:39.264419 | controller | Thursday 26 February 2026  18:31:39 +0000 (0:00:00.061)       0:02:14.379 *****
2026-02-26 18:31:39.312881 | controller | skipping: [instance]
2026-02-26 18:31:39.313115 | controller |
2026-02-26 18:31:39.313297 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-02-26 18:31:39.313521 | controller | Thursday 26 February 2026  18:31:39 +0000 (0:00:00.048)       0:02:14.428 *****
2026-02-26 18:31:39.362325 | controller | skipping: [instance]
2026-02-26 18:31:39.362472 | controller |
2026-02-26 18:31:39.362625 | controller | TASK [Call the config_drive role] **********************************************
2026-02-26 18:31:39.362743 | controller | Thursday 26 February 2026  18:31:39 +0000 (0:00:00.049)       0:02:14.478 *****
2026-02-26 18:31:39.435282 | controller |
2026-02-26 18:31:39.435522 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-02-26 18:31:39.435733 | controller | Thursday 26 February 2026  18:31:39 +0000 (0:00:00.072)       0:02:14.551 *****
2026-02-26 18:31:39.853061 | controller | ok: [instance] => (item=artifacts)
2026-02-26 18:31:39.853121 | controller | ok: [instance] => (item=logs)
2026-02-26 18:31:39.853448 | controller |
2026-02-26 18:31:41.041735 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-02-26 18:31:41.041756 | controller | Thursday 26 February 2026  18:31:39 +0000 (0:00:00.417)       0:02:14.968 *****
2026-02-26 18:31:41.041766 | controller | ok: [instance]
2026-02-26 18:31:41.264713 | controller |
2026-02-26 18:31:41.264736 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-02-26 18:31:41.264745 | controller | Thursday 26 February 2026  18:31:41 +0000 (0:00:01.188)       0:02:16.157 *****
2026-02-26 18:31:41.264755 | controller | changed: [instance]
2026-02-26 18:31:41.645592 | controller |
2026-02-26 18:31:41.645623 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-02-26 18:31:41.645632 | controller | Thursday 26 February 2026  18:31:41 +0000 (0:00:00.222)       0:02:16.380 *****
2026-02-26 18:31:41.645643 | controller | changed: [instance]
2026-02-26 18:31:42.047714 | controller |
2026-02-26 18:31:42.047750 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-02-26 18:31:42.047758 | controller | Thursday 26 February 2026  18:31:41 +0000 (0:00:00.380)       0:02:16.761 *****
2026-02-26 18:31:42.047769 | controller | changed: [instance]
2026-02-26 18:31:42.104636 | controller |
2026-02-26 18:31:42.104669 | controller | TASK [config_drive : Generate network-data] ************************************
2026-02-26 18:31:42.104678 | controller | Thursday 26 February 2026  18:31:42 +0000 (0:00:00.401)       0:02:17.162 *****
2026-02-26 18:31:42.104690 | controller | skipping: [instance]
2026-02-26 18:31:42.328072 | controller |
2026-02-26 18:31:42.328110 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-02-26 18:31:42.328120 | controller | Thursday 26 February 2026  18:31:42 +0000 (0:00:00.057)       0:02:17.220 *****
2026-02-26 18:31:42.328132 | controller | ok: [instance]
2026-02-26 18:31:42.328165 | controller |
2026-02-26 18:31:42.328198 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-02-26 18:31:42.328344 | controller | Thursday 26 February 2026  18:31:42 +0000 (0:00:00.223)       0:02:17.443 *****
2026-02-26 18:31:42.374440 | controller | skipping: [instance]
2026-02-26 18:31:42.631804 | controller |
2026-02-26 18:31:42.631884 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-02-26 18:31:42.631894 | controller | Thursday 26 February 2026  18:31:42 +0000 (0:00:00.046)       0:02:17.489 *****
2026-02-26 18:31:42.631907 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2026-02-26 18:31:42.935800 | controller | changed: [instance]
2026-02-26 18:31:42.935825 | controller |
2026-02-26 18:31:42.935833 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-02-26 18:31:42.935839 | controller | Thursday 26 February 2026  18:31:42 +0000 (0:00:00.256)       0:02:17.746 *****
2026-02-26 18:31:42.935848 | controller | changed: [instance]
2026-02-26 18:31:42.986120 | controller |
2026-02-26 18:31:42.986167 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-02-26 18:31:42.986177 | controller | Thursday 26 February 2026  18:31:42 +0000 (0:00:00.304)       0:02:18.051 *****
2026-02-26 18:31:42.986191 | controller | skipping: [instance]
2026-02-26 18:31:42.986223 | controller |
2026-02-26 18:31:42.986232 | controller | TASK [libvirt_manager : Configure boot order for controller-0] *****************
2026-02-26 18:31:42.986343 | controller | Thursday 26 February 2026  18:31:42 +0000 (0:00:00.050)       0:02:18.102 *****
2026-02-26 18:31:43.016889 | controller | skipping: [instance]
2026-02-26 18:31:43.279135 | controller |
2026-02-26 18:31:43.279200 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2026-02-26 18:31:43.279215 | controller | Thursday 26 February 2026  18:31:43 +0000 (0:00:00.030)       0:02:18.132 *****
2026-02-26 18:31:43.279228 | controller | changed: [instance]
2026-02-26 18:31:43.279256 | controller |
2026-02-26 18:31:43.279264 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2026-02-26 18:31:43.279362 | controller | Thursday 26 February 2026  18:31:43 +0000 (0:00:00.262)       0:02:18.395 *****
2026-02-26 18:31:43.515455 | controller | changed: [instance]
2026-02-26 18:31:43.855750 | controller |
2026-02-26 18:31:43.855774 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2026-02-26 18:31:43.855783 | controller | Thursday 26 February 2026  18:31:43 +0000 (0:00:00.236)       0:02:18.631 *****
2026-02-26 18:31:43.855794 | controller | changed: [instance]
2026-02-26 18:31:43.889572 | controller |
2026-02-26 18:31:43.889599 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2026-02-26 18:31:43.889610 | controller | Thursday 26 February 2026  18:31:43 +0000 (0:00:00.340)       0:02:18.971 *****
2026-02-26 18:31:43.889623 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-02-26 18:31:43.934195 | controller |
2026-02-26 18:31:43.934246 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-02-26 18:31:43.934260 | controller | Thursday 26 February 2026  18:31:43 +0000 (0:00:00.033)       0:02:19.004 *****
2026-02-26 18:31:43.934278 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-02-26 18:31:43.934324 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-02-26 18:31:43.934336 | controller |
2026-02-26 18:31:43.934349 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 18:31:43.934386 | controller | Thursday 26 February 2026  18:31:43 +0000 (0:00:00.045)       0:02:19.050 *****
2026-02-26 18:31:44.204146 | controller | ok: [instance]
2026-02-26 18:31:44.204197 | controller |
2026-02-26 18:31:44.204208 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 18:31:44.204221 | controller | Thursday 26 February 2026  18:31:44 +0000 (0:00:00.269)       0:02:19.319 *****
2026-02-26 18:31:44.256345 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 18:31:44.524988 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:31:44.525058 | controller |
2026-02-26 18:31:44.525069 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 18:31:44.525077 | controller | Thursday 26 February 2026  18:31:44 +0000 (0:00:00.052)       0:02:19.371 *****
2026-02-26 18:31:44.525092 | controller | ok: [instance]
2026-02-26 18:31:44.741478 | controller |
2026-02-26 18:31:44.741502 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 18:31:44.741510 | controller | Thursday 26 February 2026  18:31:44 +0000 (0:00:00.268)       0:02:19.640 *****
2026-02-26 18:31:44.741520 | controller | ok: [instance]
2026-02-26 18:31:45.090705 | controller |
2026-02-26 18:31:45.090740 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2026-02-26 18:31:45.090749 | controller | Thursday 26 February 2026  18:31:44 +0000 (0:00:00.216)       0:02:19.857 *****
2026-02-26 18:31:45.090759 | controller | changed: [instance]
2026-02-26 18:31:45.329423 | controller |
2026-02-26 18:31:45.329454 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-02-26 18:31:45.329461 | controller | Thursday 26 February 2026  18:31:45 +0000 (0:00:00.348)       0:02:20.206 *****
2026-02-26 18:31:45.329471 | controller | ok: [instance]
2026-02-26 18:31:45.376743 | controller |
2026-02-26 18:31:45.376769 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-02-26 18:31:45.376778 | controller | Thursday 26 February 2026  18:31:45 +0000 (0:00:00.238)       0:02:20.445 *****
2026-02-26 18:31:45.376789 | controller | ok: [instance] => (item=cifmw-public)
2026-02-26 18:31:45.606362 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-02-26 18:31:45.606398 | controller |
2026-02-26 18:31:45.606406 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-02-26 18:31:45.606412 | controller | Thursday 26 February 2026  18:31:45 +0000 (0:00:00.047)       0:02:20.492 *****
2026-02-26 18:31:45.606422 | controller | ok: [instance]
2026-02-26 18:31:45.804507 | controller |
2026-02-26 18:31:45.804544 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-02-26 18:31:45.804553 | controller | Thursday 26 February 2026  18:31:45 +0000 (0:00:00.229)       0:02:20.722 *****
2026-02-26 18:31:45.804563 | controller | ok: [instance]
2026-02-26 18:31:46.091091 | controller |
2026-02-26 18:31:46.091135 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2026-02-26 18:31:46.091146 | controller | Thursday 26 February 2026  18:31:45 +0000 (0:00:00.198)       0:02:20.920 *****
2026-02-26 18:31:46.091161 | controller | changed: [instance]
2026-02-26 18:31:46.091195 | controller |
2026-02-26 18:31:46.091206 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2026-02-26 18:31:46.091308 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.286)       0:02:21.206 *****
2026-02-26 18:31:46.114585 | controller | skipping: [instance]
2026-02-26 18:31:46.142485 | controller |
2026-02-26 18:31:46.142511 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2026-02-26 18:31:46.142520 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.023)       0:02:21.230 *****
2026-02-26 18:31:46.142531 | controller | skipping: [instance]
2026-02-26 18:31:46.171990 | controller |
2026-02-26 18:31:46.172011 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2026-02-26 18:31:46.172037 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.027)       0:02:21.258 *****
2026-02-26 18:31:46.172047 | controller | skipping: [instance]
2026-02-26 18:31:46.198928 | controller |
2026-02-26 18:31:46.198962 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2026-02-26 18:31:46.198972 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.029)       0:02:21.287 *****
2026-02-26 18:31:46.198981 | controller | skipping: [instance]
2026-02-26 18:31:46.408064 | controller |
2026-02-26 18:31:46.408096 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-02-26 18:31:46.408103 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.026)       0:02:21.314 *****
2026-02-26 18:31:46.408114 | controller | changed: [instance]
2026-02-26 18:31:46.408136 | controller |
2026-02-26 18:31:46.408144 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-02-26 18:31:46.408266 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.209)       0:02:21.523 *****
2026-02-26 18:31:46.446972 | controller | ok: [instance]
2026-02-26 18:31:46.472037 | controller |
2026-02-26 18:31:46.472061 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-02-26 18:31:46.472070 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.038)       0:02:21.562 *****
2026-02-26 18:31:46.472080 | controller | skipping: [instance]
2026-02-26 18:31:46.472235 | controller |
2026-02-26 18:31:46.472377 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-02-26 18:31:46.472495 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.025)       0:02:21.588 *****
2026-02-26 18:31:46.496879 | controller | skipping: [instance]
2026-02-26 18:31:46.497101 | controller |
2026-02-26 18:31:46.497271 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-02-26 18:31:46.497430 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.024)       0:02:21.613 *****
2026-02-26 18:31:46.539930 | controller | skipping: [instance]
2026-02-26 18:31:46.540150 | controller |
2026-02-26 18:31:46.540322 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************
2026-02-26 18:31:46.540479 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.042)       0:02:21.656 *****
2026-02-26 18:31:46.568069 | controller | skipping: [instance]
2026-02-26 18:31:46.568233 | controller |
2026-02-26 18:31:46.568383 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2026-02-26 18:31:46.568520 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.028)       0:02:21.684 *****
2026-02-26 18:31:46.630007 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2026-02-26 18:31:46.630193 | controller |
2026-02-26 18:31:46.630346 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2026-02-26 18:31:46.630499 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.061)       0:02:21.746 *****
2026-02-26 18:31:46.874805 | controller | ok: [instance] => (item=crc)
2026-02-26 18:31:48.946035 | controller |
2026-02-26 18:31:48.946072 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2026-02-26 18:31:48.946080 | controller | Thursday 26 February 2026  18:31:46 +0000 (0:00:00.244)       0:02:21.990 *****
2026-02-26 18:31:48.946091 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-02-26 18:31:48.946453 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-02-26 18:31:48.946467 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-02-26 18:31:49.840106 | controller |
2026-02-26 18:31:49.840151 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-02-26 18:31:49.840162 | controller | Thursday 26 February 2026  18:31:48 +0000 (0:00:02.071)       0:02:24.061 *****
2026-02-26 18:31:49.840175 | controller | changed: [instance]
2026-02-26 18:31:50.646936 | controller |
2026-02-26 18:31:50.647001 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-02-26 18:31:50.647026 | controller | Thursday 26 February 2026  18:31:49 +0000 (0:00:00.893)       0:02:24.955 *****
2026-02-26 18:31:50.647040 | controller | changed: [instance]
2026-02-26 18:31:51.541780 | controller |
2026-02-26 18:31:51.541814 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-02-26 18:31:51.541822 | controller | Thursday 26 February 2026  18:31:50 +0000 (0:00:00.807)       0:02:25.762 *****
2026-02-26 18:31:51.541832 | controller | changed: [instance]
2026-02-26 18:31:52.345859 | controller |
2026-02-26 18:31:52.345897 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2026-02-26 18:31:52.345912 | controller | Thursday 26 February 2026  18:31:51 +0000 (0:00:00.894)       0:02:26.657 *****
2026-02-26 18:31:52.345923 | controller | changed: [instance] => (item=compute-0.utility)
2026-02-26 18:32:15.602991 | controller | changed: [instance] => (item=controller-0.utility)
2026-02-26 18:32:15.603028 | controller | changed: [instance] => (item=crc-0.utility)
2026-02-26 18:32:15.603036 | controller |
2026-02-26 18:32:15.603041 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2026-02-26 18:32:15.603047 | controller | Thursday 26 February 2026  18:31:52 +0000 (0:00:00.803)       0:02:27.460 *****
2026-02-26 18:32:15.603057 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2026-02-26 18:32:15.721221 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2026-02-26 18:32:15.721248 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2026-02-26 18:32:15.721256 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2026-02-26 18:32:15.721262 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2026-02-26 18:32:15.721267 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left).
2026-02-26 18:32:15.721273 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left).
2026-02-26 18:32:15.721278 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j274225366515.24411', 'results_file': '/home/zuul/.ansible_async/j274225366515.24411', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2026-02-26 18:32:15.721289 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j727846625527.24428', 'results_file': '/home/zuul/.ansible_async/j727846625527.24428', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2026-02-26 18:32:15.721294 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j486876488662.24444', 'results_file': '/home/zuul/.ansible_async/j486876488662.24444', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2026-02-26 18:32:15.721304 | controller |
2026-02-26 18:32:15.721310 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2026-02-26 18:32:15.721316 | controller | Thursday 26 February 2026  18:32:15 +0000 (0:00:23.256)       0:02:50.717 *****
2026-02-26 18:32:15.721325 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-02-26 18:32:15.744012 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-02-26 18:32:15.744029 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-02-26 18:32:15.744036 | controller |
2026-02-26 18:32:15.744041 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-02-26 18:32:15.744046 | controller | Thursday 26 February 2026  18:32:15 +0000 (0:00:00.119)       0:02:50.836 *****
2026-02-26 18:32:15.744054 | controller | skipping: [instance]
2026-02-26 18:32:15.783850 | controller |
2026-02-26 18:32:15.783892 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2026-02-26 18:32:15.783901 | controller | Thursday 26 February 2026  18:32:15 +0000 (0:00:00.023)       0:02:50.860 *****
2026-02-26 18:32:15.783927 | controller |
2026-02-26 18:32:15.861120 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-02-26 18:32:15.861149 | controller | Thursday 26 February 2026  18:32:15 +0000 (0:00:00.039)       0:02:50.899 *****
2026-02-26 18:32:15.861167 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-02-26 18:32:16.083578 | controller |
2026-02-26 18:32:16.083616 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-02-26 18:32:16.083624 | controller | Thursday 26 February 2026  18:32:15 +0000 (0:00:00.077)       0:02:50.977 *****
2026-02-26 18:32:16.083635 | controller | changed: [instance]
2026-02-26 18:32:16.304734 | controller |
2026-02-26 18:32:16.304778 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-02-26 18:32:16.304786 | controller | Thursday 26 February 2026  18:32:16 +0000 (0:00:00.222)       0:02:51.199 *****
2026-02-26 18:32:16.304798 | controller | changed: [instance]
2026-02-26 18:32:16.713203 | controller |
2026-02-26 18:32:16.713254 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2026-02-26 18:32:16.713263 | controller | Thursday 26 February 2026  18:32:16 +0000 (0:00:00.221)       0:02:51.420 *****
2026-02-26 18:32:16.713274 | controller | changed: [instance]
2026-02-26 18:32:16.740261 | controller |
2026-02-26 18:32:16.740298 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2026-02-26 18:32:16.740307 | controller | Thursday 26 February 2026  18:32:16 +0000 (0:00:00.406)       0:02:51.827 *****
2026-02-26 18:32:16.740318 | controller | skipping: [instance]
2026-02-26 18:32:16.740336 | controller |
2026-02-26 18:32:16.740342 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-02-26 18:32:16.740350 | controller | Thursday 26 February 2026  18:32:16 +0000 (0:00:00.028)       0:02:51.856 *****
2026-02-26 18:32:16.768546 | controller | skipping: [instance]
2026-02-26 18:32:16.768608 | controller |
2026-02-26 18:32:16.768616 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2026-02-26 18:32:16.768625 | controller | Thursday 26 February 2026  18:32:16 +0000 (0:00:00.028)       0:02:51.884 *****
2026-02-26 18:32:16.812362 | controller | skipping: [instance]
2026-02-26 18:32:16.853691 | controller |
2026-02-26 18:32:16.853724 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2026-02-26 18:32:16.853733 | controller | Thursday 26 February 2026  18:32:16 +0000 (0:00:00.043)       0:02:51.928 *****
2026-02-26 18:32:16.853745 | controller | skipping: [instance]
2026-02-26 18:32:16.853774 | controller |
2026-02-26 18:32:16.853796 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-02-26 18:32:16.853932 | controller | Thursday 26 February 2026  18:32:16 +0000 (0:00:00.041)       0:02:51.969 *****
2026-02-26 18:32:16.880726 | controller | skipping: [instance]
2026-02-26 18:32:16.939106 | controller |
2026-02-26 18:32:16.939169 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2026-02-26 18:32:16.939177 | controller | Thursday 26 February 2026  18:32:16 +0000 (0:00:00.026)       0:02:51.996 *****
2026-02-26 18:32:16.939196 | controller |
2026-02-26 18:32:16.939216 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-02-26 18:32:16.939223 | controller | Thursday 26 February 2026  18:32:16 +0000 (0:00:00.058)       0:02:52.054 *****
2026-02-26 18:32:17.020967 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-02-26 18:32:17.021033 | controller |
2026-02-26 18:32:17.021168 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-02-26 18:32:17.021258 | controller | Thursday 26 February 2026  18:32:17 +0000 (0:00:00.081)       0:02:52.136 *****
2026-02-26 18:32:17.312408 | controller | ok: [instance]
2026-02-26 18:32:17.544407 | controller |
2026-02-26 18:32:17.544445 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-02-26 18:32:17.544453 | controller | Thursday 26 February 2026  18:32:17 +0000 (0:00:00.290)       0:02:52.427 *****
2026-02-26 18:32:17.544464 | controller | ok: [instance]
2026-02-26 18:32:17.958070 | controller |
2026-02-26 18:32:17.958108 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2026-02-26 18:32:17.958116 | controller | Thursday 26 February 2026  18:32:17 +0000 (0:00:00.231)       0:02:52.659 *****
2026-02-26 18:32:17.958134 | controller | changed: [instance]
2026-02-26 18:32:17.958151 | controller |
2026-02-26 18:32:17.958159 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2026-02-26 18:32:17.958243 | controller | Thursday 26 February 2026  18:32:17 +0000 (0:00:00.413)       0:02:53.073 *****
2026-02-26 18:32:17.987022 | controller | skipping: [instance]
2026-02-26 18:32:17.987108 | controller |
2026-02-26 18:32:17.987222 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-02-26 18:32:17.987318 | controller | Thursday 26 February 2026  18:32:17 +0000 (0:00:00.029)       0:02:53.103 *****
2026-02-26 18:32:18.019544 | controller | skipping: [instance]
2026-02-26 18:32:18.019621 | controller |
2026-02-26 18:32:18.019721 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2026-02-26 18:32:18.019833 | controller | Thursday 26 February 2026  18:32:18 +0000 (0:00:00.032)       0:02:53.135 *****
2026-02-26 18:32:19.722511 | controller | changed: [instance -> controller-0.instance]
2026-02-26 18:32:19.722582 | controller |
2026-02-26 18:32:19.722645 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2026-02-26 18:32:19.722749 | controller | Thursday 26 February 2026  18:32:19 +0000 (0:00:01.702)       0:02:54.838 *****
2026-02-26 18:32:20.841903 | controller | changed: [instance -> controller-0.instance]
2026-02-26 18:32:20.841986 | controller |
2026-02-26 18:32:20.842085 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-02-26 18:32:20.842168 | controller | Thursday 26 February 2026  18:32:20 +0000 (0:00:01.118)       0:02:55.957 *****
2026-02-26 18:32:20.891092 | controller |
2026-02-26 18:32:20.891207 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-02-26 18:32:20.891305 | controller | Thursday 26 February 2026  18:32:20 +0000 (0:00:00.049)       0:02:56.006 *****
2026-02-26 18:32:21.132302 | controller | ok: [instance]
2026-02-26 18:32:21.132378 | controller |
2026-02-26 18:32:21.132507 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-02-26 18:32:21.132568 | controller | Thursday 26 February 2026  18:32:21 +0000 (0:00:00.241)       0:02:56.248 *****
2026-02-26 18:32:21.160209 | controller | ok: [instance]
2026-02-26 18:32:21.160298 | controller |
2026-02-26 18:32:21.160397 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-02-26 18:32:21.160494 | controller | Thursday 26 February 2026  18:32:21 +0000 (0:00:00.028)       0:02:56.276 *****
2026-02-26 18:32:21.195097 | controller | skipping: [instance]
2026-02-26 18:32:21.195179 | controller |
2026-02-26 18:32:21.195276 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2026-02-26 18:32:21.195377 | controller | Thursday 26 February 2026  18:32:21 +0000 (0:00:00.033)       0:02:56.310 *****
2026-02-26 18:32:21.245930 | controller |
2026-02-26 18:32:21.246072 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-02-26 18:32:21.246162 | controller | Thursday 26 February 2026  18:32:21 +0000 (0:00:00.051)       0:02:56.361 *****
2026-02-26 18:32:21.339392 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2026-02-26 18:32:21.339487 | controller |
2026-02-26 18:32:21.339597 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-02-26 18:32:21.339714 | controller | Thursday 26 February 2026  18:32:21 +0000 (0:00:00.093)       0:02:56.455 *****
2026-02-26 18:32:21.574940 | controller | ok: [instance]
2026-02-26 18:32:21.575030 | controller |
2026-02-26 18:32:21.575042 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-02-26 18:32:21.575121 | controller | Thursday 26 February 2026  18:32:21 +0000 (0:00:00.234)       0:02:56.690 *****
2026-02-26 18:32:21.822237 | controller | ok: [instance]
2026-02-26 18:32:21.822292 | controller |
2026-02-26 18:32:21.822415 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2026-02-26 18:32:21.822510 | controller | Thursday 26 February 2026  18:32:21 +0000 (0:00:00.247)       0:02:56.937 *****
2026-02-26 18:32:22.305006 | controller | changed: [instance]
2026-02-26 18:32:22.305406 | controller |
2026-02-26 18:32:23.240879 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2026-02-26 18:32:23.240976 | controller | Thursday 26 February 2026  18:32:22 +0000 (0:00:00.482)       0:02:57.420 *****
2026-02-26 18:32:23.241001 | controller | changed: [instance]
2026-02-26 18:32:23.241241 | controller |
2026-02-26 18:32:23.241391 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-02-26 18:32:23.241486 | controller | Thursday 26 February 2026  18:32:23 +0000 (0:00:00.933)       0:02:58.354 *****
2026-02-26 18:32:23.281416 | controller | skipping: [instance]
2026-02-26 18:32:23.281493 | controller |
2026-02-26 18:32:23.281607 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2026-02-26 18:32:23.281700 | controller | Thursday 26 February 2026  18:32:23 +0000 (0:00:00.042)       0:02:58.397 *****
2026-02-26 18:32:23.338399 | controller | skipping: [instance]
2026-02-26 18:32:23.338505 | controller |
2026-02-26 18:32:23.338715 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2026-02-26 18:32:23.395984 | controller | Thursday 26 February 2026  18:32:23 +0000 (0:00:00.057)       0:02:58.454 *****
2026-02-26 18:32:23.396014 | controller | skipping: [instance]
2026-02-26 18:32:23.458284 | controller |
2026-02-26 18:32:23.458315 | controller | TASK [Create VBMC entity] ******************************************************
2026-02-26 18:32:23.458323 | controller | Thursday 26 February 2026  18:32:23 +0000 (0:00:00.057)       0:02:58.511 *****
2026-02-26 18:32:23.458353 | controller | skipping: [instance] => (item=compute-0)
2026-02-26 18:32:23.728057 | controller | skipping: [instance] => (item=controller-0)
2026-02-26 18:32:23.728109 | controller | skipping: [instance] => (item=crc-0)
2026-02-26 18:32:23.728117 | controller | skipping: [instance]
2026-02-26 18:32:23.728124 | controller |
2026-02-26 18:32:23.728130 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2026-02-26 18:32:23.728135 | controller | Thursday 26 February 2026  18:32:23 +0000 (0:00:00.060)       0:02:58.572 *****
2026-02-26 18:32:23.728149 | controller | ok: [instance]
2026-02-26 18:32:23.728171 | controller |
2026-02-26 18:32:23.728177 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2026-02-26 18:32:23.728185 | controller | Thursday 26 February 2026  18:32:23 +0000 (0:00:00.270)       0:02:58.843 *****
2026-02-26 18:32:24.143924 | controller | changed: [instance]
2026-02-26 18:32:24.182965 | controller |
2026-02-26 18:32:24.183014 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2026-02-26 18:32:24.183023 | controller | Thursday 26 February 2026  18:32:24 +0000 (0:00:00.415)       0:02:59.259 *****
2026-02-26 18:32:24.183039 | controller | skipping: [instance]
2026-02-26 18:32:24.218778 | controller |
2026-02-26 18:32:24.218824 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2026-02-26 18:32:24.218833 | controller | Thursday 26 February 2026  18:32:24 +0000 (0:00:00.039)       0:02:59.298 *****
2026-02-26 18:32:24.218848 | controller | skipping: [instance]
2026-02-26 18:32:24.256924 | controller |
2026-02-26 18:32:24.256981 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2026-02-26 18:32:24.256993 | controller | Thursday 26 February 2026  18:32:24 +0000 (0:00:00.035)       0:02:59.334 *****
2026-02-26 18:32:24.257009 | controller | skipping: [instance]
2026-02-26 18:32:25.030479 | controller |
2026-02-26 18:32:25.030535 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2026-02-26 18:32:25.030544 | controller | Thursday 26 February 2026  18:32:24 +0000 (0:00:00.038)       0:02:59.372 *****
2026-02-26 18:32:25.030561 | controller | changed: [instance]
2026-02-26 18:32:25.868916 | controller |
2026-02-26 18:32:25.868987 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2026-02-26 18:32:25.868996 | controller | Thursday 26 February 2026  18:32:25 +0000 (0:00:00.772)       0:03:00.145 *****
2026-02-26 18:32:25.869008 | controller | changed: [instance]
2026-02-26 18:32:25.869123 | controller |
2026-02-26 18:32:25.869141 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2026-02-26 18:32:25.869151 | controller | Thursday 26 February 2026  18:32:25 +0000 (0:00:00.838)       0:03:00.984 *****
2026-02-26 18:32:25.907599 | controller | skipping: [instance]
2026-02-26 18:32:25.907674 | controller |
2026-02-26 18:32:25.907771 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2026-02-26 18:32:25.907873 | controller | Thursday 26 February 2026  18:32:25 +0000 (0:00:00.038)       0:03:01.023 *****
2026-02-26 18:32:25.966436 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2026-02-26 18:32:25.966526 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2026-02-26 18:32:25.966628 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2026-02-26 18:32:25.966715 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2026-02-26 18:32:25.966807 | controller |
2026-02-26 18:32:25.966902 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2026-02-26 18:32:25.967019 | controller | Thursday 26 February 2026  18:32:25 +0000 (0:00:00.059)       0:03:01.082 *****
2026-02-26 18:32:26.012293 | controller | skipping: [instance]
2026-02-26 18:32:26.012370 | controller |
2026-02-26 18:32:26.012463 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2026-02-26 18:32:26.012553 | controller | Thursday 26 February 2026  18:32:26 +0000 (0:00:00.042)       0:03:01.125 *****
2026-02-26 18:32:26.046598 | controller | skipping: [instance]
2026-02-26 18:32:26.046706 | controller |
2026-02-26 18:32:26.046871 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2026-02-26 18:32:26.047048 | controller | Thursday 26 February 2026  18:32:26 +0000 (0:00:00.037)       0:03:01.162 *****
2026-02-26 18:32:26.084113 | controller | skipping: [instance]
2026-02-26 18:32:26.084248 | controller |
2026-02-26 18:32:26.084366 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2026-02-26 18:32:26.084480 | controller | Thursday 26 February 2026  18:32:26 +0000 (0:00:00.037)       0:03:01.200 *****
2026-02-26 18:32:26.124141 | controller | skipping: [instance]
2026-02-26 18:32:26.124220 | controller |
2026-02-26 18:32:26.124232 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2026-02-26 18:32:26.124242 | controller | Thursday 26 February 2026  18:32:26 +0000 (0:00:00.039)       0:03:01.240 *****
2026-02-26 18:32:26.878823 | controller | changed: [instance]
2026-02-26 18:32:26.879127 | controller |
2026-02-26 18:32:26.879297 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2026-02-26 18:32:26.879440 | controller | Thursday 26 February 2026  18:32:26 +0000 (0:00:00.753)       0:03:01.994 *****
2026-02-26 18:32:26.912189 | controller | skipping: [instance]
2026-02-26 18:32:26.912329 | controller |
2026-02-26 18:32:26.912460 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2026-02-26 18:32:26.912585 | controller | Thursday 26 February 2026  18:32:26 +0000 (0:00:00.034)       0:03:02.028 *****
2026-02-26 18:32:26.944849 | controller | skipping: [instance]
2026-02-26 18:32:26.945048 | controller |
2026-02-26 18:32:26.945196 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2026-02-26 18:32:26.945331 | controller | Thursday 26 February 2026  18:32:26 +0000 (0:00:00.032)       0:03:02.061 *****
2026-02-26 18:32:26.977463 | controller | skipping: [instance]
2026-02-26 18:32:26.977600 | controller |
2026-02-26 18:32:26.977728 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-02-26 18:32:26.977853 | controller | Thursday 26 February 2026  18:32:26 +0000 (0:00:00.032)       0:03:02.093 *****
2026-02-26 18:32:27.015677 | controller | skipping: [instance]
2026-02-26 18:32:27.015816 | controller |
2026-02-26 18:32:27.015997 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-02-26 18:32:27.016137 | controller | Thursday 26 February 2026  18:32:27 +0000 (0:00:00.034)       0:03:02.128 *****
2026-02-26 18:32:27.049748 | controller | skipping: [instance]
2026-02-26 18:32:27.049902 | controller |
2026-02-26 18:32:27.050069 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-02-26 18:32:27.050201 | controller | Thursday 26 February 2026  18:32:27 +0000 (0:00:00.037)       0:03:02.165 *****
2026-02-26 18:32:27.084066 | controller | skipping: [instance]
2026-02-26 18:32:27.084203 | controller |
2026-02-26 18:32:27.084330 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-02-26 18:32:27.084454 | controller | Thursday 26 February 2026  18:32:27 +0000 (0:00:00.034)       0:03:02.200 *****
2026-02-26 18:32:27.114747 | controller | skipping: [instance]
2026-02-26 18:32:27.114893 | controller |
2026-02-26 18:32:27.115077 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-02-26 18:32:27.115217 | controller | Thursday 26 February 2026  18:32:27 +0000 (0:00:00.030)       0:03:02.231 *****
2026-02-26 18:32:27.147559 | controller | skipping: [instance]
2026-02-26 18:32:27.147696 | controller |
2026-02-26 18:32:27.147825 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-02-26 18:32:27.147999 | controller | Thursday 26 February 2026  18:32:27 +0000 (0:00:00.032)       0:03:02.263 *****
2026-02-26 18:32:27.180404 | controller | skipping: [instance]
2026-02-26 18:32:27.180550 | controller |
2026-02-26 18:32:27.180690 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-02-26 18:32:27.180827 | controller | Thursday 26 February 2026  18:32:27 +0000 (0:00:00.032)       0:03:02.296 *****
2026-02-26 18:32:27.223437 | controller | skipping: [instance]
2026-02-26 18:32:27.223573 | controller |
2026-02-26 18:32:27.223701 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2026-02-26 18:32:27.223833 | controller | Thursday 26 February 2026  18:32:27 +0000 (0:00:00.043)       0:03:02.339 *****
2026-02-26 18:32:27.255480 | controller | skipping: [instance]
2026-02-26 18:32:27.255614 | controller |
2026-02-26 18:32:27.255742 | controller | TASK [reproducer : Configure Controller node] **********************************
2026-02-26 18:32:27.255889 | controller | Thursday 26 February 2026  18:32:27 +0000 (0:00:00.032)       0:03:02.371 *****
2026-02-26 18:32:27.403215 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2026-02-26 18:32:27.403363 | controller |
2026-02-26 18:32:27.403501 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-02-26 18:32:27.403625 | controller | Thursday 26 February 2026  18:32:27 +0000 (0:00:00.147)       0:03:02.519 *****
2026-02-26 18:32:28.897186 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-02-26 18:32:28.897314 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-02-26 18:32:28.897326 | controller |
2026-02-26 18:32:28.897355 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-02-26 18:32:28.897577 | controller | Thursday 26 February 2026  18:32:28 +0000 (0:00:01.492)       0:03:04.011 *****
2026-02-26 18:32:28.924096 | controller | skipping: [instance]
2026-02-26 18:32:28.924204 | controller |
2026-02-26 18:32:28.924218 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-02-26 18:32:28.924231 | controller | Thursday 26 February 2026  18:32:28 +0000 (0:00:00.027)       0:03:04.039 *****
2026-02-26 18:32:29.535141 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:29.535194 | controller |
2026-02-26 18:32:29.535202 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-02-26 18:32:29.535212 | controller | Thursday 26 February 2026  18:32:29 +0000 (0:00:00.611)       0:03:04.650 *****
2026-02-26 18:32:29.572058 | controller | skipping: [instance]
2026-02-26 18:32:29.572114 | controller |
2026-02-26 18:32:29.572126 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-02-26 18:32:29.572260 | controller | Thursday 26 February 2026  18:32:29 +0000 (0:00:00.037)       0:03:04.688 *****
2026-02-26 18:32:29.607215 | controller | skipping: [instance]
2026-02-26 18:32:29.607336 | controller |
2026-02-26 18:32:29.607354 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-02-26 18:32:29.607524 | controller | Thursday 26 February 2026  18:32:29 +0000 (0:00:00.035)       0:03:04.723 *****
2026-02-26 18:32:29.644165 | controller | skipping: [instance]
2026-02-26 18:32:29.644204 | controller |
2026-02-26 18:32:29.644218 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-02-26 18:32:29.644234 | controller | Thursday 26 February 2026  18:32:29 +0000 (0:00:00.036)       0:03:04.759 *****
2026-02-26 18:32:29.684158 | controller | skipping: [instance]
2026-02-26 18:32:29.684216 | controller |
2026-02-26 18:32:29.684227 | controller | TASK [reproducer : Get rhos-release] *******************************************
2026-02-26 18:32:29.684239 | controller | Thursday 26 February 2026  18:32:29 +0000 (0:00:00.040)       0:03:04.799 *****
2026-02-26 18:32:29.717395 | controller | skipping: [instance]
2026-02-26 18:32:29.749131 | controller |
2026-02-26 18:32:29.749168 | controller | TASK [reproducer : Install repos] **********************************************
2026-02-26 18:32:29.749178 | controller | Thursday 26 February 2026  18:32:29 +0000 (0:00:00.033)       0:03:04.833 *****
2026-02-26 18:32:29.749192 | controller | skipping: [instance]
2026-02-26 18:32:29.749352 | controller |
2026-02-26 18:32:29.749378 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2026-02-26 18:32:29.749428 | controller | Thursday 26 February 2026  18:32:29 +0000 (0:00:00.031)       0:03:04.864 *****
2026-02-26 18:32:29.779080 | controller | skipping: [instance]
2026-02-26 18:32:29.779259 | controller |
2026-02-26 18:32:29.779354 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2026-02-26 18:32:29.779463 | controller | Thursday 26 February 2026  18:32:29 +0000 (0:00:00.030)       0:03:04.895 *****
2026-02-26 18:32:29.823090 | controller | skipping: [instance]
2026-02-26 18:32:29.823307 | controller |
2026-02-26 18:32:29.823419 | controller | TASK [reproducer : Install some tools] *****************************************
2026-02-26 18:32:29.823523 | controller | Thursday 26 February 2026  18:32:29 +0000 (0:00:00.043)       0:03:04.939 *****
2026-02-26 18:32:31.000151 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:32.148994 | controller |
2026-02-26 18:32:32.149097 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2026-02-26 18:32:32.149108 | controller | Thursday 26 February 2026  18:32:30 +0000 (0:00:01.176)       0:03:06.115 *****
2026-02-26 18:32:32.149132 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:32.777616 | controller |
2026-02-26 18:32:32.777681 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2026-02-26 18:32:32.777690 | controller | Thursday 26 February 2026  18:32:32 +0000 (0:00:01.148)       0:03:07.264 *****
2026-02-26 18:32:32.777702 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:33.817102 | controller |
2026-02-26 18:32:33.817149 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2026-02-26 18:32:33.817158 | controller | Thursday 26 February 2026  18:32:32 +0000 (0:00:00.628)       0:03:07.892 *****
2026-02-26 18:32:33.817170 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:34.938593 | controller |
2026-02-26 18:32:34.938661 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2026-02-26 18:32:34.938672 | controller | Thursday 26 February 2026  18:32:33 +0000 (0:00:01.039)       0:03:08.932 *****
2026-02-26 18:32:34.938687 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-02-26 18:32:35.711153 | controller | skipping: [instance] => (item=compute-0)
2026-02-26 18:32:35.711210 | controller | skipping: [instance] => (item=controller-0)
2026-02-26 18:32:35.711224 | controller | skipping: [instance] => (item=crc-0)
2026-02-26 18:32:35.711234 | controller |
2026-02-26 18:32:35.711257 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2026-02-26 18:32:35.711269 | controller | Thursday 26 February 2026  18:32:34 +0000 (0:00:01.120)       0:03:10.053 *****
2026-02-26 18:32:35.711287 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-02-26 18:32:37.618981 | controller | skipping: [instance] => (item=compute-0)
2026-02-26 18:32:37.619018 | controller | skipping: [instance] => (item=controller-0)
2026-02-26 18:32:37.619026 | controller | skipping: [instance] => (item=crc-0)
2026-02-26 18:32:37.619032 | controller |
2026-02-26 18:32:37.619038 | controller | TASK [reproducer : Inject SSH configuration] ***********************************
2026-02-26 18:32:37.619044 | controller | Thursday 26 February 2026  18:32:35 +0000 (0:00:00.772)       0:03:10.825 *****
2026-02-26 18:32:37.619056 | controller | skipping: [instance] => (item=instance)
2026-02-26 18:32:37.619828 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
2026-02-26 18:32:38.300353 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-02-26 18:32:38.300423 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
2026-02-26 18:32:38.300432 | controller |
2026-02-26 18:32:38.300439 | controller | TASK [reproducer : Create kube directory] **************************************
2026-02-26 18:32:38.300445 | controller | Thursday 26 February 2026  18:32:37 +0000 (0:00:01.908)       0:03:12.734 *****
2026-02-26 18:32:38.300460 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:38.300483 | controller |
2026-02-26 18:32:38.300512 | controller | TASK [reproducer : Inject kubeconfig content] **********************************
2026-02-26 18:32:38.300520 | controller | Thursday 26 February 2026  18:32:38 +0000 (0:00:00.680)       0:03:13.415 *****
2026-02-26 18:32:39.523114 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:39.523198 | controller |
2026-02-26 18:32:40.642761 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************
2026-02-26 18:32:40.642849 | controller | Thursday 26 February 2026  18:32:39 +0000 (0:00:01.220)       0:03:14.635 *****
2026-02-26 18:32:40.642869 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:40.642900 | controller |
2026-02-26 18:32:40.642922 | controller | TASK [reproducer : Inject devscripts private key if set] ***********************
2026-02-26 18:32:40.677615 | controller | Thursday 26 February 2026  18:32:40 +0000 (0:00:01.121)       0:03:15.757 *****
2026-02-26 18:32:40.677657 | controller | skipping: [instance]
2026-02-26 18:32:40.677687 | controller |
2026-02-26 18:32:40.677808 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ******************************
2026-02-26 18:32:40.677904 | controller | Thursday 26 February 2026  18:32:40 +0000 (0:00:00.035)       0:03:15.793 *****
2026-02-26 18:32:41.351905 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:41.352011 | controller |
2026-02-26 18:32:41.352193 | controller | TASK [manage_secrets : Ensure directory tree exist] ****************************
2026-02-26 18:32:41.352266 | controller | Thursday 26 February 2026  18:32:41 +0000 (0:00:00.673)       0:03:16.466 *****
2026-02-26 18:32:41.964502 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:42.013145 | controller |
2026-02-26 18:32:42.013185 | controller | TASK [manage_secrets : Assert we get needed data] ******************************
2026-02-26 18:32:42.013193 | controller | Thursday 26 February 2026  18:32:41 +0000 (0:00:00.611)       0:03:17.078 *****
2026-02-26 18:32:42.013205 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:42.084810 | controller |
2026-02-26 18:32:42.084840 | controller | TASK [manage_secrets : Push reproducer secrets] ********************************
2026-02-26 18:32:42.084848 | controller | Thursday 26 February 2026  18:32:42 +0000 (0:00:00.050)       0:03:17.128 *****
2026-02-26 18:32:42.084858 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
2026-02-26 18:32:42.144368 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
2026-02-26 18:32:42.144393 | controller |
2026-02-26 18:32:42.144401 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-02-26 18:32:42.144408 | controller | Thursday 26 February 2026  18:32:42 +0000 (0:00:00.071)       0:03:17.200 *****
2026-02-26 18:32:42.144418 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 18:32:42.196765 | controller |   _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
2026-02-26 18:32:42.196794 | controller |
2026-02-26 18:32:42.196802 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-02-26 18:32:42.196808 | controller | Thursday 26 February 2026  18:32:42 +0000 (0:00:00.059)       0:03:17.260 *****
2026-02-26 18:32:42.196818 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 18:32:42.258488 | controller |   _secret_file: ''
2026-02-26 18:32:42.258513 | controller |
2026-02-26 18:32:42.258521 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-02-26 18:32:42.258528 | controller | Thursday 26 February 2026  18:32:42 +0000 (0:00:00.052)       0:03:17.312 *****
2026-02-26 18:32:42.258539 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 18:32:42.312313 | controller |   _secret_content: my-default-location-place
2026-02-26 18:32:42.312334 | controller |
2026-02-26 18:32:42.312341 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-02-26 18:32:42.312353 | controller | Thursday 26 February 2026  18:32:42 +0000 (0:00:00.061)       0:03:17.374 *****
2026-02-26 18:32:42.312363 | controller | skipping: [instance]
2026-02-26 18:32:42.369481 | controller |
2026-02-26 18:32:42.369501 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-02-26 18:32:42.369508 | controller | Thursday 26 February 2026  18:32:42 +0000 (0:00:00.054)       0:03:17.428 *****
2026-02-26 18:32:42.369517 | controller | skipping: [instance]
2026-02-26 18:32:42.424024 | controller |
2026-02-26 18:32:42.424048 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-02-26 18:32:42.424057 | controller | Thursday 26 February 2026  18:32:42 +0000 (0:00:00.057)       0:03:17.485 *****
2026-02-26 18:32:42.424075 | controller | skipping: [instance]
2026-02-26 18:32:43.453051 | controller |
2026-02-26 18:32:43.453087 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-02-26 18:32:43.453095 | controller | Thursday 26 February 2026  18:32:42 +0000 (0:00:00.054)       0:03:17.539 *****
2026-02-26 18:32:43.453105 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:43.517967 | controller |
2026-02-26 18:32:43.518000 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-02-26 18:32:43.518008 | controller | Thursday 26 February 2026  18:32:43 +0000 (0:00:01.028)       0:03:18.568 *****
2026-02-26 18:32:43.518019 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 18:32:43.569050 | controller |   _secret_dest: /home/zuul/ipmi-things
2026-02-26 18:32:43.569076 | controller |
2026-02-26 18:32:43.569084 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-02-26 18:32:43.569090 | controller | Thursday 26 February 2026  18:32:43 +0000 (0:00:00.064)       0:03:18.633 *****
2026-02-26 18:32:43.569101 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 18:32:43.569324 | controller |   _secret_file: /tmp/ipmi-things
2026-02-26 18:32:43.569336 | controller |
2026-02-26 18:32:43.569344 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-02-26 18:32:43.622248 | controller | Thursday 26 February 2026  18:32:43 +0000 (0:00:00.051)       0:03:18.684 *****
2026-02-26 18:32:43.622280 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-02-26 18:32:43.689642 | controller |   _secret_content: ''
2026-02-26 18:32:43.689668 | controller |
2026-02-26 18:32:43.689676 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-02-26 18:32:43.689682 | controller | Thursday 26 February 2026  18:32:43 +0000 (0:00:00.052)       0:03:18.737 *****
2026-02-26 18:32:43.689691 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false
2026-02-26 18:32:44.280976 | controller |   msg: All assertions passed
2026-02-26 18:32:44.281011 | controller |
2026-02-26 18:32:44.281019 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-02-26 18:32:44.281025 | controller | Thursday 26 February 2026  18:32:43 +0000 (0:00:00.066)       0:03:18.803 *****
2026-02-26 18:32:44.281035 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:45.296373 | controller |
2026-02-26 18:32:45.296407 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-02-26 18:32:45.296415 | controller | Thursday 26 February 2026  18:32:44 +0000 (0:00:00.592)       0:03:19.396 *****
2026-02-26 18:32:45.296425 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:45.361792 | controller |
2026-02-26 18:32:45.361824 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-02-26 18:32:45.361832 | controller | Thursday 26 February 2026  18:32:45 +0000 (0:00:01.015)       0:03:20.411 *****
2026-02-26 18:32:45.361843 | controller | skipping: [instance]
2026-02-26 18:32:46.023617 | controller |
2026-02-26 18:32:46.023654 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
2026-02-26 18:32:46.023662 | controller | Thursday 26 February 2026  18:32:45 +0000 (0:00:00.065)       0:03:20.477 *****
2026-02-26 18:32:46.023671 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:32:46.691915 | controller |
2026-02-26 18:32:46.691971 | controller | TASK [reproducer : Check if async file is still available] *********************
2026-02-26 18:32:46.691983 | controller | Thursday 26 February 2026  18:32:46 +0000 (0:00:00.661)       0:03:21.138 *****
2026-02-26 18:32:46.691993 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:31.736823 | controller |
2026-02-26 18:33:31.736882 | controller | TASK [reproducer : Check package install status] *******************************
2026-02-26 18:33:31.736890 | controller | Thursday 26 February 2026  18:32:46 +0000 (0:00:00.668)       0:03:21.807 *****
2026-02-26 18:33:31.736913 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
2026-02-26 18:33:32.532573 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
2026-02-26 18:33:32.532615 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
2026-02-26 18:33:32.532623 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
2026-02-26 18:33:32.532629 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
2026-02-26 18:33:32.532639 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
2026-02-26 18:33:32.532644 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
2026-02-26 18:33:32.532649 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left).
2026-02-26 18:33:32.532654 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:32.532660 | controller |
2026-02-26 18:33:32.532665 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
2026-02-26 18:33:32.532670 | controller | Thursday 26 February 2026  18:33:31 +0000 (0:00:45.041)       0:04:06.848 *****
2026-02-26 18:33:32.532679 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:35.533150 | controller |
2026-02-26 18:33:35.533217 | controller | TASK [sushy_emulator : Install required packages] ******************************
2026-02-26 18:33:35.533227 | controller | Thursday 26 February 2026  18:33:32 +0000 (0:00:00.798)       0:04:07.647 *****
2026-02-26 18:33:35.533241 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:35.583098 | controller |
2026-02-26 18:33:35.583133 | controller | TASK [sushy_emulator : Get ingresses domain] ***********************************
2026-02-26 18:33:35.583141 | controller | Thursday 26 February 2026  18:33:35 +0000 (0:00:02.999)       0:04:10.646 *****
2026-02-26 18:33:35.583153 | controller | skipping: [instance]
2026-02-26 18:33:35.637720 | controller |
2026-02-26 18:33:35.637758 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] *********************
2026-02-26 18:33:35.637767 | controller | Thursday 26 February 2026  18:33:35 +0000 (0:00:00.052)       0:04:10.698 *****
2026-02-26 18:33:35.637778 | controller | skipping: [instance]
2026-02-26 18:33:36.383648 | controller |
2026-02-26 18:33:36.383723 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
2026-02-26 18:33:36.383733 | controller | Thursday 26 February 2026  18:33:35 +0000 (0:00:00.048)       0:04:10.747 *****
2026-02-26 18:33:36.383749 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:36.383774 | controller |
2026-02-26 18:33:36.383780 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ********************
2026-02-26 18:33:36.383788 | controller | Thursday 26 February 2026  18:33:36 +0000 (0:00:00.747)       0:04:11.495 *****
2026-02-26 18:33:37.022634 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:37.022703 | controller |
2026-02-26 18:33:37.022763 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
2026-02-26 18:33:37.022855 | controller | Thursday 26 February 2026  18:33:37 +0000 (0:00:00.643)       0:04:12.138 *****
2026-02-26 18:33:37.379600 | controller | changed: [instance]
2026-02-26 18:33:37.379692 | controller |
2026-02-26 18:33:37.379707 | controller | TASK [sushy_emulator : Run ssh-keyscan] ****************************************
2026-02-26 18:33:37.379754 | controller | Thursday 26 February 2026  18:33:37 +0000 (0:00:00.356)       0:04:12.495 *****
2026-02-26 18:33:38.135822 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:38.135894 | controller |
2026-02-26 18:33:38.135936 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************
2026-02-26 18:33:38.136070 | controller | Thursday 26 February 2026  18:33:38 +0000 (0:00:00.756)       0:04:13.251 *****
2026-02-26 18:33:39.225383 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:39.225434 | controller |
2026-02-26 18:33:39.225541 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-02-26 18:33:39.225640 | controller | Thursday 26 February 2026  18:33:39 +0000 (0:00:01.089)       0:04:14.341 *****
2026-02-26 18:33:39.288295 | controller | skipping: [instance]
2026-02-26 18:33:39.336609 | controller |
2026-02-26 18:33:39.336655 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-02-26 18:33:39.336666 | controller | Thursday 26 February 2026  18:33:39 +0000 (0:00:00.062)       0:04:14.403 *****
2026-02-26 18:33:39.336681 | controller | skipping: [instance]
2026-02-26 18:33:39.378040 | controller |
2026-02-26 18:33:39.378071 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-02-26 18:33:39.378079 | controller | Thursday 26 February 2026  18:33:39 +0000 (0:00:00.048)       0:04:14.452 *****
2026-02-26 18:33:39.378091 | controller | skipping: [instance]
2026-02-26 18:33:39.437354 | controller |
2026-02-26 18:33:39.437386 | controller | TASK [sushy_emulator : Generate list of filtered VMs] **************************
2026-02-26 18:33:39.437396 | controller | Thursday 26 February 2026  18:33:39 +0000 (0:00:00.041)       0:04:14.493 *****
2026-02-26 18:33:39.437408 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:39.480286 | controller |
2026-02-26 18:33:39.480317 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
2026-02-26 18:33:39.480325 | controller | Thursday 26 February 2026  18:33:39 +0000 (0:00:00.059)       0:04:14.553 *****
2026-02-26 18:33:39.480335 | controller | skipping: [instance]
2026-02-26 18:33:39.521742 | controller |
2026-02-26 18:33:39.521764 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
2026-02-26 18:33:39.521771 | controller | Thursday 26 February 2026  18:33:39 +0000 (0:00:00.042)       0:04:14.596 *****
2026-02-26 18:33:39.521781 | controller | skipping: [instance]
2026-02-26 18:33:39.561480 | controller |
2026-02-26 18:33:39.561501 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
2026-02-26 18:33:39.561515 | controller | Thursday 26 February 2026  18:33:39 +0000 (0:00:00.041)       0:04:14.637 *****
2026-02-26 18:33:39.561525 | controller | skipping: [instance]
2026-02-26 18:33:40.157315 | controller |
2026-02-26 18:33:40.157364 | controller | TASK [sushy_emulator : Generate htpasswd string] *******************************
2026-02-26 18:33:40.157373 | controller | Thursday 26 February 2026  18:33:39 +0000 (0:00:00.039)       0:04:14.677 *****
2026-02-26 18:33:40.157385 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:40.278442 | controller |
2026-02-26 18:33:40.278515 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] *********************
2026-02-26 18:33:40.278525 | controller | Thursday 26 February 2026  18:33:40 +0000 (0:00:00.595)       0:04:15.272 *****
2026-02-26 18:33:40.278540 | controller | skipping: [instance] => (item=secret)
2026-02-26 18:33:41.445335 | controller | skipping: [instance] => (item=configmap)
2026-02-26 18:33:41.445406 | controller | skipping: [instance] => (item=pod)
2026-02-26 18:33:41.445414 | controller | skipping: [instance] => (item=service)
2026-02-26 18:33:41.445420 | controller | skipping: [instance] => (item=route)
2026-02-26 18:33:41.445425 | controller | skipping: [instance]
2026-02-26 18:33:41.445432 | controller |
2026-02-26 18:33:41.445438 | controller | TASK [sushy_emulator : Write sushy emulator config] ****************************
2026-02-26 18:33:41.445444 | controller | Thursday 26 February 2026  18:33:40 +0000 (0:00:00.120)       0:04:15.393 *****
2026-02-26 18:33:41.445458 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:41.445560 | controller |
2026-02-26 18:33:42.510278 | controller | TASK [sushy_emulator : Write htpasswd string to file] **************************
2026-02-26 18:33:42.510333 | controller | Thursday 26 February 2026  18:33:41 +0000 (0:00:01.167)       0:04:16.560 *****
2026-02-26 18:33:42.510348 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:42.559246 | controller |
2026-02-26 18:33:42.559275 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
2026-02-26 18:33:42.559282 | controller | Thursday 26 February 2026  18:33:42 +0000 (0:00:01.064)       0:04:17.625 *****
2026-02-26 18:33:42.559293 | controller | skipping: [instance]
2026-02-26 18:33:42.612298 | controller |
2026-02-26 18:33:42.612323 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
2026-02-26 18:33:42.612330 | controller | Thursday 26 February 2026  18:33:42 +0000 (0:00:00.049)       0:04:17.674 *****
2026-02-26 18:33:42.612349 | controller | skipping: [instance]
2026-02-26 18:33:42.699431 | controller |
2026-02-26 18:33:42.699463 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
2026-02-26 18:33:42.699470 | controller | Thursday 26 February 2026  18:33:42 +0000 (0:00:00.052)       0:04:17.727 *****
2026-02-26 18:33:42.699481 | controller | skipping: [instance] => (item=secret)
2026-02-26 18:33:42.746465 | controller | skipping: [instance] => (item=configmap)
2026-02-26 18:33:42.746491 | controller | skipping: [instance] => (item=service)
2026-02-26 18:33:42.746498 | controller | skipping: [instance] => (item=route)
2026-02-26 18:33:42.746504 | controller | skipping: [instance]
2026-02-26 18:33:42.746509 | controller |
2026-02-26 18:33:42.746515 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
2026-02-26 18:33:42.746521 | controller | Thursday 26 February 2026  18:33:42 +0000 (0:00:00.086)       0:04:17.814 *****
2026-02-26 18:33:42.746530 | controller | skipping: [instance]
2026-02-26 18:33:44.554039 | controller |
2026-02-26 18:33:44.554085 | controller | TASK [podman : Ensure podman is installed] *************************************
2026-02-26 18:33:44.554093 | controller | Thursday 26 February 2026  18:33:42 +0000 (0:00:00.047)       0:04:17.862 *****
2026-02-26 18:33:44.554106 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:45.474271 | controller |
2026-02-26 18:33:45.474303 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] *********************
2026-02-26 18:33:45.474312 | controller | Thursday 26 February 2026  18:33:44 +0000 (0:00:01.806)       0:04:19.669 *****
2026-02-26 18:33:45.474323 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:45.522106 | controller |
2026-02-26 18:33:45.522142 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
2026-02-26 18:33:45.522150 | controller | Thursday 26 February 2026  18:33:45 +0000 (0:00:00.920)       0:04:20.589 *****
2026-02-26 18:33:45.522161 | controller | skipping: [instance]
2026-02-26 18:33:45.522485 | controller |
2026-02-26 18:33:45.564130 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
2026-02-26 18:33:45.564152 | controller | Thursday 26 February 2026  18:33:45 +0000 (0:00:00.047)       0:04:20.637 *****
2026-02-26 18:33:45.564162 | controller | skipping: [instance]
2026-02-26 18:33:45.564395 | controller |
2026-02-26 18:33:45.564409 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
2026-02-26 18:33:45.616379 | controller | Thursday 26 February 2026  18:33:45 +0000 (0:00:00.042)       0:04:20.679 *****
2026-02-26 18:33:45.616404 | controller | skipping: [instance]
2026-02-26 18:33:56.516477 | controller |
2026-02-26 18:33:56.516540 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
2026-02-26 18:33:56.516550 | controller | Thursday 26 February 2026  18:33:45 +0000 (0:00:00.051)       0:04:20.731 *****
2026-02-26 18:33:56.516563 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:57.881480 | controller |
2026-02-26 18:33:57.881539 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] **************
2026-02-26 18:33:57.881548 | controller | Thursday 26 February 2026  18:33:56 +0000 (0:00:10.899)       0:04:31.631 *****
2026-02-26 18:33:57.881568 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:57.881968 | controller |
2026-02-26 18:33:59.051816 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-02-26 18:33:59.051872 | controller | Thursday 26 February 2026  18:33:57 +0000 (0:00:01.365)       0:04:32.996 *****
2026-02-26 18:33:59.051887 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-02-26 18:33:59.096086 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-02-26 18:33:59.096123 | controller |
2026-02-26 18:33:59.096131 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] *************
2026-02-26 18:33:59.096138 | controller | Thursday 26 February 2026  18:33:59 +0000 (0:00:01.169)       0:04:34.166 *****
2026-02-26 18:33:59.096150 | controller | skipping: [instance]
2026-02-26 18:33:59.096245 | controller |
2026-02-26 18:33:59.096255 | controller | TASK [reproducer : Check if baremetal-info.yml exists] *************************
2026-02-26 18:33:59.096268 | controller | Thursday 26 February 2026  18:33:59 +0000 (0:00:00.045)       0:04:34.211 *****
2026-02-26 18:33:59.713135 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:33:59.755373 | controller |
2026-02-26 18:33:59.755413 | controller | TASK [reproducer : Get content of baremetal-info file] *************************
2026-02-26 18:33:59.755422 | controller | Thursday 26 February 2026  18:33:59 +0000 (0:00:00.616)       0:04:34.828 *****
2026-02-26 18:33:59.755434 | controller | skipping: [instance]
2026-02-26 18:33:59.804524 | controller |
2026-02-26 18:33:59.804559 | controller | TASK [reproducer : Interpret remote file content as yaml] **********************
2026-02-26 18:33:59.804567 | controller | Thursday 26 February 2026  18:33:59 +0000 (0:00:00.043)       0:04:34.871 *****
2026-02-26 18:33:59.804579 | controller | skipping: [instance]
2026-02-26 18:33:59.853494 | controller |
2026-02-26 18:33:59.853529 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-02-26 18:33:59.853538 | controller | Thursday 26 February 2026  18:33:59 +0000 (0:00:00.049)       0:04:34.920 *****
2026-02-26 18:33:59.853550 | controller | skipping: [instance]
2026-02-26 18:33:59.897377 | controller |
2026-02-26 18:33:59.897405 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-02-26 18:33:59.897414 | controller | Thursday 26 February 2026  18:33:59 +0000 (0:00:00.048)       0:04:34.969 *****
2026-02-26 18:33:59.897426 | controller | skipping: [instance]
2026-02-26 18:34:00.054874 | controller |
2026-02-26 18:34:00.054904 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
2026-02-26 18:34:00.054927 | controller | Thursday 26 February 2026  18:33:59 +0000 (0:00:00.043)       0:04:35.013 *****
2026-02-26 18:34:00.054954 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'})
2026-02-26 18:34:01.110907 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'})
2026-02-26 18:34:01.110998 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'})
2026-02-26 18:34:01.111009 | controller |
2026-02-26 18:34:01.111016 | controller | TASK [reproducer : Output baremetal info file] *********************************
2026-02-26 18:34:01.111023 | controller | Thursday 26 February 2026  18:34:00 +0000 (0:00:00.157)       0:04:35.170 *****
2026-02-26 18:34:01.111036 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:01.168930 | controller |
2026-02-26 18:34:01.168995 | controller | TASK [reproducer : Output ironic_nodes to file] ********************************
2026-02-26 18:34:01.169005 | controller | Thursday 26 February 2026  18:34:01 +0000 (0:00:01.055)       0:04:36.225 *****
2026-02-26 18:34:01.169018 | controller | skipping: [instance]
2026-02-26 18:34:01.314729 | controller |
2026-02-26 18:34:01.314764 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
2026-02-26 18:34:01.314772 | controller | Thursday 26 February 2026  18:34:01 +0000 (0:00:00.058)       0:04:36.284 *****
2026-02-26 18:34:01.314783 | controller |
2026-02-26 18:34:01.378972 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
2026-02-26 18:34:01.379004 | controller | Thursday 26 February 2026  18:34:01 +0000 (0:00:00.145)       0:04:36.430 *****
2026-02-26 18:34:01.379019 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:01.441907 | controller |
2026-02-26 18:34:01.441968 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-02-26 18:34:01.441980 | controller | Thursday 26 February 2026  18:34:01 +0000 (0:00:00.064)       0:04:36.494 *****
2026-02-26 18:34:01.441992 | controller | skipping: [instance]
2026-02-26 18:34:01.492469 | controller |
2026-02-26 18:34:01.492499 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-02-26 18:34:01.492507 | controller | Thursday 26 February 2026  18:34:01 +0000 (0:00:00.062)       0:04:36.557 *****
2026-02-26 18:34:01.492518 | controller | skipping: [instance]
2026-02-26 18:34:02.959535 | controller |
2026-02-26 18:34:02.959580 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
2026-02-26 18:34:02.959588 | controller | Thursday 26 February 2026  18:34:01 +0000 (0:00:00.050)       0:04:36.607 *****
2026-02-26 18:34:02.959600 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:10.389023 | controller |
2026-02-26 18:34:10.389056 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
2026-02-26 18:34:10.389065 | controller | Thursday 26 February 2026  18:34:02 +0000 (0:00:01.467)       0:04:38.074 *****
2026-02-26 18:34:10.389075 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1)
2026-02-26 18:34:10.389124 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b)
2026-02-26 18:34:10.389132 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282)
2026-02-26 18:34:10.389137 | controller |
2026-02-26 18:34:10.389142 | controller | TASK [sushy_emulator : Verify baremetal VM power status] ***********************
2026-02-26 18:34:10.389149 | controller | Thursday 26 February 2026  18:34:10 +0000 (0:00:07.429)       0:04:45.504 *****
2026-02-26 18:34:10.491020 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
2026-02-26 18:34:10.491422 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
2026-02-26 18:34:10.491438 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
2026-02-26 18:34:10.724109 | controller |
2026-02-26 18:34:10.724145 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
2026-02-26 18:34:10.724153 | controller | Thursday 26 February 2026  18:34:10 +0000 (0:00:00.102)       0:04:45.606 *****
2026-02-26 18:34:10.724163 | controller | ok: [instance -> localhost]
2026-02-26 18:34:12.746424 | controller |
2026-02-26 18:34:12.746466 | controller | TASK [reproducer : Sync local repositories to other hosts if present] **********
2026-02-26 18:34:12.746475 | controller | Thursday 26 February 2026  18:34:10 +0000 (0:00:00.232)       0:04:45.839 *****
2026-02-26 18:34:12.746485 | controller | changed: [instance -> localhost] => (item=controller-0)
2026-02-26 18:34:13.390497 | controller |
2026-02-26 18:34:13.390545 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
2026-02-26 18:34:13.390554 | controller | Thursday 26 February 2026  18:34:12 +0000 (0:00:02.022)       0:04:47.861 *****
2026-02-26 18:34:13.390564 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:14.123706 | controller |
2026-02-26 18:34:14.123744 | controller | TASK [reproducer : Install ansible dependencies] *******************************
2026-02-26 18:34:14.123752 | controller | Thursday 26 February 2026  18:34:13 +0000 (0:00:00.644)       0:04:48.505 *****
2026-02-26 18:34:14.123763 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:15.189788 | controller |
2026-02-26 18:34:15.189825 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
2026-02-26 18:34:15.189834 | controller | Thursday 26 February 2026  18:34:14 +0000 (0:00:00.733)       0:04:49.239 *****
2026-02-26 18:34:15.189847 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:15.189865 | controller |
2026-02-26 18:34:15.189968 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
2026-02-26 18:34:15.190071 | controller | Thursday 26 February 2026  18:34:15 +0000 (0:00:01.066)       0:04:50.305 *****
2026-02-26 18:34:15.826472 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:15.826545 | controller |
2026-02-26 18:34:15.826615 | controller | TASK [reproducer : Inject local environment parameters] ************************
2026-02-26 18:34:15.826703 | controller | Thursday 26 February 2026  18:34:15 +0000 (0:00:00.636)       0:04:50.942 *****
2026-02-26 18:34:16.945855 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:16.945911 | controller |
2026-02-26 18:34:16.946059 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
2026-02-26 18:34:16.946157 | controller | Thursday 26 February 2026  18:34:16 +0000 (0:00:01.119)       0:04:52.061 *****
2026-02-26 18:34:17.530621 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:17.530868 | controller |
2026-02-26 18:34:17.530985 | controller | TASK [reproducer : Get interfaces-info content] ********************************
2026-02-26 18:34:17.531001 | controller | Thursday 26 February 2026  18:34:17 +0000 (0:00:00.584)       0:04:52.646 *****
2026-02-26 18:34:18.134834 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:19.506086 | controller |
2026-02-26 18:34:19.506123 | controller | TASK [reproducer : Wait for OCP nodes to be ready] *****************************
2026-02-26 18:34:19.506132 | controller | Thursday 26 February 2026  18:34:18 +0000 (0:00:00.601)       0:04:53.247 *****
2026-02-26 18:34:19.506145 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-02-26 18:34:19.542365 | controller |
2026-02-26 18:34:19.542404 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-02-26 18:34:19.542412 | controller | Thursday 26 February 2026  18:34:19 +0000 (0:00:01.373)       0:04:54.621 *****
2026-02-26 18:34:19.542422 | controller | skipping: [instance]
2026-02-26 18:34:19.578818 | controller |
2026-02-26 18:34:19.578847 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-02-26 18:34:19.578854 | controller | Thursday 26 February 2026  18:34:19 +0000 (0:00:00.036)       0:04:54.658 *****
2026-02-26 18:34:19.578864 | controller | skipping: [instance]
2026-02-26 18:34:19.613697 | controller |
2026-02-26 18:34:19.613725 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-02-26 18:34:19.613733 | controller | Thursday 26 February 2026  18:34:19 +0000 (0:00:00.036)       0:04:54.694 *****
2026-02-26 18:34:19.613743 | controller | skipping: [instance]
2026-02-26 18:34:19.652721 | controller |
2026-02-26 18:34:19.652747 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-02-26 18:34:19.652756 | controller | Thursday 26 February 2026  18:34:19 +0000 (0:00:00.034)       0:04:54.729 *****
2026-02-26 18:34:19.652766 | controller | skipping: [instance]
2026-02-26 18:34:19.689137 | controller |
2026-02-26 18:34:19.689159 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-02-26 18:34:19.689167 | controller | Thursday 26 February 2026  18:34:19 +0000 (0:00:00.039)       0:04:54.768 *****
2026-02-26 18:34:19.689181 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:19.797198 | controller |
2026-02-26 18:34:19.797232 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-02-26 18:34:19.797240 | controller | Thursday 26 February 2026  18:34:19 +0000 (0:00:00.036)       0:04:54.804 *****
2026-02-26 18:34:19.797261 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
2026-02-26 18:34:19.842429 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={})
2026-02-26 18:34:19.842456 | controller |
2026-02-26 18:34:19.842463 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-02-26 18:34:19.842469 | controller | Thursday 26 February 2026  18:34:19 +0000 (0:00:00.107)       0:04:54.912 *****
2026-02-26 18:34:19.842478 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
2026-02-26 18:34:23.217426 | controller |
2026-02-26 18:34:23.217465 | controller | TASK [networking_mapper : Gather the facts] ************************************
2026-02-26 18:34:23.217473 | controller | Thursday 26 February 2026  18:34:19 +0000 (0:00:00.045)       0:04:54.958 *****
2026-02-26 18:34:23.217484 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-02-26 18:34:24.187597 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
2026-02-26 18:34:24.187628 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-02-26 18:34:24.187635 | controller |
2026-02-26 18:34:24.187641 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
2026-02-26 18:34:24.187646 | controller | Thursday 26 February 2026  18:34:23 +0000 (0:00:03.373)       0:04:58.332 *****
2026-02-26 18:34:24.187656 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:24.652178 | controller |
2026-02-26 18:34:24.652209 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-02-26 18:34:24.652217 | controller | Thursday 26 February 2026  18:34:24 +0000 (0:00:00.970)       0:04:59.303 *****
2026-02-26 18:34:24.652232 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:25.589081 | controller |
2026-02-26 18:34:25.589115 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-02-26 18:34:25.589123 | controller | Thursday 26 February 2026  18:34:24 +0000 (0:00:00.464)       0:04:59.767 *****
2026-02-26 18:34:25.589134 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:25.664047 | controller |
2026-02-26 18:34:25.664078 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-02-26 18:34:25.664086 | controller | Thursday 26 February 2026  18:34:25 +0000 (0:00:00.936)       0:05:00.704 *****
2026-02-26 18:34:25.664097 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:25.715914 | controller |
2026-02-26 18:34:25.715939 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-02-26 18:34:25.715972 | controller | Thursday 26 February 2026  18:34:25 +0000 (0:00:00.074)       0:05:00.779 *****
2026-02-26 18:34:25.715997 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:26.718703 | controller |
2026-02-26 18:34:26.718740 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-02-26 18:34:26.718747 | controller | Thursday 26 February 2026  18:34:25 +0000 (0:00:00.052)       0:05:00.831 *****
2026-02-26 18:34:26.718758 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:27.600486 | controller |
2026-02-26 18:34:27.600518 | controller | TASK [reproducer : Inject CRC ssh key] *****************************************
2026-02-26 18:34:27.600526 | controller | Thursday 26 February 2026  18:34:26 +0000 (0:00:01.002)       0:05:01.834 *****
2026-02-26 18:34:27.600541 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:33.555157 | controller |
2026-02-26 18:34:33.555191 | controller | TASK [reproducer : Ensure we have all dependencies installed] ******************
2026-02-26 18:34:33.555199 | controller | Thursday 26 February 2026  18:34:27 +0000 (0:00:00.881)       0:05:02.716 *****
2026-02-26 18:34:33.555209 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
2026-02-26 18:34:33.746760 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:33.746790 | controller |
2026-02-26 18:34:33.746797 | controller | TASK [Configure ntp service] ***************************************************
2026-02-26 18:34:33.746804 | controller | Thursday 26 February 2026  18:34:33 +0000 (0:00:05.954)       0:05:08.670 *****
2026-02-26 18:34:33.746814 | controller |
2026-02-26 18:34:34.712033 | controller | TASK [cifmw_ntp : Install chrony] **********************************************
2026-02-26 18:34:34.712068 | controller | Thursday 26 February 2026  18:34:33 +0000 (0:00:00.191)       0:05:08.862 *****
2026-02-26 18:34:34.712080 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:34.712448 | controller |
2026-02-26 18:34:35.666123 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] *************************
2026-02-26 18:34:35.666156 | controller | Thursday 26 February 2026  18:34:34 +0000 (0:00:00.963)       0:05:09.826 *****
2026-02-26 18:34:35.666169 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
2026-02-26 18:34:36.495893 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
2026-02-26 18:34:36.495924 | controller |
2026-02-26 18:34:36.495932 | controller | TASK [cifmw_ntp : Render chrony extra config file] *****************************
2026-02-26 18:34:36.495938 | controller | Thursday 26 February 2026  18:34:35 +0000 (0:00:00.955)       0:05:10.781 *****
2026-02-26 18:34:36.496364 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:37.121635 | controller |
2026-02-26 18:34:37.121668 | controller | TASK [cifmw_ntp : Enable chrony service] ***************************************
2026-02-26 18:34:37.121681 | controller | Thursday 26 February 2026  18:34:36 +0000 (0:00:00.829)       0:05:11.611 *****
2026-02-26 18:34:37.121691 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:37.257134 | controller |
2026-02-26 18:34:37.257165 | controller | TASK [reproducer : Configure CRC node if available] ****************************
2026-02-26 18:34:37.257173 | controller | Thursday 26 February 2026  18:34:37 +0000 (0:00:00.625)       0:05:12.237 *****
2026-02-26 18:34:37.257185 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
2026-02-26 18:34:37.707292 | controller |
2026-02-26 18:34:37.707329 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] ***
2026-02-26 18:34:37.707338 | controller | Thursday 26 February 2026  18:34:37 +0000 (0:00:00.135)       0:05:12.372 *****
2026-02-26 18:34:37.707349 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:38.148934 | controller |
2026-02-26 18:34:38.148986 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ********************
2026-02-26 18:34:38.148994 | controller | Thursday 26 February 2026  18:34:37 +0000 (0:00:00.449)       0:05:12.822 *****
2026-02-26 18:34:38.149005 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-02-26 18:34:38.749512 | controller |
2026-02-26 18:34:38.749551 | controller | TASK [reproducer : Configure local DNS for CRC pod] ****************************
2026-02-26 18:34:38.749559 | controller | Thursday 26 February 2026  18:34:38 +0000 (0:00:00.441)       0:05:13.264 *****
2026-02-26 18:34:38.749570 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-02-26 18:34:39.273518 | controller |
2026-02-26 18:34:39.273551 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
2026-02-26 18:34:39.273559 | controller | Thursday 26 February 2026  18:34:38 +0000 (0:00:00.600)       0:05:13.865 *****
2026-02-26 18:34:39.273585 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-02-26 18:34:39.321766 | controller |
2026-02-26 18:34:39.321792 | controller | TASK [Restart DNS in CRC VM] ***************************************************
2026-02-26 18:34:39.321801 | controller | Thursday 26 February 2026  18:34:39 +0000 (0:00:00.524)       0:05:14.389 *****
2026-02-26 18:34:39.321812 | controller |
2026-02-26 18:34:39.745451 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
2026-02-26 18:34:39.745483 | controller | Thursday 26 February 2026  18:34:39 +0000 (0:00:00.048)       0:05:14.437 *****
2026-02-26 18:34:39.745496 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-02-26 18:34:40.457623 | controller |
2026-02-26 18:34:40.457666 | controller | TASK [openshift_setup : Restart dnsmasq service if used] ***********************
2026-02-26 18:34:40.457674 | controller | Thursday 26 February 2026  18:34:39 +0000 (0:00:00.422)       0:05:14.860 *****
2026-02-26 18:34:40.457685 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-02-26 18:34:40.457843 | controller |
2026-02-26 18:34:40.458009 | controller | TASK [openshift_setup : Stop dnsmasq] ******************************************
2026-02-26 18:34:40.458158 | controller | Thursday 26 February 2026  18:34:40 +0000 (0:00:00.712)       0:05:15.573 *****
2026-02-26 18:34:40.486380 | controller | skipping: [instance]
2026-02-26 18:34:40.486518 | controller |
2026-02-26 18:34:40.486648 | controller | TASK [openshift_setup : Start dnsmasq] *****************************************
2026-02-26 18:34:40.486773 | controller | Thursday 26 February 2026  18:34:40 +0000 (0:00:00.029)       0:05:15.602 *****
2026-02-26 18:34:40.519495 | controller | skipping: [instance]
2026-02-26 18:34:40.519630 | controller |
2026-02-26 18:34:40.519766 | controller | TASK [reproducer : Remove entry from /etc/hosts] *******************************
2026-02-26 18:34:40.519890 | controller | Thursday 26 February 2026  18:34:40 +0000 (0:00:00.033)       0:05:15.635 *****
2026-02-26 18:34:40.753520 | controller | changed: [instance]
2026-02-26 18:34:40.824974 | controller |
2026-02-26 18:34:40.824996 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
2026-02-26 18:34:40.825005 | controller | Thursday 26 February 2026  18:34:40 +0000 (0:00:00.233)       0:05:15.869 *****
2026-02-26 18:34:40.825014 | controller | skipping: [instance] => (item=)
2026-02-26 18:34:40.859593 | controller |
2026-02-26 18:34:40.859616 | controller | TASK [dnsmasq : Assert we have needed address data] ****************************
2026-02-26 18:34:40.859625 | controller | Thursday 26 February 2026  18:34:40 +0000 (0:00:00.071)       0:05:15.940 *****
2026-02-26 18:34:40.859633 | controller | ok: [instance]
2026-02-26 18:34:40.930711 | controller |
2026-02-26 18:34:40.930731 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-02-26 18:34:40.930739 | controller | Thursday 26 February 2026  18:34:40 +0000 (0:00:00.034)       0:05:15.975 *****
2026-02-26 18:34:40.930748 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-02-26 18:34:41.177073 | controller |
2026-02-26 18:34:41.177101 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-02-26 18:34:41.177108 | controller | Thursday 26 February 2026  18:34:40 +0000 (0:00:00.071)       0:05:16.046 *****
2026-02-26 18:34:41.177123 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-02-26 18:34:41.230003 | controller |
2026-02-26 18:34:41.230027 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
2026-02-26 18:34:41.230048 | controller | Thursday 26 February 2026  18:34:41 +0000 (0:00:00.246)       0:05:16.292 *****
2026-02-26 18:34:41.230058 | controller |
2026-02-26 18:34:41.291410 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-02-26 18:34:41.291432 | controller | Thursday 26 February 2026  18:34:41 +0000 (0:00:00.053)       0:05:16.346 *****
2026-02-26 18:34:41.291443 | controller | ok: [instance]
2026-02-26 18:34:41.345217 | controller |
2026-02-26 18:34:41.345290 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-02-26 18:34:41.345299 | controller | Thursday 26 February 2026  18:34:41 +0000 (0:00:00.061)       0:05:16.407 *****
2026-02-26 18:34:41.345315 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-02-26 18:34:41.598002 | controller |
2026-02-26 18:34:41.598027 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-02-26 18:34:41.598045 | controller | Thursday 26 February 2026  18:34:41 +0000 (0:00:00.053)       0:05:16.461 *****
2026-02-26 18:34:41.598056 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-02-26 18:34:41.654309 | controller |
2026-02-26 18:34:41.654332 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-02-26 18:34:41.654340 | controller | Thursday 26 February 2026  18:34:41 +0000 (0:00:00.252)       0:05:16.713 *****
2026-02-26 18:34:41.654354 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-02-26 18:34:42.072340 | controller | skipping: [instance]
2026-02-26 18:34:42.072373 | controller |
2026-02-26 18:34:42.072381 | controller | TASK [reproducer : Ensure "testing" domain is "local"] *************************
2026-02-26 18:34:42.072387 | controller | Thursday 26 February 2026  18:34:41 +0000 (0:00:00.056)       0:05:16.769 *****
2026-02-26 18:34:42.072396 | controller | changed: [instance]
2026-02-26 18:34:42.724845 | controller |
2026-02-26 18:34:42.724879 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-02-26 18:34:42.724887 | controller | Thursday 26 February 2026  18:34:42 +0000 (0:00:00.400)       0:05:17.170 *****
2026-02-26 18:34:42.724892 | controller |
2026-02-26 18:34:42.724897 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
2026-02-26 18:34:42.724903 | controller | Thursday 26 February 2026  18:34:42 +0000 (0:00:00.017)       0:05:17.187 *****
2026-02-26 18:34:42.724912 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:43.121456 | controller |
2026-02-26 18:34:43.121489 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-02-26 18:34:43.121497 | controller | Thursday 26 February 2026  18:34:42 +0000 (0:00:00.652)       0:05:17.840 *****
2026-02-26 18:34:43.121507 | controller | changed: [instance]
2026-02-26 18:34:43.302015 | controller |
2026-02-26 18:34:43.302057 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
2026-02-26 18:34:43.302067 | controller | Thursday 26 February 2026  18:34:43 +0000 (0:00:00.396)       0:05:18.236 *****
2026-02-26 18:34:43.302079 | controller | skipping: [instance] => (item=controller-0)
2026-02-26 18:34:43.302337 | controller | skipping: [instance] => (item=crc-0)
2026-02-26 18:34:43.302349 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
2026-02-26 18:34:43.302355 | controller |
2026-02-26 18:34:43.302363 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
2026-02-26 18:34:44.792858 | controller | Thursday 26 February 2026  18:34:43 +0000 (0:00:00.180)       0:05:18.417 *****
2026-02-26 18:34:44.792933 | controller | changed: [instance -> compute-0(compute-0.instance)]
2026-02-26 18:34:44.821269 | controller |
2026-02-26 18:34:44.821522 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-02-26 18:34:44.821532 | controller | Thursday 26 February 2026  18:34:44 +0000 (0:00:01.490)       0:05:19.908 *****
2026-02-26 18:34:44.821546 | controller | skipping: [instance]
2026-02-26 18:34:44.821565 | controller |
2026-02-26 18:34:44.821641 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-02-26 18:34:44.821768 | controller | Thursday 26 February 2026  18:34:44 +0000 (0:00:00.028)       0:05:19.936 *****
2026-02-26 18:34:45.328525 | controller | ok: [instance -> compute-0(compute-0.instance)]
2026-02-26 18:34:45.328582 | controller |
2026-02-26 18:34:45.328661 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-02-26 18:34:45.328775 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.502)       0:05:20.438 *****
2026-02-26 18:34:45.364440 | controller | skipping: [instance]
2026-02-26 18:34:45.364491 | controller |
2026-02-26 18:34:45.364613 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-02-26 18:34:45.364671 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.041)       0:05:20.480 *****
2026-02-26 18:34:45.399963 | controller | skipping: [instance]
2026-02-26 18:34:45.400065 | controller |
2026-02-26 18:34:45.400179 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-02-26 18:34:45.400286 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.034)       0:05:20.515 *****
2026-02-26 18:34:45.439303 | controller | skipping: [instance]
2026-02-26 18:34:45.439345 | controller |
2026-02-26 18:34:45.439439 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-02-26 18:34:45.439525 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.039)       0:05:20.555 *****
2026-02-26 18:34:45.492924 | controller | skipping: [instance]
2026-02-26 18:34:45.493080 | controller |
2026-02-26 18:34:45.493220 | controller | TASK [reproducer : Get rhos-release and setup repos] ***************************
2026-02-26 18:34:45.493354 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.053)       0:05:20.608 *****
2026-02-26 18:34:45.541777 | controller | skipping: [instance]
2026-02-26 18:34:45.541847 | controller |
2026-02-26 18:34:45.541960 | controller | TASK [reproducer : Create repositories on computes] ****************************
2026-02-26 18:34:45.542080 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.049)       0:05:20.657 *****
2026-02-26 18:34:45.564299 | controller | skipping: [instance]
2026-02-26 18:34:45.564409 | controller |
2026-02-26 18:34:45.564537 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
2026-02-26 18:34:45.564651 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.022)       0:05:20.680 *****
2026-02-26 18:34:45.595299 | controller | skipping: [instance]
2026-02-26 18:34:45.595374 | controller |
2026-02-26 18:34:45.595462 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2026-02-26 18:34:45.595549 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.030)       0:05:20.711 *****
2026-02-26 18:34:45.653565 | controller | ok: [instance]
2026-02-26 18:34:45.653642 | controller |
2026-02-26 18:34:45.653749 | controller | TASK [reproducer : Push local code] ********************************************
2026-02-26 18:34:45.653846 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.058)       0:05:20.769 *****
2026-02-26 18:34:45.751242 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
2026-02-26 18:34:45.751370 | controller |
2026-02-26 18:34:45.751558 | controller | TASK [reproducer : Check if repository directories already exist] **************
2026-02-26 18:34:45.751728 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.097)       0:05:20.866 *****
2026-02-26 18:34:45.791447 | controller | skipping: [instance]
2026-02-26 18:34:45.791516 | controller |
2026-02-26 18:34:45.791607 | controller | TASK [reproducer : Ensure we are not in the job_id branch] *********************
2026-02-26 18:34:45.791698 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.040)       0:05:20.907 *****
2026-02-26 18:34:45.840514 | controller | skipping: [instance]
2026-02-26 18:34:45.840561 | controller |
2026-02-26 18:34:45.840684 | controller | TASK [reproducer : Fetch zuul.items repositories] ******************************
2026-02-26 18:34:45.840781 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.048)       0:05:20.956 *****
2026-02-26 18:34:45.883422 | controller | skipping: [instance]
2026-02-26 18:34:45.883497 | controller |
2026-02-26 18:34:45.883597 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
2026-02-26 18:34:45.883695 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.043)       0:05:20.999 *****
2026-02-26 18:34:45.934997 | controller | skipping: [instance]
2026-02-26 18:34:45.935074 | controller |
2026-02-26 18:34:45.935174 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
2026-02-26 18:34:45.935272 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.051)       0:05:21.051 *****
2026-02-26 18:34:45.974536 | controller | skipping: [instance]
2026-02-26 18:34:45.974593 | controller |
2026-02-26 18:34:45.974699 | controller | TASK [reproducer : Create target directories beforehand] ***********************
2026-02-26 18:34:45.974793 | controller | Thursday 26 February 2026  18:34:45 +0000 (0:00:00.039)       0:05:21.090 *****
2026-02-26 18:34:46.494495 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
2026-02-26 18:34:46.494549 | controller |
2026-02-26 18:34:46.494628 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2026-02-26 18:34:46.494727 | controller | Thursday 26 February 2026  18:34:46 +0000 (0:00:00.519)       0:05:21.609 *****
2026-02-26 18:34:47.120394 | controller | ok: [instance -> localhost] => (item=ci-framework)
2026-02-26 18:34:47.120480 | controller |
2026-02-26 18:34:47.120514 | controller | TASK [reproducer : Sync remote repositories] ***********************************
2026-02-26 18:34:47.120687 | controller | Thursday 26 February 2026  18:34:47 +0000 (0:00:00.626)       0:05:22.236 *****
2026-02-26 18:34:47.167084 | controller | skipping: [instance] => (item=ci-framework)
2026-02-26 18:34:47.251752 | controller | skipping: [instance]
2026-02-26 18:34:47.251793 | controller |
2026-02-26 18:34:47.251803 | controller | TASK [reproducer : Ensure default repositories are present] ********************
2026-02-26 18:34:47.251810 | controller | Thursday 26 February 2026  18:34:47 +0000 (0:00:00.046)       0:05:22.282 *****
2026-02-26 18:34:47.251821 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework)
2026-02-26 18:34:47.771565 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls)
2026-02-26 18:34:47.771595 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture)
2026-02-26 18:34:47.771603 | controller |
2026-02-26 18:34:47.771610 | controller | TASK [reproducer : Check repository availability: ci-framework] ****************
2026-02-26 18:34:47.771616 | controller | Thursday 26 February 2026  18:34:47 +0000 (0:00:00.084)       0:05:22.366 *****
2026-02-26 18:34:47.771630 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:47.806772 | controller |
2026-02-26 18:34:47.806800 | controller | TASK [reproducer : Clone repository if needed: ci-framework] *******************
2026-02-26 18:34:47.806808 | controller | Thursday 26 February 2026  18:34:47 +0000 (0:00:00.520)       0:05:22.887 *****
2026-02-26 18:34:47.806819 | controller | skipping: [instance]
2026-02-26 18:34:48.254527 | controller |
2026-02-26 18:34:48.254558 | controller | TASK [reproducer : Check repository availability: install_yamls] ***************
2026-02-26 18:34:48.254565 | controller | Thursday 26 February 2026  18:34:47 +0000 (0:00:00.035)       0:05:22.922 *****
2026-02-26 18:34:48.254576 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:48.294025 | controller |
2026-02-26 18:34:48.294052 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ******************
2026-02-26 18:34:48.294073 | controller | Thursday 26 February 2026  18:34:48 +0000 (0:00:00.447)       0:05:23.370 *****
2026-02-26 18:34:48.294085 | controller | skipping: [instance]
2026-02-26 18:34:48.294114 | controller |
2026-02-26 18:34:48.294318 | controller | TASK [reproducer : Check repository availability: architecture] ****************
2026-02-26 18:34:48.763882 | controller | Thursday 26 February 2026  18:34:48 +0000 (0:00:00.039)       0:05:23.410 *****
2026-02-26 18:34:48.763917 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:34:48.763935 | controller |
2026-02-26 18:34:48.763961 | controller | TASK [reproducer : Clone repository if needed: architecture] *******************
2026-02-26 18:34:48.764040 | controller | Thursday 26 February 2026  18:34:48 +0000 (0:00:00.469)       0:05:23.879 *****
2026-02-26 18:34:51.151394 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:11.553830 | controller |
2026-02-26 18:35:11.553904 | controller | TASK [reproducer : Install collections on controller-0] ************************
2026-02-26 18:35:11.553914 | controller | Thursday 26 February 2026  18:34:51 +0000 (0:00:02.387)       0:05:26.266 *****
2026-02-26 18:35:11.553927 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:12.576537 | controller |
2026-02-26 18:35:12.576571 | controller | TASK [reproducer : Inject CI Framework motd] ***********************************
2026-02-26 18:35:12.576585 | controller | Thursday 26 February 2026  18:35:11 +0000 (0:00:20.400)       0:05:46.667 *****
2026-02-26 18:35:12.576596 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:12.678145 | controller |
2026-02-26 18:35:12.678223 | controller | TASK [reproducer : Rotate some logs] *******************************************
2026-02-26 18:35:12.678235 | controller | Thursday 26 February 2026  18:35:12 +0000 (0:00:01.023)       0:05:47.691 *****
2026-02-26 18:35:12.678254 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log)
2026-02-26 18:35:13.146529 | controller |
2026-02-26 18:35:13.146596 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] *********************
2026-02-26 18:35:13.146607 | controller | Thursday 26 February 2026  18:35:12 +0000 (0:00:00.102)       0:05:47.793 *****
2026-02-26 18:35:13.146620 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:13.192729 | controller |
2026-02-26 18:35:13.192766 | controller | TASK [reproducer : Rotate log if present] **************************************
2026-02-26 18:35:13.192774 | controller | Thursday 26 February 2026  18:35:13 +0000 (0:00:00.467)       0:05:48.261 *****
2026-02-26 18:35:13.192785 | controller | skipping: [instance]
2026-02-26 18:35:13.243759 | controller |
2026-02-26 18:35:13.243799 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] ***********************
2026-02-26 18:35:13.243811 | controller | Thursday 26 February 2026  18:35:13 +0000 (0:00:00.046)       0:05:48.308 *****
2026-02-26 18:35:13.243825 | controller | skipping: [instance]
2026-02-26 18:35:13.243861 | controller |
2026-02-26 18:35:13.243870 | controller | TASK [cifmw_setup : Get customized parameters] *********************************
2026-02-26 18:35:13.243880 | controller | Thursday 26 February 2026  18:35:13 +0000 (0:00:00.050)       0:05:48.359 *****
2026-02-26 18:35:13.345541 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:13.841369 | controller |
2026-02-26 18:35:13.841405 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-02-26 18:35:13.841414 | controller | Thursday 26 February 2026  18:35:13 +0000 (0:00:00.101)       0:05:48.461 *****
2026-02-26 18:35:13.841425 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:13.889477 | controller |
2026-02-26 18:35:13.889552 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-02-26 18:35:13.889562 | controller | Thursday 26 February 2026  18:35:13 +0000 (0:00:00.495)       0:05:48.956 *****
2026-02-26 18:35:13.889577 | controller | skipping: [instance]
2026-02-26 18:35:13.938535 | controller |
2026-02-26 18:35:13.938576 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-02-26 18:35:13.938584 | controller | Thursday 26 February 2026  18:35:13 +0000 (0:00:00.047)       0:05:49.004 *****
2026-02-26 18:35:13.938594 | controller | skipping: [instance]
2026-02-26 18:35:13.987652 | controller |
2026-02-26 18:35:13.987677 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-02-26 18:35:13.987684 | controller | Thursday 26 February 2026  18:35:13 +0000 (0:00:00.049)       0:05:49.054 *****
2026-02-26 18:35:13.987713 | controller | skipping: [instance]
2026-02-26 18:35:14.049096 | controller |
2026-02-26 18:35:14.049126 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-02-26 18:35:14.049137 | controller | Thursday 26 February 2026  18:35:13 +0000 (0:00:00.048)       0:05:49.102 *****
2026-02-26 18:35:14.049150 | controller | skipping: [instance]
2026-02-26 18:35:14.049207 | controller |
2026-02-26 18:35:14.049461 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-02-26 18:35:15.495693 | controller | Thursday 26 February 2026  18:35:14 +0000 (0:00:00.062)       0:05:49.164 *****
2026-02-26 18:35:15.496841 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:35:15.496877 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:35:15.496884 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:35:15.496889 | controller | changed: [instance -> controller-0]
2026-02-26 18:35:15.496895 | controller |
2026-02-26 18:35:15.496909 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-02-26 18:35:16.485689 | controller | Thursday 26 February 2026  18:35:15 +0000 (0:00:01.444)       0:05:50.609 *****
2026-02-26 18:35:16.485733 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:16.485999 | controller |
2026-02-26 18:35:16.486155 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-02-26 18:35:16.486239 | controller | Thursday 26 February 2026  18:35:16 +0000 (0:00:00.990)       0:05:51.599 *****
2026-02-26 18:35:17.784666 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:17.784727 | controller |
2026-02-26 18:35:17.784738 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-02-26 18:35:17.784884 | controller | Thursday 26 February 2026  18:35:17 +0000 (0:00:01.299)       0:05:52.899 *****
2026-02-26 18:35:25.190757 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:26.182504 | controller |
2026-02-26 18:35:26.182542 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-02-26 18:35:26.182551 | controller | Thursday 26 February 2026  18:35:25 +0000 (0:00:07.406)       0:06:00.306 *****
2026-02-26 18:35:26.182564 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:26.182584 | controller |
2026-02-26 18:35:26.182592 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-02-26 18:35:26.182624 | controller | Thursday 26 February 2026  18:35:26 +0000 (0:00:00.991)       0:06:01.297 *****
2026-02-26 18:35:26.224663 | controller | skipping: [instance]
2026-02-26 18:35:26.224722 | controller |
2026-02-26 18:35:26.224827 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-02-26 18:35:26.224922 | controller | Thursday 26 February 2026  18:35:26 +0000 (0:00:00.042)       0:06:01.340 *****
2026-02-26 18:35:27.358711 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:27.425061 | controller |
2026-02-26 18:35:27.425087 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-02-26 18:35:27.425095 | controller | Thursday 26 February 2026  18:35:27 +0000 (0:00:01.133)       0:06:02.473 *****
2026-02-26 18:35:27.425105 | controller | skipping: [instance]
2026-02-26 18:35:27.491072 | controller |
2026-02-26 18:35:27.491114 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-02-26 18:35:27.491125 | controller | Thursday 26 February 2026  18:35:27 +0000 (0:00:00.066)       0:06:02.540 *****
2026-02-26 18:35:27.491139 | controller | skipping: [instance]
2026-02-26 18:35:27.491221 | controller |
2026-02-26 18:35:27.491321 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-02-26 18:35:27.491348 | controller | Thursday 26 February 2026  18:35:27 +0000 (0:00:00.066)       0:06:02.606 *****
2026-02-26 18:35:27.558091 | controller | skipping: [instance]
2026-02-26 18:35:27.558245 | controller |
2026-02-26 18:35:27.558269 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-02-26 18:35:28.427688 | controller | Thursday 26 February 2026  18:35:27 +0000 (0:00:00.067)       0:06:02.674 *****
2026-02-26 18:35:28.427728 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:29.344081 | controller |
2026-02-26 18:35:29.344125 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-02-26 18:35:29.344133 | controller | Thursday 26 February 2026  18:35:28 +0000 (0:00:00.868)       0:06:03.543 *****
2026-02-26 18:35:29.344147 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:29.344189 | controller |
2026-02-26 18:35:29.344197 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-02-26 18:35:29.390056 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.916)       0:06:04.459 *****
2026-02-26 18:35:29.390097 | controller | skipping: [instance]
2026-02-26 18:35:29.390127 | controller |
2026-02-26 18:35:29.390136 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-02-26 18:35:29.390286 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.046)       0:06:04.505 *****
2026-02-26 18:35:29.431591 | controller | skipping: [instance]
2026-02-26 18:35:29.474996 | controller |
2026-02-26 18:35:29.475029 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-02-26 18:35:29.475038 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.041)       0:06:04.547 *****
2026-02-26 18:35:29.475049 | controller | skipping: [instance]
2026-02-26 18:35:29.529062 | controller |
2026-02-26 18:35:29.529092 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-02-26 18:35:29.529100 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.043)       0:06:04.590 *****
2026-02-26 18:35:29.529110 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:29.529141 | controller |
2026-02-26 18:35:29.529442 | controller | TASK [repo_setup : Create download directory] **********************************
2026-02-26 18:35:29.570461 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.054)       0:06:04.645 *****
2026-02-26 18:35:29.570487 | controller | skipping: [instance]
2026-02-26 18:35:29.611739 | controller |
2026-02-26 18:35:29.611766 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-02-26 18:35:29.611775 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.041)       0:06:04.686 *****
2026-02-26 18:35:29.611785 | controller | skipping: [instance]
2026-02-26 18:35:29.611813 | controller |
2026-02-26 18:35:29.612014 | controller | TASK [Download the RPM] ********************************************************
2026-02-26 18:35:29.651592 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.041)       0:06:04.727 *****
2026-02-26 18:35:29.651619 | controller | skipping: [instance]
2026-02-26 18:35:29.689849 | controller |
2026-02-26 18:35:29.689890 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-02-26 18:35:29.689900 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.039)       0:06:04.767 *****
2026-02-26 18:35:29.689914 | controller | skipping: [instance]
2026-02-26 18:35:29.740432 | controller |
2026-02-26 18:35:29.740458 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-02-26 18:35:29.740466 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.038)       0:06:04.805 *****
2026-02-26 18:35:29.740476 | controller | skipping: [instance]
2026-02-26 18:35:29.789382 | controller |
2026-02-26 18:35:29.789403 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-02-26 18:35:29.789410 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.050)       0:06:04.856 *****
2026-02-26 18:35:29.789418 | controller | skipping: [instance]
2026-02-26 18:35:29.832724 | controller |
2026-02-26 18:35:29.832742 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-02-26 18:35:29.832761 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.049)       0:06:04.905 *****
2026-02-26 18:35:29.832770 | controller | skipping: [instance]
2026-02-26 18:35:30.332608 | controller |
2026-02-26 18:35:30.332649 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-02-26 18:35:30.332658 | controller | Thursday 26 February 2026  18:35:29 +0000 (0:00:00.043)       0:06:04.948 *****
2026-02-26 18:35:30.332668 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:30.391096 | controller |
2026-02-26 18:35:30.391139 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-02-26 18:35:30.391150 | controller | Thursday 26 February 2026  18:35:30 +0000 (0:00:00.498)       0:06:05.447 *****
2026-02-26 18:35:30.391164 | controller | skipping: [instance]
2026-02-26 18:35:30.391217 | controller |
2026-02-26 18:35:30.391230 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-02-26 18:35:30.391349 | controller | Thursday 26 February 2026  18:35:30 +0000 (0:00:00.059)       0:06:05.506 *****
2026-02-26 18:35:30.450736 | controller | skipping: [instance]
2026-02-26 18:35:30.491396 | controller |
2026-02-26 18:35:30.491426 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-02-26 18:35:30.491434 | controller | Thursday 26 February 2026  18:35:30 +0000 (0:00:00.058)       0:06:05.564 *****
2026-02-26 18:35:30.491445 | controller | skipping: [instance]
2026-02-26 18:35:30.557654 | controller |
2026-02-26 18:35:30.557685 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-02-26 18:35:30.557701 | controller | Thursday 26 February 2026  18:35:30 +0000 (0:00:00.041)       0:06:05.606 *****
2026-02-26 18:35:30.557711 | controller | skipping: [instance]
2026-02-26 18:35:30.557772 | controller |
2026-02-26 18:35:30.557781 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-02-26 18:35:30.557789 | controller | Thursday 26 February 2026  18:35:30 +0000 (0:00:00.066)       0:06:05.673 *****
2026-02-26 18:35:30.616670 | controller | skipping: [instance]
2026-02-26 18:35:30.679972 | controller |
2026-02-26 18:35:30.679994 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-02-26 18:35:30.680002 | controller | Thursday 26 February 2026  18:35:30 +0000 (0:00:00.058)       0:06:05.732 *****
2026-02-26 18:35:30.680012 | controller | skipping: [instance]
2026-02-26 18:35:30.734660 | controller |
2026-02-26 18:35:30.734681 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-02-26 18:35:30.734689 | controller | Thursday 26 February 2026  18:35:30 +0000 (0:00:00.063)       0:06:05.795 *****
2026-02-26 18:35:30.734706 | controller | skipping: [instance]
2026-02-26 18:35:30.804001 | controller |
2026-02-26 18:35:30.804027 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-02-26 18:35:30.804038 | controller | Thursday 26 February 2026  18:35:30 +0000 (0:00:00.054)       0:06:05.850 *****
2026-02-26 18:35:30.804051 | controller | skipping: [instance]
2026-02-26 18:35:31.465489 | controller |
2026-02-26 18:35:31.465526 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-02-26 18:35:31.465535 | controller | Thursday 26 February 2026  18:35:30 +0000 (0:00:00.068)       0:06:05.918 *****
2026-02-26 18:35:31.465546 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:32.519078 | controller |
2026-02-26 18:35:32.519117 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-02-26 18:35:32.519127 | controller | Thursday 26 February 2026  18:35:31 +0000 (0:00:00.661)       0:06:06.580 *****
2026-02-26 18:35:32.519141 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:35:32.519181 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:35:32.519534 | controller | changed: [instance -> controller-0]
2026-02-26 18:35:32.519589 | controller |
2026-02-26 18:35:33.243996 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-02-26 18:35:33.244027 | controller | Thursday 26 February 2026  18:35:32 +0000 (0:00:01.053)       0:06:07.634 *****
2026-02-26 18:35:33.244040 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:33.783525 | controller |
2026-02-26 18:35:33.783565 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-02-26 18:35:33.783574 | controller | Thursday 26 February 2026  18:35:33 +0000 (0:00:00.724)       0:06:08.359 *****
2026-02-26 18:35:33.783585 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:35:33.849491 | controller |
2026-02-26 18:35:33.849516 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-02-26 18:35:33.849523 | controller | Thursday 26 February 2026  18:35:33 +0000 (0:00:00.539)       0:06:08.898 *****
2026-02-26 18:35:33.849534 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:35:33.910011 | controller | ok: [instance -> controller-0]
2026-02-26 18:35:33.910038 | controller |
2026-02-26 18:35:33.910048 | controller | TASK [ci_setup : List packages to install] *************************************
2026-02-26 18:35:33.910055 | controller | Thursday 26 February 2026  18:35:33 +0000 (0:00:00.066)       0:06:08.965 *****
2026-02-26 18:35:33.910067 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:09.902621 | controller |
2026-02-26 18:36:09.902659 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-02-26 18:36:09.902667 | controller | Thursday 26 February 2026  18:35:33 +0000 (0:00:00.060)       0:06:09.025 *****
2026-02-26 18:36:09.902678 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:09.902768 | controller |
2026-02-26 18:36:09.902793 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-02-26 18:36:09.902802 | controller | Thursday 26 February 2026  18:36:09 +0000 (0:00:35.992)       0:06:45.018 *****
2026-02-26 18:36:10.413705 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:10.413763 | controller |
2026-02-26 18:36:10.413962 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-02-26 18:36:10.910391 | controller | Thursday 26 February 2026  18:36:10 +0000 (0:00:00.510)       0:06:45.529 *****
2026-02-26 18:36:10.910429 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:16.800078 | controller |
2026-02-26 18:36:16.800139 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-02-26 18:36:16.800152 | controller | Thursday 26 February 2026  18:36:10 +0000 (0:00:00.496)       0:06:46.025 *****
2026-02-26 18:36:16.800169 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:16.862489 | controller |
2026-02-26 18:36:16.862525 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-02-26 18:36:16.862534 | controller | Thursday 26 February 2026  18:36:16 +0000 (0:00:05.889)       0:06:51.915 *****
2026-02-26 18:36:16.862545 | controller | skipping: [instance]
2026-02-26 18:36:17.516934 | controller |
2026-02-26 18:36:17.517000 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-02-26 18:36:17.517009 | controller | Thursday 26 February 2026  18:36:16 +0000 (0:00:00.062)       0:06:51.978 *****
2026-02-26 18:36:17.517020 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:18.015966 | controller |
2026-02-26 18:36:18.015999 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-02-26 18:36:18.016008 | controller | Thursday 26 February 2026  18:36:17 +0000 (0:00:00.654)       0:06:52.632 *****
2026-02-26 18:36:18.016018 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:18.016243 | controller |
2026-02-26 18:36:18.057173 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-02-26 18:36:18.057227 | controller | Thursday 26 February 2026  18:36:18 +0000 (0:00:00.499)       0:06:53.131 *****
2026-02-26 18:36:18.057247 | controller | skipping: [instance]
2026-02-26 18:36:18.103506 | controller |
2026-02-26 18:36:18.103536 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-02-26 18:36:18.103544 | controller | Thursday 26 February 2026  18:36:18 +0000 (0:00:00.040)       0:06:53.172 *****
2026-02-26 18:36:18.103554 | controller | skipping: [instance]
2026-02-26 18:36:18.103650 | controller |
2026-02-26 18:36:18.103670 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-02-26 18:36:18.144084 | controller | Thursday 26 February 2026  18:36:18 +0000 (0:00:00.046)       0:06:53.219 *****
2026-02-26 18:36:18.144121 | controller | skipping: [instance]
2026-02-26 18:36:18.144455 | controller |
2026-02-26 18:36:18.188053 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-02-26 18:36:18.188076 | controller | Thursday 26 February 2026  18:36:18 +0000 (0:00:00.040)       0:06:53.260 *****
2026-02-26 18:36:18.188087 | controller | skipping: [instance]
2026-02-26 18:36:18.188118 | controller |
2026-02-26 18:36:18.188127 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-02-26 18:36:18.188259 | controller | Thursday 26 February 2026  18:36:18 +0000 (0:00:00.043)       0:06:53.303 *****
2026-02-26 18:36:18.230105 | controller | skipping: [instance]
2026-02-26 18:36:18.230160 | controller |
2026-02-26 18:36:18.230168 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-02-26 18:36:18.230177 | controller | Thursday 26 February 2026  18:36:18 +0000 (0:00:00.041)       0:06:53.345 *****
2026-02-26 18:36:18.275076 | controller | skipping: [instance]
2026-02-26 18:36:18.275116 | controller |
2026-02-26 18:36:18.275316 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-02-26 18:36:20.835843 | controller | Thursday 26 February 2026  18:36:18 +0000 (0:00:00.045)       0:06:53.391 *****
2026-02-26 18:36:20.836314 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:36:20.836929 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:36:20.837038 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:36:20.837182 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:36:20.837315 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:36:20.837440 | controller | changed: [instance -> controller-0]
2026-02-26 18:36:20.837531 | controller |
2026-02-26 18:36:20.837644 | controller | TASK [Prepare install_yamls make targets] **************************************
2026-02-26 18:36:20.837741 | controller | Thursday 26 February 2026  18:36:20 +0000 (0:00:02.550)       0:06:55.941 *****
2026-02-26 18:36:20.979412 | controller |
2026-02-26 18:36:20.979560 | controller | TASK [install_yamls : Ensure directories exist] ********************************
2026-02-26 18:36:20.979687 | controller | Thursday 26 February 2026  18:36:20 +0000 (0:00:00.154)       0:06:56.095 *****
2026-02-26 18:36:22.491925 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:36:22.555114 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:36:22.555148 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:36:22.555160 | controller | changed: [instance -> controller-0]
2026-02-26 18:36:22.555169 | controller |
2026-02-26 18:36:22.555178 | controller | TASK [Create variables with local repos based on Zuul items] *******************
2026-02-26 18:36:22.555185 | controller | Thursday 26 February 2026  18:36:22 +0000 (0:00:01.510)       0:06:57.605 *****
2026-02-26 18:36:22.555200 | controller |
2026-02-26 18:36:22.555289 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] ***********
2026-02-26 18:36:22.555308 | controller | Thursday 26 February 2026  18:36:22 +0000 (0:00:00.065)       0:06:57.671 *****
2026-02-26 18:36:22.599503 | controller | skipping: [instance]
2026-02-26 18:36:22.599581 | controller |
2026-02-26 18:36:22.599674 | controller | TASK [install_yamls : Print helpful data for debugging] ************************
2026-02-26 18:36:22.599770 | controller | Thursday 26 February 2026  18:36:22 +0000 (0:00:00.044)       0:06:57.715 *****
2026-02-26 18:36:22.652859 | controller | skipping: [instance]
2026-02-26 18:36:22.652966 | controller |
2026-02-26 18:36:22.653064 | controller | TASK [Customize install_yamls devsetup vars if needed] *************************
2026-02-26 18:36:22.653146 | controller | Thursday 26 February 2026  18:36:22 +0000 (0:00:00.053)       0:06:57.768 *****
2026-02-26 18:36:22.727190 | controller |
2026-02-26 18:36:22.727273 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] ***
2026-02-26 18:36:22.727289 | controller | Thursday 26 February 2026  18:36:22 +0000 (0:00:00.074)       0:06:57.842 *****
2026-02-26 18:36:22.770291 | controller | skipping: [instance]
2026-02-26 18:36:22.770381 | controller |
2026-02-26 18:36:22.770487 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] ***
2026-02-26 18:36:22.770572 | controller | Thursday 26 February 2026  18:36:22 +0000 (0:00:00.043)       0:06:57.886 *****
2026-02-26 18:36:22.825973 | controller | skipping: [instance]
2026-02-26 18:36:22.826129 | controller |
2026-02-26 18:36:22.826234 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] ***
2026-02-26 18:36:22.826332 | controller | Thursday 26 February 2026  18:36:22 +0000 (0:00:00.055)       0:06:57.941 *****
2026-02-26 18:36:22.874439 | controller | skipping: [instance]
2026-02-26 18:36:22.874517 | controller |
2026-02-26 18:36:22.874609 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] ***
2026-02-26 18:36:22.874696 | controller | Thursday 26 February 2026  18:36:22 +0000 (0:00:00.048)       0:06:57.990 *****
2026-02-26 18:36:22.920478 | controller | skipping: [instance]
2026-02-26 18:36:22.920551 | controller |
2026-02-26 18:36:22.920640 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ********
2026-02-26 18:36:22.920742 | controller | Thursday 26 February 2026  18:36:22 +0000 (0:00:00.045)       0:06:58.036 *****
2026-02-26 18:36:23.027805 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-02-26 18:36:23.027900 | controller | ok: [instance -> controller-0]
2026-02-26 18:36:23.028035 | controller |
2026-02-26 18:36:23.028218 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] ***
2026-02-26 18:36:23.028283 | controller | Thursday 26 February 2026  18:36:23 +0000 (0:00:00.107)       0:06:58.143 *****
2026-02-26 18:36:23.107501 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:23.107628 | controller |
2026-02-26 18:36:23.107742 | controller | TASK [install_yamls : Get environment structure] *******************************
2026-02-26 18:36:23.107836 | controller | Thursday 26 February 2026  18:36:23 +0000 (0:00:00.079)       0:06:58.223 *****
2026-02-26 18:36:24.024424 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:24.024509 | controller |
2026-02-26 18:36:24.024643 | controller | TASK [install_yamls : Ensure Output directory exists] **************************
2026-02-26 18:36:24.024658 | controller | Thursday 26 February 2026  18:36:24 +0000 (0:00:00.916)       0:06:59.140 *****
2026-02-26 18:36:24.079755 | controller | skipping: [instance]
2026-02-26 18:36:24.079815 | controller |
2026-02-26 18:36:24.079910 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] ***
2026-02-26 18:36:24.080031 | controller | Thursday 26 February 2026  18:36:24 +0000 (0:00:00.055)       0:06:59.195 *****
2026-02-26 18:36:24.140334 | controller | skipping: [instance]
2026-02-26 18:36:24.140390 | controller |
2026-02-26 18:36:24.140529 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] ***
2026-02-26 18:36:24.140636 | controller | Thursday 26 February 2026  18:36:24 +0000 (0:00:00.060)       0:06:59.256 *****
2026-02-26 18:36:24.189718 | controller | skipping: [instance]
2026-02-26 18:36:24.189816 | controller |
2026-02-26 18:36:24.190128 | controller | TASK [install_yamls : Set install_yamls default values] ************************
2026-02-26 18:36:24.190242 | controller | Thursday 26 February 2026  18:36:24 +0000 (0:00:00.049)       0:06:59.305 *****
2026-02-26 18:36:24.260981 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:24.261086 | controller |
2026-02-26 18:36:24.261199 | controller | TASK [install_yamls : Show the env structure] **********************************
2026-02-26 18:36:24.261304 | controller | Thursday 26 February 2026  18:36:24 +0000 (0:00:00.071)       0:06:59.376 *****
2026-02-26 18:36:24.312856 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:24.312974 | controller |
2026-02-26 18:36:24.313138 | controller | TASK [install_yamls : Show the env structure defaults] *************************
2026-02-26 18:36:24.313271 | controller | Thursday 26 February 2026  18:36:24 +0000 (0:00:00.051)       0:06:59.428 *****
2026-02-26 18:36:24.379978 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:24.380123 | controller |
2026-02-26 18:36:24.380257 | controller | TASK [install_yamls : Generate make targets] ***********************************
2026-02-26 18:36:24.380382 | controller | Thursday 26 February 2026  18:36:24 +0000 (0:00:00.066)       0:06:59.495 *****
2026-02-26 18:36:25.151115 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:25.151196 | controller |
2026-02-26 18:36:25.151417 | controller | TASK [install_yamls : Debug generate_make module] ******************************
2026-02-26 18:36:25.209651 | controller | Thursday 26 February 2026  18:36:25 +0000 (0:00:00.770)       0:07:00.266 *****
2026-02-26 18:36:25.209682 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:25.209741 | controller |
2026-02-26 18:36:25.209851 | controller | TASK [install_yamls : Create the install_yamls parameters file] ****************
2026-02-26 18:36:25.210017 | controller | Thursday 26 February 2026  18:36:25 +0000 (0:00:00.058)       0:07:00.325 *****
2026-02-26 18:36:26.290875 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:26.290932 | controller |
2026-02-26 18:36:26.291039 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] ***
2026-02-26 18:36:26.291158 | controller | Thursday 26 February 2026  18:36:26 +0000 (0:00:01.080)       0:07:01.405 *****
2026-02-26 18:36:26.339534 | controller | skipping: [instance]
2026-02-26 18:36:26.339593 | controller |
2026-02-26 18:36:26.339704 | controller | TASK [discover_latest_image : Get latest image] ********************************
2026-02-26 18:36:26.339801 | controller | Thursday 26 February 2026  18:36:26 +0000 (0:00:00.049)       0:07:01.455 *****
2026-02-26 18:36:27.159385 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:27.159490 | controller |
2026-02-26 18:36:27.159601 | controller | TASK [discover_latest_image : Export facts accordingly] ************************
2026-02-26 18:36:27.159614 | controller | Thursday 26 February 2026  18:36:27 +0000 (0:00:00.819)       0:07:02.274 *****
2026-02-26 18:36:27.222277 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:27.222330 | controller |
2026-02-26 18:36:27.222430 | controller | TASK [cifmw_setup : Create artifacts with custom params] ***********************
2026-02-26 18:36:27.222521 | controller | Thursday 26 February 2026  18:36:27 +0000 (0:00:00.063)       0:07:02.338 *****
2026-02-26 18:36:28.180793 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:28.180878 | controller |
2026-02-26 18:36:28.181034 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] *******
2026-02-26 18:36:28.181182 | controller | Thursday 26 February 2026  18:36:28 +0000 (0:00:00.958)       0:07:03.296 *****
2026-02-26 18:36:28.733891 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-02-26 18:36:28.733989 | controller |
2026-02-26 18:36:28.734125 | controller | TASK [Configure CRC network if needed] *****************************************
2026-02-26 18:36:28.734257 | controller | Thursday 26 February 2026  18:36:28 +0000 (0:00:00.553)       0:07:03.849 *****
2026-02-26 18:36:28.881552 | controller |
2026-02-26 18:36:28.881650 | controller | TASK [openshift_setup : Gather network.operator info] **************************
2026-02-26 18:36:28.881722 | controller | Thursday 26 February 2026  18:36:28 +0000 (0:00:00.147)       0:07:03.997 *****
2026-02-26 18:36:30.175244 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)')))
2026-02-26 18:36:30.177912 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false
2026-02-26 18:36:30.178176 | controller |   module_stderr: |-
2026-02-26 18:36:30.178204 | controller |     Shared connection to controller-0.utility closed.
2026-02-26 18:36:30.178212 | controller |   module_stdout: |-
2026-02-26 18:36:30.178218 | controller |     Traceback (most recent call last):
2026-02-26 18:36:30.178225 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen
2026-02-26 18:36:30.178231 | controller |         httplib_response = self._make_request(
2026-02-26 18:36:30.178237 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request
2026-02-26 18:36:30.178243 | controller |         self._validate_conn(conn)
2026-02-26 18:36:30.178254 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn
2026-02-26 18:36:30.178295 | controller |         conn.connect()
2026-02-26 18:36:30.178301 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect
2026-02-26 18:36:30.178309 | controller |         self.sock = ssl_wrap_socket(
2026-02-26 18:36:30.179169 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket
2026-02-26 18:36:30.179614 | controller |         ssl_sock = _ssl_wrap_socket_impl(
2026-02-26 18:36:30.179672 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
2026-02-26 18:36:30.179683 | controller |         return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
2026-02-26 18:36:30.179690 | controller |       File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket
2026-02-26 18:36:30.179696 | controller |         return self.sslsocket_class._create(
2026-02-26 18:36:30.179702 | controller |       File "/usr/lib64/python3.9/ssl.py", line 1076, in _create
2026-02-26 18:36:30.179709 | controller |         self.do_handshake()
2026-02-26 18:36:30.179716 | controller |       File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake
2026-02-26 18:36:30.179721 | controller |         self._sslobj.do_handshake()
2026-02-26 18:36:30.179735 | controller |     ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)
2026-02-26 18:36:30.179764 | controller |
2026-02-26 18:36:30.179771 | controller |     During handling of the above exception, another exception occurred:
2026-02-26 18:36:30.179776 | controller |
2026-02-26 18:36:30.179784 | controller |     Traceback (most recent call last):
2026-02-26 18:36:30.179856 | controller |       File "/tmp/ansible-tmp-1772130988.921467-28222-225524382481980/AnsiballZ_k8s_info.py", line 107, in <module>
2026-02-26 18:36:30.179869 | controller |         _ansiballz_main()
2026-02-26 18:36:30.179879 | controller |       File "/tmp/ansible-tmp-1772130988.921467-28222-225524382481980/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main
2026-02-26 18:36:30.179966 | controller |         invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS)
2026-02-26 18:36:30.180175 | controller |       File "/tmp/ansible-tmp-1772130988.921467-28222-225524382481980/AnsiballZ_k8s_info.py", line 47, in invoke_module
2026-02-26 18:36:30.180214 | controller |         runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path),
2026-02-26 18:36:30.180255 | controller |       File "/usr/lib64/python3.9/runpy.py", line 225, in run_module
2026-02-26 18:36:30.180397 | controller |         return _run_module_code(code, init_globals, run_name, mod_spec)
2026-02-26 18:36:30.180440 | controller |       File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code
2026-02-26 18:36:30.180653 | controller |         _run_code(code, mod_globals, init_globals,
2026-02-26 18:36:30.180705 | controller |       File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code
2026-02-26 18:36:30.180717 | controller |         exec(code, run_globals)
2026-02-26 18:36:30.180845 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_auvcgkmz/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in <module>
2026-02-26 18:36:30.180993 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_auvcgkmz/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main
2026-02-26 18:36:30.181064 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_auvcgkmz/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client
2026-02-26 18:36:30.181079 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_auvcgkmz/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper
2026-02-26 18:36:30.181185 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_auvcgkmz/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client
2026-02-26 18:36:30.181298 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__
2026-02-26 18:36:30.181409 | controller |         self.__discoverer = discoverer(self, cache_file)
2026-02-26 18:36:30.181515 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_auvcgkmz/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__
2026-02-26 18:36:30.181617 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_auvcgkmz/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__
2026-02-26 18:36:30.181708 | controller |       File "/tmp/ansible_kubernetes.core.k8s_info_payload_auvcgkmz/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache
2026-02-26 18:36:30.181834 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info
2026-02-26 18:36:30.181926 | controller |         'kubernetes': self.client.request('get', '/version', serializer=just_json)
2026-02-26 18:36:30.182070 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner
2026-02-26 18:36:30.182187 | controller |         resp = func(self, *args, **kwargs)
2026-02-26 18:36:30.182274 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request
2026-02-26 18:36:30.182378 | controller |         api_response = self.client.call_api(
2026-02-26 18:36:30.182480 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api
2026-02-26 18:36:30.182598 | controller |         return self.__call_api(resource_path, method,
2026-02-26 18:36:30.182692 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api
2026-02-26 18:36:30.182782 | controller |         response_data = self.request(
2026-02-26 18:36:30.182877 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request
2026-02-26 18:36:30.182984 | controller |         return self.rest_client.GET(url,
2026-02-26 18:36:30.183093 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET
2026-02-26 18:36:30.183188 | controller |         return self.request("GET", url,
2026-02-26 18:36:30.183286 | controller |       File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request
2026-02-26 18:36:30.183400 | controller |         r = self.pool_manager.request(method, url,
2026-02-26 18:36:30.183499 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request
2026-02-26 18:36:30.183594 | controller |         return self.request_encode_url(
2026-02-26 18:36:30.183692 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url
2026-02-26 18:36:30.183788 | controller |         return self.urlopen(method, url, **extra_kw)
2026-02-26 18:36:30.183885 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen
2026-02-26 18:36:30.183997 | controller |         response = conn.urlopen(method, u.request_uri, **kw)
2026-02-26 18:36:30.184124 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen
2026-02-26 18:36:30.184211 | controller |         return self.urlopen(
2026-02-26 18:36:30.184303 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen
2026-02-26 18:36:30.184410 | controller |         return self.urlopen(
2026-02-26 18:36:30.184508 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen
2026-02-26 18:36:30.184603 | controller |         return self.urlopen(
2026-02-26 18:36:30.184699 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen
2026-02-26 18:36:30.184793 | controller |         retries = retries.increment(
2026-02-26 18:36:30.184889 | controller |       File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment
2026-02-26 18:36:30.185067 | controller |         raise MaxRetryError(_pool, url, error or ResponseError(cause))
2026-02-26 18:36:30.185189 | controller |     urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)')))
2026-02-26 18:36:30.185286 | controller |   msg: |-
2026-02-26 18:36:30.185391 | controller |     MODULE FAILURE
2026-02-26 18:36:30.185496 | controller |     See stdout/stderr for the exact error
2026-02-26 18:36:30.185608 | controller |   rc: 1
2026-02-26 18:36:30.187538 | controller |
2026-02-26 18:36:30.187659 | controller | TASK [Create dnsmasq dir] ******************************************************
2026-02-26 18:36:30.187763 | controller | Thursday 26 February 2026  18:36:30 +0000 (0:00:01.306)       0:07:05.303 *****
2026-02-26 18:36:30.435438 | controller | changed: [instance]
2026-02-26 18:36:30.435514 | controller |
2026-02-26 18:36:30.435529 | controller | TASK [Get journalctl in a file] ************************************************
2026-02-26 18:36:30.435636 | controller | Thursday 26 February 2026  18:36:30 +0000 (0:00:00.247)       0:07:05.551 *****
2026-02-26 18:36:30.694153 | controller | changed: [instance]
2026-02-26 18:36:31.170090 | controller |
2026-02-26 18:36:31.170141 | controller | TASK [Dump journalctl output] **************************************************
2026-02-26 18:36:31.170151 | controller | Thursday 26 February 2026  18:36:30 +0000 (0:00:00.258)       0:07:05.809 *****
2026-02-26 18:36:31.170162 | controller | changed: [instance]
2026-02-26 18:36:31.170304 | controller |
2026-02-26 18:36:31.728674 | controller | TASK [Copy all dnsmasq config] *************************************************
2026-02-26 18:36:31.728728 | controller | Thursday 26 February 2026  18:36:31 +0000 (0:00:00.476)       0:07:06.285 *****
2026-02-26 18:36:31.728747 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-02-26 18:36:31.728775 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2026-02-26 18:36:31.728842 | controller |
2026-02-26 18:36:31.728961 | controller | TASK [Create log directory] ****************************************************
2026-02-26 18:36:31.729056 | controller | Thursday 26 February 2026  18:36:31 +0000 (0:00:00.558)       0:07:06.844 *****
2026-02-26 18:36:31.953211 | controller | changed: [instance]
2026-02-26 18:36:31.953269 | controller |
2026-02-26 18:36:31.953380 | controller | TASK [Sync logs from controller-0] *********************************************
2026-02-26 18:36:31.953481 | controller | Thursday 26 February 2026  18:36:31 +0000 (0:00:00.224)       0:07:07.069 *****
2026-02-26 18:36:32.961823 | controller | changed: [instance]
2026-02-26 18:36:32.961877 | controller |
2026-02-26 18:36:32.961991 | controller | PLAY RECAP *********************************************************************
2026-02-26 18:36:32.962115 | controller | instance                   : ok=541  changed=208  unreachable=0    failed=1    skipped=229  rescued=0    ignored=0
2026-02-26 18:36:32.962194 | controller |
2026-02-26 18:36:32.962283 | controller | Thursday 26 February 2026  18:36:32 +0000 (0:00:01.006)       0:07:08.075 *****
2026-02-26 18:36:32.962358 | controller | ===============================================================================
2026-02-26 18:36:32.962454 | controller | reproducer : Check package install status ------------------------------ 45.04s
2026-02-26 18:36:32.962536 | controller | ci_setup : Install needed packages ------------------------------------- 35.99s
2026-02-26 18:36:32.962618 | controller | libvirt_manager : Download base image ---------------------------------- 29.42s
2026-02-26 18:36:32.962700 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.26s
2026-02-26 18:36:32.962784 | controller | reproducer : Install collections on controller-0 ----------------------- 20.40s
2026-02-26 18:36:32.962870 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.90s
2026-02-26 18:36:32.963272 | controller | libvirt_manager : Install packages required for using KVM --------------- 9.55s
2026-02-26 18:36:32.963375 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.43s
2026-02-26 18:36:32.963386 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.41s
2026-02-26 18:36:32.963394 | controller | reproducer : Ensure we have all dependencies installed ------------------ 5.95s
2026-02-26 18:36:32.963554 | controller | ci_setup : Install openshift client ------------------------------------- 5.89s
2026-02-26 18:36:32.963572 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.13s
2026-02-26 18:36:32.964046 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.63s
2026-02-26 18:36:32.964066 | controller | networking_mapper : Gather the facts ------------------------------------ 3.37s
2026-02-26 18:36:32.964158 | controller | sushy_emulator : Install required packages ------------------------------ 3.00s
2026-02-26 18:36:32.964172 | controller | dnsmasq : Add/Remove address -------------------------------------------- 2.96s
2026-02-26 18:36:32.964179 | controller | ci_setup : Manage directories ------------------------------------------- 2.55s
2026-02-26 18:36:32.964184 | controller | reproducer : Ensure the required parameters are loaded ------------------ 2.55s
2026-02-26 18:36:32.964192 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.39s
2026-02-26 18:36:33.099101 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s
2026-02-26 18:36:33.099165 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml']
2026-02-26 18:36:33.099549 | controller | WARNING  An error occurred during the test sequence action: 'converge'. Cleaning up.
2026-02-26 18:36:33.108082 | controller | INFO     Running crc_layout > cleanup
2026-02-26 18:36:33.108493 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-02-26 18:36:33.115561 | controller | INFO     Running crc_layout > destroy
2026-02-26 18:36:33.115821 | controller | WARNING  Skipping, instances are delegated.
2026-02-26 18:36:33.116122 | controller | INFO     Pruning extra files from scenario ephemeral directory
2026-02-26 18:36:33.117578 | controller | INFO     Writing /tmp/report.html report.
2026-02-26 18:36:33.340114 | [controller] Waiting on logger
2026-02-26 18:36:38.524023 | [controller] Waiting on logger
2026-02-26 18:36:48.955953 | [controller] Waiting on logger
2026-02-26 18:36:59.387919 | [controller] Waiting on logger
2026-02-26 18:37:03.230193 | [Zuul] Log Stream did not terminate
2026-02-26 18:37:03.230517 | controller | ERROR
2026-02-26 18:37:03.230645 | controller | {
2026-02-26 18:37:03.230701 | controller |   "delta": "0:08:48.654042",
2026-02-26 18:37:03.230737 | controller |   "end": "2026-02-26 18:36:33.187815",
2026-02-26 18:37:03.230769 | controller |   "msg": "non-zero return code",
2026-02-26 18:37:03.230797 | controller |   "rc": 1,
2026-02-26 18:37:03.230823 | controller |   "start": "2026-02-26 18:27:44.533773"
2026-02-26 18:37:03.230849 | controller | }
failure
2026-02-26 18:37:03.290532 | 
2026-02-26 18:37:03.290580 | PLAY RECAP
2026-02-26 18:37:03.290621 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0
2026-02-26 18:37:03.290644 | 
2026-02-26 18:37:03.351127 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-02-26 18:37:03.351926 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-02-26 18:37:03.880011 | 
2026-02-26 18:37:03.880150 | PLAY [Run ci/playbooks/collect-logs.yml]
2026-02-26 18:37:03.900474 | 
2026-02-26 18:37:03.900552 | TASK [Filter out host if needed]
2026-02-26 18:37:03.909627 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2026-02-26 18:37:03.914055 | 
2026-02-26 18:37:03.914121 | TASK [Ensure file is present]
2026-02-26 18:37:04.338463 | controller | ok
2026-02-26 18:37:04.344077 | 
2026-02-26 18:37:04.344148 | TASK [Manage molecule report file]
2026-02-26 18:37:04.364082 | [controller] Waiting on logger
2026-02-26 18:37:13.723976 | [controller] Waiting on logger
2026-02-26 18:37:24.155806 | [controller] Waiting on logger
2026-02-26 18:37:33.499821 | [controller] Waiting on logger
2026-02-26 18:37:34.777695 | [Zuul] Log Stream did not terminate
2026-02-26 18:37:34.777857 | controller | changed
2026-02-26 18:37:34.783072 | 
2026-02-26 18:37:34.783135 | TASK [Check if we get ci-framework-data basedir]
2026-02-26 18:37:35.064130 | controller | ok
2026-02-26 18:37:35.069052 | 
2026-02-26 18:37:35.069130 | TASK [Create ci-framework-data log directory for zuul]
2026-02-26 18:37:35.452383 | controller | changed
2026-02-26 18:37:35.457458 | 
2026-02-26 18:37:35.457519 | TASK [Copy ci-framework interesting files]
2026-02-26 18:37:35.480315 | [controller] Waiting on logger
2026-02-26 18:37:45.915990 | [controller] Waiting on logger
2026-02-26 18:37:56.347856 | [controller] Waiting on logger
2026-02-26 18:38:05.691960 | [controller] Waiting on logger
2026-02-26 18:38:05.779049 | [Zuul] Log Stream did not terminate
2026-02-26 18:38:05.779263 | controller | changed
2026-02-26 18:38:05.784547 | 
2026-02-26 18:38:05.784610 | TASK [Get SELinux listing]
2026-02-26 18:38:06.843768 | [controller] Waiting on logger
2026-02-26 18:38:13.102608 | controller | changed
2026-02-26 18:38:13.108246 | 
2026-02-26 18:38:13.108322 | TASK [Generate log index]
2026-02-26 18:38:14.236580 | controller | changed
2026-02-26 18:38:14.241263 | 
2026-02-26 18:38:14.241341 | TASK [Get some env related data]
2026-02-26 18:38:17.340167 | [controller] Waiting on logger
2026-02-26 18:38:27.771630 | [controller] Waiting on logger
2026-02-26 18:38:38.203727 | [controller] Waiting on logger
2026-02-26 18:38:45.489005 | [Zuul] Log Stream did not terminate
2026-02-26 18:38:45.489247 | controller | changed
2026-02-26 18:38:45.494226 | 
2026-02-26 18:38:45.494282 | TASK [Generate list of logs to collect in home directory]
2026-02-26 18:38:45.853878 | controller | ok: All paths examined
2026-02-26 18:38:45.858792 | 
2026-02-26 18:38:45.858851 | LOOP [Copy logs from home directory]
2026-02-26 18:38:46.485355 | controller | changed:
2026-02-26 18:38:46.485551 | controller | {
2026-02-26 18:38:46.485580 | controller |   "atime": 1743544925.4788878,
2026-02-26 18:38:46.485601 | controller |   "ctime": 1743545329.1409318,
2026-02-26 18:38:46.485619 | controller |   "dev": 64513,
2026-02-26 18:38:46.485636 | controller |   "gid": 1000,
2026-02-26 18:38:46.485652 | controller |   "gr_name": "zuul",
2026-02-26 18:38:46.485667 | controller |   "inode": 4518807,
2026-02-26 18:38:46.485683 | controller |   "isblk": false,
2026-02-26 18:38:46.485698 | controller |   "ischr": false,
2026-02-26 18:38:46.485712 | controller |   "isdir": false,
2026-02-26 18:38:46.485726 | controller |   "isfifo": false,
2026-02-26 18:38:46.485740 | controller |   "isgid": false,
2026-02-26 18:38:46.485754 | controller |   "islnk": false,
2026-02-26 18:38:46.485767 | controller |   "isreg": true,
2026-02-26 18:38:46.485780 | controller |   "issock": false,
2026-02-26 18:38:46.485796 | controller |   "isuid": false,
2026-02-26 18:38:46.485810 | controller |   "mode": "0644",
2026-02-26 18:38:46.485824 | controller |   "mtime": 1743545329.1409318,
2026-02-26 18:38:46.485838 | controller |   "nlink": 1,
2026-02-26 18:38:46.485851 | controller |   "path": "/home/zuul/crc-setup.log",
2026-02-26 18:38:46.485865 | controller |   "pw_name": "zuul",
2026-02-26 18:38:46.485878 | controller |   "rgrp": true,
2026-02-26 18:38:46.485907 | controller |   "roth": true,
2026-02-26 18:38:46.485922 | controller |   "rusr": true,
2026-02-26 18:38:46.485936 | controller |   "size": 4108,
2026-02-26 18:38:46.485950 | controller |   "uid": 1000,
2026-02-26 18:38:46.485963 | controller |   "wgrp": false,
2026-02-26 18:38:46.485977 | controller |   "woth": false,
2026-02-26 18:38:46.485989 | controller |   "wusr": true,
2026-02-26 18:38:46.486002 | controller |   "xgrp": false,
2026-02-26 18:38:46.486015 | controller |   "xoth": false,
2026-02-26 18:38:46.486028 | controller |   "xusr": false
2026-02-26 18:38:46.486040 | controller | }
2026-02-26 18:38:47.084540 | controller | changed:
2026-02-26 18:38:47.084601 | controller | {
2026-02-26 18:38:47.084627 | controller |   "atime": 1743545331.0429637,
2026-02-26 18:38:47.084646 | controller |   "ctime": 1743545842.0111232,
2026-02-26 18:38:47.084664 | controller |   "dev": 64513,
2026-02-26 18:38:47.084685 | controller |   "gid": 1000,
2026-02-26 18:38:47.084702 | controller |   "gr_name": "zuul",
2026-02-26 18:38:47.084718 | controller |   "inode": 4194437,
2026-02-26 18:38:47.084732 | controller |   "isblk": false,
2026-02-26 18:38:47.084747 | controller |   "ischr": false,
2026-02-26 18:38:47.084761 | controller |   "isdir": false,
2026-02-26 18:38:47.084775 | controller |   "isfifo": false,
2026-02-26 18:38:47.084789 | controller |   "isgid": false,
2026-02-26 18:38:47.084802 | controller |   "islnk": false,
2026-02-26 18:38:47.084816 | controller |   "isreg": true,
2026-02-26 18:38:47.084829 | controller |   "issock": false,
2026-02-26 18:38:47.084843 | controller |   "isuid": false,
2026-02-26 18:38:47.084856 | controller |   "mode": "0644",
2026-02-26 18:38:47.084870 | controller |   "mtime": 1743545842.0111232,
2026-02-26 18:38:47.084896 | controller |   "nlink": 1,
2026-02-26 18:38:47.084913 | controller |   "path": "/home/zuul/crc-start.log",
2026-02-26 18:38:47.084928 | controller |   "pw_name": "zuul",
2026-02-26 18:38:47.084942 | controller |   "rgrp": true,
2026-02-26 18:38:47.084955 | controller |   "roth": true,
2026-02-26 18:38:47.084969 | controller |   "rusr": true,
2026-02-26 18:38:47.084982 | controller |   "size": 4023,
2026-02-26 18:38:47.084995 | controller |   "uid": 1000,
2026-02-26 18:38:47.085008 | controller |   "wgrp": false,
2026-02-26 18:38:47.085022 | controller |   "woth": false,
2026-02-26 18:38:47.085037 | controller |   "wusr": true,
2026-02-26 18:38:47.085052 | controller |   "xgrp": false,
2026-02-26 18:38:47.085066 | controller |   "xoth": false,
2026-02-26 18:38:47.085080 | controller |   "xusr": false
2026-02-26 18:38:47.085094 | controller | }
2026-02-26 18:38:47.547837 | [controller] Waiting on logger
2026-02-26 18:38:47.710546 | controller | changed:
2026-02-26 18:38:47.710640 | controller | {
2026-02-26 18:38:47.710667 | controller |   "atime": 1772130445.5352745,
2026-02-26 18:38:47.710688 | controller |   "ctime": 1772130462.159515,
2026-02-26 18:38:47.710705 | controller |   "dev": 64513,
2026-02-26 18:38:47.710720 | controller |   "gid": 1000,
2026-02-26 18:38:47.710735 | controller |   "gr_name": "zuul",
2026-02-26 18:38:47.710750 | controller |   "inode": 4234045,
2026-02-26 18:38:47.710766 | controller |   "isblk": false,
2026-02-26 18:38:47.710780 | controller |   "ischr": false,
2026-02-26 18:38:47.710797 | controller |   "isdir": false,
2026-02-26 18:38:47.710812 | controller |   "isfifo": false,
2026-02-26 18:38:47.710825 | controller |   "isgid": false,
2026-02-26 18:38:47.710838 | controller |   "islnk": false,
2026-02-26 18:38:47.710851 | controller |   "isreg": true,
2026-02-26 18:38:47.710864 | controller |   "issock": false,
2026-02-26 18:38:47.710877 | controller |   "isuid": false,
2026-02-26 18:38:47.710911 | controller |   "mode": "0644",
2026-02-26 18:38:47.710927 | controller |   "mtime": 1772130462.159515,
2026-02-26 18:38:47.710941 | controller |   "nlink": 1,
2026-02-26 18:38:47.710954 | controller |   "path": "/home/zuul/ansible.log",
2026-02-26 18:38:47.710969 | controller |   "pw_name": "zuul",
2026-02-26 18:38:47.710984 | controller |   "rgrp": true,
2026-02-26 18:38:47.710999 | controller |   "roth": true,
2026-02-26 18:38:47.711014 | controller |   "rusr": true,
2026-02-26 18:38:47.711028 | controller |   "size": 6749,
2026-02-26 18:38:47.711042 | controller |   "uid": 1000,
2026-02-26 18:38:47.711057 | controller |   "wgrp": false,
2026-02-26 18:38:47.711071 | controller |   "woth": false,
2026-02-26 18:38:47.711084 | controller |   "wusr": true,
2026-02-26 18:38:47.711098 | controller |   "xgrp": false,
2026-02-26 18:38:47.711111 | controller |   "xoth": false,
2026-02-26 18:38:47.711124 | controller |   "xusr": false
2026-02-26 18:38:47.711137 | controller | }
2026-02-26 18:38:47.725953 | 
2026-02-26 18:38:47.726057 | TASK [Copy crio stats log file]
2026-02-26 18:38:47.739013 | controller | skipping: Conditional result was False
2026-02-26 18:38:47.744279 | 
2026-02-26 18:38:47.744357 | TASK [Get SELinux related data]
2026-02-26 18:38:50.875986 | [controller] Waiting on logger
2026-02-26 18:39:07.259694 | [controller] Waiting on logger
2026-02-26 18:39:10.588208 | [controller] Waiting on logger
2026-02-26 18:39:18.066571 | [Zuul] Log Stream did not terminate
2026-02-26 18:39:18.066786 | controller | ERROR
2026-02-26 18:39:18.066877 | controller | {
2026-02-26 18:39:18.066915 | controller |   "delta": "0:00:00.012322",
2026-02-26 18:39:18.066934 | controller |   "end": "2026-02-26 18:38:48.039814",
2026-02-26 18:39:18.066950 | controller |   "msg": "non-zero return code",
2026-02-26 18:39:18.066967 | controller |   "rc": 1,
2026-02-26 18:39:18.066984 | controller |   "start": "2026-02-26 18:38:48.027492"
2026-02-26 18:39:18.067000 | controller | }
2026-02-26 18:39:18.067021 | controller | ERROR: Ignoring Errors
2026-02-26 18:39:18.072014 | 
2026-02-26 18:39:18.072076 | TASK [Create system configuration directory]
2026-02-26 18:39:18.415936 | controller | changed
2026-02-26 18:39:18.420640 | 
2026-02-26 18:39:18.420702 | TASK [Get some of the system configurations]
2026-02-26 18:39:18.440743 | [controller] Waiting on logger
2026-02-26 18:39:24.654800 | controller | changed
2026-02-26 18:39:24.660865 | 
2026-02-26 18:39:24.660948 | TASK [Copy generated documentation if available]
2026-02-26 18:39:24.674514 | controller | skipping: Conditional result was False
2026-02-26 18:39:24.679747 | 
2026-02-26 18:39:24.679808 | TASK [Copy generated AsciiDoc documentation if available]
2026-02-26 18:39:24.693098 | controller | skipping: Conditional result was False
2026-02-26 18:39:24.698410 | 
2026-02-26 18:39:24.698474 | TASK [Compress logs bigger than 2MB]
2026-02-26 18:39:24.722099 | [controller] Waiting on logger
2026-02-26 18:39:27.931807 | [controller] Waiting on logger
2026-02-26 18:39:29.829040 | controller | changed
2026-02-26 18:39:29.833955 | 
2026-02-26 18:39:29.834014 | TASK [Copy files from workspace on node]
2026-02-26 18:39:29.851592 | controller | ok
2026-02-26 18:39:29.872751 | 
2026-02-26 18:39:29.872819 | TASK [fetch-output : Set log path for multiple nodes]
2026-02-26 18:39:29.886424 | controller | skipping: Conditional result was False
2026-02-26 18:39:29.891714 | 
2026-02-26 18:39:29.891783 | TASK [fetch-output : Set log path for single node]
2026-02-26 18:39:29.920410 | controller | ok
2026-02-26 18:39:29.924980 | 
2026-02-26 18:39:29.925041 | LOOP [fetch-output : Ensure local output dirs]
2026-02-26 18:39:30.104403 | controller -> localhost | ok: "/var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/logs"
2026-02-26 18:39:30.104614 | controller -> localhost | changed: All items complete
2026-02-26 18:39:30.104641 | 
2026-02-26 18:39:30.266087 | controller -> localhost | changed: "/var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/artifacts"
2026-02-26 18:39:30.424930 | controller -> localhost | changed: "/var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/docs"
2026-02-26 18:39:30.440971 | 
2026-02-26 18:39:30.441089 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-02-26 18:39:31.058721 | controller | changed:
2026-02-26 18:39:31.058911 | controller | .d..t...... ./
2026-02-26 18:39:31.058942 | controller | >f+++++++++ README.html
2026-02-26 18:39:31.058963 | controller | >f+++++++++ ansible-execution.log
2026-02-26 18:39:31.058982 | controller | >f+++++++++ ansible.log
2026-02-26 18:39:31.059000 | controller | >f+++++++++ crc-setup.log
2026-02-26 18:39:31.059017 | controller | >f+++++++++ crc-start.log
2026-02-26 18:39:31.059032 | controller | >f+++++++++ dmesg.log
2026-02-26 18:39:31.059048 | controller | >f+++++++++ installed-pkgs.log
2026-02-26 18:39:31.059062 | controller | >f+++++++++ python.log
2026-02-26 18:39:31.059076 | controller | >f+++++++++ registries.conf
2026-02-26 18:39:31.059092 | controller | >f+++++++++ report.html
2026-02-26 18:39:31.059106 | controller | >f+++++++++ selinux-denials.log
2026-02-26 18:39:31.059121 | controller | >f+++++++++ selinux-listing.log
2026-02-26 18:39:31.059135 | controller | cd+++++++++ ci-framework-data/
2026-02-26 18:39:31.059154 | controller | cd+++++++++ ci-framework-data/artifacts/
2026-02-26 18:39:31.059170 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2026-02-26 18:39:31.059185 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2026-02-26 18:39:31.059199 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf
2026-02-26 18:39:31.059213 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2026-02-26 18:39:31.059226 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf
2026-02-26 18:39:31.059239 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2026-02-26 18:39:31.059252 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2026-02-26 18:39:31.059266 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2026-02-26 18:39:31.059280 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2026-02-26 18:39:31.059349 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2026-02-26 18:39:31.059377 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2026-02-26 18:39:31.059396 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2026-02-26 18:39:31.059412 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2026-02-26 18:39:31.059426 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:a3:75:ee
2026-02-26 18:39:31.059441 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:fd:75:f8
2026-02-26 18:39:31.059455 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:8b:35:6e
2026-02-26 18:39:31.059469 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:3e:ec:8b
2026-02-26 18:39:31.059483 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:1c:31:f9
2026-02-26 18:39:31.059496 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:2d:ee:47
2026-02-26 18:39:31.059511 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2026-02-26 18:39:31.059524 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2026-02-26 18:39:31.059538 | controller | cd+++++++++ ci-framework-data/logs/
2026-02-26 18:39:31.059551 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2026-02-26 18:39:31.059564 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2026-02-26 18:39:31.059578 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log
2026-02-26 18:39:31.059592 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2026-02-26 18:39:31.059607 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2026-02-26 18:39:31.059621 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml
2026-02-26 18:39:31.059635 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2026-02-26 18:39:31.059649 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/
2026-02-26 18:39:31.059665 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/
2026-02-26 18:39:31.059680 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/
2026-02-26 18:39:31.059695 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/
2026-02-26 18:39:31.059712 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml
2026-02-26 18:39:31.059727 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml
2026-02-26 18:39:31.059744 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/
2026-02-26 18:39:31.059759 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo
2026-02-26 18:39:31.059773 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo
2026-02-26 18:39:31.059788 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5
2026-02-26 18:39:31.059802 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo
2026-02-26 18:39:31.059816 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo
2026-02-26 18:39:31.059830 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo
2026-02-26 18:39:31.059844 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo
2026-02-26 18:39:31.059858 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/
2026-02-26 18:39:31.059871 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/
2026-02-26 18:39:31.059897 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd
2026-02-26 18:39:31.059912 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf
2026-02-26 18:39:31.059925 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts
2026-02-26 18:39:31.059939 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/
2026-02-26 18:39:31.059952 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2026-02-26 18:39:31.059965 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml
2026-02-26 18:39:31.059978 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2026-02-26 18:39:31.059991 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml
2026-02-26 18:39:31.060005 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml
2026-02-26 18:39:31.060019 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/
2026-02-26 18:39:31.060032 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt
2026-02-26 18:39:31.060045 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/
2026-02-26 18:39:31.060059 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2026-02-26 18:39:31.060073 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd
2026-02-26 18:39:31.060086 | controller | cd+++++++++ registries.conf.d/
2026-02-26 18:39:31.060100 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2026-02-26 18:39:31.060113 | controller | cd+++++++++ system-config/
2026-02-26 18:39:31.060126 | controller | cd+++++++++ system-config/libvirt/
2026-02-26 18:39:31.060139 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2026-02-26 18:39:31.060152 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2026-02-26 18:39:31.060165 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2026-02-26 18:39:31.060178 | controller | >f+++++++++ system-config/libvirt/network.conf
2026-02-26 18:39:31.060191 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2026-02-26 18:39:31.060207 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2026-02-26 18:39:31.060221 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2026-02-26 18:39:31.060234 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2026-02-26 18:39:31.060248 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2026-02-26 18:39:31.060261 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2026-02-26 18:39:31.060274 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2026-02-26 18:39:31.060286 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2026-02-26 18:39:31.060321 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2026-02-26 18:39:31.060339 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2026-02-26 18:39:31.060353 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2026-02-26 18:39:31.060366 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2026-02-26 18:39:31.497102 | controller | changed: .d..t...... ./
2026-02-26 18:39:31.946408 | controller | changed: .d..t...... ./
2026-02-26 18:39:31.965955 | 
2026-02-26 18:39:31.966022 | TASK [Return artifact to Zuul]
2026-02-26 18:39:31.993600 | controller | ok
2026-02-26 18:39:32.010687 | 
2026-02-26 18:39:32.010740 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2026-02-26 18:39:32.010825 | 
2026-02-26 18:39:32.010849 | PLAY RECAP
2026-02-26 18:39:32.010891 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2026-02-26 18:39:32.010911 | 
2026-02-26 18:39:32.084408 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-02-26 18:39:32.085065 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-02-26 18:39:32.559511 | 
2026-02-26 18:39:32.559646 | PLAY [all]
2026-02-26 18:39:32.576603 | 
2026-02-26 18:39:32.576669 | TASK [include_role : fetch-output]
2026-02-26 18:39:32.604853 | controller | ok
2026-02-26 18:39:32.620898 | 
2026-02-26 18:39:32.620975 | TASK [fetch-output : Set log path for multiple nodes]
2026-02-26 18:39:32.664826 | controller | skipping: Conditional result was False
2026-02-26 18:39:32.669944 | 
2026-02-26 18:39:32.670013 | TASK [fetch-output : Set log path for single node]
2026-02-26 18:39:32.697936 | controller | ok
2026-02-26 18:39:32.702378 | 
2026-02-26 18:39:32.702442 | LOOP [fetch-output : Ensure local output dirs]
2026-02-26 18:39:33.014943 | controller -> localhost | ok: "/var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/logs"
2026-02-26 18:39:33.201086 | controller -> localhost | ok: "/var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/artifacts"
2026-02-26 18:39:33.375918 | controller -> localhost | ok: "/var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/docs"
2026-02-26 18:39:33.384618 | 
2026-02-26 18:39:33.384725 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-02-26 18:39:33.970046 | controller | ok
2026-02-26 18:39:33.970260 | controller | ok: All items complete
2026-02-26 18:39:33.970291 | 
2026-02-26 18:39:34.431475 | controller | ok
2026-02-26 18:39:34.906351 | controller | ok
2026-02-26 18:39:34.926813 | 
2026-02-26 18:39:34.926888 | TASK [include_role : fetch-output-openshift]
2026-02-26 18:39:34.940265 | controller | skipping: Conditional result was False
2026-02-26 18:39:34.945848 | 
2026-02-26 18:39:34.945952 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-02-26 18:39:35.276064 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006208
2026-02-26 18:39:35.460724 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006930
2026-02-26 18:39:35.488719 | 
2026-02-26 18:39:35.488768 | PLAY [all]
2026-02-26 18:39:35.501819 | 
2026-02-26 18:39:35.501893 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-02-26 18:39:35.997412 | controller | changed
2026-02-26 18:39:36.018432 | 
2026-02-26 18:39:36.018485 | PLAY RECAP
2026-02-26 18:39:36.018527 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2026-02-26 18:39:36.018549 | 
2026-02-26 18:39:36.084393 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-02-26 18:39:36.085077 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2026-02-26 18:39:36.608440 | 
2026-02-26 18:39:36.608536 | PLAY [localhost]
2026-02-26 18:39:36.624375 | 
2026-02-26 18:39:36.624446 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-02-26 18:39:36.925277 | localhost | changed
2026-02-26 18:39:36.929787 | 
2026-02-26 18:39:36.929873 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-02-26 18:39:36.947997 | localhost | ok
2026-02-26 18:39:36.955851 | 
2026-02-26 18:39:36.955933 | TASK [add-fileserver : Create SSH private key tempfile]
2026-02-26 18:39:37.236967 | localhost | changed
2026-02-26 18:39:37.242410 | 
2026-02-26 18:39:37.242487 | TASK [add-fileserver : Create SSH private key from secret]
2026-02-26 18:39:37.766099 | localhost | changed
2026-02-26 18:39:37.771257 | 
2026-02-26 18:39:37.771370 | TASK [add-fileserver : Add fileserver ssh key]
2026-02-26 18:39:38.092458 | localhost | Identity added: /var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/tmp/ansible.sp6blioq (/var/lib/zuul/builds/7339d894f0954257b6a2bfce67bd2072/work/tmp/ansible.sp6blioq)
2026-02-26 18:39:38.092619 | localhost | ok: Runtime: 0:00:00.006081
2026-02-26 18:39:38.096813 | 
2026-02-26 18:39:38.096894 | TASK [add-fileserver : Remove SSH private key from disk]
2026-02-26 18:39:38.306553 | localhost | ok: Runtime: 0:00:00.004094
2026-02-26 18:39:38.311011 | 
2026-02-26 18:39:38.311081 | TASK [add-fileserver : Add fileserver to inventory]
2026-02-26 18:39:38.359497 | localhost | changed
2026-02-26 18:39:38.364390 | 
2026-02-26 18:39:38.364459 | TASK [add-fileserver : Add fileserver server to known hosts]
2026-02-26 18:39:38.666538 | localhost | changed
2026-02-26 18:39:38.685790 | 
2026-02-26 18:39:38.685864 | PLAY [localhost]
2026-02-26 18:39:38.696694 | 
2026-02-26 18:39:38.696758 | TASK [Generate bulk log download script]
2026-02-26 18:39:38.715277 | localhost | ok
2026-02-26 18:39:38.726132 | 
2026-02-26 18:39:38.726200 | TASK [local-log-download : Check API endpoint is defined]
2026-02-26 18:39:38.753489 | localhost | ok: All assertions passed
2026-02-26 18:39:38.757912 | 
2026-02-26 18:39:38.757976 | TASK [local-log-download : Create download script]
2026-02-26 18:39:39.085927 | localhost -> localhost | changed
2026-02-26 18:39:39.094215 | 
2026-02-26 18:39:39.094281 | TASK [Register quick-download link]
2026-02-26 18:39:39.111269 | localhost | ok
2026-02-26 18:39:39.146179 | 
2026-02-26 18:39:39.146242 | PLAY [logserver.rdoproject.org]
2026-02-26 18:39:39.155551 | 
2026-02-26 18:39:39.155610 | TASK [Set zuul-log-path fact]
2026-02-26 18:39:39.171803 | logserver.rdoproject.org | ok
2026-02-26 18:39:39.180218 | 
2026-02-26 18:39:39.180287 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-02-26 18:39:39.206040 | logserver.rdoproject.org | ok
2026-02-26 18:39:39.211202 | 
2026-02-26 18:39:39.211267 | TASK [upload-logs : Create log directories]
2026-02-26 18:39:41.448087 | logserver.rdoproject.org | changed
2026-02-26 18:39:41.450844 | 
2026-02-26 18:39:41.450922 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-02-26 18:39:41.656832 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004297
2026-02-26 18:39:41.661437 | 
2026-02-26 18:39:41.661498 | TASK [upload-logs : Upload logs to log server]
2026-02-26 18:39:43.140548 | logserver.rdoproject.org | Output suppressed because no_log was given
2026-02-26 18:39:43.143579 | 
2026-02-26 18:39:43.143795 | LOOP [upload-logs : Compress console log and json output]
2026-02-26 18:39:43.180001 | logserver.rdoproject.org | skipping: Conditional result was False
2026-02-26 18:39:43.188254 | logserver.rdoproject.org | skipping: Conditional result was False
2026-02-26 18:39:43.201535 | 
2026-02-26 18:39:43.201618 | LOOP [upload-logs : Upload compressed console log and json output]
2026-02-26 18:39:43.235195 | logserver.rdoproject.org | skipping: Conditional result was False
2026-02-26 18:39:43.235436 | 
2026-02-26 18:39:43.238720 | logserver.rdoproject.org | skipping: Conditional result was False
2026-02-26 18:39:43.249336 | 
2026-02-26 18:39:43.249414 | LOOP [upload-logs : Upload console log and json output]