2026-02-24 08:49:43.167137 | Job console starting... 2026-02-24 08:49:43.386549 | Updating repositories 2026-02-24 08:49:44.152011 | Preparing job workspace 2026-02-24 08:49:50.953827 | Running Ansible setup... 2026-02-24 08:49:54.432255 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 08:49:54.908636 | 2026-02-24 08:49:54.908735 | PLAY [localhost] 2026-02-24 08:49:54.917029 | 2026-02-24 08:49:54.917113 | TASK [Gathering Facts] 2026-02-24 08:49:55.671980 | localhost | ok 2026-02-24 08:49:55.684021 | 2026-02-24 08:49:55.684109 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-24 08:49:55.971334 | localhost -> localhost | changed 2026-02-24 08:49:55.976322 | 2026-02-24 08:49:55.976390 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-24 08:49:56.608229 | localhost -> localhost | changed 2026-02-24 08:49:56.616230 | 2026-02-24 08:49:56.616333 | TASK [Setup log path fact] 2026-02-24 08:49:56.632724 | localhost | ok 2026-02-24 08:49:56.643131 | 2026-02-24 08:49:56.643203 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 08:49:56.659823 | localhost | ok 2026-02-24 08:49:56.666596 | 2026-02-24 08:49:56.666665 | TASK [emit-job-header : Print job information] 2026-02-24 08:49:56.692672 | # Job Information 2026-02-24 08:49:56.692786 | Ansible Version: 2.15.12 2026-02-24 08:49:56.692816 | Job: cifmw-molecule-reproducer 2026-02-24 08:49:56.692839 | Pipeline: github-check 2026-02-24 08:49:56.692860 | Executor: ibm-bm4-ze.softwarefactory-project.io 2026-02-24 08:49:56.692880 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3706 2026-02-24 08:49:56.692901 | Log URL (when completed): https://logserver.rdoproject.org/fd1/rdoproject.org/fd11f156221145ff90b8e6847847a6b1/ 2026-02-24 08:49:56.692921 | Event ID: 99c325d0-115d-11f1-9571-ae2148c810f0 2026-02-24 08:49:56.696571 | 2026-02-24 08:49:56.696641 | LOOP [emit-job-header : Print node information] 2026-02-24 08:49:56.774162 | localhost | ok: 2026-02-24 08:49:56.774327 | localhost | # Node Information 2026-02-24 08:49:56.774362 | localhost | Inventory Hostname: controller 2026-02-24 08:49:56.774387 | localhost | Hostname: np0005627739 2026-02-24 08:49:56.774408 | localhost | Username: zuul 2026-02-24 08:49:56.774428 | localhost | Distro: CentOS 9 2026-02-24 08:49:56.774447 | localhost | Provider: ibm-bm4-nodepool 2026-02-24 08:49:56.774464 | localhost | Region: regionOne 2026-02-24 08:49:56.774480 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-24 08:49:56.774497 | localhost | Product Name: OpenStack Compute 2026-02-24 08:49:56.774513 | localhost | Interface IP: 192.168.26.27 2026-02-24 08:49:56.798105 | 2026-02-24 08:49:56.798177 | PLAY [all] 2026-02-24 08:49:56.803845 | 2026-02-24 08:49:56.803905 | TASK [Gather network facts] 2026-02-24 08:49:57.217625 | controller | ok 2026-02-24 08:49:57.230835 | 2026-02-24 08:49:57.230891 | TASK [include_role : start-zuul-console] 2026-02-24 08:49:57.247896 | controller | ok 2026-02-24 08:49:57.258366 | 2026-02-24 08:49:57.258426 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-24 08:49:57.610599 | controller | ok 2026-02-24 08:49:57.618701 | 2026-02-24 08:49:57.618762 | TASK [include_role : add-build-sshkey] 2026-02-24 08:49:57.635830 | controller | ok 2026-02-24 08:49:57.647813 | 2026-02-24 08:49:57.647879 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-24 08:49:57.833657 | controller -> localhost | ok 2026-02-24 08:49:57.838563 | 2026-02-24 08:49:57.838625 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-24 08:49:57.857337 | controller | ok 2026-02-24 08:49:57.869687 | controller | included: /var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-24 08:49:57.875055 | 2026-02-24 08:49:57.875131 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-24 08:49:58.514654 | controller -> localhost | Generating public/private rsa key pair. 2026-02-24 08:49:58.514851 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/fd11f156221145ff90b8e6847847a6b1_id_rsa. 2026-02-24 08:49:58.514882 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/fd11f156221145ff90b8e6847847a6b1_id_rsa.pub. 2026-02-24 08:49:58.514903 | controller -> localhost | The key fingerprint is: 2026-02-24 08:49:58.514923 | controller -> localhost | SHA256:ozokzv9qbGUz/coLaFCjRXyqpLK6brOVawa+EYkmTNc zuul-build-sshkey 2026-02-24 08:49:58.514940 | controller -> localhost | The key's randomart image is: 2026-02-24 08:49:58.514956 | controller -> localhost | +---[RSA 3072]----+ 2026-02-24 08:49:58.514972 | controller -> localhost | | .. | 2026-02-24 08:49:58.514989 | controller -> localhost | | .o . | 2026-02-24 08:49:58.515004 | controller -> localhost | | . .+E | 2026-02-24 08:49:58.515018 | controller -> localhost | |+ ++.. | 2026-02-24 08:49:58.515033 | controller -> localhost | |oBo. .S | 2026-02-24 08:49:58.515048 | controller -> localhost | |=.+.o.=... | 2026-02-24 08:49:58.515073 | controller -> localhost | |o=.*oooo . | 2026-02-24 08:49:58.515092 | controller -> localhost | |.+=+*. o . | 2026-02-24 08:49:58.515107 | controller -> localhost | |*=*=++. +o | 2026-02-24 08:49:58.515121 | controller -> localhost | +----[SHA256]-----+ 2026-02-24 08:49:58.515160 | controller -> localhost | ok: Runtime: 0:00:00.325534 2026-02-24 08:49:58.520254 | 2026-02-24 08:49:58.520329 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-24 08:49:58.538262 | controller | ok 2026-02-24 08:49:58.547011 | controller | included: /var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-24 08:49:58.554239 | 2026-02-24 08:49:58.554347 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-24 08:49:58.568085 | controller | skipping: Conditional result was False 2026-02-24 08:49:58.573432 | 2026-02-24 08:49:58.573502 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-24 08:49:59.059757 | controller | changed 2026-02-24 08:49:59.064224 | 2026-02-24 08:49:59.064286 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-24 08:49:59.336934 | controller | ok 2026-02-24 08:49:59.341536 | 2026-02-24 08:49:59.341598 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-24 08:50:00.492556 | controller | changed 2026-02-24 08:50:00.497319 | 2026-02-24 08:50:00.497400 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-24 08:50:01.683251 | controller | changed 2026-02-24 08:50:01.688002 | 2026-02-24 08:50:01.688082 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-24 08:50:01.701843 | controller | skipping: Conditional result was False 2026-02-24 08:50:01.707193 | 2026-02-24 08:50:01.707261 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-24 08:50:01.983404 | controller -> localhost | changed 2026-02-24 08:50:01.992495 | 2026-02-24 08:50:01.992569 | TASK [add-build-sshkey : Add back temp key] 2026-02-24 08:50:02.198412 | controller -> localhost | Identity added: /var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/fd11f156221145ff90b8e6847847a6b1_id_rsa (zuul-build-sshkey) 2026-02-24 08:50:02.198617 | controller -> localhost | ok: Runtime: 0:00:00.006147 2026-02-24 08:50:02.204016 | 2026-02-24 08:50:02.204090 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-24 08:50:02.558089 | controller | ok 2026-02-24 08:50:02.562380 | 2026-02-24 08:50:02.562443 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-24 08:50:02.586012 | controller | skipping: Conditional result was False 2026-02-24 08:50:02.594634 | 2026-02-24 08:50:02.594695 | TASK [include_role : validate-host] 2026-02-24 08:50:02.612003 | controller | ok 2026-02-24 08:50:02.628628 | 2026-02-24 08:50:02.628691 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-24 08:50:02.656143 | controller | ok 2026-02-24 08:50:02.660394 | 2026-02-24 08:50:02.660454 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-24 08:50:02.845665 | controller -> localhost | ok 2026-02-24 08:50:02.850983 | 2026-02-24 08:50:02.851059 | TASK [validate-host : Collect information about the host] 2026-02-24 08:50:03.594358 | controller | ok 2026-02-24 08:50:03.601523 | 2026-02-24 08:50:03.601582 | TASK [validate-host : Sanitize hostname] 2026-02-24 08:50:03.639586 | controller | ok 2026-02-24 08:50:03.643946 | 2026-02-24 08:50:03.644006 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-24 08:50:03.991365 | controller -> localhost | changed 2026-02-24 08:50:03.996525 | 2026-02-24 08:50:03.996597 | TASK [validate-host : Collect information about zuul worker] 2026-02-24 08:50:04.380539 | controller | ok 2026-02-24 08:50:04.384930 | 2026-02-24 08:50:04.385000 | TASK [validate-host : Write out all zuul information for each host] 2026-02-24 08:50:04.712447 | controller -> localhost | changed 2026-02-24 08:50:04.721571 | 2026-02-24 08:50:04.721633 | TASK [include_role : prepare-workspace-openshift] 2026-02-24 08:50:04.734943 | controller | skipping: Conditional result was False 2026-02-24 08:50:04.739742 | 2026-02-24 08:50:04.739806 | TASK [include_role : remove-zuul-sshkey] 2026-02-24 08:50:04.752769 | controller | skipping: Conditional result was False 2026-02-24 08:50:04.757195 | 2026-02-24 08:50:04.757254 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-24 08:50:05.019065 | controller | ok: "logs" 2026-02-24 08:50:05.019309 | controller | ok: All items complete 2026-02-24 08:50:05.019341 | 2026-02-24 08:50:05.253776 | controller | ok: "artifacts" 2026-02-24 08:50:05.493903 | controller | ok: "docs" 2026-02-24 08:50:05.507003 | 2026-02-24 08:50:05.507118 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-24 08:50:05.781871 | controller | changed: "logs" 2026-02-24 08:50:06.023271 | controller | changed: "artifacts" 2026-02-24 08:50:06.267206 | controller | changed: "docs" 2026-02-24 08:50:06.292839 | 2026-02-24 08:50:06.292937 | PLAY RECAP 2026-02-24 08:50:06.292986 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 08:50:06.293015 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 08:50:06.293034 | 2026-02-24 08:50:06.368128 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 08:50:06.368830 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 08:50:06.889867 | 2026-02-24 08:50:06.889965 | PLAY [all] 2026-02-24 08:50:06.908032 | 2026-02-24 08:50:06.908112 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 08:50:06.957195 | controller | ok 2026-02-24 08:50:06.962036 | 2026-02-24 08:50:06.962121 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 08:50:07.356281 | controller | changed 2026-02-24 08:50:07.361630 | 2026-02-24 08:50:07.361703 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 08:50:08.637026 | controller | changed 2026-02-24 08:50:08.646903 | 2026-02-24 08:50:08.646977 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-24 08:50:09.072964 | controller | changed: 2026-02-24 08:50:09.073156 | controller | { 2026-02-24 08:50:09.073191 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-24 08:50:09.073224 | controller | } 2026-02-24 08:50:09.363684 | controller | changed: 2026-02-24 08:50:09.363778 | controller | { 2026-02-24 08:50:09.363806 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-24 08:50:09.363828 | controller | } 2026-02-24 08:50:09.649813 | controller | changed: 2026-02-24 08:50:09.649899 | controller | { 2026-02-24 08:50:09.649926 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-24 08:50:09.649946 | controller | } 2026-02-24 08:50:09.932334 | controller | changed: 2026-02-24 08:50:09.932411 | controller | { 2026-02-24 08:50:09.932439 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-24 08:50:09.932460 | controller | } 2026-02-24 08:50:10.216356 | controller | changed: 2026-02-24 08:50:10.216470 | controller | { 2026-02-24 08:50:10.216497 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-24 08:50:10.216516 | controller | } 2026-02-24 08:50:10.508610 | controller | changed: 2026-02-24 08:50:10.508713 | controller | { 2026-02-24 08:50:10.508744 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-24 08:50:10.508766 | controller | } 2026-02-24 08:50:10.811667 | controller | changed: 2026-02-24 08:50:10.811762 | controller | { 2026-02-24 08:50:10.811788 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-24 08:50:10.811809 | controller | } 2026-02-24 08:50:11.113849 | controller | changed: 2026-02-24 08:50:11.113907 | controller | { 2026-02-24 08:50:11.113935 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-24 08:50:11.114017 | controller | } 2026-02-24 08:50:11.406688 | controller | changed: 2026-02-24 08:50:11.406774 | controller | { 2026-02-24 08:50:11.406802 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-24 08:50:11.406824 | controller | } 2026-02-24 08:50:11.721667 | controller | changed: 2026-02-24 08:50:11.721750 | controller | { 2026-02-24 08:50:11.721776 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-24 08:50:11.721798 | controller | } 2026-02-24 08:50:11.993040 | controller | changed: 2026-02-24 08:50:11.993102 | controller | { 2026-02-24 08:50:11.993127 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-24 08:50:11.993146 | controller | } 2026-02-24 08:50:12.286461 | controller | changed: 2026-02-24 08:50:12.286560 | controller | { 2026-02-24 08:50:12.286587 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-24 08:50:12.286607 | controller | } 2026-02-24 08:50:12.587917 | controller | changed: 2026-02-24 08:50:12.588016 | controller | { 2026-02-24 08:50:12.588043 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-24 08:50:12.588063 | controller | } 2026-02-24 08:50:12.884127 | controller | changed: 2026-02-24 08:50:12.884188 | controller | { 2026-02-24 08:50:12.884215 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-24 08:50:12.884235 | controller | } 2026-02-24 08:50:13.174408 | controller | changed: 2026-02-24 08:50:13.174457 | controller | { 2026-02-24 08:50:13.174482 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-24 08:50:13.174503 | controller | } 2026-02-24 08:50:13.465541 | controller | changed: 2026-02-24 08:50:13.465589 | controller | { 2026-02-24 08:50:13.465613 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-24 08:50:13.465631 | controller | } 2026-02-24 08:50:13.754913 | controller | changed: 2026-02-24 08:50:13.754986 | controller | { 2026-02-24 08:50:13.755012 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-24 08:50:13.755033 | controller | } 2026-02-24 08:50:14.050616 | controller | changed: 2026-02-24 08:50:14.050672 | controller | { 2026-02-24 08:50:14.050698 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-24 08:50:14.050727 | controller | } 2026-02-24 08:50:14.344666 | controller | changed: 2026-02-24 08:50:14.344716 | controller | { 2026-02-24 08:50:14.344740 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-24 08:50:14.344758 | controller | } 2026-02-24 08:50:14.629327 | controller | changed: 2026-02-24 08:50:14.629378 | controller | { 2026-02-24 08:50:14.629404 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-24 08:50:14.629424 | controller | } 2026-02-24 08:50:14.911644 | controller | changed: 2026-02-24 08:50:14.911699 | controller | { 2026-02-24 08:50:14.911732 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-24 08:50:14.911760 | controller | } 2026-02-24 08:50:15.192957 | controller | changed: 2026-02-24 08:50:15.193005 | controller | { 2026-02-24 08:50:15.193028 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-24 08:50:15.193046 | controller | } 2026-02-24 08:50:15.471180 | controller | changed: 2026-02-24 08:50:15.471226 | controller | { 2026-02-24 08:50:15.471250 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-24 08:50:15.471269 | controller | } 2026-02-24 08:50:15.754083 | controller | changed: 2026-02-24 08:50:15.754138 | controller | { 2026-02-24 08:50:15.754162 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-24 08:50:15.754179 | controller | } 2026-02-24 08:50:16.044392 | controller | changed: 2026-02-24 08:50:16.044474 | controller | { 2026-02-24 08:50:16.044498 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-24 08:50:16.044516 | controller | } 2026-02-24 08:50:16.331117 | controller | changed: 2026-02-24 08:50:16.331169 | controller | { 2026-02-24 08:50:16.331195 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-24 08:50:16.331214 | controller | } 2026-02-24 08:50:16.351604 | 2026-02-24 08:50:16.351681 | TASK [Set timezone to UTC] 2026-02-24 08:50:16.837123 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-24 08:50:16.841713 | 2026-02-24 08:50:16.841781 | TASK [Create nodepool directory] 2026-02-24 08:50:17.124744 | controller | changed 2026-02-24 08:50:17.130050 | 2026-02-24 08:50:17.130127 | TASK [Create nodepool sub_nodes file] 2026-02-24 08:50:18.123253 | controller | changed 2026-02-24 08:50:18.128024 | 2026-02-24 08:50:18.128100 | TASK [Create nodepool sub_nodes_private file] 2026-02-24 08:50:19.163152 | controller | changed 2026-02-24 08:50:19.168070 | 2026-02-24 08:50:19.168148 | LOOP [Populate nodepool sub_nodes file] 2026-02-24 08:50:19.196317 | 2026-02-24 08:50:19.196444 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-24 08:50:19.224256 | 2026-02-24 08:50:19.224403 | TASK [Create nodepool primary file] 2026-02-24 08:50:19.247155 | controller | skipping: Conditional result was False 2026-02-24 08:50:19.252463 | 2026-02-24 08:50:19.252533 | TASK [Create nodepool node_private for this node] 2026-02-24 08:50:20.265861 | controller | changed 2026-02-24 08:50:20.271103 | 2026-02-24 08:50:20.271166 | LOOP [Copy ssh keys to nodepool directory] 2026-02-24 08:50:20.678001 | controller | ok: Item: id_rsa Runtime: 0:00:00.005344 2026-02-24 08:50:20.678189 | 2026-02-24 08:50:20.915787 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.006461 2026-02-24 08:50:20.927728 | 2026-02-24 08:50:20.927825 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-24 08:50:21.908282 | controller | changed 2026-02-24 08:50:21.913031 | 2026-02-24 08:50:21.913104 | TASK [Validate sudoers config after edits] 2026-02-24 08:50:22.199378 | controller | /etc/sudoers: parsed OK 2026-02-24 08:50:22.199444 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-24 08:50:22.199588 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-24 08:50:22.199596 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-24 08:50:22.437800 | controller | ok: Runtime: 0:00:00.006654 2026-02-24 08:50:22.442645 | 2026-02-24 08:50:22.442702 | TASK [Show the environment passed in to job shell scripts] 2026-02-24 08:50:22.706385 | controller | SHELL=/bin/bash 2026-02-24 08:50:22.706446 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-24 08:50:22.706457 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-24 08:50:22.706463 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/06/3706/c8624b7468d2ae8916f1fc7427f6643fbf0ac01c 2026-02-24 08:50:22.706468 | controller | PWD=/home/zuul 2026-02-24 08:50:22.706473 | controller | ZUUL_PIPELINE=github-check 2026-02-24 08:50:22.706479 | controller | LOGNAME=zuul 2026-02-24 08:50:22.706484 | controller | XDG_SESSION_TYPE=tty 2026-02-24 08:50:22.706488 | controller | _=/usr/bin/env 2026-02-24 08:50:22.706493 | controller | MOTD_SHOWN=pam 2026-02-24 08:50:22.706504 | controller | HOME=/home/zuul 2026-02-24 08:50:22.706557 | controller | LANG=en_US.UTF-8 2026-02-24 08:50:22.706566 | controller | SSH_CONNECTION=192.168.26.12 60364 192.168.26.27 22 2026-02-24 08:50:22.706572 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-24 08:50:22.706580 | controller | ZUUL_CHANGE_IDS=3706,c8624b7468d2ae8916f1fc7427f6643fbf0ac01c 2026-02-24 08:50:22.706585 | controller | WORKSPACE=/home/zuul/workspace 2026-02-24 08:50:22.706590 | controller | XDG_SESSION_CLASS=user 2026-02-24 08:50:22.706596 | controller | SELINUX_ROLE_REQUESTED= 2026-02-24 08:50:22.706601 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-24 08:50:22.706606 | controller | USER=zuul 2026-02-24 08:50:22.706611 | controller | ZUUL_VOTING=True 2026-02-24 08:50:22.706615 | controller | BUILD_TIMEOUT=5400000 2026-02-24 08:50:22.706620 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-24 08:50:22.706625 | controller | SHLVL=1 2026-02-24 08:50:22.706630 | controller | ZUUL_PATCHSET=c8624b7468d2ae8916f1fc7427f6643fbf0ac01c 2026-02-24 08:50:22.706635 | controller | XDG_SESSION_ID=1 2026-02-24 08:50:22.706640 | controller | ZUUL_BRANCH=main 2026-02-24 08:50:22.706645 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-24 08:50:22.706650 | controller | SSH_CLIENT=192.168.26.12 60364 22 2026-02-24 08:50:22.706655 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-24 08:50:22.706660 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-24 08:50:22.706665 | controller | which_declare=declare -f 2026-02-24 08:50:22.706670 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-24 08:50:22.706675 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-24 08:50:22.706680 | controller | ZUUL_CHANGE=3706 2026-02-24 08:50:22.706685 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-24 08:50:22.706690 | controller | ZUUL_UUID=fd11f156221145ff90b8e6847847a6b1 2026-02-24 08:50:22.706697 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-24 08:50:22.706702 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-24 08:50:22.706708 | controller | } 2026-02-24 08:50:22.968401 | controller | ok: Runtime: 0:00:00.007197 2026-02-24 08:50:22.973288 | 2026-02-24 08:50:22.973363 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-24 08:50:22.986119 | controller | skipping: Conditional result was False 2026-02-24 08:50:22.991040 | 2026-02-24 08:50:22.991109 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-24 08:50:23.534013 | controller | skipping: Conditional result was False 2026-02-24 08:50:23.539687 | 2026-02-24 08:50:23.539752 | TASK [Ensure legacy workspace directory] 2026-02-24 08:50:23.790812 | controller | changed 2026-02-24 08:50:23.808168 | 2026-02-24 08:50:23.808224 | PLAY RECAP 2026-02-24 08:50:23.808269 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 08:50:23.808309 | 2026-02-24 08:50:23.874388 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 08:50:23.875123 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 08:50:24.335059 | 2026-02-24 08:50:24.335155 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-24 08:50:24.353174 | 2026-02-24 08:50:24.353246 | TASK [Create zuul-output directory] 2026-02-24 08:50:24.726658 | controller | changed 2026-02-24 08:50:24.731509 | 2026-02-24 08:50:24.731583 | TASK [Slurp Zuul inventory test] 2026-02-24 08:50:24.977070 | controller -> localhost | ok 2026-02-24 08:50:24.982704 | 2026-02-24 08:50:24.982771 | TASK [Save zuul inventory] 2026-02-24 08:50:26.289997 | controller | changed 2026-02-24 08:50:26.295471 | 2026-02-24 08:50:26.295556 | TASK [Save zuul vars without the change_message] 2026-02-24 08:50:27.408263 | controller | changed 2026-02-24 08:50:27.426039 | 2026-02-24 08:50:27.426093 | PLAY RECAP 2026-02-24 08:50:27.426153 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 08:50:27.426176 | 2026-02-24 08:50:27.483728 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 08:50:27.484427 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 08:50:28.002229 | 2026-02-24 08:50:28.002348 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-24 08:50:28.021092 | 2026-02-24 08:50:28.021168 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-24 08:50:28.039281 | controller | ok 2026-02-24 08:50:28.055169 | 2026-02-24 08:50:28.055247 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 08:50:28.078939 | controller | skipping: Conditional result was False 2026-02-24 08:50:28.084432 | 2026-02-24 08:50:28.084503 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 08:50:28.487241 | controller | ok 2026-02-24 08:50:28.492718 | 2026-02-24 08:50:28.492789 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 08:50:29.465502 | controller | ok 2026-02-24 08:50:29.474812 | 2026-02-24 08:50:29.474903 | TASK [Prepare workspace] 2026-02-24 08:50:29.493488 | controller | ok 2026-02-24 08:50:29.509775 | 2026-02-24 08:50:29.509849 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-24 08:50:29.875402 | controller | ok 2026-02-24 08:50:29.880982 | 2026-02-24 08:50:29.881048 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-24 08:50:32.229884 | controller | Output suppressed because no_log was given 2026-02-24 08:50:32.238343 | 2026-02-24 08:50:32.238407 | LOOP [Create zuul-output directory] 2026-02-24 08:50:32.502152 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-24 08:50:32.733133 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-24 08:50:32.745548 | 2026-02-24 08:50:32.745619 | TASK [Install required packages] 2026-02-24 08:50:52.763863 | controller | ok: Nothing to do 2026-02-24 08:50:52.768679 | 2026-02-24 08:50:52.768739 | TASK [Install venv] 2026-02-24 08:51:56.186982 | controller | changed 2026-02-24 08:51:56.228264 | 2026-02-24 08:51:56.228363 | PLAY RECAP 2026-02-24 08:51:56.228404 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-24 08:51:56.228426 | 2026-02-24 08:51:56.284438 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 08:51:56.285131 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 08:51:56.761353 | 2026-02-24 08:51:56.761486 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-24 08:51:56.780532 | 2026-02-24 08:51:56.780602 | TASK [Gather required facts] 2026-02-24 08:51:57.296830 | controller | ok 2026-02-24 08:51:57.302136 | 2026-02-24 08:51:57.302211 | TASK [Load environment var if instructed to] 2026-02-24 08:51:57.326028 | controller | skipping: Conditional result was False 2026-02-24 08:51:57.331204 | 2026-02-24 08:51:57.331283 | TASK [Ensure group_vars dir exists] 2026-02-24 08:51:57.704809 | controller | ok 2026-02-24 08:51:57.709997 | 2026-02-24 08:51:57.710064 | TASK [Print related variables] 2026-02-24 08:51:57.737992 | controller | ok: 2026-02-24 08:51:57.738098 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-24 08:51:57.738129 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-24 08:51:57.742755 | 2026-02-24 08:51:57.742818 | TASK [Run molecule] 2026-02-24 08:51:58.718916 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-24 08:51:58.979835 | controller | INFO Performing prerun with role_name_check=0... 2026-02-24 08:52:16.410033 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.410451 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.410807 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.411204 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.411648 | controller | WARNING Another version of 'cifmw.general' 1.0.0+c8624b74 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+c8624b74 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.412042 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.412438 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.412856 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.413238 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.413643 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.414006 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.414399 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.414964 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.415263 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.415934 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 08:52:16.425325 | controller | INFO Running crc_layout > prepare 2026-02-24 08:52:17.093014 | controller | 2026-02-24 08:52:17.093060 | controller | PLAY [Prepare] ***************************************************************** 2026-02-24 08:52:17.093160 | controller | 2026-02-24 08:52:17.093249 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 08:52:17.093351 | controller | Tuesday 24 February 2026 08:52:17 +0000 (0:00:00.019) 0:00:00.019 ****** 2026-02-24 08:52:17.953467 | controller | ok: [instance] 2026-02-24 08:52:17.953547 | controller | 2026-02-24 08:52:17.953665 | controller | TASK [Create custom basedir] *************************************************** 2026-02-24 08:52:17.953757 | controller | Tuesday 24 February 2026 08:52:17 +0000 (0:00:00.860) 0:00:00.880 ****** 2026-02-24 08:52:18.300435 | controller | changed: [instance] 2026-02-24 08:52:18.300569 | controller | 2026-02-24 08:52:18.300686 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-24 08:52:18.300796 | controller | Tuesday 24 February 2026 08:52:18 +0000 (0:00:00.347) 0:00:01.227 ****** 2026-02-24 08:52:18.320179 | controller | skipping: [instance] 2026-02-24 08:52:18.320281 | controller | 2026-02-24 08:52:18.320404 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-24 08:52:18.320546 | controller | Tuesday 24 February 2026 08:52:18 +0000 (0:00:00.020) 0:00:01.247 ****** 2026-02-24 08:52:18.367171 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-24 08:52:18.367280 | controller | 2026-02-24 08:52:18.367423 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-24 08:52:18.367553 | controller | Tuesday 24 February 2026 08:52:18 +0000 (0:00:00.046) 0:00:01.294 ****** 2026-02-24 08:52:18.673086 | controller | ok: [instance] 2026-02-24 08:52:18.673155 | controller | 2026-02-24 08:52:18.673260 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-24 08:52:18.673350 | controller | Tuesday 24 February 2026 08:52:18 +0000 (0:00:00.305) 0:00:01.600 ****** 2026-02-24 08:52:18.889664 | controller | ok: [instance] 2026-02-24 08:52:18.889723 | controller | 2026-02-24 08:52:18.889813 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-24 08:52:18.889899 | controller | Tuesday 24 February 2026 08:52:18 +0000 (0:00:00.216) 0:00:01.817 ****** 2026-02-24 08:52:19.628865 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-24 08:52:19.628951 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-24 08:52:19.629058 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-24 08:52:19.629163 | controller | 2026-02-24 08:52:19.629272 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-24 08:52:19.629358 | controller | Tuesday 24 February 2026 08:52:19 +0000 (0:00:00.738) 0:00:02.555 ****** 2026-02-24 08:52:19.694082 | controller | 2026-02-24 08:52:19.694273 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-24 08:52:19.694494 | controller | Tuesday 24 February 2026 08:52:19 +0000 (0:00:00.065) 0:00:02.621 ****** 2026-02-24 08:52:20.254016 | controller | changed: [instance] => (item=tmp) 2026-02-24 08:52:20.254050 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-24 08:52:20.254166 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-24 08:52:20.254251 | controller | 2026-02-24 08:52:20.254337 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-24 08:52:20.254465 | controller | Tuesday 24 February 2026 08:52:20 +0000 (0:00:00.559) 0:00:03.181 ****** 2026-02-24 08:52:21.118882 | controller | ok: [instance] 2026-02-24 08:52:21.118943 | controller | 2026-02-24 08:52:21.119161 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-24 08:52:22.284451 | controller | Tuesday 24 February 2026 08:52:21 +0000 (0:00:00.864) 0:00:04.045 ****** 2026-02-24 08:52:22.284502 | controller | changed: [instance] 2026-02-24 08:52:29.922547 | controller | 2026-02-24 08:52:29.922596 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-24 08:52:29.922607 | controller | Tuesday 24 February 2026 08:52:22 +0000 (0:00:01.165) 0:00:05.211 ****** 2026-02-24 08:52:29.922620 | controller | changed: [instance] 2026-02-24 08:52:30.639490 | controller | 2026-02-24 08:52:30.639536 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-24 08:52:30.639544 | controller | Tuesday 24 February 2026 08:52:29 +0000 (0:00:07.638) 0:00:12.849 ****** 2026-02-24 08:52:30.639556 | controller | changed: [instance] 2026-02-24 08:52:30.666389 | controller | 2026-02-24 08:52:30.666446 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-24 08:52:30.666456 | controller | Tuesday 24 February 2026 08:52:30 +0000 (0:00:00.716) 0:00:13.565 ****** 2026-02-24 08:52:30.666468 | controller | skipping: [instance] 2026-02-24 08:52:31.503145 | controller | 2026-02-24 08:52:31.503179 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-24 08:52:31.503187 | controller | Tuesday 24 February 2026 08:52:30 +0000 (0:00:00.027) 0:00:13.593 ****** 2026-02-24 08:52:31.503196 | controller | changed: [instance] 2026-02-24 08:52:31.541529 | controller | 2026-02-24 08:52:31.541568 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-24 08:52:31.541577 | controller | Tuesday 24 February 2026 08:52:31 +0000 (0:00:00.836) 0:00:14.429 ****** 2026-02-24 08:52:31.541590 | controller | skipping: [instance] 2026-02-24 08:52:31.578513 | controller | 2026-02-24 08:52:31.578538 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-24 08:52:31.578547 | controller | Tuesday 24 February 2026 08:52:31 +0000 (0:00:00.038) 0:00:14.468 ****** 2026-02-24 08:52:31.578558 | controller | skipping: [instance] 2026-02-24 08:52:31.578592 | controller | 2026-02-24 08:52:31.578602 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-24 08:52:31.578705 | controller | Tuesday 24 February 2026 08:52:31 +0000 (0:00:00.036) 0:00:14.505 ****** 2026-02-24 08:52:31.614923 | controller | skipping: [instance] 2026-02-24 08:52:32.150936 | controller | 2026-02-24 08:52:32.150961 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-24 08:52:32.150968 | controller | Tuesday 24 February 2026 08:52:31 +0000 (0:00:00.036) 0:00:14.542 ****** 2026-02-24 08:52:32.150977 | controller | changed: [instance] 2026-02-24 08:52:32.595357 | controller | 2026-02-24 08:52:32.595397 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-24 08:52:32.595422 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.535) 0:00:15.077 ****** 2026-02-24 08:52:32.595437 | controller | changed: [instance] 2026-02-24 08:52:32.627090 | controller | 2026-02-24 08:52:32.627117 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-24 08:52:32.627125 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.444) 0:00:15.521 ****** 2026-02-24 08:52:32.627135 | controller | skipping: [instance] 2026-02-24 08:52:32.658238 | controller | 2026-02-24 08:52:32.658259 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-24 08:52:32.658267 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.032) 0:00:15.554 ****** 2026-02-24 08:52:32.658280 | controller | skipping: [instance] 2026-02-24 08:52:32.688468 | controller | 2026-02-24 08:52:32.688488 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-24 08:52:32.688496 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.031) 0:00:15.585 ****** 2026-02-24 08:52:32.688506 | controller | skipping: [instance] 2026-02-24 08:52:32.728989 | controller | 2026-02-24 08:52:32.729009 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-24 08:52:32.729016 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.030) 0:00:15.615 ****** 2026-02-24 08:52:32.729024 | controller | ok: [instance] 2026-02-24 08:52:32.758536 | controller | 2026-02-24 08:52:32.758560 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-24 08:52:32.758570 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.040) 0:00:15.656 ****** 2026-02-24 08:52:32.758604 | controller | skipping: [instance] 2026-02-24 08:52:32.787481 | controller | 2026-02-24 08:52:32.787495 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-24 08:52:32.787501 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.029) 0:00:15.685 ****** 2026-02-24 08:52:32.787510 | controller | skipping: [instance] 2026-02-24 08:52:32.787621 | controller | 2026-02-24 08:52:32.787774 | controller | TASK [Download the RPM] ******************************************************** 2026-02-24 08:52:32.787931 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.029) 0:00:15.714 ****** 2026-02-24 08:52:32.834748 | controller | skipping: [instance] 2026-02-24 08:52:32.834900 | controller | 2026-02-24 08:52:32.835030 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-24 08:52:32.835136 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.047) 0:00:15.762 ****** 2026-02-24 08:52:32.862739 | controller | skipping: [instance] 2026-02-24 08:52:32.862916 | controller | 2026-02-24 08:52:32.863060 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-24 08:52:32.863172 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.027) 0:00:15.790 ****** 2026-02-24 08:52:32.892269 | controller | skipping: [instance] 2026-02-24 08:52:32.892440 | controller | 2026-02-24 08:52:32.892594 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-24 08:52:32.892699 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.029) 0:00:15.819 ****** 2026-02-24 08:52:32.922392 | controller | skipping: [instance] 2026-02-24 08:52:32.922562 | controller | 2026-02-24 08:52:32.922714 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-24 08:52:32.922826 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.030) 0:00:15.849 ****** 2026-02-24 08:52:32.950378 | controller | skipping: [instance] 2026-02-24 08:52:32.950522 | controller | 2026-02-24 08:52:32.950711 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-24 08:52:32.950838 | controller | Tuesday 24 February 2026 08:52:32 +0000 (0:00:00.028) 0:00:15.877 ****** 2026-02-24 08:52:33.142305 | controller | ok: [instance] 2026-02-24 08:52:33.363505 | controller | 2026-02-24 08:52:33.363571 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-24 08:52:33.363585 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.191) 0:00:16.069 ****** 2026-02-24 08:52:33.363605 | controller | changed: [instance] 2026-02-24 08:52:33.602024 | controller | 2026-02-24 08:52:33.602056 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-24 08:52:33.602064 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.221) 0:00:16.290 ****** 2026-02-24 08:52:33.602073 | controller | changed: [instance] 2026-02-24 08:52:33.625558 | controller | 2026-02-24 08:52:33.625597 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-24 08:52:33.625608 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.238) 0:00:16.528 ****** 2026-02-24 08:52:33.625622 | controller | skipping: [instance] 2026-02-24 08:52:33.625630 | controller | 2026-02-24 08:52:33.625638 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-24 08:52:33.625648 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.023) 0:00:16.552 ****** 2026-02-24 08:52:33.650582 | controller | skipping: [instance] 2026-02-24 08:52:33.679848 | controller | 2026-02-24 08:52:33.679867 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-24 08:52:33.679874 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.024) 0:00:16.577 ****** 2026-02-24 08:52:33.679883 | controller | skipping: [instance] 2026-02-24 08:52:33.705162 | controller | 2026-02-24 08:52:33.705191 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-24 08:52:33.705204 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.029) 0:00:16.606 ****** 2026-02-24 08:52:33.705218 | controller | skipping: [instance] 2026-02-24 08:52:33.732519 | controller | 2026-02-24 08:52:33.732556 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-24 08:52:33.732575 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.025) 0:00:16.632 ****** 2026-02-24 08:52:33.732587 | controller | skipping: [instance] 2026-02-24 08:52:33.732650 | controller | 2026-02-24 08:52:33.732663 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-24 08:52:33.732674 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.027) 0:00:16.659 ****** 2026-02-24 08:52:33.762165 | controller | skipping: [instance] 2026-02-24 08:52:33.762304 | controller | 2026-02-24 08:52:33.762455 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-24 08:52:33.762606 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.030) 0:00:16.689 ****** 2026-02-24 08:52:33.782713 | controller | skipping: [instance] 2026-02-24 08:52:33.782933 | controller | 2026-02-24 08:52:33.783132 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-24 08:52:33.783265 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.020) 0:00:16.709 ****** 2026-02-24 08:52:33.813105 | controller | skipping: [instance] 2026-02-24 08:52:33.813308 | controller | 2026-02-24 08:52:33.813529 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-24 08:52:33.813741 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.030) 0:00:16.740 ****** 2026-02-24 08:52:33.834164 | controller | skipping: [instance] 2026-02-24 08:52:33.834390 | controller | 2026-02-24 08:52:33.834659 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-24 08:52:33.834892 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.020) 0:00:16.761 ****** 2026-02-24 08:52:33.856549 | controller | skipping: [instance] 2026-02-24 08:52:33.856636 | controller | 2026-02-24 08:52:33.856795 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-24 08:52:33.856862 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.022) 0:00:16.784 ****** 2026-02-24 08:52:33.891316 | controller | skipping: [instance] 2026-02-24 08:52:33.891481 | controller | 2026-02-24 08:52:33.891628 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-24 08:52:33.891730 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.034) 0:00:16.818 ****** 2026-02-24 08:52:33.922171 | controller | skipping: [instance] 2026-02-24 08:52:33.922268 | controller | 2026-02-24 08:52:33.922427 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-24 08:52:33.922508 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.030) 0:00:16.849 ****** 2026-02-24 08:52:33.952158 | controller | skipping: [instance] 2026-02-24 08:52:33.952259 | controller | 2026-02-24 08:52:33.952431 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-24 08:52:33.952534 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.030) 0:00:16.879 ****** 2026-02-24 08:52:33.984029 | controller | skipping: [instance] 2026-02-24 08:52:33.984176 | controller | 2026-02-24 08:52:33.984280 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-24 08:52:33.984385 | controller | Tuesday 24 February 2026 08:52:33 +0000 (0:00:00.031) 0:00:16.911 ****** 2026-02-24 08:53:26.198510 | controller | ok: [instance] 2026-02-24 08:53:26.198560 | controller | 2026-02-24 08:53:26.198571 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-24 08:53:26.198596 | controller | Tuesday 24 February 2026 08:53:26 +0000 (0:00:52.212) 0:01:09.124 ****** 2026-02-24 08:53:27.433813 | controller | ok: [instance] 2026-02-24 08:53:27.433871 | controller | 2026-02-24 08:53:27.434084 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-24 08:53:27.466562 | controller | Tuesday 24 February 2026 08:53:27 +0000 (0:00:01.236) 0:01:10.361 ****** 2026-02-24 08:53:27.466587 | controller | skipping: [instance] 2026-02-24 08:53:27.508842 | controller | 2026-02-24 08:53:27.508864 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-24 08:53:27.508873 | controller | Tuesday 24 February 2026 08:53:27 +0000 (0:00:00.032) 0:01:10.393 ****** 2026-02-24 08:53:27.508883 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-24 08:53:27.529518 | controller | 2026-02-24 08:53:27.529553 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-24 08:53:27.529570 | controller | Tuesday 24 February 2026 08:53:27 +0000 (0:00:00.042) 0:01:10.435 ****** 2026-02-24 08:53:27.529581 | controller | ok: [instance] => 2026-02-24 08:53:27.529606 | controller | cifmw_ci_setup_packages: 2026-02-24 08:53:27.529612 | controller | - bash-completion 2026-02-24 08:53:27.529618 | controller | - ca-certificates 2026-02-24 08:53:27.529623 | controller | - git-core 2026-02-24 08:53:27.529628 | controller | - make 2026-02-24 08:53:27.529636 | controller | - tar 2026-02-24 08:53:27.529967 | controller | - tmux 2026-02-24 08:53:27.529988 | controller | - python3-pip 2026-02-24 08:53:34.916065 | controller | 2026-02-24 08:53:34.916103 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-24 08:53:34.916111 | controller | Tuesday 24 February 2026 08:53:27 +0000 (0:00:00.020) 0:01:10.456 ****** 2026-02-24 08:53:34.916124 | controller | changed: [instance] 2026-02-24 08:53:34.916306 | controller | 2026-02-24 08:53:34.916318 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-24 08:53:35.523605 | controller | Tuesday 24 February 2026 08:53:34 +0000 (0:00:07.386) 0:01:17.842 ****** 2026-02-24 08:53:35.523689 | controller | ok: [instance] 2026-02-24 08:53:35.523724 | controller | 2026-02-24 08:53:35.523915 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-24 08:53:35.523968 | controller | Tuesday 24 February 2026 08:53:35 +0000 (0:00:00.607) 0:01:18.450 ****** 2026-02-24 08:53:35.744015 | controller | changed: [instance] 2026-02-24 08:53:35.744184 | controller | 2026-02-24 08:53:35.744217 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-24 08:53:41.774512 | controller | Tuesday 24 February 2026 08:53:35 +0000 (0:00:00.220) 0:01:18.670 ****** 2026-02-24 08:53:41.774572 | controller | changed: [instance] 2026-02-24 08:53:41.774732 | controller | 2026-02-24 08:53:41.774765 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-24 08:53:41.812047 | controller | Tuesday 24 February 2026 08:53:41 +0000 (0:00:06.030) 0:01:24.701 ****** 2026-02-24 08:53:41.812079 | controller | ok: [instance] 2026-02-24 08:53:42.128546 | controller | 2026-02-24 08:53:42.128587 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-24 08:53:42.128596 | controller | Tuesday 24 February 2026 08:53:41 +0000 (0:00:00.037) 0:01:24.739 ****** 2026-02-24 08:53:42.128608 | controller | changed: [instance] 2026-02-24 08:53:42.128634 | controller | 2026-02-24 08:53:42.128643 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-24 08:53:42.128665 | controller | Tuesday 24 February 2026 08:53:42 +0000 (0:00:00.316) 0:01:25.055 ****** 2026-02-24 08:53:42.406533 | controller | changed: [instance] 2026-02-24 08:53:42.406588 | controller | 2026-02-24 08:53:42.406806 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-24 08:53:42.426453 | controller | Tuesday 24 February 2026 08:53:42 +0000 (0:00:00.278) 0:01:25.333 ****** 2026-02-24 08:53:42.426481 | controller | skipping: [instance] 2026-02-24 08:53:42.445136 | controller | 2026-02-24 08:53:42.445157 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-24 08:53:42.445165 | controller | Tuesday 24 February 2026 08:53:42 +0000 (0:00:00.019) 0:01:25.353 ****** 2026-02-24 08:53:42.445175 | controller | skipping: [instance] 2026-02-24 08:53:42.465033 | controller | 2026-02-24 08:53:42.465055 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-24 08:53:42.465064 | controller | Tuesday 24 February 2026 08:53:42 +0000 (0:00:00.018) 0:01:25.372 ****** 2026-02-24 08:53:42.465075 | controller | skipping: [instance] 2026-02-24 08:53:42.484070 | controller | 2026-02-24 08:53:42.484091 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-24 08:53:42.484101 | controller | Tuesday 24 February 2026 08:53:42 +0000 (0:00:00.019) 0:01:25.392 ****** 2026-02-24 08:53:42.484111 | controller | skipping: [instance] 2026-02-24 08:53:42.501571 | controller | 2026-02-24 08:53:42.501593 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-24 08:53:42.501610 | controller | Tuesday 24 February 2026 08:53:42 +0000 (0:00:00.019) 0:01:25.411 ****** 2026-02-24 08:53:42.501620 | controller | skipping: [instance] 2026-02-24 08:53:42.501803 | controller | 2026-02-24 08:53:42.501828 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-24 08:53:42.523928 | controller | Tuesday 24 February 2026 08:53:42 +0000 (0:00:00.017) 0:01:25.428 ****** 2026-02-24 08:53:42.523950 | controller | skipping: [instance] 2026-02-24 08:53:43.500795 | controller | 2026-02-24 08:53:43.500830 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-24 08:53:43.500838 | controller | Tuesday 24 February 2026 08:53:42 +0000 (0:00:00.022) 0:01:25.451 ****** 2026-02-24 08:53:43.500849 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-24 08:53:43.837569 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-24 08:53:43.837606 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-24 08:53:43.837615 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-24 08:53:43.837622 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-24 08:53:43.837629 | controller | 2026-02-24 08:53:43.837636 | controller | TASK [Create secret file] ****************************************************** 2026-02-24 08:53:43.837643 | controller | Tuesday 24 February 2026 08:53:43 +0000 (0:00:00.976) 0:01:26.427 ****** 2026-02-24 08:53:43.837663 | controller | changed: [instance] 2026-02-24 08:53:43.837695 | controller | 2026-02-24 08:53:43.837704 | controller | PLAY RECAP ********************************************************************* 2026-02-24 08:53:43.837711 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-24 08:53:43.837720 | controller | 2026-02-24 08:53:43.839625 | controller | Tuesday 24 February 2026 08:53:43 +0000 (0:00:00.337) 0:01:26.764 ****** 2026-02-24 08:53:43.839645 | controller | =============================================================================== 2026-02-24 08:53:43.898873 | controller | test_deps : Install selinux python libs -------------------------------- 52.21s 2026-02-24 08:53:43.898899 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.64s 2026-02-24 08:53:43.898906 | controller | ci_setup : Install needed packages -------------------------------------- 7.39s 2026-02-24 08:53:43.898911 | controller | ci_setup : Install openshift client ------------------------------------- 6.03s 2026-02-24 08:53:43.898916 | controller | test_deps : Install python yaml libs ------------------------------------ 1.24s 2026-02-24 08:53:43.898921 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.17s 2026-02-24 08:53:43.898926 | controller | ci_setup : Manage directories ------------------------------------------- 0.98s 2026-02-24 08:53:43.898930 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.86s 2026-02-24 08:53:43.898935 | controller | Gathering Facts --------------------------------------------------------- 0.86s 2026-02-24 08:53:43.898940 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.84s 2026-02-24 08:53:43.898945 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.74s 2026-02-24 08:53:43.898949 | controller | repo_setup : Install repo-setup package --------------------------------- 0.72s 2026-02-24 08:53:43.898954 | controller | ci_setup : Gather version of openshift client --------------------------- 0.61s 2026-02-24 08:53:43.898959 | controller | repo_setup : Ensure directories are present ----------------------------- 0.56s 2026-02-24 08:53:43.898964 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.54s 2026-02-24 08:53:43.898968 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.44s 2026-02-24 08:53:43.898973 | controller | Create custom basedir --------------------------------------------------- 0.35s 2026-02-24 08:53:43.898978 | controller | Create secret file ------------------------------------------------------ 0.34s 2026-02-24 08:53:43.898983 | controller | ci_setup : Create completion file --------------------------------------- 0.32s 2026-02-24 08:53:43.898992 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.31s 2026-02-24 08:53:43.899001 | controller | INFO Running crc_layout > converge 2026-02-24 08:53:44.458976 | controller | 2026-02-24 08:53:44.459274 | controller | PLAY [Converge] **************************************************************** 2026-02-24 08:53:44.459524 | controller | 2026-02-24 08:53:44.459703 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 08:53:44.459837 | controller | Tuesday 24 February 2026 08:53:44 +0000 (0:00:00.025) 0:00:00.025 ****** 2026-02-24 08:53:45.279106 | controller | ok: [instance] 2026-02-24 08:53:45.300470 | controller | 2026-02-24 08:53:45.300497 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-24 08:53:45.300506 | controller | Tuesday 24 February 2026 08:53:45 +0000 (0:00:00.819) 0:00:00.845 ****** 2026-02-24 08:53:45.300517 | controller | ok: [instance] 2026-02-24 08:53:47.098040 | controller | 2026-02-24 08:53:47.098073 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-24 08:53:47.098081 | controller | Tuesday 24 February 2026 08:53:45 +0000 (0:00:00.021) 0:00:00.866 ****** 2026-02-24 08:53:47.098090 | controller | changed: [instance] 2026-02-24 08:53:47.126664 | controller | 2026-02-24 08:53:47.126688 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-24 08:53:47.126704 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:01.797) 0:00:02.664 ****** 2026-02-24 08:53:47.126714 | controller | ok: [instance] 2026-02-24 08:53:47.126754 | controller | 2026-02-24 08:53:47.126762 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-24 08:53:47.126771 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:00.028) 0:00:02.692 ****** 2026-02-24 08:53:47.149062 | controller | skipping: [instance] 2026-02-24 08:53:47.199125 | controller | 2026-02-24 08:53:47.199154 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-24 08:53:47.199167 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:00.022) 0:00:02.715 ****** 2026-02-24 08:53:47.199182 | controller | 2026-02-24 08:53:47.278508 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-24 08:53:47.278529 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:00.049) 0:00:02.765 ****** 2026-02-24 08:53:47.278541 | controller | ok: [instance] 2026-02-24 08:53:47.344559 | controller | 2026-02-24 08:53:47.344586 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-24 08:53:47.344595 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:00.079) 0:00:02.845 ****** 2026-02-24 08:53:47.344606 | controller | skipping: [instance] 2026-02-24 08:53:47.344645 | controller | 2026-02-24 08:53:47.344653 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-24 08:53:47.344662 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:00.065) 0:00:02.910 ****** 2026-02-24 08:53:47.371331 | controller | ok: [instance] 2026-02-24 08:53:47.371500 | controller | 2026-02-24 08:53:47.371631 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-24 08:53:47.371791 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:00.027) 0:00:02.938 ****** 2026-02-24 08:53:47.396516 | controller | ok: [instance] => changed=false 2026-02-24 08:53:47.396654 | controller | msg: All assertions passed 2026-02-24 08:53:47.396964 | controller | 2026-02-24 08:53:47.397052 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-24 08:53:47.397067 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:00.025) 0:00:02.963 ****** 2026-02-24 08:53:47.441723 | controller | ok: [instance] 2026-02-24 08:53:47.903490 | controller | 2026-02-24 08:53:47.903531 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-24 08:53:47.903541 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:00.044) 0:00:03.007 ****** 2026-02-24 08:53:47.903567 | controller | ok: [instance] => (item=artifacts) 2026-02-24 08:53:47.979982 | controller | ok: [instance] => (item=logs) 2026-02-24 08:53:47.980014 | controller | 2026-02-24 08:53:47.980027 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-24 08:53:47.980046 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:00.461) 0:00:03.469 ****** 2026-02-24 08:53:47.980061 | controller | 2026-02-24 08:53:48.164683 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-24 08:53:48.164712 | controller | Tuesday 24 February 2026 08:53:47 +0000 (0:00:00.076) 0:00:03.546 ****** 2026-02-24 08:53:48.164724 | controller | ok: [instance] 2026-02-24 08:53:48.442508 | controller | 2026-02-24 08:53:48.442536 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-24 08:53:48.442544 | controller | Tuesday 24 February 2026 08:53:48 +0000 (0:00:00.184) 0:00:03.730 ****** 2026-02-24 08:53:48.442565 | controller | changed: [instance] 2026-02-24 08:53:48.442676 | controller | 2026-02-24 08:53:48.442686 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-24 08:53:48.442694 | controller | Tuesday 24 February 2026 08:53:48 +0000 (0:00:00.277) 0:00:04.008 ****** 2026-02-24 08:53:48.724645 | controller | ok: [instance] 2026-02-24 08:53:48.724721 | controller | 2026-02-24 08:53:48.724732 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-24 08:53:48.724757 | controller | Tuesday 24 February 2026 08:53:48 +0000 (0:00:00.282) 0:00:04.291 ****** 2026-02-24 08:53:48.754941 | controller | skipping: [instance] 2026-02-24 08:53:48.773892 | controller | 2026-02-24 08:53:48.773911 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-24 08:53:48.773918 | controller | Tuesday 24 February 2026 08:53:48 +0000 (0:00:00.030) 0:00:04.321 ****** 2026-02-24 08:53:48.773927 | controller | skipping: [instance] 2026-02-24 08:53:48.796139 | controller | 2026-02-24 08:53:48.796159 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-24 08:53:48.796168 | controller | Tuesday 24 February 2026 08:53:48 +0000 (0:00:00.018) 0:00:04.340 ****** 2026-02-24 08:53:48.796178 | controller | ok: [instance] 2026-02-24 08:53:48.824349 | controller | 2026-02-24 08:53:48.824378 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-24 08:53:48.824398 | controller | Tuesday 24 February 2026 08:53:48 +0000 (0:00:00.022) 0:00:04.362 ****** 2026-02-24 08:53:48.824439 | controller | skipping: [instance] 2026-02-24 08:53:56.626124 | controller | 2026-02-24 08:53:56.626162 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-24 08:53:56.626171 | controller | Tuesday 24 February 2026 08:53:48 +0000 (0:00:00.027) 0:00:04.390 ****** 2026-02-24 08:53:56.626182 | controller | changed: [instance] 2026-02-24 08:53:56.626188 | controller | 2026-02-24 08:53:56.626196 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-24 08:53:56.626287 | controller | Tuesday 24 February 2026 08:53:56 +0000 (0:00:07.801) 0:00:12.191 ****** 2026-02-24 08:53:56.859975 | controller | changed: [instance] 2026-02-24 08:53:56.860296 | controller | 2026-02-24 08:53:57.385913 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-24 08:53:57.385943 | controller | Tuesday 24 February 2026 08:53:56 +0000 (0:00:00.234) 0:00:12.426 ****** 2026-02-24 08:53:57.385955 | controller | changed: [instance] 2026-02-24 08:53:59.032169 | controller | 2026-02-24 08:53:59.032202 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-24 08:53:59.032209 | controller | Tuesday 24 February 2026 08:53:57 +0000 (0:00:00.525) 0:00:12.952 ****** 2026-02-24 08:53:59.032219 | controller | changed: [instance] 2026-02-24 08:53:59.233669 | controller | 2026-02-24 08:53:59.233712 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-24 08:53:59.233722 | controller | Tuesday 24 February 2026 08:53:59 +0000 (0:00:01.646) 0:00:14.598 ****** 2026-02-24 08:53:59.233734 | controller | ok: [instance] 2026-02-24 08:53:59.911490 | controller | 2026-02-24 08:53:59.911528 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-24 08:53:59.911537 | controller | Tuesday 24 February 2026 08:53:59 +0000 (0:00:00.201) 0:00:14.800 ****** 2026-02-24 08:53:59.911549 | controller | ok: [instance] 2026-02-24 08:54:00.730399 | controller | 2026-02-24 08:54:00.730459 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-24 08:54:00.730480 | controller | Tuesday 24 February 2026 08:53:59 +0000 (0:00:00.677) 0:00:15.477 ****** 2026-02-24 08:54:00.730494 | controller | changed: [instance] 2026-02-24 08:54:00.856711 | controller | 2026-02-24 08:54:00.856730 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-24 08:54:00.856738 | controller | Tuesday 24 February 2026 08:54:00 +0000 (0:00:00.818) 0:00:16.296 ****** 2026-02-24 08:54:00.856747 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-24 08:54:01.191465 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-24 08:54:01.191485 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-24 08:54:01.191492 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-24 08:54:01.191498 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-24 08:54:01.191504 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-24 08:54:01.191509 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-24 08:54:01.191515 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-24 08:54:01.191520 | controller | 2026-02-24 08:54:01.191526 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-24 08:54:01.191532 | controller | Tuesday 24 February 2026 08:54:00 +0000 (0:00:00.125) 0:00:16.422 ****** 2026-02-24 08:54:01.191540 | controller | ok: [instance] 2026-02-24 08:54:01.191834 | controller | 2026-02-24 08:54:01.522317 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-24 08:54:01.522349 | controller | Tuesday 24 February 2026 08:54:01 +0000 (0:00:00.335) 0:00:16.757 ****** 2026-02-24 08:54:01.522361 | controller | ok: [instance] 2026-02-24 08:54:01.853980 | controller | 2026-02-24 08:54:01.854016 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-24 08:54:01.854025 | controller | Tuesday 24 February 2026 08:54:01 +0000 (0:00:00.330) 0:00:17.088 ****** 2026-02-24 08:54:01.854036 | controller | ok: [instance] 2026-02-24 08:54:02.190480 | controller | 2026-02-24 08:54:02.190508 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-24 08:54:02.190516 | controller | Tuesday 24 February 2026 08:54:01 +0000 (0:00:00.331) 0:00:17.419 ****** 2026-02-24 08:54:02.190526 | controller | ok: [instance] 2026-02-24 08:54:02.190550 | controller | 2026-02-24 08:54:02.190793 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-24 08:54:02.523485 | controller | Tuesday 24 February 2026 08:54:02 +0000 (0:00:00.337) 0:00:17.756 ****** 2026-02-24 08:54:02.523521 | controller | ok: [instance] 2026-02-24 08:54:02.523578 | controller | 2026-02-24 08:54:02.523587 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-24 08:54:02.523605 | controller | Tuesday 24 February 2026 08:54:02 +0000 (0:00:00.332) 0:00:18.089 ****** 2026-02-24 08:54:02.861582 | controller | ok: [instance] 2026-02-24 08:54:02.861643 | controller | 2026-02-24 08:54:02.861651 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-24 08:54:02.861660 | controller | Tuesday 24 February 2026 08:54:02 +0000 (0:00:00.337) 0:00:18.427 ****** 2026-02-24 08:54:03.218463 | controller | ok: [instance] 2026-02-24 08:54:03.541135 | controller | 2026-02-24 08:54:03.541174 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-24 08:54:03.541184 | controller | Tuesday 24 February 2026 08:54:03 +0000 (0:00:00.357) 0:00:18.784 ****** 2026-02-24 08:54:03.541204 | controller | ok: [instance] 2026-02-24 08:54:03.885037 | controller | 2026-02-24 08:54:03.885069 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-24 08:54:03.885078 | controller | Tuesday 24 February 2026 08:54:03 +0000 (0:00:00.322) 0:00:19.107 ****** 2026-02-24 08:54:03.885088 | controller | ok: [instance] 2026-02-24 08:54:04.216478 | controller | 2026-02-24 08:54:04.216513 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-24 08:54:04.216523 | controller | Tuesday 24 February 2026 08:54:03 +0000 (0:00:00.343) 0:00:19.451 ****** 2026-02-24 08:54:04.216535 | controller | ok: [instance] 2026-02-24 08:54:04.556037 | controller | 2026-02-24 08:54:04.556071 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-24 08:54:04.556079 | controller | Tuesday 24 February 2026 08:54:04 +0000 (0:00:00.331) 0:00:19.782 ****** 2026-02-24 08:54:04.556089 | controller | ok: [instance] 2026-02-24 08:54:04.900515 | controller | 2026-02-24 08:54:04.900554 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-24 08:54:04.900564 | controller | Tuesday 24 February 2026 08:54:04 +0000 (0:00:00.339) 0:00:20.122 ****** 2026-02-24 08:54:04.900576 | controller | ok: [instance] 2026-02-24 08:54:04.900584 | controller | 2026-02-24 08:54:04.900604 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-24 08:54:04.900614 | controller | Tuesday 24 February 2026 08:54:04 +0000 (0:00:00.344) 0:00:20.466 ****** 2026-02-24 08:54:05.255365 | controller | ok: [instance] 2026-02-24 08:54:05.603141 | controller | 2026-02-24 08:54:05.603176 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-24 08:54:05.603186 | controller | Tuesday 24 February 2026 08:54:05 +0000 (0:00:00.354) 0:00:20.821 ****** 2026-02-24 08:54:05.603198 | controller | ok: [instance] 2026-02-24 08:54:05.941311 | controller | 2026-02-24 08:54:05.941341 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-24 08:54:05.941349 | controller | Tuesday 24 February 2026 08:54:05 +0000 (0:00:00.347) 0:00:21.169 ****** 2026-02-24 08:54:05.941359 | controller | ok: [instance] 2026-02-24 08:54:06.283089 | controller | 2026-02-24 08:54:06.283117 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-24 08:54:06.283125 | controller | Tuesday 24 February 2026 08:54:05 +0000 (0:00:00.338) 0:00:21.507 ****** 2026-02-24 08:54:06.283135 | controller | ok: [instance] 2026-02-24 08:54:06.616508 | controller | 2026-02-24 08:54:06.616553 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-24 08:54:06.616562 | controller | Tuesday 24 February 2026 08:54:06 +0000 (0:00:00.341) 0:00:21.849 ****** 2026-02-24 08:54:06.616573 | controller | ok: [instance] 2026-02-24 08:54:06.951505 | controller | 2026-02-24 08:54:06.951541 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-24 08:54:06.951551 | controller | Tuesday 24 February 2026 08:54:06 +0000 (0:00:00.333) 0:00:22.182 ****** 2026-02-24 08:54:06.951563 | controller | ok: [instance] 2026-02-24 08:54:06.951602 | controller | 2026-02-24 08:54:06.951794 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-24 08:54:07.285145 | controller | Tuesday 24 February 2026 08:54:06 +0000 (0:00:00.335) 0:00:22.518 ****** 2026-02-24 08:54:07.285173 | controller | ok: [instance] 2026-02-24 08:54:07.616340 | controller | 2026-02-24 08:54:07.616369 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-24 08:54:07.616379 | controller | Tuesday 24 February 2026 08:54:07 +0000 (0:00:00.333) 0:00:22.851 ****** 2026-02-24 08:54:07.616391 | controller | ok: [instance] 2026-02-24 08:54:07.953633 | controller | 2026-02-24 08:54:07.953678 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-24 08:54:07.953692 | controller | Tuesday 24 February 2026 08:54:07 +0000 (0:00:00.331) 0:00:23.182 ****** 2026-02-24 08:54:07.953708 | controller | ok: [instance] 2026-02-24 08:54:07.953758 | controller | 2026-02-24 08:54:07.953771 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-24 08:54:08.292278 | controller | Tuesday 24 February 2026 08:54:07 +0000 (0:00:00.337) 0:00:23.519 ****** 2026-02-24 08:54:08.292331 | controller | ok: [instance] 2026-02-24 08:54:08.619319 | controller | 2026-02-24 08:54:08.619363 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-24 08:54:08.619382 | controller | Tuesday 24 February 2026 08:54:08 +0000 (0:00:00.338) 0:00:23.858 ****** 2026-02-24 08:54:08.619392 | controller | ok: [instance] 2026-02-24 08:54:08.951384 | controller | 2026-02-24 08:54:08.951428 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-24 08:54:08.951439 | controller | Tuesday 24 February 2026 08:54:08 +0000 (0:00:00.327) 0:00:24.185 ****** 2026-02-24 08:54:08.951449 | controller | ok: [instance] 2026-02-24 08:54:08.974995 | controller | 2026-02-24 08:54:08.975011 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-24 08:54:08.975018 | controller | Tuesday 24 February 2026 08:54:08 +0000 (0:00:00.332) 0:00:24.517 ****** 2026-02-24 08:54:08.975025 | controller | skipping: [instance] 2026-02-24 08:54:09.261389 | controller | 2026-02-24 08:54:09.261428 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-24 08:54:09.261463 | controller | Tuesday 24 February 2026 08:54:08 +0000 (0:00:00.023) 0:00:24.541 ****** 2026-02-24 08:54:09.261473 | controller | ok: [instance] 2026-02-24 08:54:09.672564 | controller | 2026-02-24 08:54:09.672642 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-24 08:54:09.672659 | controller | Tuesday 24 February 2026 08:54:09 +0000 (0:00:00.286) 0:00:24.827 ****** 2026-02-24 08:54:09.672678 | controller | ok: [instance] 2026-02-24 08:54:10.002604 | controller | 2026-02-24 08:54:10.002647 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-24 08:54:10.002656 | controller | Tuesday 24 February 2026 08:54:09 +0000 (0:00:00.411) 0:00:25.238 ****** 2026-02-24 08:54:10.002668 | controller | changed: [instance] 2026-02-24 08:54:10.313733 | controller | 2026-02-24 08:54:10.313770 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-24 08:54:10.313780 | controller | Tuesday 24 February 2026 08:54:09 +0000 (0:00:00.329) 0:00:25.568 ****** 2026-02-24 08:54:10.313792 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-24 08:54:10.323388 | controller | changed: [instance] 2026-02-24 08:54:10.401044 | controller | 2026-02-24 08:54:10.401063 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-24 08:54:10.401071 | controller | Tuesday 24 February 2026 08:54:10 +0000 (0:00:00.305) 0:00:25.874 ****** 2026-02-24 08:54:10.401077 | controller | 2026-02-24 08:54:10.401082 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-24 08:54:10.401087 | controller | Tuesday 24 February 2026 08:54:10 +0000 (0:00:00.015) 0:00:25.889 ****** 2026-02-24 08:54:10.401096 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-24 08:54:10.480673 | controller | 2026-02-24 08:54:10.480701 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-24 08:54:10.480710 | controller | Tuesday 24 February 2026 08:54:10 +0000 (0:00:00.077) 0:00:25.967 ****** 2026-02-24 08:54:10.480728 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-24 08:54:10.534624 | controller | 2026-02-24 08:54:10.534691 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-24 08:54:10.534703 | controller | Tuesday 24 February 2026 08:54:10 +0000 (0:00:00.079) 0:00:26.047 ****** 2026-02-24 08:54:10.534721 | controller | ok: [instance] => (item=compute) 2026-02-24 08:54:10.581540 | controller | ok: [instance] => (item=controller) 2026-02-24 08:54:10.581589 | controller | ok: [instance] => (item=crc) 2026-02-24 08:54:10.581607 | controller | 2026-02-24 08:54:10.581614 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-24 08:54:10.581621 | controller | Tuesday 24 February 2026 08:54:10 +0000 (0:00:00.053) 0:00:26.100 ****** 2026-02-24 08:54:10.581635 | controller | ok: [instance] 2026-02-24 08:54:10.626639 | controller | 2026-02-24 08:54:10.626688 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-24 08:54:10.626709 | controller | Tuesday 24 February 2026 08:54:10 +0000 (0:00:00.047) 0:00:26.147 ****** 2026-02-24 08:54:10.626725 | controller | ok: [instance] => changed=false 2026-02-24 08:54:10.669704 | controller | msg: All assertions passed 2026-02-24 08:54:10.669734 | controller | 2026-02-24 08:54:10.669743 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-24 08:54:10.669749 | controller | Tuesday 24 February 2026 08:54:10 +0000 (0:00:00.045) 0:00:26.192 ****** 2026-02-24 08:54:10.669761 | controller | 2026-02-24 08:54:10.669938 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-24 08:54:10.670133 | controller | Tuesday 24 February 2026 08:54:10 +0000 (0:00:00.043) 0:00:26.236 ****** 2026-02-24 08:54:10.749211 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-24 08:54:10.749352 | controller | ok: [instance] => (item={}) 2026-02-24 08:54:10.749444 | controller | 2026-02-24 08:54:10.749639 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-24 08:54:10.749710 | controller | Tuesday 24 February 2026 08:54:10 +0000 (0:00:00.079) 0:00:26.315 ****** 2026-02-24 08:54:10.769292 | controller | skipping: [instance] 2026-02-24 08:54:10.769530 | controller | 2026-02-24 08:54:10.769743 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-24 08:54:10.769810 | controller | Tuesday 24 February 2026 08:54:10 +0000 (0:00:00.020) 0:00:26.335 ****** 2026-02-24 08:54:11.007445 | controller | ok: [instance] 2026-02-24 08:54:11.356568 | controller | 2026-02-24 08:54:11.356634 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-24 08:54:11.356647 | controller | Tuesday 24 February 2026 08:54:11 +0000 (0:00:00.237) 0:00:26.573 ****** 2026-02-24 08:54:11.356663 | controller | changed: [instance] 2026-02-24 08:54:11.356696 | controller | 2026-02-24 08:54:11.356709 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-24 08:54:12.117113 | controller | Tuesday 24 February 2026 08:54:11 +0000 (0:00:00.349) 0:00:26.923 ****** 2026-02-24 08:54:12.117162 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-24 08:54:12.147569 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-24 08:54:12.147628 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-24 08:54:12.147639 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-24 08:54:12.147648 | controller | 2026-02-24 08:54:12.147656 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-24 08:54:12.147664 | controller | Tuesday 24 February 2026 08:54:12 +0000 (0:00:00.759) 0:00:27.683 ****** 2026-02-24 08:54:12.147678 | controller | skipping: [instance] 2026-02-24 08:54:12.147713 | controller | 2026-02-24 08:54:12.147724 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-24 08:54:12.147849 | controller | Tuesday 24 February 2026 08:54:12 +0000 (0:00:00.031) 0:00:27.714 ****** 2026-02-24 08:54:12.538557 | controller | changed: [instance] 2026-02-24 08:54:12.538629 | controller | 2026-02-24 08:54:12.538640 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-24 08:54:12.538649 | controller | Tuesday 24 February 2026 08:54:12 +0000 (0:00:00.382) 0:00:28.096 ****** 2026-02-24 08:54:12.538656 | controller | 2026-02-24 08:54:12.538665 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 08:54:12.538740 | controller | Tuesday 24 February 2026 08:54:12 +0000 (0:00:00.008) 0:00:28.104 ****** 2026-02-24 08:54:12.985260 | controller | changed: [instance] 2026-02-24 08:54:12.985320 | controller | 2026-02-24 08:54:12.985576 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-24 08:54:13.063140 | controller | Tuesday 24 February 2026 08:54:12 +0000 (0:00:00.446) 0:00:28.551 ****** 2026-02-24 08:54:13.063175 | controller | 2026-02-24 08:54:14.323901 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-24 08:54:14.323939 | controller | Tuesday 24 February 2026 08:54:13 +0000 (0:00:00.077) 0:00:28.629 ****** 2026-02-24 08:54:14.323950 | controller | ok: [instance] 2026-02-24 08:54:14.574054 | controller | 2026-02-24 08:54:14.574091 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-24 08:54:14.574099 | controller | Tuesday 24 February 2026 08:54:14 +0000 (0:00:01.260) 0:00:29.890 ****** 2026-02-24 08:54:14.574110 | controller | ok: [instance] 2026-02-24 08:54:15.078030 | controller | 2026-02-24 08:54:15.078063 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-24 08:54:15.078071 | controller | Tuesday 24 February 2026 08:54:14 +0000 (0:00:00.250) 0:00:30.140 ****** 2026-02-24 08:54:15.078082 | controller | ok: [instance] 2026-02-24 08:54:15.307526 | controller | 2026-02-24 08:54:15.307558 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-24 08:54:15.307568 | controller | Tuesday 24 February 2026 08:54:15 +0000 (0:00:00.504) 0:00:30.644 ****** 2026-02-24 08:54:15.307580 | controller | ok: [instance] 2026-02-24 08:54:15.307621 | controller | 2026-02-24 08:54:15.307632 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-24 08:54:15.307714 | controller | Tuesday 24 February 2026 08:54:15 +0000 (0:00:00.229) 0:00:30.874 ****** 2026-02-24 08:54:16.541880 | controller | ok: [instance] 2026-02-24 08:54:16.874147 | controller | 2026-02-24 08:54:16.874175 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-24 08:54:16.874184 | controller | Tuesday 24 February 2026 08:54:16 +0000 (0:00:01.233) 0:00:32.108 ****** 2026-02-24 08:54:16.874201 | controller | ok: [instance] 2026-02-24 08:54:17.198066 | controller | 2026-02-24 08:54:17.198093 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-24 08:54:17.198101 | controller | Tuesday 24 February 2026 08:54:16 +0000 (0:00:00.332) 0:00:32.440 ****** 2026-02-24 08:54:17.198111 | controller | changed: [instance] 2026-02-24 08:54:17.521807 | controller | 2026-02-24 08:54:17.521839 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-24 08:54:17.521848 | controller | Tuesday 24 February 2026 08:54:17 +0000 (0:00:00.323) 0:00:32.764 ****** 2026-02-24 08:54:17.521857 | controller | changed: [instance] 2026-02-24 08:54:19.121528 | controller | 2026-02-24 08:54:19.121561 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-24 08:54:19.121570 | controller | Tuesday 24 February 2026 08:54:17 +0000 (0:00:00.323) 0:00:33.088 ****** 2026-02-24 08:54:19.121581 | controller | changed: [instance] => (item=arptables) 2026-02-24 08:54:19.448309 | controller | changed: [instance] => (item=iptables) 2026-02-24 08:54:19.448341 | controller | changed: [instance] => (item=ip6tables) 2026-02-24 08:54:19.448350 | controller | 2026-02-24 08:54:19.448358 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-24 08:54:19.448366 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:01.599) 0:00:34.687 ****** 2026-02-24 08:54:19.448377 | controller | ok: [instance] 2026-02-24 08:54:19.562996 | controller | 2026-02-24 08:54:19.563028 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-24 08:54:19.563038 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.326) 0:00:35.014 ****** 2026-02-24 08:54:19.563049 | controller | ok: [instance] 2026-02-24 08:54:19.607116 | controller | 2026-02-24 08:54:19.607142 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-24 08:54:19.607152 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.114) 0:00:35.129 ****** 2026-02-24 08:54:19.607163 | controller | 2026-02-24 08:54:19.632655 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-24 08:54:19.632715 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.044) 0:00:35.173 ****** 2026-02-24 08:54:19.632737 | controller | skipping: [instance] 2026-02-24 08:54:19.658328 | controller | 2026-02-24 08:54:19.658353 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-24 08:54:19.658360 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.025) 0:00:35.199 ****** 2026-02-24 08:54:19.658369 | controller | skipping: [instance] 2026-02-24 08:54:19.683388 | controller | 2026-02-24 08:54:19.683448 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 08:54:19.683460 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.025) 0:00:35.224 ****** 2026-02-24 08:54:19.683470 | controller | skipping: [instance] 2026-02-24 08:54:19.683650 | controller | 2026-02-24 08:54:19.683826 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-24 08:54:19.683995 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.025) 0:00:35.250 ****** 2026-02-24 08:54:19.717208 | controller | skipping: [instance] 2026-02-24 08:54:19.717469 | controller | 2026-02-24 08:54:19.717628 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-24 08:54:19.717764 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.033) 0:00:35.283 ****** 2026-02-24 08:54:19.759173 | controller | ok: [instance] 2026-02-24 08:54:19.759318 | controller | 2026-02-24 08:54:19.759478 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-24 08:54:19.759628 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.042) 0:00:35.326 ****** 2026-02-24 08:54:19.795632 | controller | skipping: [instance] 2026-02-24 08:54:19.795812 | controller | 2026-02-24 08:54:19.795992 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-24 08:54:19.796154 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.036) 0:00:35.362 ****** 2026-02-24 08:54:19.820794 | controller | skipping: [instance] 2026-02-24 08:54:19.820970 | controller | 2026-02-24 08:54:19.821138 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-24 08:54:19.821299 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.025) 0:00:35.387 ****** 2026-02-24 08:54:19.877629 | controller | ok: [instance] 2026-02-24 08:54:19.877730 | controller | 2026-02-24 08:54:19.877838 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-24 08:54:19.877940 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.056) 0:00:35.444 ****** 2026-02-24 08:54:19.900883 | controller | skipping: [instance] 2026-02-24 08:54:19.901055 | controller | 2026-02-24 08:54:19.901278 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-24 08:54:19.901479 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.023) 0:00:35.467 ****** 2026-02-24 08:54:19.951871 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-24 08:54:19.952017 | controller | 2026-02-24 08:54:19.952153 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 08:54:19.952260 | controller | Tuesday 24 February 2026 08:54:19 +0000 (0:00:00.050) 0:00:35.518 ****** 2026-02-24 08:54:20.276840 | controller | ok: [instance -> localhost] 2026-02-24 08:54:25.490204 | controller | 2026-02-24 08:54:25.490234 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-24 08:54:25.490242 | controller | Tuesday 24 February 2026 08:54:20 +0000 (0:00:00.324) 0:00:35.842 ****** 2026-02-24 08:54:25.490251 | controller | changed: [instance -> localhost] 2026-02-24 08:54:25.690236 | controller | 2026-02-24 08:54:25.690265 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 08:54:25.690273 | controller | Tuesday 24 February 2026 08:54:25 +0000 (0:00:05.213) 0:00:41.056 ****** 2026-02-24 08:54:25.690282 | controller | changed: [instance] 2026-02-24 08:54:26.071940 | controller | 2026-02-24 08:54:26.071974 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-24 08:54:26.071983 | controller | Tuesday 24 February 2026 08:54:25 +0000 (0:00:00.200) 0:00:41.256 ****** 2026-02-24 08:54:26.072001 | controller | changed: [instance] 2026-02-24 08:54:27.744093 | controller | 2026-02-24 08:54:27.744126 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-24 08:54:27.744136 | controller | Tuesday 24 February 2026 08:54:26 +0000 (0:00:00.381) 0:00:41.638 ****** 2026-02-24 08:54:27.744148 | controller | changed: [instance -> localhost] 2026-02-24 08:54:28.123284 | controller | 2026-02-24 08:54:28.123310 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-24 08:54:28.123318 | controller | Tuesday 24 February 2026 08:54:27 +0000 (0:00:01.672) 0:00:43.310 ****** 2026-02-24 08:54:28.123327 | controller | changed: [instance] 2026-02-24 08:54:28.156574 | controller | 2026-02-24 08:54:28.156615 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-24 08:54:28.156626 | controller | Tuesday 24 February 2026 08:54:28 +0000 (0:00:00.379) 0:00:43.689 ****** 2026-02-24 08:54:28.156637 | controller | ok: [instance] 2026-02-24 08:54:28.281322 | controller | 2026-02-24 08:54:28.281344 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-24 08:54:28.281352 | controller | Tuesday 24 February 2026 08:54:28 +0000 (0:00:00.033) 0:00:43.722 ****** 2026-02-24 08:54:28.281362 | controller | 2026-02-24 08:54:28.302381 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-24 08:54:28.302402 | controller | Tuesday 24 February 2026 08:54:28 +0000 (0:00:00.124) 0:00:43.847 ****** 2026-02-24 08:54:28.302443 | controller | ok: [instance] 2026-02-24 08:54:28.490369 | controller | 2026-02-24 08:54:28.490395 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-24 08:54:28.490404 | controller | Tuesday 24 February 2026 08:54:28 +0000 (0:00:00.020) 0:00:43.868 ****** 2026-02-24 08:54:28.490432 | controller | ok: [instance] 2026-02-24 08:54:28.522042 | controller | 2026-02-24 08:54:28.522062 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-24 08:54:28.522071 | controller | Tuesday 24 February 2026 08:54:28 +0000 (0:00:00.187) 0:00:44.056 ****** 2026-02-24 08:54:28.522080 | controller | skipping: [instance] 2026-02-24 08:54:28.551391 | controller | 2026-02-24 08:54:28.551426 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-24 08:54:28.551437 | controller | Tuesday 24 February 2026 08:54:28 +0000 (0:00:00.031) 0:00:44.088 ****** 2026-02-24 08:54:28.551446 | controller | skipping: [instance] 2026-02-24 08:54:28.612643 | controller | 2026-02-24 08:54:28.612668 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-24 08:54:28.612677 | controller | Tuesday 24 February 2026 08:54:28 +0000 (0:00:00.029) 0:00:44.117 ****** 2026-02-24 08:54:28.612693 | controller | ok: [instance] 2026-02-24 08:54:28.743367 | controller | 2026-02-24 08:54:28.743394 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-24 08:54:28.743403 | controller | Tuesday 24 February 2026 08:54:28 +0000 (0:00:00.060) 0:00:44.178 ****** 2026-02-24 08:54:28.743438 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 08:54:28.743619 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 08:54:28.743752 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 08:54:28.743865 | controller | 2026-02-24 08:54:28.743993 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-24 08:54:28.744112 | controller | Tuesday 24 February 2026 08:54:28 +0000 (0:00:00.131) 0:00:44.309 ****** 2026-02-24 08:54:28.786825 | controller | skipping: [instance] 2026-02-24 08:54:28.786961 | controller | 2026-02-24 08:54:28.787090 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-24 08:54:28.787211 | controller | Tuesday 24 February 2026 08:54:28 +0000 (0:00:00.043) 0:00:44.353 ****** 2026-02-24 08:54:29.181336 | controller | changed: [instance] 2026-02-24 08:54:29.278165 | controller | 2026-02-24 08:54:29.278193 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-24 08:54:29.278201 | controller | Tuesday 24 February 2026 08:54:29 +0000 (0:00:00.393) 0:00:44.747 ****** 2026-02-24 08:54:29.278233 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-24 08:54:29.335548 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-24 08:54:29.335589 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-24 08:54:29.335610 | controller | 2026-02-24 08:54:29.335618 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 08:54:29.335626 | controller | Tuesday 24 February 2026 08:54:29 +0000 (0:00:00.096) 0:00:44.844 ****** 2026-02-24 08:54:29.335638 | controller | changed: [instance] 2026-02-24 08:54:29.335670 | controller | 2026-02-24 08:54:29.335680 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 08:54:29.335738 | controller | Tuesday 24 February 2026 08:54:29 +0000 (0:00:00.057) 0:00:44.901 ****** 2026-02-24 08:54:29.627507 | controller | changed: [instance] 2026-02-24 08:54:29.627557 | controller | 2026-02-24 08:54:29.627568 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 08:54:29.627695 | controller | Tuesday 24 February 2026 08:54:29 +0000 (0:00:00.291) 0:00:45.193 ****** 2026-02-24 08:54:29.871444 | controller | changed: [instance] 2026-02-24 08:54:29.937989 | controller | 2026-02-24 08:54:29.938009 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 08:54:29.938017 | controller | Tuesday 24 February 2026 08:54:29 +0000 (0:00:00.244) 0:00:45.437 ****** 2026-02-24 08:54:29.938026 | controller | changed: [instance] 2026-02-24 08:54:30.159362 | controller | 2026-02-24 08:54:30.159382 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 08:54:30.159390 | controller | Tuesday 24 February 2026 08:54:29 +0000 (0:00:00.066) 0:00:45.504 ****** 2026-02-24 08:54:30.159399 | controller | changed: [instance] 2026-02-24 08:54:30.385028 | controller | 2026-02-24 08:54:30.385053 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 08:54:30.385062 | controller | Tuesday 24 February 2026 08:54:30 +0000 (0:00:00.220) 0:00:45.725 ****** 2026-02-24 08:54:30.385072 | controller | changed: [instance] 2026-02-24 08:54:30.442276 | controller | 2026-02-24 08:54:30.442296 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 08:54:30.442305 | controller | Tuesday 24 February 2026 08:54:30 +0000 (0:00:00.226) 0:00:45.951 ****** 2026-02-24 08:54:30.442315 | controller | changed: [instance] 2026-02-24 08:54:30.659858 | controller | 2026-02-24 08:54:30.659882 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 08:54:30.659891 | controller | Tuesday 24 February 2026 08:54:30 +0000 (0:00:00.057) 0:00:46.008 ****** 2026-02-24 08:54:30.659901 | controller | changed: [instance] 2026-02-24 08:54:30.903125 | controller | 2026-02-24 08:54:30.903147 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 08:54:30.903155 | controller | Tuesday 24 February 2026 08:54:30 +0000 (0:00:00.217) 0:00:46.226 ****** 2026-02-24 08:54:30.903164 | controller | changed: [instance] 2026-02-24 08:54:31.119357 | controller | 2026-02-24 08:54:31.119377 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-24 08:54:31.119385 | controller | Tuesday 24 February 2026 08:54:30 +0000 (0:00:00.243) 0:00:46.469 ****** 2026-02-24 08:54:31.119393 | controller | ok: [instance] 2026-02-24 08:54:31.627241 | controller | 2026-02-24 08:54:31.627262 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-24 08:54:31.627270 | controller | Tuesday 24 February 2026 08:54:31 +0000 (0:00:00.216) 0:00:46.685 ****** 2026-02-24 08:54:31.627279 | controller | changed: [instance] 2026-02-24 08:54:31.822876 | controller | 2026-02-24 08:54:31.822899 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-24 08:54:31.822909 | controller | Tuesday 24 February 2026 08:54:31 +0000 (0:00:00.507) 0:00:47.193 ****** 2026-02-24 08:54:31.822924 | controller | changed: [instance] 2026-02-24 08:54:31.851391 | controller | 2026-02-24 08:54:31.851430 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 08:54:31.851443 | controller | Tuesday 24 February 2026 08:54:31 +0000 (0:00:00.195) 0:00:47.389 ****** 2026-02-24 08:54:31.851453 | controller | skipping: [instance] 2026-02-24 08:54:31.885299 | controller | 2026-02-24 08:54:31.885319 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 08:54:31.885335 | controller | Tuesday 24 February 2026 08:54:31 +0000 (0:00:00.028) 0:00:47.417 ****** 2026-02-24 08:54:31.885345 | controller | skipping: [instance] 2026-02-24 08:54:31.913371 | controller | 2026-02-24 08:54:31.913391 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 08:54:31.913400 | controller | Tuesday 24 February 2026 08:54:31 +0000 (0:00:00.033) 0:00:47.451 ****** 2026-02-24 08:54:31.913426 | controller | skipping: [instance] 2026-02-24 08:54:31.947022 | controller | 2026-02-24 08:54:31.947058 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 08:54:31.947068 | controller | Tuesday 24 February 2026 08:54:31 +0000 (0:00:00.028) 0:00:47.479 ****** 2026-02-24 08:54:31.947080 | controller | skipping: [instance] 2026-02-24 08:54:31.971086 | controller | 2026-02-24 08:54:31.971111 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 08:54:31.971121 | controller | Tuesday 24 February 2026 08:54:31 +0000 (0:00:00.033) 0:00:47.513 ****** 2026-02-24 08:54:31.971132 | controller | ok: [instance] 2026-02-24 08:54:32.063360 | controller | 2026-02-24 08:54:32.063381 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 08:54:32.063390 | controller | Tuesday 24 February 2026 08:54:31 +0000 (0:00:00.024) 0:00:47.537 ****** 2026-02-24 08:54:32.063403 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 08:54:32.063596 | controller | 2026-02-24 08:54:32.063781 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 08:54:32.063939 | controller | Tuesday 24 February 2026 08:54:32 +0000 (0:00:00.092) 0:00:47.630 ****** 2026-02-24 08:54:32.085327 | controller | skipping: [instance] 2026-02-24 08:54:32.085533 | controller | 2026-02-24 08:54:32.085723 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 08:54:32.085884 | controller | Tuesday 24 February 2026 08:54:32 +0000 (0:00:00.021) 0:00:47.652 ****** 2026-02-24 08:54:32.304534 | controller | changed: [instance] 2026-02-24 08:54:32.720002 | controller | 2026-02-24 08:54:32.720036 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 08:54:32.720046 | controller | Tuesday 24 February 2026 08:54:32 +0000 (0:00:00.218) 0:00:47.870 ****** 2026-02-24 08:54:32.720057 | controller | changed: [instance] 2026-02-24 08:54:32.790990 | controller | 2026-02-24 08:54:32.791015 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 08:54:32.791025 | controller | Tuesday 24 February 2026 08:54:32 +0000 (0:00:00.415) 0:00:48.286 ****** 2026-02-24 08:54:32.791036 | controller | ok: [instance] 2026-02-24 08:54:32.826992 | controller | 2026-02-24 08:54:32.827014 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 08:54:32.827022 | controller | Tuesday 24 February 2026 08:54:32 +0000 (0:00:00.071) 0:00:48.357 ****** 2026-02-24 08:54:32.827032 | controller | ok: [instance] 2026-02-24 08:54:33.254512 | controller | 2026-02-24 08:54:33.254556 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 08:54:33.254566 | controller | Tuesday 24 February 2026 08:54:32 +0000 (0:00:00.036) 0:00:48.393 ****** 2026-02-24 08:54:33.254578 | controller | changed: [instance] 2026-02-24 08:54:33.254624 | controller | 2026-02-24 08:54:33.254634 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-24 08:54:33.254643 | controller | Tuesday 24 February 2026 08:54:33 +0000 (0:00:00.427) 0:00:48.820 ****** 2026-02-24 08:54:33.347015 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-24 08:54:33.406525 | controller | 2026-02-24 08:54:33.406549 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-24 08:54:33.406558 | controller | Tuesday 24 February 2026 08:54:33 +0000 (0:00:00.092) 0:00:48.913 ****** 2026-02-24 08:54:33.406569 | controller | ok: [instance] => (item=public) 2026-02-24 08:54:33.875442 | controller | ok: [instance] => (item=osp_trunk) 2026-02-24 08:54:33.875467 | controller | 2026-02-24 08:54:33.875475 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-24 08:54:33.875481 | controller | Tuesday 24 February 2026 08:54:33 +0000 (0:00:00.059) 0:00:48.972 ****** 2026-02-24 08:54:33.875490 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 08:54:34.530126 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:54:34.530159 | controller | 2026-02-24 08:54:34.530167 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-24 08:54:34.530174 | controller | Tuesday 24 February 2026 08:54:33 +0000 (0:00:00.468) 0:00:49.441 ****** 2026-02-24 08:54:34.530184 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 08:54:35.007559 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:54:35.007613 | controller | 2026-02-24 08:54:35.007624 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-24 08:54:35.007632 | controller | Tuesday 24 February 2026 08:54:34 +0000 (0:00:00.654) 0:00:50.096 ****** 2026-02-24 08:54:35.007654 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 08:54:35.477217 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:54:35.477253 | controller | 2026-02-24 08:54:35.477262 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-24 08:54:35.477269 | controller | Tuesday 24 February 2026 08:54:35 +0000 (0:00:00.477) 0:00:50.573 ****** 2026-02-24 08:54:35.477279 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 08:54:35.542795 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:54:35.542813 | controller | 2026-02-24 08:54:35.542820 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-24 08:54:35.542826 | controller | Tuesday 24 February 2026 08:54:35 +0000 (0:00:00.469) 0:00:51.043 ****** 2026-02-24 08:54:35.542834 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-24 08:54:35.748331 | controller | 2026-02-24 08:54:35.748354 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-24 08:54:35.748364 | controller | Tuesday 24 February 2026 08:54:35 +0000 (0:00:00.066) 0:00:51.109 ****** 2026-02-24 08:54:35.748375 | controller | ok: [instance] 2026-02-24 08:54:36.152499 | controller | 2026-02-24 08:54:36.152531 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-24 08:54:36.152541 | controller | Tuesday 24 February 2026 08:54:35 +0000 (0:00:00.205) 0:00:51.314 ****** 2026-02-24 08:54:36.152552 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 08:54:36.152578 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:54:36.152587 | controller | 2026-02-24 08:54:36.152595 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-24 08:54:36.152615 | controller | Tuesday 24 February 2026 08:54:36 +0000 (0:00:00.404) 0:00:51.718 ****** 2026-02-24 08:54:36.222585 | controller | 2026-02-24 08:54:36.222817 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 08:54:36.222842 | controller | Tuesday 24 February 2026 08:54:36 +0000 (0:00:00.070) 0:00:51.788 ****** 2026-02-24 08:54:36.262103 | controller | skipping: [instance] 2026-02-24 08:54:37.616453 | controller | 2026-02-24 08:54:37.616477 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-24 08:54:37.616485 | controller | Tuesday 24 February 2026 08:54:36 +0000 (0:00:00.039) 0:00:51.828 ****** 2026-02-24 08:54:37.616495 | controller | ok: [instance] 2026-02-24 08:54:37.811318 | controller | 2026-02-24 08:54:37.811336 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 08:54:37.811343 | controller | Tuesday 24 February 2026 08:54:37 +0000 (0:00:01.354) 0:00:53.182 ****** 2026-02-24 08:54:37.811351 | controller | ok: [instance] 2026-02-24 08:54:38.201494 | controller | 2026-02-24 08:54:38.201531 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-24 08:54:38.201540 | controller | Tuesday 24 February 2026 08:54:37 +0000 (0:00:00.195) 0:00:53.377 ****** 2026-02-24 08:54:38.201551 | controller | changed: [instance] 2026-02-24 08:54:38.201588 | controller | 2026-02-24 08:54:38.201595 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-24 08:54:39.878528 | controller | Tuesday 24 February 2026 08:54:38 +0000 (0:00:00.390) 0:00:53.767 ****** 2026-02-24 08:54:39.878569 | controller | changed: [instance] 2026-02-24 08:54:39.878662 | controller | 2026-02-24 08:54:39.878692 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-24 08:54:39.878705 | controller | Tuesday 24 February 2026 08:54:39 +0000 (0:00:01.676) 0:00:55.444 ****** 2026-02-24 08:54:40.275921 | controller | changed: [instance] 2026-02-24 08:54:40.317725 | controller | 2026-02-24 08:54:40.317743 | controller | TASK [Create extra network configuration] ************************************** 2026-02-24 08:54:40.317751 | controller | Tuesday 24 February 2026 08:54:40 +0000 (0:00:00.397) 0:00:55.842 ****** 2026-02-24 08:54:40.317760 | controller | skipping: [instance] 2026-02-24 08:54:40.354346 | controller | 2026-02-24 08:54:40.354432 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-24 08:54:40.354445 | controller | Tuesday 24 February 2026 08:54:40 +0000 (0:00:00.041) 0:00:55.883 ****** 2026-02-24 08:54:40.354459 | controller | skipping: [instance] 2026-02-24 08:54:40.845589 | controller | 2026-02-24 08:54:40.845647 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-24 08:54:40.845658 | controller | Tuesday 24 February 2026 08:54:40 +0000 (0:00:00.036) 0:00:55.919 ****** 2026-02-24 08:54:40.845673 | controller | ok: [instance] 2026-02-24 08:54:41.004009 | controller | 2026-02-24 08:54:41.004049 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-24 08:54:41.004057 | controller | Tuesday 24 February 2026 08:54:40 +0000 (0:00:00.491) 0:00:56.411 ****** 2026-02-24 08:54:41.004067 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 08:54:42.219573 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:54:42.219649 | controller | 2026-02-24 08:54:42.219657 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-24 08:54:42.219691 | controller | Tuesday 24 February 2026 08:54:41 +0000 (0:00:00.158) 0:00:56.569 ****** 2026-02-24 08:54:42.219705 | controller | ok: [instance] 2026-02-24 08:54:46.127497 | controller | 2026-02-24 08:54:46.127533 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-24 08:54:46.127541 | controller | Tuesday 24 February 2026 08:54:42 +0000 (0:00:01.214) 0:00:57.784 ****** 2026-02-24 08:54:46.127552 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 08:54:46.127575 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 08:54:46.127581 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-24 08:54:46.127586 | controller | 2026-02-24 08:54:46.127593 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-24 08:54:46.127791 | controller | Tuesday 24 February 2026 08:54:46 +0000 (0:00:03.908) 0:01:01.693 ****** 2026-02-24 08:54:46.364497 | controller | changed: [instance] 2026-02-24 08:54:46.746215 | controller | 2026-02-24 08:54:46.746257 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-24 08:54:46.746268 | controller | Tuesday 24 February 2026 08:54:46 +0000 (0:00:00.237) 0:01:01.930 ****** 2026-02-24 08:54:46.746281 | controller | changed: [instance] 2026-02-24 08:54:47.221356 | controller | 2026-02-24 08:54:47.221394 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-24 08:54:47.221405 | controller | Tuesday 24 February 2026 08:54:46 +0000 (0:00:00.381) 0:01:02.312 ****** 2026-02-24 08:54:47.221437 | controller | changed: [instance] 2026-02-24 08:54:47.259060 | controller | 2026-02-24 08:54:47.259081 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-24 08:54:47.259090 | controller | Tuesday 24 February 2026 08:54:47 +0000 (0:00:00.475) 0:01:02.787 ****** 2026-02-24 08:54:47.259101 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-24 08:54:47.684353 | controller | 2026-02-24 08:54:47.684397 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-24 08:54:47.684428 | controller | Tuesday 24 February 2026 08:54:47 +0000 (0:00:00.038) 0:01:02.825 ****** 2026-02-24 08:54:47.684447 | controller | changed: [instance] 2026-02-24 08:54:47.709383 | controller | 2026-02-24 08:54:47.709427 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-24 08:54:47.709442 | controller | Tuesday 24 February 2026 08:54:47 +0000 (0:00:00.424) 0:01:03.250 ****** 2026-02-24 08:54:47.709453 | controller | skipping: [instance] 2026-02-24 08:54:47.749520 | controller | 2026-02-24 08:54:47.749560 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-24 08:54:47.749571 | controller | Tuesday 24 February 2026 08:54:47 +0000 (0:00:00.025) 0:01:03.275 ****** 2026-02-24 08:54:47.749584 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-24 08:54:47.749742 | controller | 2026-02-24 08:54:48.192549 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-24 08:54:48.192577 | controller | Tuesday 24 February 2026 08:54:47 +0000 (0:00:00.040) 0:01:03.316 ****** 2026-02-24 08:54:48.192588 | controller | changed: [instance] 2026-02-24 08:54:48.214537 | controller | 2026-02-24 08:54:48.214572 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-24 08:54:48.214582 | controller | Tuesday 24 February 2026 08:54:48 +0000 (0:00:00.442) 0:01:03.758 ****** 2026-02-24 08:54:48.214611 | controller | skipping: [instance] 2026-02-24 08:54:48.214691 | controller | 2026-02-24 08:54:48.214710 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-24 08:54:48.214722 | controller | Tuesday 24 February 2026 08:54:48 +0000 (0:00:00.022) 0:01:03.781 ****** 2026-02-24 08:54:48.447312 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-24 08:54:49.166522 | controller | 2026-02-24 08:54:49.166561 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-24 08:54:49.166572 | controller | Tuesday 24 February 2026 08:54:48 +0000 (0:00:00.232) 0:01:04.013 ****** 2026-02-24 08:54:49.166585 | controller | changed: [instance] 2026-02-24 08:54:49.166631 | controller | 2026-02-24 08:54:49.166643 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-24 08:54:49.190040 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.718) 0:01:04.732 ****** 2026-02-24 08:54:49.190086 | controller | skipping: [instance] 2026-02-24 08:54:49.213552 | controller | 2026-02-24 08:54:49.213579 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-24 08:54:49.213589 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.023) 0:01:04.756 ****** 2026-02-24 08:54:49.213601 | controller | skipping: [instance] 2026-02-24 08:54:49.248502 | controller | 2026-02-24 08:54:49.248520 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-24 08:54:49.248528 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.023) 0:01:04.779 ****** 2026-02-24 08:54:49.248542 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 08:54:49.367953 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-24 08:54:49.367985 | controller | skipping: [instance] 2026-02-24 08:54:49.367999 | controller | 2026-02-24 08:54:49.368010 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-24 08:54:49.368020 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.034) 0:01:04.814 ****** 2026-02-24 08:54:49.368034 | controller | 2026-02-24 08:54:49.399176 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 08:54:49.399196 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.120) 0:01:04.934 ****** 2026-02-24 08:54:49.399208 | controller | ok: [instance] => changed=false 2026-02-24 08:54:49.399367 | controller | msg: All assertions passed 2026-02-24 08:54:49.399577 | controller | 2026-02-24 08:54:49.399745 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 08:54:49.399863 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.031) 0:01:04.966 ****** 2026-02-24 08:54:49.437308 | controller | ok: [instance] => changed=false 2026-02-24 08:54:49.437514 | controller | msg: All assertions passed 2026-02-24 08:54:49.437678 | controller | 2026-02-24 08:54:49.437836 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 08:54:49.437993 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.037) 0:01:05.003 ****** 2026-02-24 08:54:49.908582 | controller | changed: [instance] 2026-02-24 08:54:49.908652 | controller | 2026-02-24 08:54:49.908664 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 08:54:49.908785 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.470) 0:01:05.474 ****** 2026-02-24 08:54:49.931570 | controller | skipping: [instance] 2026-02-24 08:54:49.959524 | controller | 2026-02-24 08:54:49.959548 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 08:54:49.959558 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.023) 0:01:05.498 ****** 2026-02-24 08:54:49.959568 | controller | skipping: [instance] 2026-02-24 08:54:49.959601 | controller | 2026-02-24 08:54:49.959826 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 08:54:49.994079 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.028) 0:01:05.526 ****** 2026-02-24 08:54:49.994110 | controller | ok: [instance] => changed=false 2026-02-24 08:54:50.035298 | controller | msg: All assertions passed 2026-02-24 08:54:50.035320 | controller | 2026-02-24 08:54:50.035327 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 08:54:50.035338 | controller | Tuesday 24 February 2026 08:54:49 +0000 (0:00:00.034) 0:01:05.560 ****** 2026-02-24 08:54:50.035347 | controller | ok: [instance] => changed=false 2026-02-24 08:54:50.496569 | controller | msg: All assertions passed 2026-02-24 08:54:50.496623 | controller | 2026-02-24 08:54:50.496634 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 08:54:50.496643 | controller | Tuesday 24 February 2026 08:54:50 +0000 (0:00:00.041) 0:01:05.601 ****** 2026-02-24 08:54:50.496655 | controller | changed: [instance] 2026-02-24 08:54:50.496687 | controller | 2026-02-24 08:54:50.496697 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 08:54:50.496823 | controller | Tuesday 24 February 2026 08:54:50 +0000 (0:00:00.460) 0:01:06.062 ****** 2026-02-24 08:54:50.520584 | controller | skipping: [instance] 2026-02-24 08:54:50.520667 | controller | 2026-02-24 08:54:50.520685 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 08:54:50.520802 | controller | Tuesday 24 February 2026 08:54:50 +0000 (0:00:00.024) 0:01:06.087 ****** 2026-02-24 08:54:50.550016 | controller | skipping: [instance] 2026-02-24 08:54:50.585222 | controller | 2026-02-24 08:54:50.585251 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-24 08:54:50.585261 | controller | Tuesday 24 February 2026 08:54:50 +0000 (0:00:00.029) 0:01:06.116 ****** 2026-02-24 08:54:50.585272 | controller | skipping: [instance] 2026-02-24 08:54:51.116305 | controller | 2026-02-24 08:54:51.116335 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-24 08:54:51.116344 | controller | Tuesday 24 February 2026 08:54:50 +0000 (0:00:00.035) 0:01:06.151 ****** 2026-02-24 08:54:51.116354 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 08:54:51.116427 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:54:51.116461 | controller | 2026-02-24 08:54:51.116470 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 08:54:51.116481 | controller | Tuesday 24 February 2026 08:54:51 +0000 (0:00:00.530) 0:01:06.681 ****** 2026-02-24 08:54:51.155258 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-24 08:54:51.516735 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-24 08:54:51.516769 | controller | 2026-02-24 08:54:51.516777 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 08:54:51.516783 | controller | Tuesday 24 February 2026 08:54:51 +0000 (0:00:00.039) 0:01:06.721 ****** 2026-02-24 08:54:51.516793 | controller | ok: [instance] 2026-02-24 08:54:51.555865 | controller | 2026-02-24 08:54:51.555893 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 08:54:51.555907 | controller | Tuesday 24 February 2026 08:54:51 +0000 (0:00:00.361) 0:01:07.082 ****** 2026-02-24 08:54:51.555919 | controller | ok: [instance] 2026-02-24 08:54:51.788548 | controller | 2026-02-24 08:54:51.788585 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 08:54:51.788595 | controller | Tuesday 24 February 2026 08:54:51 +0000 (0:00:00.039) 0:01:07.122 ****** 2026-02-24 08:54:51.788620 | controller | ok: [instance] 2026-02-24 08:54:51.788652 | controller | 2026-02-24 08:54:51.788784 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 08:54:51.788814 | controller | Tuesday 24 February 2026 08:54:51 +0000 (0:00:00.232) 0:01:07.355 ****** 2026-02-24 08:54:51.833223 | controller | ok: [instance] 2026-02-24 08:54:52.213899 | controller | 2026-02-24 08:54:52.213929 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-24 08:54:52.213939 | controller | Tuesday 24 February 2026 08:54:51 +0000 (0:00:00.044) 0:01:07.399 ****** 2026-02-24 08:54:52.213952 | controller | changed: [instance] 2026-02-24 08:54:52.592499 | controller | 2026-02-24 08:54:52.592563 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-24 08:54:52.592579 | controller | Tuesday 24 February 2026 08:54:52 +0000 (0:00:00.380) 0:01:07.780 ****** 2026-02-24 08:54:52.592592 | controller | changed: [instance] 2026-02-24 08:54:52.592641 | controller | 2026-02-24 08:54:52.592810 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-24 08:54:52.592862 | controller | Tuesday 24 February 2026 08:54:52 +0000 (0:00:00.378) 0:01:08.158 ****** 2026-02-24 08:54:53.124158 | controller | changed: [instance] 2026-02-24 08:54:53.219793 | controller | 2026-02-24 08:54:53.219830 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-24 08:54:53.219841 | controller | Tuesday 24 February 2026 08:54:53 +0000 (0:00:00.531) 0:01:08.690 ****** 2026-02-24 08:54:53.219855 | controller | ok: [instance] 2026-02-24 08:54:53.593386 | controller | 2026-02-24 08:54:53.593430 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-24 08:54:53.593442 | controller | Tuesday 24 February 2026 08:54:53 +0000 (0:00:00.095) 0:01:08.785 ****** 2026-02-24 08:54:53.593452 | controller | changed: [instance] 2026-02-24 08:54:53.624029 | controller | 2026-02-24 08:54:53.624061 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 08:54:53.624075 | controller | Tuesday 24 February 2026 08:54:53 +0000 (0:00:00.374) 0:01:09.159 ****** 2026-02-24 08:54:53.624090 | controller | skipping: [instance] 2026-02-24 08:54:53.651807 | controller | 2026-02-24 08:54:53.651824 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 08:54:53.651831 | controller | Tuesday 24 February 2026 08:54:53 +0000 (0:00:00.030) 0:01:09.190 ****** 2026-02-24 08:54:53.651839 | controller | skipping: [instance] 2026-02-24 08:54:53.680444 | controller | 2026-02-24 08:54:53.680478 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 08:54:53.680492 | controller | Tuesday 24 February 2026 08:54:53 +0000 (0:00:00.027) 0:01:09.218 ****** 2026-02-24 08:54:53.680507 | controller | skipping: [instance] 2026-02-24 08:54:53.708392 | controller | 2026-02-24 08:54:53.708431 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 08:54:53.708443 | controller | Tuesday 24 February 2026 08:54:53 +0000 (0:00:00.028) 0:01:09.246 ****** 2026-02-24 08:54:53.708454 | controller | skipping: [instance] 2026-02-24 08:54:53.733601 | controller | 2026-02-24 08:54:53.733659 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 08:54:53.733673 | controller | Tuesday 24 February 2026 08:54:53 +0000 (0:00:00.028) 0:01:09.274 ****** 2026-02-24 08:54:53.733691 | controller | ok: [instance] 2026-02-24 08:54:53.829025 | controller | 2026-02-24 08:54:53.829058 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 08:54:53.829071 | controller | Tuesday 24 February 2026 08:54:53 +0000 (0:00:00.024) 0:01:09.299 ****** 2026-02-24 08:54:53.829091 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 08:54:53.829290 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-24 08:54:53.829436 | controller | 2026-02-24 08:54:53.829576 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 08:54:53.829710 | controller | Tuesday 24 February 2026 08:54:53 +0000 (0:00:00.095) 0:01:09.395 ****** 2026-02-24 08:54:53.852791 | controller | skipping: [instance] 2026-02-24 08:54:53.853050 | controller | 2026-02-24 08:54:53.853235 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 08:54:53.853364 | controller | Tuesday 24 February 2026 08:54:53 +0000 (0:00:00.023) 0:01:09.419 ****** 2026-02-24 08:54:54.091535 | controller | ok: [instance] 2026-02-24 08:54:54.500055 | controller | 2026-02-24 08:54:54.500092 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 08:54:54.500101 | controller | Tuesday 24 February 2026 08:54:54 +0000 (0:00:00.238) 0:01:09.657 ****** 2026-02-24 08:54:54.500112 | controller | changed: [instance] 2026-02-24 08:54:54.601838 | controller | 2026-02-24 08:54:54.601858 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 08:54:54.601865 | controller | Tuesday 24 February 2026 08:54:54 +0000 (0:00:00.408) 0:01:10.066 ****** 2026-02-24 08:54:54.601875 | controller | ok: [instance] 2026-02-24 08:54:54.636200 | controller | 2026-02-24 08:54:54.636229 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 08:54:54.636241 | controller | Tuesday 24 February 2026 08:54:54 +0000 (0:00:00.101) 0:01:10.168 ****** 2026-02-24 08:54:54.636256 | controller | ok: [instance] 2026-02-24 08:54:55.076373 | controller | 2026-02-24 08:54:55.076398 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 08:54:55.076407 | controller | Tuesday 24 February 2026 08:54:54 +0000 (0:00:00.034) 0:01:10.202 ****** 2026-02-24 08:54:55.076436 | controller | changed: [instance] 2026-02-24 08:54:55.111665 | controller | 2026-02-24 08:54:55.111704 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-24 08:54:55.111713 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.440) 0:01:10.642 ****** 2026-02-24 08:54:55.111726 | controller | ok: [instance] 2026-02-24 08:54:55.111755 | controller | 2026-02-24 08:54:55.111765 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-24 08:54:55.111834 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.035) 0:01:10.678 ****** 2026-02-24 08:54:55.131955 | controller | ok: [instance] 2026-02-24 08:54:55.153434 | controller | 2026-02-24 08:54:55.153457 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-24 08:54:55.153466 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.020) 0:01:10.698 ****** 2026-02-24 08:54:55.153477 | controller | ok: [instance] 2026-02-24 08:54:55.227540 | controller | 2026-02-24 08:54:55.227577 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-24 08:54:55.227593 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.021) 0:01:10.719 ****** 2026-02-24 08:54:55.227618 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-24 08:54:55.227652 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-24 08:54:55.228423 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-24 08:54:55.363047 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-24 08:54:55.363080 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-24 08:54:55.363094 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-24 08:54:55.363104 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-24 08:54:55.363114 | controller | 2026-02-24 08:54:55.363124 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 08:54:55.363134 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.074) 0:01:10.794 ****** 2026-02-24 08:54:55.363148 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-24 08:54:55.363406 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-24 08:54:55.363733 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-24 08:54:55.363960 | controller | 2026-02-24 08:54:55.364191 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 08:54:55.364349 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.135) 0:01:10.929 ****** 2026-02-24 08:54:55.444080 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-24 08:54:55.444294 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-24 08:54:55.444438 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-24 08:54:55.444574 | controller | skipping: [instance] 2026-02-24 08:54:55.444699 | controller | 2026-02-24 08:54:55.444825 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 08:54:55.444940 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.080) 0:01:11.010 ****** 2026-02-24 08:54:55.526689 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-24 08:54:55.526970 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-24 08:54:55.527213 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-24 08:54:55.527438 | controller | skipping: [instance] 2026-02-24 08:54:55.527567 | controller | 2026-02-24 08:54:55.527720 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 08:54:55.527842 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.082) 0:01:11.093 ****** 2026-02-24 08:54:55.608884 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-24 08:54:55.609161 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-24 08:54:55.609400 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-24 08:54:55.609631 | controller | skipping: [instance] 2026-02-24 08:54:55.609748 | controller | 2026-02-24 08:54:55.609865 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 08:54:55.609979 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.082) 0:01:11.175 ****** 2026-02-24 08:54:55.705985 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-24 08:54:55.706260 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-24 08:54:55.706545 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-24 08:54:55.706768 | controller | skipping: [instance] 2026-02-24 08:54:55.706878 | controller | 2026-02-24 08:54:55.706993 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 08:54:55.707114 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.096) 0:01:11.272 ****** 2026-02-24 08:54:55.802163 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-24 08:54:55.802489 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-24 08:54:55.802774 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-24 08:54:55.802946 | controller | skipping: [instance] 2026-02-24 08:54:55.803064 | controller | 2026-02-24 08:54:55.803198 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 08:54:55.803324 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.096) 0:01:11.368 ****** 2026-02-24 08:54:55.949812 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-24 08:54:55.950092 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-24 08:54:55.950267 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-24 08:54:55.950378 | controller | 2026-02-24 08:54:55.950522 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-24 08:54:55.950662 | controller | Tuesday 24 February 2026 08:54:55 +0000 (0:00:00.147) 0:01:11.516 ****** 2026-02-24 08:54:56.061355 | controller | 2026-02-24 08:54:56.061575 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-24 08:54:56.061769 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.111) 0:01:11.628 ****** 2026-02-24 08:54:56.105346 | controller | ok: [instance] 2026-02-24 08:54:56.211324 | controller | 2026-02-24 08:54:56.211343 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-24 08:54:56.211350 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.043) 0:01:11.671 ****** 2026-02-24 08:54:56.211360 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:37:b6:3b', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 08:54:56.266992 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:85:87:d9', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 08:54:56.267009 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:5b:81:46', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 08:54:56.267016 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:10:66:7b', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 08:54:56.267022 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:6c:4e:e5', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 08:54:56.267028 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:80:f1:b1', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 08:54:56.267033 | controller | 2026-02-24 08:54:56.267039 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-24 08:54:56.267044 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.105) 0:01:11.777 ****** 2026-02-24 08:54:56.267053 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-24 08:54:56.447655 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-24 08:54:56.447700 | controller | 2026-02-24 08:54:56.447710 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 08:54:56.447719 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.055) 0:01:11.833 ****** 2026-02-24 08:54:56.447731 | controller | ok: [instance] 2026-02-24 08:54:56.474088 | controller | 2026-02-24 08:54:56.474111 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 08:54:56.474119 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.180) 0:01:12.013 ****** 2026-02-24 08:54:56.474129 | controller | ok: [instance] 2026-02-24 08:54:56.669023 | controller | 2026-02-24 08:54:56.669045 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 08:54:56.669053 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.026) 0:01:12.040 ****** 2026-02-24 08:54:56.669062 | controller | ok: [instance] 2026-02-24 08:54:56.694647 | controller | 2026-02-24 08:54:56.694665 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 08:54:56.694673 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.194) 0:01:12.235 ****** 2026-02-24 08:54:56.694682 | controller | ok: [instance] 2026-02-24 08:54:56.715504 | controller | 2026-02-24 08:54:56.715544 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-24 08:54:56.715553 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.025) 0:01:12.260 ****** 2026-02-24 08:54:56.715564 | controller | ok: [instance] 2026-02-24 08:54:56.715591 | controller | 2026-02-24 08:54:56.715889 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-24 08:54:56.900499 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.021) 0:01:12.281 ****** 2026-02-24 08:54:56.900527 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:37:b6:3b', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 08:54:56.900556 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:85:87:d9', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 08:54:56.900566 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:5b:81:46', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 08:54:56.901120 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:10:66:7b', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 08:54:56.941015 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:6c:4e:e5', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 08:54:56.941036 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:80:f1:b1', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 08:54:56.941045 | controller | 2026-02-24 08:54:56.941052 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-24 08:54:56.941057 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.185) 0:01:12.467 ****** 2026-02-24 08:54:56.941065 | controller | ok: [instance] 2026-02-24 08:54:59.122586 | controller | 2026-02-24 08:54:59.122634 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-24 08:54:59.122644 | controller | Tuesday 24 February 2026 08:54:56 +0000 (0:00:00.040) 0:01:12.507 ****** 2026-02-24 08:54:59.122656 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:37:b6:3b', 'entry': 'set:compute,52:54:00:37:b6:3b,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-24 08:54:59.122689 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:85:87:d9', 'entry': 'set:controller,52:54:01:85:87:d9,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-24 08:54:59.122697 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:5b:81:46', 'entry': 'set:ocp,52:54:02:5b:81:46,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-24 08:54:59.122704 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:10:66:7b', 'entry': 'set:compute,52:54:00:10:66:7b,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-24 08:54:59.122710 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:6c:4e:e5', 'entry': 'set:controller,52:54:01:6c:4e:e5,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-24 08:54:59.122716 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:80:f1:b1', 'entry': 'set:ocp,52:54:02:80:f1:b1,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-24 08:54:59.122722 | controller | 2026-02-24 08:54:59.122731 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-24 08:54:59.145152 | controller | Tuesday 24 February 2026 08:54:59 +0000 (0:00:02.180) 0:01:14.687 ****** 2026-02-24 08:54:59.145198 | controller | skipping: [instance] 2026-02-24 08:54:59.357665 | controller | 2026-02-24 08:54:59.357701 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-24 08:54:59.357711 | controller | Tuesday 24 February 2026 08:54:59 +0000 (0:00:00.023) 0:01:14.711 ****** 2026-02-24 08:54:59.357723 | controller | ok: [instance] => (item=compute-0) 2026-02-24 08:54:59.357756 | controller | ok: [instance] => (item=controller-0) 2026-02-24 08:54:59.358026 | controller | ok: [instance] => (item=crc-0) 2026-02-24 08:54:59.358049 | controller | 2026-02-24 08:54:59.541009 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-24 08:54:59.541027 | controller | Tuesday 24 February 2026 08:54:59 +0000 (0:00:00.212) 0:01:14.923 ****** 2026-02-24 08:54:59.541037 | controller | 2026-02-24 08:54:59.592150 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 08:54:59.592168 | controller | Tuesday 24 February 2026 08:54:59 +0000 (0:00:00.181) 0:01:15.105 ****** 2026-02-24 08:54:59.592187 | controller | ok: [instance] 2026-02-24 08:54:59.835659 | controller | 2026-02-24 08:54:59.835693 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 08:54:59.835707 | controller | Tuesday 24 February 2026 08:54:59 +0000 (0:00:00.052) 0:01:15.158 ****** 2026-02-24 08:54:59.835723 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 08:54:59.835987 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 08:54:59.836230 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 08:54:59.836517 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 08:54:59.836680 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 08:54:59.836811 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 08:54:59.836932 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 08:54:59.837058 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 08:54:59.837176 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 08:54:59.837292 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 08:54:59.837431 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 08:54:59.837566 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 08:54:59.837694 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 08:54:59.837811 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 08:54:59.837925 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 08:54:59.838090 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 08:54:59.838198 | controller | 2026-02-24 08:54:59.838312 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 08:54:59.838451 | controller | Tuesday 24 February 2026 08:54:59 +0000 (0:00:00.243) 0:01:15.402 ****** 2026-02-24 08:55:03.175541 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.175728 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.175751 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.175760 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.175770 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.175796 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.175806 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.176526 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 08:55:03.176583 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 08:55:03.176592 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 08:55:03.176599 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.176615 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.176621 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.176627 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.176632 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.176640 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.176912 | controller | 2026-02-24 08:55:03.568490 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 08:55:03.568519 | controller | Tuesday 24 February 2026 08:55:03 +0000 (0:00:03.339) 0:01:18.741 ****** 2026-02-24 08:55:03.568534 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.569939 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.569960 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.569968 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.569977 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.593517 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.593547 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 08:55:03.593557 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 08:55:03.593565 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 08:55:03.593572 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 08:55:03.593579 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.593585 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.593592 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.593598 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.593615 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.593623 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 08:55:03.593636 | controller | 2026-02-24 08:55:03.593643 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-24 08:55:03.593650 | controller | Tuesday 24 February 2026 08:55:03 +0000 (0:00:00.392) 0:01:19.134 ****** 2026-02-24 08:55:03.593662 | controller | ok: [instance] 2026-02-24 08:55:03.651616 | controller | 2026-02-24 08:55:03.651666 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-24 08:55:03.651681 | controller | Tuesday 24 February 2026 08:55:03 +0000 (0:00:00.025) 0:01:19.159 ****** 2026-02-24 08:55:03.651698 | controller | skipping: [instance] => (item=compute) 2026-02-24 08:55:03.651745 | controller | skipping: [instance] => (item=controller) 2026-02-24 08:55:03.651757 | controller | skipping: [instance] => (item=crc) 2026-02-24 08:55:03.651770 | controller | skipping: [instance] 2026-02-24 08:55:03.651804 | controller | 2026-02-24 08:55:03.651817 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-24 08:55:03.651880 | controller | Tuesday 24 February 2026 08:55:03 +0000 (0:00:00.058) 0:01:19.218 ****** 2026-02-24 08:55:03.688546 | controller | skipping: [instance] 2026-02-24 08:55:03.688771 | controller | 2026-02-24 08:55:03.688796 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-24 08:55:04.084546 | controller | Tuesday 24 February 2026 08:55:03 +0000 (0:00:00.037) 0:01:19.255 ****** 2026-02-24 08:55:04.084584 | controller | changed: [instance] 2026-02-24 08:55:04.084621 | controller | 2026-02-24 08:55:04.084632 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-24 08:55:04.084958 | controller | Tuesday 24 February 2026 08:55:04 +0000 (0:00:00.384) 0:01:19.639 ****** 2026-02-24 08:55:04.778228 | controller | 2026-02-24 08:55:04.778263 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 08:55:04.778274 | controller | Tuesday 24 February 2026 08:55:04 +0000 (0:00:00.011) 0:01:19.650 ****** 2026-02-24 08:55:04.778287 | controller | changed: [instance] 2026-02-24 08:55:04.778529 | controller | 2026-02-24 08:55:04.778554 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 08:55:05.165533 | controller | Tuesday 24 February 2026 08:55:04 +0000 (0:00:00.693) 0:01:20.344 ****** 2026-02-24 08:55:05.165568 | controller | changed: [instance] 2026-02-24 08:55:05.165593 | controller | 2026-02-24 08:55:05.165611 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-24 08:55:05.165621 | controller | Tuesday 24 February 2026 08:55:05 +0000 (0:00:00.386) 0:01:20.731 ****** 2026-02-24 08:55:05.546303 | controller | changed: [instance] 2026-02-24 08:55:05.951388 | controller | 2026-02-24 08:55:05.951437 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-24 08:55:05.951452 | controller | Tuesday 24 February 2026 08:55:05 +0000 (0:00:00.380) 0:01:21.112 ****** 2026-02-24 08:55:05.951464 | controller | changed: [instance] 2026-02-24 08:55:06.378592 | controller | 2026-02-24 08:55:06.378646 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-24 08:55:06.378656 | controller | Tuesday 24 February 2026 08:55:05 +0000 (0:00:00.405) 0:01:21.517 ****** 2026-02-24 08:55:06.378670 | controller | changed: [instance] 2026-02-24 08:55:06.422614 | controller | 2026-02-24 08:55:06.422653 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-24 08:55:06.422661 | controller | Tuesday 24 February 2026 08:55:06 +0000 (0:00:00.427) 0:01:21.944 ****** 2026-02-24 08:55:06.422672 | controller | 2026-02-24 08:55:06.422701 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 08:55:06.422709 | controller | Tuesday 24 February 2026 08:55:06 +0000 (0:00:00.044) 0:01:21.989 ****** 2026-02-24 08:55:06.536403 | controller | ok: [instance] 2026-02-24 08:55:06.648484 | controller | 2026-02-24 08:55:06.648502 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 08:55:06.648510 | controller | Tuesday 24 February 2026 08:55:06 +0000 (0:00:00.113) 0:01:22.102 ****** 2026-02-24 08:55:06.648524 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 08:55:07.149187 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 08:55:07.149206 | controller | 2026-02-24 08:55:07.149214 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 08:55:07.149220 | controller | Tuesday 24 February 2026 08:55:06 +0000 (0:00:00.111) 0:01:22.214 ****** 2026-02-24 08:55:07.149229 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 08:55:07.481641 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 08:55:07.481689 | controller | 2026-02-24 08:55:07.481703 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 08:55:07.481714 | controller | Tuesday 24 February 2026 08:55:07 +0000 (0:00:00.501) 0:01:22.715 ****** 2026-02-24 08:55:07.481731 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 08:55:09.020486 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 08:55:09.020528 | controller | 2026-02-24 08:55:09.020537 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-24 08:55:09.020543 | controller | Tuesday 24 February 2026 08:55:07 +0000 (0:00:00.320) 0:01:23.035 ****** 2026-02-24 08:55:09.020548 | controller | 2026-02-24 08:55:09.020554 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 08:55:09.020559 | controller | Tuesday 24 February 2026 08:55:07 +0000 (0:00:00.011) 0:01:23.047 ****** 2026-02-24 08:55:09.020569 | controller | changed: [instance] 2026-02-24 08:55:09.020606 | controller | 2026-02-24 08:55:09.020720 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 08:55:09.020843 | controller | Tuesday 24 February 2026 08:55:09 +0000 (0:00:01.539) 0:01:24.586 ****** 2026-02-24 08:55:09.414235 | controller | changed: [instance] 2026-02-24 08:55:09.453015 | controller | 2026-02-24 08:55:09.453040 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-24 08:55:09.453051 | controller | Tuesday 24 February 2026 08:55:09 +0000 (0:00:00.393) 0:01:24.980 ****** 2026-02-24 08:55:09.453063 | controller | skipping: [instance] 2026-02-24 08:55:09.540637 | controller | 2026-02-24 08:55:09.540690 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-24 08:55:09.540704 | controller | Tuesday 24 February 2026 08:55:09 +0000 (0:00:00.039) 0:01:25.019 ****** 2026-02-24 08:55:09.540722 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-24 08:55:09.540769 | controller | 2026-02-24 08:55:09.540783 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-24 08:55:09.753478 | controller | Tuesday 24 February 2026 08:55:09 +0000 (0:00:00.087) 0:01:25.107 ****** 2026-02-24 08:55:09.753503 | controller | ok: [instance] 2026-02-24 08:55:09.777271 | controller | 2026-02-24 08:55:09.777304 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-24 08:55:09.777318 | controller | Tuesday 24 February 2026 08:55:09 +0000 (0:00:00.212) 0:01:25.320 ****** 2026-02-24 08:55:09.777333 | controller | skipping: [instance] 2026-02-24 08:55:10.131837 | controller | 2026-02-24 08:55:10.131857 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-24 08:55:10.131865 | controller | Tuesday 24 February 2026 08:55:09 +0000 (0:00:00.023) 0:01:25.343 ****** 2026-02-24 08:55:10.131874 | controller | ok: [instance] 2026-02-24 08:55:10.399708 | controller | 2026-02-24 08:55:10.399773 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-24 08:55:10.399784 | controller | Tuesday 24 February 2026 08:55:10 +0000 (0:00:00.354) 0:01:25.698 ****** 2026-02-24 08:55:10.399799 | controller | ok: [instance] 2026-02-24 08:55:10.641629 | controller | 2026-02-24 08:55:10.641679 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-24 08:55:10.641690 | controller | Tuesday 24 February 2026 08:55:10 +0000 (0:00:00.267) 0:01:25.965 ****** 2026-02-24 08:55:10.641704 | controller | ok: [instance] 2026-02-24 08:55:10.885135 | controller | 2026-02-24 08:55:10.885161 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-24 08:55:10.885169 | controller | Tuesday 24 February 2026 08:55:10 +0000 (0:00:00.242) 0:01:26.208 ****** 2026-02-24 08:55:10.885179 | controller | ok: [instance] 2026-02-24 08:55:11.132551 | controller | 2026-02-24 08:55:11.132612 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-24 08:55:11.132625 | controller | Tuesday 24 February 2026 08:55:10 +0000 (0:00:00.243) 0:01:26.451 ****** 2026-02-24 08:55:11.132642 | controller | ok: [instance] 2026-02-24 08:55:11.178110 | controller | 2026-02-24 08:55:11.178142 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 08:55:11.178152 | controller | Tuesday 24 February 2026 08:55:11 +0000 (0:00:00.247) 0:01:26.699 ****** 2026-02-24 08:55:11.178165 | controller | 2026-02-24 08:55:11.390638 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 08:55:11.390717 | controller | Tuesday 24 February 2026 08:55:11 +0000 (0:00:00.045) 0:01:26.744 ****** 2026-02-24 08:55:11.390750 | controller | ok: [instance] 2026-02-24 08:55:11.420473 | controller | 2026-02-24 08:55:11.420520 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 08:55:11.420535 | controller | Tuesday 24 February 2026 08:55:11 +0000 (0:00:00.212) 0:01:26.957 ****** 2026-02-24 08:55:11.420547 | controller | ok: [instance] 2026-02-24 08:55:11.450582 | controller | 2026-02-24 08:55:11.450640 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 08:55:11.450649 | controller | Tuesday 24 February 2026 08:55:11 +0000 (0:00:00.029) 0:01:26.986 ****** 2026-02-24 08:55:11.450658 | controller | skipping: [instance] 2026-02-24 08:55:11.773435 | controller | 2026-02-24 08:55:11.773453 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-24 08:55:11.773460 | controller | Tuesday 24 February 2026 08:55:11 +0000 (0:00:00.030) 0:01:27.016 ****** 2026-02-24 08:55:11.773468 | controller | ok: [instance] 2026-02-24 08:55:12.018472 | controller | 2026-02-24 08:55:12.018493 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-24 08:55:12.018501 | controller | Tuesday 24 February 2026 08:55:11 +0000 (0:00:00.322) 0:01:27.339 ****** 2026-02-24 08:55:12.018510 | controller | ok: [instance] 2026-02-24 08:55:12.018863 | controller | 2026-02-24 08:55:12.220477 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-24 08:55:12.220525 | controller | Tuesday 24 February 2026 08:55:12 +0000 (0:00:00.245) 0:01:27.585 ****** 2026-02-24 08:55:12.220542 | controller | ok: [instance] 2026-02-24 08:55:12.283177 | controller | 2026-02-24 08:55:12.283200 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-24 08:55:12.283208 | controller | Tuesday 24 February 2026 08:55:12 +0000 (0:00:00.201) 0:01:27.786 ****** 2026-02-24 08:55:12.283218 | controller | 2026-02-24 08:55:12.336578 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 08:55:12.336625 | controller | Tuesday 24 February 2026 08:55:12 +0000 (0:00:00.062) 0:01:27.849 ****** 2026-02-24 08:55:12.336640 | controller | ok: [instance] => changed=false 2026-02-24 08:55:12.336671 | controller | msg: All assertions passed 2026-02-24 08:55:12.336679 | controller | 2026-02-24 08:55:12.336688 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 08:55:12.336733 | controller | Tuesday 24 February 2026 08:55:12 +0000 (0:00:00.053) 0:01:27.903 ****** 2026-02-24 08:55:12.532889 | controller | ok: [instance] 2026-02-24 08:55:12.749104 | controller | 2026-02-24 08:55:12.749122 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 08:55:12.749129 | controller | Tuesday 24 February 2026 08:55:12 +0000 (0:00:00.196) 0:01:28.099 ****** 2026-02-24 08:55:12.749139 | controller | ok: [instance] 2026-02-24 08:55:12.780924 | controller | 2026-02-24 08:55:12.780940 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 08:55:12.780947 | controller | Tuesday 24 February 2026 08:55:12 +0000 (0:00:00.216) 0:01:28.315 ****** 2026-02-24 08:55:12.780955 | controller | ok: [instance] => changed=false 2026-02-24 08:55:12.988165 | controller | msg: All assertions passed 2026-02-24 08:55:12.988198 | controller | 2026-02-24 08:55:12.988212 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 08:55:12.988222 | controller | Tuesday 24 February 2026 08:55:12 +0000 (0:00:00.031) 0:01:28.347 ****** 2026-02-24 08:55:12.988238 | controller | ok: [instance] 2026-02-24 08:55:13.185528 | controller | 2026-02-24 08:55:13.185571 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 08:55:13.185580 | controller | Tuesday 24 February 2026 08:55:12 +0000 (0:00:00.206) 0:01:28.554 ****** 2026-02-24 08:55:13.185603 | controller | ok: [instance] 2026-02-24 08:55:13.185631 | controller | 2026-02-24 08:55:13.185639 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 08:55:13.185819 | controller | Tuesday 24 February 2026 08:55:13 +0000 (0:00:00.197) 0:01:28.751 ****** 2026-02-24 08:55:13.241076 | controller | ok: [instance] 2026-02-24 08:55:13.677584 | controller | 2026-02-24 08:55:13.677656 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-24 08:55:13.677668 | controller | Tuesday 24 February 2026 08:55:13 +0000 (0:00:00.055) 0:01:28.807 ****** 2026-02-24 08:55:13.677683 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-24 08:55:13.677711 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-24 08:55:13.677743 | controller | 2026-02-24 08:55:13.677752 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-24 08:55:13.677892 | controller | Tuesday 24 February 2026 08:55:13 +0000 (0:00:00.436) 0:01:29.244 ****** 2026-02-24 08:55:13.707149 | controller | skipping: [instance] 2026-02-24 08:55:13.739001 | controller | 2026-02-24 08:55:13.739017 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-24 08:55:13.739029 | controller | Tuesday 24 February 2026 08:55:13 +0000 (0:00:00.029) 0:01:29.273 ****** 2026-02-24 08:55:13.739038 | controller | skipping: [instance] 2026-02-24 08:55:13.879206 | controller | 2026-02-24 08:55:13.879224 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-24 08:55:13.879231 | controller | Tuesday 24 February 2026 08:55:13 +0000 (0:00:00.032) 0:01:29.305 ****** 2026-02-24 08:55:13.879240 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-24 08:55:13.912093 | controller | 2026-02-24 08:55:13.912124 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-24 08:55:13.912138 | controller | Tuesday 24 February 2026 08:55:13 +0000 (0:00:00.139) 0:01:29.445 ****** 2026-02-24 08:55:13.912154 | controller | skipping: [instance] 2026-02-24 08:55:14.363499 | controller | 2026-02-24 08:55:14.363530 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-24 08:55:14.363543 | controller | Tuesday 24 February 2026 08:55:13 +0000 (0:00:00.033) 0:01:29.478 ****** 2026-02-24 08:55:14.363557 | controller | changed: [instance] 2026-02-24 08:55:14.363752 | controller | 2026-02-24 08:55:14.363773 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-24 08:55:14.364007 | controller | Tuesday 24 February 2026 08:55:14 +0000 (0:00:00.451) 0:01:29.929 ****** 2026-02-24 08:55:14.917583 | controller | changed: [instance] 2026-02-24 08:55:14.917676 | controller | 2026-02-24 08:55:14.917693 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-24 08:55:14.918009 | controller | Tuesday 24 February 2026 08:55:14 +0000 (0:00:00.543) 0:01:30.473 ****** 2026-02-24 08:55:14.918036 | controller | 2026-02-24 08:55:15.368665 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 08:55:15.368715 | controller | Tuesday 24 February 2026 08:55:14 +0000 (0:00:00.010) 0:01:30.483 ****** 2026-02-24 08:55:15.368729 | controller | changed: [instance] 2026-02-24 08:55:15.368751 | controller | 2026-02-24 08:55:15.368977 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 08:55:16.098059 | controller | Tuesday 24 February 2026 08:55:15 +0000 (0:00:00.451) 0:01:30.934 ****** 2026-02-24 08:55:16.098097 | controller | changed: [instance] 2026-02-24 08:55:16.145817 | controller | 2026-02-24 08:55:16.145840 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-24 08:55:16.145848 | controller | Tuesday 24 February 2026 08:55:16 +0000 (0:00:00.729) 0:01:31.664 ****** 2026-02-24 08:55:16.145857 | controller | skipping: [instance] 2026-02-24 08:55:16.187571 | controller | 2026-02-24 08:55:16.187646 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-24 08:55:16.187657 | controller | Tuesday 24 February 2026 08:55:16 +0000 (0:00:00.047) 0:01:31.712 ****** 2026-02-24 08:55:16.187670 | controller | skipping: [instance] 2026-02-24 08:55:16.811772 | controller | 2026-02-24 08:55:16.811828 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-24 08:55:16.811838 | controller | Tuesday 24 February 2026 08:55:16 +0000 (0:00:00.041) 0:01:31.753 ****** 2026-02-24 08:55:16.811857 | controller | changed: [instance] => (item=workload) 2026-02-24 08:55:17.279551 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-24 08:55:17.279635 | controller | ok: [instance] => (item=volumes) 2026-02-24 08:55:17.279652 | controller | 2026-02-24 08:55:17.279659 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-24 08:55:17.279666 | controller | Tuesday 24 February 2026 08:55:16 +0000 (0:00:00.623) 0:01:32.377 ****** 2026-02-24 08:55:17.279678 | controller | changed: [instance] => (item=workload) 2026-02-24 08:55:17.279706 | controller | changed: [instance] => (item=volumes) 2026-02-24 08:55:17.279714 | controller | 2026-02-24 08:55:17.279941 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-24 08:55:17.313546 | controller | Tuesday 24 February 2026 08:55:17 +0000 (0:00:00.468) 0:01:32.845 ****** 2026-02-24 08:55:17.313607 | controller | skipping: [instance] 2026-02-24 08:55:17.313693 | controller | 2026-02-24 08:55:17.313721 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-24 08:55:17.313738 | controller | Tuesday 24 February 2026 08:55:17 +0000 (0:00:00.033) 0:01:32.879 ****** 2026-02-24 08:55:18.480560 | controller | changed: [instance] => (item=compute) 2026-02-24 08:55:18.480633 | controller | changed: [instance] => (item=controller) 2026-02-24 08:55:18.480646 | controller | changed: [instance] => (item=crc) 2026-02-24 08:55:18.481015 | controller | 2026-02-24 08:55:18.515809 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-24 08:55:18.515828 | controller | Tuesday 24 February 2026 08:55:18 +0000 (0:00:01.166) 0:01:34.046 ****** 2026-02-24 08:55:18.515838 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-24 08:55:18.717114 | controller | 2026-02-24 08:55:18.717137 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-24 08:55:18.717146 | controller | Tuesday 24 February 2026 08:55:18 +0000 (0:00:00.035) 0:01:34.082 ****** 2026-02-24 08:55:18.717164 | controller | ok: [instance] 2026-02-24 08:55:18.741249 | controller | 2026-02-24 08:55:18.741278 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-24 08:55:18.741291 | controller | Tuesday 24 February 2026 08:55:18 +0000 (0:00:00.201) 0:01:34.283 ****** 2026-02-24 08:55:18.741305 | controller | skipping: [instance] 2026-02-24 08:55:19.150596 | controller | 2026-02-24 08:55:19.150658 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-24 08:55:19.150668 | controller | Tuesday 24 February 2026 08:55:18 +0000 (0:00:00.023) 0:01:34.307 ****** 2026-02-24 08:55:19.150684 | controller | changed: [instance] 2026-02-24 08:55:19.178558 | controller | 2026-02-24 08:55:19.178620 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-24 08:55:19.178636 | controller | Tuesday 24 February 2026 08:55:19 +0000 (0:00:00.409) 0:01:34.717 ****** 2026-02-24 08:55:19.178653 | controller | skipping: [instance] 2026-02-24 08:55:19.178701 | controller | 2026-02-24 08:55:19.179024 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-24 08:55:19.208013 | controller | Tuesday 24 February 2026 08:55:19 +0000 (0:00:00.027) 0:01:34.745 ****** 2026-02-24 08:55:19.208039 | controller | skipping: [instance] 2026-02-24 08:55:19.251926 | controller | 2026-02-24 08:55:19.251947 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-24 08:55:19.251956 | controller | Tuesday 24 February 2026 08:55:19 +0000 (0:00:00.029) 0:01:34.774 ****** 2026-02-24 08:55:19.251966 | controller | skipping: [instance] 2026-02-24 08:55:19.323580 | controller | 2026-02-24 08:55:19.323615 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-24 08:55:19.323624 | controller | Tuesday 24 February 2026 08:55:19 +0000 (0:00:00.043) 0:01:34.818 ****** 2026-02-24 08:55:19.323634 | controller | skipping: [instance] => (item=crc) 2026-02-24 08:55:19.323669 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-24 08:55:19.323678 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-24 08:55:19.323690 | controller | 2026-02-24 08:55:19.323699 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 08:55:19.323756 | controller | Tuesday 24 February 2026 08:55:19 +0000 (0:00:00.071) 0:01:34.889 ****** 2026-02-24 08:55:19.552614 | controller | changed: [instance] 2026-02-24 08:55:19.552695 | controller | 2026-02-24 08:55:19.552709 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 08:55:19.552741 | controller | Tuesday 24 February 2026 08:55:19 +0000 (0:00:00.229) 0:01:35.119 ****** 2026-02-24 08:55:19.747399 | controller | ok: [instance] 2026-02-24 08:55:49.669321 | controller | 2026-02-24 08:55:49.669361 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 08:55:49.669369 | controller | Tuesday 24 February 2026 08:55:19 +0000 (0:00:00.194) 0:01:35.313 ****** 2026-02-24 08:55:49.669380 | controller | changed: [instance] 2026-02-24 08:55:49.882595 | controller | 2026-02-24 08:55:49.882645 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 08:55:49.882658 | controller | Tuesday 24 February 2026 08:55:49 +0000 (0:00:29.921) 0:02:05.235 ****** 2026-02-24 08:55:49.882675 | controller | ok: [instance] 2026-02-24 08:55:49.926873 | controller | 2026-02-24 08:55:49.926903 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 08:55:49.926912 | controller | Tuesday 24 February 2026 08:55:49 +0000 (0:00:00.213) 0:02:05.448 ****** 2026-02-24 08:55:49.926924 | controller | ok: [instance] => changed=false 2026-02-24 08:55:50.142933 | controller | msg: All assertions passed 2026-02-24 08:55:50.142965 | controller | 2026-02-24 08:55:50.142975 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 08:55:50.142982 | controller | Tuesday 24 February 2026 08:55:49 +0000 (0:00:00.044) 0:02:05.493 ****** 2026-02-24 08:55:50.142994 | controller | changed: [instance] 2026-02-24 08:55:50.360303 | controller | 2026-02-24 08:55:50.360339 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 08:55:50.360347 | controller | Tuesday 24 February 2026 08:55:50 +0000 (0:00:00.215) 0:02:05.708 ****** 2026-02-24 08:55:50.360357 | controller | ok: [instance] 2026-02-24 08:55:50.566522 | controller | 2026-02-24 08:55:50.566575 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 08:55:50.566587 | controller | Tuesday 24 February 2026 08:55:50 +0000 (0:00:00.217) 0:02:05.926 ****** 2026-02-24 08:55:50.566600 | controller | ok: [instance] 2026-02-24 08:55:50.566637 | controller | 2026-02-24 08:55:50.566664 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 08:55:50.566794 | controller | Tuesday 24 February 2026 08:55:50 +0000 (0:00:00.206) 0:02:06.133 ****** 2026-02-24 08:55:50.590145 | controller | skipping: [instance] 2026-02-24 08:55:50.797108 | controller | 2026-02-24 08:55:50.797128 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 08:55:50.797139 | controller | Tuesday 24 February 2026 08:55:50 +0000 (0:00:00.023) 0:02:06.156 ****** 2026-02-24 08:55:50.797149 | controller | ok: [instance] 2026-02-24 08:55:50.840169 | controller | 2026-02-24 08:55:50.840188 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 08:55:50.840195 | controller | Tuesday 24 February 2026 08:55:50 +0000 (0:00:00.206) 0:02:06.363 ****** 2026-02-24 08:55:50.840204 | controller | ok: [instance] => changed=false 2026-02-24 08:55:51.054110 | controller | msg: All assertions passed 2026-02-24 08:55:51.054135 | controller | 2026-02-24 08:55:51.054145 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 08:55:51.054152 | controller | Tuesday 24 February 2026 08:55:50 +0000 (0:00:00.043) 0:02:06.406 ****** 2026-02-24 08:55:51.054163 | controller | ok: [instance] 2026-02-24 08:55:51.243977 | controller | 2026-02-24 08:55:51.244002 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-24 08:55:51.244011 | controller | Tuesday 24 February 2026 08:55:51 +0000 (0:00:00.213) 0:02:06.620 ****** 2026-02-24 08:55:51.244022 | controller | ok: [instance] 2026-02-24 08:55:51.642055 | controller | 2026-02-24 08:55:51.642086 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-24 08:55:51.642099 | controller | Tuesday 24 February 2026 08:55:51 +0000 (0:00:00.189) 0:02:06.810 ****** 2026-02-24 08:55:51.642109 | controller | changed: [instance] 2026-02-24 08:55:51.829868 | controller | 2026-02-24 08:55:51.829905 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-24 08:55:51.829915 | controller | Tuesday 24 February 2026 08:55:51 +0000 (0:00:00.398) 0:02:07.208 ****** 2026-02-24 08:55:51.829928 | controller | ok: [instance] 2026-02-24 08:55:52.016323 | controller | 2026-02-24 08:55:52.016355 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-24 08:55:52.016363 | controller | Tuesday 24 February 2026 08:55:51 +0000 (0:00:00.187) 0:02:07.396 ****** 2026-02-24 08:55:52.016374 | controller | ok: [instance] 2026-02-24 08:55:52.426569 | controller | 2026-02-24 08:55:52.426603 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-24 08:55:52.426611 | controller | Tuesday 24 February 2026 08:55:52 +0000 (0:00:00.186) 0:02:07.582 ****** 2026-02-24 08:55:52.426623 | controller | changed: [instance] 2026-02-24 08:55:52.448950 | controller | 2026-02-24 08:55:52.448979 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-24 08:55:52.448989 | controller | Tuesday 24 February 2026 08:55:52 +0000 (0:00:00.410) 0:02:07.993 ****** 2026-02-24 08:55:52.449001 | controller | ok: [instance] 2026-02-24 08:55:52.751500 | controller | 2026-02-24 08:55:52.751532 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-24 08:55:52.751540 | controller | Tuesday 24 February 2026 08:55:52 +0000 (0:00:00.022) 0:02:08.015 ****** 2026-02-24 08:55:52.751560 | controller | ok: [instance] 2026-02-24 08:55:52.753134 | controller | 2026-02-24 08:55:52.753164 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-24 08:55:52.753178 | controller | Tuesday 24 February 2026 08:55:52 +0000 (0:00:00.301) 0:02:08.316 ****** 2026-02-24 08:55:53.237865 | controller | ok: [instance] 2026-02-24 08:55:53.370388 | controller | 2026-02-24 08:55:53.370455 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-24 08:55:53.370473 | controller | Tuesday 24 February 2026 08:55:53 +0000 (0:00:00.484) 0:02:08.800 ****** 2026-02-24 08:55:53.370489 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 08:55:53.370770 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 08:55:53.370979 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 08:55:53.371101 | controller | 2026-02-24 08:55:53.371227 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-24 08:55:53.371353 | controller | Tuesday 24 February 2026 08:55:53 +0000 (0:00:00.135) 0:02:08.936 ****** 2026-02-24 08:55:53.671399 | controller | changed: [instance] 2026-02-24 08:55:53.909995 | controller | 2026-02-24 08:55:53.910029 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-24 08:55:53.910037 | controller | Tuesday 24 February 2026 08:55:53 +0000 (0:00:00.300) 0:02:09.237 ****** 2026-02-24 08:55:53.910047 | controller | changed: [instance] 2026-02-24 08:55:54.213877 | controller | 2026-02-24 08:55:54.213909 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-24 08:55:54.213917 | controller | Tuesday 24 February 2026 08:55:53 +0000 (0:00:00.238) 0:02:09.476 ****** 2026-02-24 08:55:54.213928 | controller | changed: [instance] 2026-02-24 08:55:54.246173 | controller | 2026-02-24 08:55:54.246203 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-24 08:55:54.246217 | controller | Tuesday 24 February 2026 08:55:54 +0000 (0:00:00.303) 0:02:09.780 ****** 2026-02-24 08:55:54.246237 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 08:55:54.293914 | controller | 2026-02-24 08:55:54.293932 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 08:55:54.293940 | controller | Tuesday 24 February 2026 08:55:54 +0000 (0:00:00.032) 0:02:09.812 ****** 2026-02-24 08:55:54.293949 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 08:55:54.532898 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 08:55:54.532926 | controller | 2026-02-24 08:55:54.532935 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 08:55:54.532941 | controller | Tuesday 24 February 2026 08:55:54 +0000 (0:00:00.047) 0:02:09.860 ****** 2026-02-24 08:55:54.532950 | controller | ok: [instance] 2026-02-24 08:55:54.583529 | controller | 2026-02-24 08:55:54.583564 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 08:55:54.583574 | controller | Tuesday 24 February 2026 08:55:54 +0000 (0:00:00.238) 0:02:10.099 ****** 2026-02-24 08:55:54.583584 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 08:55:54.583612 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:55:54.583621 | controller | 2026-02-24 08:55:54.583827 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 08:55:54.821041 | controller | Tuesday 24 February 2026 08:55:54 +0000 (0:00:00.050) 0:02:10.150 ****** 2026-02-24 08:55:54.821066 | controller | ok: [instance] 2026-02-24 08:55:55.030079 | controller | 2026-02-24 08:55:55.030113 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 08:55:55.030121 | controller | Tuesday 24 February 2026 08:55:54 +0000 (0:00:00.237) 0:02:10.387 ****** 2026-02-24 08:55:55.030131 | controller | ok: [instance] 2026-02-24 08:55:55.336507 | controller | 2026-02-24 08:55:55.336540 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-24 08:55:55.336559 | controller | Tuesday 24 February 2026 08:55:55 +0000 (0:00:00.208) 0:02:10.596 ****** 2026-02-24 08:55:55.336572 | controller | changed: [instance] 2026-02-24 08:55:55.584327 | controller | 2026-02-24 08:55:55.584351 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 08:55:55.584360 | controller | Tuesday 24 February 2026 08:55:55 +0000 (0:00:00.306) 0:02:10.902 ****** 2026-02-24 08:55:55.584369 | controller | ok: [instance] 2026-02-24 08:55:55.634311 | controller | 2026-02-24 08:55:55.634345 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 08:55:55.634358 | controller | Tuesday 24 February 2026 08:55:55 +0000 (0:00:00.247) 0:02:11.150 ****** 2026-02-24 08:55:55.634374 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 08:55:55.877914 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:55:55.877946 | controller | 2026-02-24 08:55:55.877955 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 08:55:55.877961 | controller | Tuesday 24 February 2026 08:55:55 +0000 (0:00:00.049) 0:02:11.200 ****** 2026-02-24 08:55:55.877970 | controller | ok: [instance] 2026-02-24 08:55:56.089087 | controller | 2026-02-24 08:55:56.089114 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 08:55:56.089122 | controller | Tuesday 24 February 2026 08:55:55 +0000 (0:00:00.244) 0:02:11.444 ****** 2026-02-24 08:55:56.089132 | controller | ok: [instance] 2026-02-24 08:55:56.396178 | controller | 2026-02-24 08:55:56.396208 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-24 08:55:56.396216 | controller | Tuesday 24 February 2026 08:55:56 +0000 (0:00:00.211) 0:02:11.655 ****** 2026-02-24 08:55:56.396226 | controller | changed: [instance] 2026-02-24 08:55:56.420049 | controller | 2026-02-24 08:55:56.420078 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-24 08:55:56.420088 | controller | Tuesday 24 February 2026 08:55:56 +0000 (0:00:00.306) 0:02:11.962 ****** 2026-02-24 08:55:56.420099 | controller | skipping: [instance] 2026-02-24 08:55:56.449512 | controller | 2026-02-24 08:55:56.449532 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-24 08:55:56.449540 | controller | Tuesday 24 February 2026 08:55:56 +0000 (0:00:00.023) 0:02:11.986 ****** 2026-02-24 08:55:56.449559 | controller | skipping: [instance] 2026-02-24 08:55:56.482040 | controller | 2026-02-24 08:55:56.482058 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-24 08:55:56.482065 | controller | Tuesday 24 February 2026 08:55:56 +0000 (0:00:00.029) 0:02:12.016 ****** 2026-02-24 08:55:56.482074 | controller | skipping: [instance] 2026-02-24 08:55:56.510562 | controller | 2026-02-24 08:55:56.510604 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-24 08:55:56.510614 | controller | Tuesday 24 February 2026 08:55:56 +0000 (0:00:00.032) 0:02:12.048 ****** 2026-02-24 08:55:56.510626 | controller | skipping: [instance] 2026-02-24 08:55:56.510911 | controller | 2026-02-24 08:55:56.510946 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 08:55:56.741970 | controller | Tuesday 24 February 2026 08:55:56 +0000 (0:00:00.028) 0:02:12.077 ****** 2026-02-24 08:55:56.741991 | controller | changed: [instance] 2026-02-24 08:55:56.782683 | controller | 2026-02-24 08:55:56.782740 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 08:55:56.782751 | controller | Tuesday 24 February 2026 08:55:56 +0000 (0:00:00.231) 0:02:12.308 ****** 2026-02-24 08:55:56.782767 | controller | ok: [instance] 2026-02-24 08:55:56.838332 | controller | 2026-02-24 08:55:56.838386 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 08:55:56.838398 | controller | Tuesday 24 February 2026 08:55:56 +0000 (0:00:00.040) 0:02:12.349 ****** 2026-02-24 08:55:56.838443 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 08:55:57.053630 | controller | 2026-02-24 08:55:57.053686 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 08:55:57.053700 | controller | Tuesday 24 February 2026 08:55:56 +0000 (0:00:00.055) 0:02:12.404 ****** 2026-02-24 08:55:57.053719 | controller | ok: [instance] 2026-02-24 08:55:57.117313 | controller | 2026-02-24 08:55:57.117346 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 08:55:57.117356 | controller | Tuesday 24 February 2026 08:55:57 +0000 (0:00:00.215) 0:02:12.619 ****** 2026-02-24 08:55:57.117367 | controller | ok: [instance] 2026-02-24 08:55:57.178231 | controller | 2026-02-24 08:55:57.178250 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 08:55:57.178258 | controller | Tuesday 24 February 2026 08:55:57 +0000 (0:00:00.063) 0:02:12.683 ****** 2026-02-24 08:55:57.178267 | controller | ok: [instance] 2026-02-24 08:55:57.225976 | controller | 2026-02-24 08:55:57.225999 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 08:55:57.226009 | controller | Tuesday 24 February 2026 08:55:57 +0000 (0:00:00.060) 0:02:12.744 ****** 2026-02-24 08:55:57.226020 | controller | skipping: [instance] 2026-02-24 08:55:57.277613 | controller | 2026-02-24 08:55:57.277668 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 08:55:57.277682 | controller | Tuesday 24 February 2026 08:55:57 +0000 (0:00:00.047) 0:02:12.792 ****** 2026-02-24 08:55:57.277697 | controller | skipping: [instance] 2026-02-24 08:55:57.344803 | controller | 2026-02-24 08:55:57.344837 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 08:55:57.344847 | controller | Tuesday 24 February 2026 08:55:57 +0000 (0:00:00.051) 0:02:12.843 ****** 2026-02-24 08:55:57.344859 | controller | 2026-02-24 08:55:57.790260 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 08:55:57.790286 | controller | Tuesday 24 February 2026 08:55:57 +0000 (0:00:00.067) 0:02:12.911 ****** 2026-02-24 08:55:57.790297 | controller | ok: [instance] => (item=artifacts) 2026-02-24 08:55:59.078612 | controller | ok: [instance] => (item=logs) 2026-02-24 08:55:59.078668 | controller | 2026-02-24 08:55:59.078678 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 08:55:59.078698 | controller | Tuesday 24 February 2026 08:55:57 +0000 (0:00:00.445) 0:02:13.356 ****** 2026-02-24 08:55:59.078716 | controller | ok: [instance] 2026-02-24 08:55:59.078763 | controller | 2026-02-24 08:55:59.078948 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 08:55:59.079016 | controller | Tuesday 24 February 2026 08:55:59 +0000 (0:00:01.288) 0:02:14.644 ****** 2026-02-24 08:55:59.316310 | controller | changed: [instance] 2026-02-24 08:55:59.722818 | controller | 2026-02-24 08:55:59.722849 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 08:55:59.722857 | controller | Tuesday 24 February 2026 08:55:59 +0000 (0:00:00.237) 0:02:14.882 ****** 2026-02-24 08:55:59.722867 | controller | changed: [instance] 2026-02-24 08:56:00.125174 | controller | 2026-02-24 08:56:00.125202 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 08:56:00.125210 | controller | Tuesday 24 February 2026 08:55:59 +0000 (0:00:00.406) 0:02:15.289 ****** 2026-02-24 08:56:00.125220 | controller | changed: [instance] 2026-02-24 08:56:00.177350 | controller | 2026-02-24 08:56:00.177372 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 08:56:00.177381 | controller | Tuesday 24 February 2026 08:56:00 +0000 (0:00:00.402) 0:02:15.691 ****** 2026-02-24 08:56:00.177392 | controller | skipping: [instance] 2026-02-24 08:56:00.398904 | controller | 2026-02-24 08:56:00.398925 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 08:56:00.398932 | controller | Tuesday 24 February 2026 08:56:00 +0000 (0:00:00.052) 0:02:15.743 ****** 2026-02-24 08:56:00.398947 | controller | ok: [instance] 2026-02-24 08:56:00.445837 | controller | 2026-02-24 08:56:00.445909 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 08:56:00.445925 | controller | Tuesday 24 February 2026 08:56:00 +0000 (0:00:00.221) 0:02:15.965 ****** 2026-02-24 08:56:00.445945 | controller | skipping: [instance] 2026-02-24 08:56:00.708512 | controller | 2026-02-24 08:56:00.708559 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 08:56:00.708569 | controller | Tuesday 24 February 2026 08:56:00 +0000 (0:00:00.046) 0:02:16.011 ****** 2026-02-24 08:56:00.708581 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-24 08:56:01.031360 | controller | changed: [instance] 2026-02-24 08:56:01.031403 | controller | 2026-02-24 08:56:01.031432 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 08:56:01.031443 | controller | Tuesday 24 February 2026 08:56:00 +0000 (0:00:00.262) 0:02:16.274 ****** 2026-02-24 08:56:01.031455 | controller | changed: [instance] 2026-02-24 08:56:01.084666 | controller | 2026-02-24 08:56:01.084729 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 08:56:01.084744 | controller | Tuesday 24 February 2026 08:56:01 +0000 (0:00:00.322) 0:02:16.597 ****** 2026-02-24 08:56:01.084764 | controller | skipping: [instance] 2026-02-24 08:56:01.119876 | controller | 2026-02-24 08:56:01.119909 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-24 08:56:01.119917 | controller | Tuesday 24 February 2026 08:56:01 +0000 (0:00:00.053) 0:02:16.651 ****** 2026-02-24 08:56:01.119928 | controller | skipping: [instance] 2026-02-24 08:56:01.395164 | controller | 2026-02-24 08:56:01.395205 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-24 08:56:01.395218 | controller | Tuesday 24 February 2026 08:56:01 +0000 (0:00:00.035) 0:02:16.686 ****** 2026-02-24 08:56:01.395233 | controller | changed: [instance] 2026-02-24 08:56:01.643091 | controller | 2026-02-24 08:56:01.643140 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-24 08:56:01.643150 | controller | Tuesday 24 February 2026 08:56:01 +0000 (0:00:00.275) 0:02:16.961 ****** 2026-02-24 08:56:01.643163 | controller | changed: [instance] 2026-02-24 08:56:02.012697 | controller | 2026-02-24 08:56:02.012744 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-24 08:56:02.012753 | controller | Tuesday 24 February 2026 08:56:01 +0000 (0:00:00.247) 0:02:17.208 ****** 2026-02-24 08:56:02.012771 | controller | changed: [instance] 2026-02-24 08:56:02.044517 | controller | 2026-02-24 08:56:02.044540 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-24 08:56:02.044563 | controller | Tuesday 24 February 2026 08:56:02 +0000 (0:00:00.369) 0:02:17.578 ****** 2026-02-24 08:56:02.044575 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 08:56:02.131383 | controller | 2026-02-24 08:56:02.131468 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 08:56:02.131477 | controller | Tuesday 24 February 2026 08:56:02 +0000 (0:00:00.032) 0:02:17.610 ****** 2026-02-24 08:56:02.131492 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 08:56:02.386093 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 08:56:02.386153 | controller | 2026-02-24 08:56:02.386163 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 08:56:02.386171 | controller | Tuesday 24 February 2026 08:56:02 +0000 (0:00:00.085) 0:02:17.696 ****** 2026-02-24 08:56:02.386185 | controller | ok: [instance] 2026-02-24 08:56:02.444241 | controller | 2026-02-24 08:56:02.444272 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 08:56:02.444280 | controller | Tuesday 24 February 2026 08:56:02 +0000 (0:00:00.254) 0:02:17.951 ****** 2026-02-24 08:56:02.444291 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 08:56:02.697858 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:56:02.697894 | controller | 2026-02-24 08:56:02.697902 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 08:56:02.697909 | controller | Tuesday 24 February 2026 08:56:02 +0000 (0:00:00.058) 0:02:18.010 ****** 2026-02-24 08:56:02.697919 | controller | ok: [instance] 2026-02-24 08:56:02.912632 | controller | 2026-02-24 08:56:02.912691 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 08:56:02.912702 | controller | Tuesday 24 February 2026 08:56:02 +0000 (0:00:00.253) 0:02:18.264 ****** 2026-02-24 08:56:02.912718 | controller | ok: [instance] 2026-02-24 08:56:03.214536 | controller | 2026-02-24 08:56:03.214586 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-24 08:56:03.214597 | controller | Tuesday 24 February 2026 08:56:02 +0000 (0:00:00.215) 0:02:18.479 ****** 2026-02-24 08:56:03.214617 | controller | changed: [instance] 2026-02-24 08:56:03.214654 | controller | 2026-02-24 08:56:03.214665 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 08:56:03.486896 | controller | Tuesday 24 February 2026 08:56:03 +0000 (0:00:00.301) 0:02:18.780 ****** 2026-02-24 08:56:03.486956 | controller | ok: [instance] 2026-02-24 08:56:03.547093 | controller | 2026-02-24 08:56:03.547133 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 08:56:03.547141 | controller | Tuesday 24 February 2026 08:56:03 +0000 (0:00:00.272) 0:02:19.053 ****** 2026-02-24 08:56:03.547154 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 08:56:03.808219 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:56:03.808262 | controller | 2026-02-24 08:56:03.808271 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 08:56:03.808277 | controller | Tuesday 24 February 2026 08:56:03 +0000 (0:00:00.060) 0:02:19.113 ****** 2026-02-24 08:56:03.808287 | controller | ok: [instance] 2026-02-24 08:56:04.032621 | controller | 2026-02-24 08:56:04.032657 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 08:56:04.032666 | controller | Tuesday 24 February 2026 08:56:03 +0000 (0:00:00.261) 0:02:19.374 ****** 2026-02-24 08:56:04.032676 | controller | ok: [instance] 2026-02-24 08:56:04.348365 | controller | 2026-02-24 08:56:04.348396 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-24 08:56:04.348403 | controller | Tuesday 24 February 2026 08:56:04 +0000 (0:00:00.224) 0:02:19.598 ****** 2026-02-24 08:56:04.348437 | controller | changed: [instance] 2026-02-24 08:56:04.374337 | controller | 2026-02-24 08:56:04.374353 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-24 08:56:04.374359 | controller | Tuesday 24 February 2026 08:56:04 +0000 (0:00:00.316) 0:02:19.914 ****** 2026-02-24 08:56:04.374367 | controller | skipping: [instance] 2026-02-24 08:56:04.407620 | controller | 2026-02-24 08:56:04.407698 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-24 08:56:04.407714 | controller | Tuesday 24 February 2026 08:56:04 +0000 (0:00:00.026) 0:02:19.940 ****** 2026-02-24 08:56:04.407738 | controller | skipping: [instance] 2026-02-24 08:56:04.408095 | controller | 2026-02-24 08:56:04.441133 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-24 08:56:04.441152 | controller | Tuesday 24 February 2026 08:56:04 +0000 (0:00:00.033) 0:02:19.974 ****** 2026-02-24 08:56:04.441162 | controller | skipping: [instance] 2026-02-24 08:56:04.472290 | controller | 2026-02-24 08:56:04.472306 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-24 08:56:04.472313 | controller | Tuesday 24 February 2026 08:56:04 +0000 (0:00:00.033) 0:02:20.007 ****** 2026-02-24 08:56:04.472322 | controller | skipping: [instance] 2026-02-24 08:56:04.706887 | controller | 2026-02-24 08:56:04.706920 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 08:56:04.706928 | controller | Tuesday 24 February 2026 08:56:04 +0000 (0:00:00.031) 0:02:20.038 ****** 2026-02-24 08:56:04.706937 | controller | changed: [instance] 2026-02-24 08:56:04.749319 | controller | 2026-02-24 08:56:04.749343 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 08:56:04.749353 | controller | Tuesday 24 February 2026 08:56:04 +0000 (0:00:00.234) 0:02:20.273 ****** 2026-02-24 08:56:04.749365 | controller | ok: [instance] 2026-02-24 08:56:04.808638 | controller | 2026-02-24 08:56:04.808690 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 08:56:04.808701 | controller | Tuesday 24 February 2026 08:56:04 +0000 (0:00:00.042) 0:02:20.315 ****** 2026-02-24 08:56:04.808717 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 08:56:04.808750 | controller | 2026-02-24 08:56:04.808759 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 08:56:04.808911 | controller | Tuesday 24 February 2026 08:56:04 +0000 (0:00:00.059) 0:02:20.375 ****** 2026-02-24 08:56:05.032675 | controller | ok: [instance] 2026-02-24 08:56:05.032769 | controller | 2026-02-24 08:56:05.032788 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 08:56:05.100553 | controller | Tuesday 24 February 2026 08:56:05 +0000 (0:00:00.223) 0:02:20.598 ****** 2026-02-24 08:56:05.100595 | controller | ok: [instance] 2026-02-24 08:56:05.100638 | controller | 2026-02-24 08:56:05.100958 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 08:56:05.152240 | controller | Tuesday 24 February 2026 08:56:05 +0000 (0:00:00.068) 0:02:20.667 ****** 2026-02-24 08:56:05.152270 | controller | ok: [instance] 2026-02-24 08:56:05.201625 | controller | 2026-02-24 08:56:05.201679 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 08:56:05.201696 | controller | Tuesday 24 February 2026 08:56:05 +0000 (0:00:00.051) 0:02:20.718 ****** 2026-02-24 08:56:05.201709 | controller | skipping: [instance] 2026-02-24 08:56:05.201748 | controller | 2026-02-24 08:56:05.201759 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 08:56:05.201975 | controller | Tuesday 24 February 2026 08:56:05 +0000 (0:00:00.049) 0:02:20.767 ****** 2026-02-24 08:56:05.248610 | controller | skipping: [instance] 2026-02-24 08:56:05.248721 | controller | 2026-02-24 08:56:05.248748 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 08:56:05.248759 | controller | Tuesday 24 February 2026 08:56:05 +0000 (0:00:00.046) 0:02:20.814 ****** 2026-02-24 08:56:05.312639 | controller | 2026-02-24 08:56:05.312835 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 08:56:05.312855 | controller | Tuesday 24 February 2026 08:56:05 +0000 (0:00:00.064) 0:02:20.878 ****** 2026-02-24 08:56:05.756993 | controller | ok: [instance] => (item=artifacts) 2026-02-24 08:56:06.987254 | controller | ok: [instance] => (item=logs) 2026-02-24 08:56:06.987315 | controller | 2026-02-24 08:56:06.987324 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 08:56:06.987331 | controller | Tuesday 24 February 2026 08:56:05 +0000 (0:00:00.444) 0:02:21.323 ****** 2026-02-24 08:56:06.987344 | controller | ok: [instance] 2026-02-24 08:56:07.222275 | controller | 2026-02-24 08:56:07.222338 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 08:56:07.222348 | controller | Tuesday 24 February 2026 08:56:06 +0000 (0:00:01.229) 0:02:22.553 ****** 2026-02-24 08:56:07.222363 | controller | changed: [instance] 2026-02-24 08:56:07.623599 | controller | 2026-02-24 08:56:07.623646 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 08:56:07.623657 | controller | Tuesday 24 February 2026 08:56:07 +0000 (0:00:00.234) 0:02:22.787 ****** 2026-02-24 08:56:07.623672 | controller | changed: [instance] 2026-02-24 08:56:08.037331 | controller | 2026-02-24 08:56:08.037390 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 08:56:08.037400 | controller | Tuesday 24 February 2026 08:56:07 +0000 (0:00:00.401) 0:02:23.189 ****** 2026-02-24 08:56:08.037431 | controller | changed: [instance] 2026-02-24 08:56:08.090071 | controller | 2026-02-24 08:56:08.090103 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 08:56:08.090112 | controller | Tuesday 24 February 2026 08:56:08 +0000 (0:00:00.413) 0:02:23.603 ****** 2026-02-24 08:56:08.090124 | controller | skipping: [instance] 2026-02-24 08:56:08.308286 | controller | 2026-02-24 08:56:08.308338 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 08:56:08.308348 | controller | Tuesday 24 February 2026 08:56:08 +0000 (0:00:00.053) 0:02:23.656 ****** 2026-02-24 08:56:08.308361 | controller | ok: [instance] 2026-02-24 08:56:08.355210 | controller | 2026-02-24 08:56:08.355232 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 08:56:08.355242 | controller | Tuesday 24 February 2026 08:56:08 +0000 (0:00:00.217) 0:02:23.873 ****** 2026-02-24 08:56:08.355251 | controller | skipping: [instance] 2026-02-24 08:56:08.604585 | controller | 2026-02-24 08:56:08.604626 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 08:56:08.604636 | controller | Tuesday 24 February 2026 08:56:08 +0000 (0:00:00.047) 0:02:23.921 ****** 2026-02-24 08:56:08.604649 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-24 08:56:08.604686 | controller | changed: [instance] 2026-02-24 08:56:08.604695 | controller | 2026-02-24 08:56:08.604705 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 08:56:08.604731 | controller | Tuesday 24 February 2026 08:56:08 +0000 (0:00:00.249) 0:02:24.170 ****** 2026-02-24 08:56:08.906122 | controller | changed: [instance] 2026-02-24 08:56:08.954333 | controller | 2026-02-24 08:56:08.954372 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 08:56:08.954382 | controller | Tuesday 24 February 2026 08:56:08 +0000 (0:00:00.301) 0:02:24.471 ****** 2026-02-24 08:56:08.954395 | controller | skipping: [instance] 2026-02-24 08:56:08.985948 | controller | 2026-02-24 08:56:08.985985 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-24 08:56:08.985995 | controller | Tuesday 24 February 2026 08:56:08 +0000 (0:00:00.048) 0:02:24.520 ****** 2026-02-24 08:56:08.986007 | controller | skipping: [instance] 2026-02-24 08:56:09.321895 | controller | 2026-02-24 08:56:09.321927 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-24 08:56:09.321941 | controller | Tuesday 24 February 2026 08:56:08 +0000 (0:00:00.031) 0:02:24.552 ****** 2026-02-24 08:56:09.321951 | controller | changed: [instance] 2026-02-24 08:56:09.570963 | controller | 2026-02-24 08:56:09.571000 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-24 08:56:09.571015 | controller | Tuesday 24 February 2026 08:56:09 +0000 (0:00:00.335) 0:02:24.888 ****** 2026-02-24 08:56:09.571025 | controller | changed: [instance] 2026-02-24 08:56:09.926508 | controller | 2026-02-24 08:56:09.926562 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-24 08:56:09.926573 | controller | Tuesday 24 February 2026 08:56:09 +0000 (0:00:00.248) 0:02:25.137 ****** 2026-02-24 08:56:09.926587 | controller | changed: [instance] 2026-02-24 08:56:09.926684 | controller | 2026-02-24 08:56:09.926719 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-24 08:56:09.959943 | controller | Tuesday 24 February 2026 08:56:09 +0000 (0:00:00.355) 0:02:25.492 ****** 2026-02-24 08:56:09.959974 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 08:56:10.006172 | controller | 2026-02-24 08:56:10.006191 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 08:56:10.006198 | controller | Tuesday 24 February 2026 08:56:09 +0000 (0:00:00.033) 0:02:25.526 ****** 2026-02-24 08:56:10.006206 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 08:56:10.258227 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 08:56:10.258258 | controller | 2026-02-24 08:56:10.258267 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 08:56:10.258273 | controller | Tuesday 24 February 2026 08:56:10 +0000 (0:00:00.046) 0:02:25.572 ****** 2026-02-24 08:56:10.258284 | controller | ok: [instance] 2026-02-24 08:56:10.307517 | controller | 2026-02-24 08:56:10.307565 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 08:56:10.307576 | controller | Tuesday 24 February 2026 08:56:10 +0000 (0:00:00.251) 0:02:25.824 ****** 2026-02-24 08:56:10.307588 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 08:56:10.307620 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:56:10.307947 | controller | 2026-02-24 08:56:10.550157 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 08:56:10.550184 | controller | Tuesday 24 February 2026 08:56:10 +0000 (0:00:00.049) 0:02:25.874 ****** 2026-02-24 08:56:10.550196 | controller | ok: [instance] 2026-02-24 08:56:10.764626 | controller | 2026-02-24 08:56:10.764674 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 08:56:10.764688 | controller | Tuesday 24 February 2026 08:56:10 +0000 (0:00:00.242) 0:02:26.116 ****** 2026-02-24 08:56:10.764704 | controller | ok: [instance] 2026-02-24 08:56:11.108335 | controller | 2026-02-24 08:56:11.108370 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-24 08:56:11.108379 | controller | Tuesday 24 February 2026 08:56:10 +0000 (0:00:00.214) 0:02:26.330 ****** 2026-02-24 08:56:11.108389 | controller | changed: [instance] 2026-02-24 08:56:11.352290 | controller | 2026-02-24 08:56:11.352327 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 08:56:11.352335 | controller | Tuesday 24 February 2026 08:56:11 +0000 (0:00:00.343) 0:02:26.674 ****** 2026-02-24 08:56:11.352345 | controller | ok: [instance] 2026-02-24 08:56:11.402155 | controller | 2026-02-24 08:56:11.402180 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 08:56:11.402188 | controller | Tuesday 24 February 2026 08:56:11 +0000 (0:00:00.243) 0:02:26.918 ****** 2026-02-24 08:56:11.402197 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 08:56:11.646724 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 08:56:11.646760 | controller | 2026-02-24 08:56:11.646770 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 08:56:11.646777 | controller | Tuesday 24 February 2026 08:56:11 +0000 (0:00:00.049) 0:02:26.968 ****** 2026-02-24 08:56:11.646788 | controller | ok: [instance] 2026-02-24 08:56:11.860873 | controller | 2026-02-24 08:56:11.860913 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 08:56:11.860924 | controller | Tuesday 24 February 2026 08:56:11 +0000 (0:00:00.244) 0:02:27.212 ****** 2026-02-24 08:56:11.860935 | controller | ok: [instance] 2026-02-24 08:56:12.162518 | controller | 2026-02-24 08:56:12.162561 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-24 08:56:12.162571 | controller | Tuesday 24 February 2026 08:56:11 +0000 (0:00:00.214) 0:02:27.427 ****** 2026-02-24 08:56:12.162583 | controller | changed: [instance] 2026-02-24 08:56:12.186908 | controller | 2026-02-24 08:56:12.186929 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-24 08:56:12.186938 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.301) 0:02:27.728 ****** 2026-02-24 08:56:12.186948 | controller | skipping: [instance] 2026-02-24 08:56:12.218568 | controller | 2026-02-24 08:56:12.218604 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-24 08:56:12.218617 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.024) 0:02:27.753 ****** 2026-02-24 08:56:12.218632 | controller | skipping: [instance] 2026-02-24 08:56:12.248283 | controller | 2026-02-24 08:56:12.248303 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-24 08:56:12.248312 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.031) 0:02:27.784 ****** 2026-02-24 08:56:12.248323 | controller | skipping: [instance] 2026-02-24 08:56:12.281185 | controller | 2026-02-24 08:56:12.281208 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-24 08:56:12.281218 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.029) 0:02:27.814 ****** 2026-02-24 08:56:12.281229 | controller | skipping: [instance] 2026-02-24 08:56:12.504279 | controller | 2026-02-24 08:56:12.504302 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 08:56:12.504310 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.032) 0:02:27.847 ****** 2026-02-24 08:56:12.504319 | controller | changed: [instance] 2026-02-24 08:56:12.545375 | controller | 2026-02-24 08:56:12.545395 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 08:56:12.545402 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.223) 0:02:28.070 ****** 2026-02-24 08:56:12.545429 | controller | ok: [instance] 2026-02-24 08:56:12.575163 | controller | 2026-02-24 08:56:12.575180 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 08:56:12.575188 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.041) 0:02:28.111 ****** 2026-02-24 08:56:12.575196 | controller | skipping: [instance] 2026-02-24 08:56:12.605262 | controller | 2026-02-24 08:56:12.605284 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 08:56:12.605294 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.029) 0:02:28.141 ****** 2026-02-24 08:56:12.605305 | controller | skipping: [instance] 2026-02-24 08:56:12.652449 | controller | 2026-02-24 08:56:12.652467 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 08:56:12.652475 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.029) 0:02:28.171 ****** 2026-02-24 08:56:12.652484 | controller | skipping: [instance] 2026-02-24 08:56:12.681745 | controller | 2026-02-24 08:56:12.681787 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-24 08:56:12.681797 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.047) 0:02:28.218 ****** 2026-02-24 08:56:12.681810 | controller | skipping: [instance] 2026-02-24 08:56:12.745587 | controller | 2026-02-24 08:56:12.745632 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-24 08:56:12.745642 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.029) 0:02:28.248 ****** 2026-02-24 08:56:12.745654 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-24 08:56:12.745687 | controller | 2026-02-24 08:56:12.745696 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-24 08:56:12.999462 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.064) 0:02:28.312 ****** 2026-02-24 08:56:12.999494 | controller | ok: [instance] => (item=crc) 2026-02-24 08:56:15.075208 | controller | 2026-02-24 08:56:15.075246 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-24 08:56:15.075253 | controller | Tuesday 24 February 2026 08:56:12 +0000 (0:00:00.253) 0:02:28.565 ****** 2026-02-24 08:56:15.075264 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 08:56:15.976068 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 08:56:15.976104 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 08:56:15.976113 | controller | 2026-02-24 08:56:15.976119 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 08:56:15.976125 | controller | Tuesday 24 February 2026 08:56:15 +0000 (0:00:02.075) 0:02:30.641 ****** 2026-02-24 08:56:15.976135 | controller | changed: [instance] 2026-02-24 08:56:16.806724 | controller | 2026-02-24 08:56:16.806759 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 08:56:16.806767 | controller | Tuesday 24 February 2026 08:56:15 +0000 (0:00:00.901) 0:02:31.542 ****** 2026-02-24 08:56:16.806777 | controller | changed: [instance] 2026-02-24 08:56:17.676124 | controller | 2026-02-24 08:56:17.676157 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 08:56:17.676165 | controller | Tuesday 24 February 2026 08:56:16 +0000 (0:00:00.830) 0:02:32.372 ****** 2026-02-24 08:56:17.676175 | controller | changed: [instance] 2026-02-24 08:56:18.434586 | controller | 2026-02-24 08:56:18.434618 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-24 08:56:18.434631 | controller | Tuesday 24 February 2026 08:56:17 +0000 (0:00:00.869) 0:02:33.242 ****** 2026-02-24 08:56:18.434642 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-24 08:56:41.472604 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-24 08:56:41.472648 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-24 08:56:41.472656 | controller | 2026-02-24 08:56:41.472663 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-24 08:56:41.472668 | controller | Tuesday 24 February 2026 08:56:18 +0000 (0:00:00.758) 0:02:34.000 ****** 2026-02-24 08:56:41.472678 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-24 08:56:41.588348 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-24 08:56:41.588376 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-24 08:56:41.588383 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-24 08:56:41.588388 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-24 08:56:41.588393 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-24 08:56:41.588398 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-24 08:56:41.588403 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j810969420924.24835', 'results_file': '/home/zuul/.ansible_async/j810969420924.24835', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-24 08:56:41.588434 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j604358137174.24852', 'results_file': '/home/zuul/.ansible_async/j604358137174.24852', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-24 08:56:41.588440 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j778062063065.24868', 'results_file': '/home/zuul/.ansible_async/j778062063065.24868', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-24 08:56:41.588450 | controller | 2026-02-24 08:56:41.588456 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-24 08:56:41.588461 | controller | Tuesday 24 February 2026 08:56:41 +0000 (0:00:23.037) 0:02:57.037 ****** 2026-02-24 08:56:41.588470 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 08:56:41.588600 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 08:56:41.588614 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 08:56:41.588825 | controller | 2026-02-24 08:56:41.588967 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 08:56:41.588980 | controller | Tuesday 24 February 2026 08:56:41 +0000 (0:00:00.116) 0:02:57.154 ****** 2026-02-24 08:56:41.619143 | controller | skipping: [instance] 2026-02-24 08:56:41.619197 | controller | 2026-02-24 08:56:41.619207 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-24 08:56:41.619255 | controller | Tuesday 24 February 2026 08:56:41 +0000 (0:00:00.031) 0:02:57.185 ****** 2026-02-24 08:56:41.665965 | controller | 2026-02-24 08:56:41.666066 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 08:56:41.666159 | controller | Tuesday 24 February 2026 08:56:41 +0000 (0:00:00.046) 0:02:57.232 ****** 2026-02-24 08:56:41.754166 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 08:56:41.754225 | controller | 2026-02-24 08:56:41.754347 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 08:56:41.754451 | controller | Tuesday 24 February 2026 08:56:41 +0000 (0:00:00.087) 0:02:57.320 ****** 2026-02-24 08:56:42.017778 | controller | changed: [instance] 2026-02-24 08:56:42.017834 | controller | 2026-02-24 08:56:42.018078 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 08:56:42.268242 | controller | Tuesday 24 February 2026 08:56:42 +0000 (0:00:00.262) 0:02:57.583 ****** 2026-02-24 08:56:42.268291 | controller | changed: [instance] 2026-02-24 08:56:42.268313 | controller | 2026-02-24 08:56:42.268320 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-24 08:56:42.268327 | controller | Tuesday 24 February 2026 08:56:42 +0000 (0:00:00.250) 0:02:57.834 ****** 2026-02-24 08:56:42.685862 | controller | changed: [instance] 2026-02-24 08:56:42.685930 | controller | 2026-02-24 08:56:42.686008 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-24 08:56:42.686119 | controller | Tuesday 24 February 2026 08:56:42 +0000 (0:00:00.417) 0:02:58.252 ****** 2026-02-24 08:56:42.716157 | controller | skipping: [instance] 2026-02-24 08:56:42.716223 | controller | 2026-02-24 08:56:42.716240 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 08:56:42.716258 | controller | Tuesday 24 February 2026 08:56:42 +0000 (0:00:00.030) 0:02:58.282 ****** 2026-02-24 08:56:42.749689 | controller | skipping: [instance] 2026-02-24 08:56:42.750015 | controller | 2026-02-24 08:56:42.815476 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-24 08:56:42.815521 | controller | Tuesday 24 February 2026 08:56:42 +0000 (0:00:00.033) 0:02:58.316 ****** 2026-02-24 08:56:42.815541 | controller | skipping: [instance] 2026-02-24 08:56:42.863341 | controller | 2026-02-24 08:56:42.863390 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-24 08:56:42.863399 | controller | Tuesday 24 February 2026 08:56:42 +0000 (0:00:00.065) 0:02:58.381 ****** 2026-02-24 08:56:42.863431 | controller | skipping: [instance] 2026-02-24 08:56:42.890681 | controller | 2026-02-24 08:56:42.890750 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 08:56:42.890759 | controller | Tuesday 24 February 2026 08:56:42 +0000 (0:00:00.047) 0:02:58.429 ****** 2026-02-24 08:56:42.890774 | controller | skipping: [instance] 2026-02-24 08:56:42.890808 | controller | 2026-02-24 08:56:42.890817 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-24 08:56:42.933681 | controller | Tuesday 24 February 2026 08:56:42 +0000 (0:00:00.027) 0:02:58.457 ****** 2026-02-24 08:56:42.933730 | controller | 2026-02-24 08:56:42.933753 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 08:56:42.933855 | controller | Tuesday 24 February 2026 08:56:42 +0000 (0:00:00.043) 0:02:58.500 ****** 2026-02-24 08:56:43.016845 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 08:56:43.016900 | controller | 2026-02-24 08:56:43.017019 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 08:56:43.017119 | controller | Tuesday 24 February 2026 08:56:43 +0000 (0:00:00.083) 0:02:58.583 ****** 2026-02-24 08:56:43.246277 | controller | ok: [instance] 2026-02-24 08:56:43.246343 | controller | 2026-02-24 08:56:43.246457 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 08:56:43.246473 | controller | Tuesday 24 February 2026 08:56:43 +0000 (0:00:00.229) 0:02:58.812 ****** 2026-02-24 08:56:43.490511 | controller | ok: [instance] 2026-02-24 08:56:43.938784 | controller | 2026-02-24 08:56:43.938823 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-24 08:56:43.938831 | controller | Tuesday 24 February 2026 08:56:43 +0000 (0:00:00.243) 0:02:59.056 ****** 2026-02-24 08:56:43.938843 | controller | changed: [instance] 2026-02-24 08:56:43.969284 | controller | 2026-02-24 08:56:43.969308 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-24 08:56:43.969315 | controller | Tuesday 24 February 2026 08:56:43 +0000 (0:00:00.448) 0:02:59.504 ****** 2026-02-24 08:56:43.969324 | controller | skipping: [instance] 2026-02-24 08:56:43.969364 | controller | 2026-02-24 08:56:43.969448 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 08:56:43.969544 | controller | Tuesday 24 February 2026 08:56:43 +0000 (0:00:00.031) 0:02:59.536 ****** 2026-02-24 08:56:43.998443 | controller | skipping: [instance] 2026-02-24 08:56:43.998539 | controller | 2026-02-24 08:56:43.998646 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-24 08:56:43.998750 | controller | Tuesday 24 February 2026 08:56:43 +0000 (0:00:00.029) 0:02:59.565 ****** 2026-02-24 08:56:45.771519 | controller | changed: [instance -> controller-0.instance] 2026-02-24 08:56:45.771580 | controller | 2026-02-24 08:56:45.771690 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-24 08:56:45.771771 | controller | Tuesday 24 February 2026 08:56:45 +0000 (0:00:01.772) 0:03:01.337 ****** 2026-02-24 08:56:46.993680 | controller | changed: [instance -> controller-0.instance] 2026-02-24 08:56:46.993737 | controller | 2026-02-24 08:56:46.993829 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 08:56:46.993931 | controller | Tuesday 24 February 2026 08:56:46 +0000 (0:00:01.222) 0:03:02.560 ****** 2026-02-24 08:56:47.042062 | controller | 2026-02-24 08:56:47.268783 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 08:56:47.268826 | controller | Tuesday 24 February 2026 08:56:47 +0000 (0:00:00.048) 0:03:02.608 ****** 2026-02-24 08:56:47.268840 | controller | ok: [instance] 2026-02-24 08:56:47.298897 | controller | 2026-02-24 08:56:47.298922 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 08:56:47.298930 | controller | Tuesday 24 February 2026 08:56:47 +0000 (0:00:00.226) 0:03:02.834 ****** 2026-02-24 08:56:47.298940 | controller | ok: [instance] 2026-02-24 08:56:47.332266 | controller | 2026-02-24 08:56:47.332289 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 08:56:47.332297 | controller | Tuesday 24 February 2026 08:56:47 +0000 (0:00:00.030) 0:03:02.865 ****** 2026-02-24 08:56:47.332307 | controller | skipping: [instance] 2026-02-24 08:56:47.381525 | controller | 2026-02-24 08:56:47.381547 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-24 08:56:47.381555 | controller | Tuesday 24 February 2026 08:56:47 +0000 (0:00:00.033) 0:03:02.898 ****** 2026-02-24 08:56:47.381564 | controller | 2026-02-24 08:56:47.468762 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 08:56:47.468785 | controller | Tuesday 24 February 2026 08:56:47 +0000 (0:00:00.049) 0:03:02.948 ****** 2026-02-24 08:56:47.468797 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-24 08:56:47.727127 | controller | 2026-02-24 08:56:47.727155 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 08:56:47.727163 | controller | Tuesday 24 February 2026 08:56:47 +0000 (0:00:00.086) 0:03:03.034 ****** 2026-02-24 08:56:47.727174 | controller | ok: [instance] 2026-02-24 08:56:47.967164 | controller | 2026-02-24 08:56:47.967203 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 08:56:47.967211 | controller | Tuesday 24 February 2026 08:56:47 +0000 (0:00:00.258) 0:03:03.293 ****** 2026-02-24 08:56:47.967223 | controller | ok: [instance] 2026-02-24 08:56:48.408682 | controller | 2026-02-24 08:56:48.408748 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-24 08:56:48.408765 | controller | Tuesday 24 February 2026 08:56:47 +0000 (0:00:00.239) 0:03:03.533 ****** 2026-02-24 08:56:48.408779 | controller | changed: [instance] 2026-02-24 08:56:48.408802 | controller | 2026-02-24 08:56:48.408809 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-24 08:56:48.408826 | controller | Tuesday 24 February 2026 08:56:48 +0000 (0:00:00.441) 0:03:03.974 ****** 2026-02-24 08:56:49.239073 | controller | changed: [instance] 2026-02-24 08:56:49.239755 | controller | 2026-02-24 08:56:49.239873 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 08:56:49.239970 | controller | Tuesday 24 February 2026 08:56:49 +0000 (0:00:00.830) 0:03:04.805 ****** 2026-02-24 08:56:49.277756 | controller | skipping: [instance] 2026-02-24 08:56:49.277835 | controller | 2026-02-24 08:56:49.277937 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-24 08:56:49.278032 | controller | Tuesday 24 February 2026 08:56:49 +0000 (0:00:00.038) 0:03:04.844 ****** 2026-02-24 08:56:49.337358 | controller | skipping: [instance] 2026-02-24 08:56:49.337432 | controller | 2026-02-24 08:56:49.337555 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-24 08:56:49.337645 | controller | Tuesday 24 February 2026 08:56:49 +0000 (0:00:00.059) 0:03:04.904 ****** 2026-02-24 08:56:49.393857 | controller | skipping: [instance] 2026-02-24 08:56:49.393913 | controller | 2026-02-24 08:56:49.394026 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-24 08:56:49.394129 | controller | Tuesday 24 February 2026 08:56:49 +0000 (0:00:00.056) 0:03:04.960 ****** 2026-02-24 08:56:49.451027 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 08:56:49.451111 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 08:56:49.451213 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 08:56:49.451322 | controller | skipping: [instance] 2026-02-24 08:56:49.451436 | controller | 2026-02-24 08:56:49.451547 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-24 08:56:49.451647 | controller | Tuesday 24 February 2026 08:56:49 +0000 (0:00:00.057) 0:03:05.017 ****** 2026-02-24 08:56:49.734441 | controller | ok: [instance] 2026-02-24 08:56:49.734578 | controller | 2026-02-24 08:56:49.734715 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-24 08:56:49.734822 | controller | Tuesday 24 February 2026 08:56:49 +0000 (0:00:00.283) 0:03:05.300 ****** 2026-02-24 08:56:50.137208 | controller | changed: [instance] 2026-02-24 08:56:50.179726 | controller | 2026-02-24 08:56:50.179792 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-24 08:56:50.179803 | controller | Tuesday 24 February 2026 08:56:50 +0000 (0:00:00.402) 0:03:05.703 ****** 2026-02-24 08:56:50.179818 | controller | skipping: [instance] 2026-02-24 08:56:50.179842 | controller | 2026-02-24 08:56:50.179852 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-24 08:56:50.221319 | controller | Tuesday 24 February 2026 08:56:50 +0000 (0:00:00.043) 0:03:05.746 ****** 2026-02-24 08:56:50.221374 | controller | skipping: [instance] 2026-02-24 08:56:50.221398 | controller | 2026-02-24 08:56:50.221405 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-24 08:56:50.221438 | controller | Tuesday 24 February 2026 08:56:50 +0000 (0:00:00.041) 0:03:05.787 ****** 2026-02-24 08:56:50.261209 | controller | skipping: [instance] 2026-02-24 08:56:51.030930 | controller | 2026-02-24 08:56:51.030972 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-24 08:56:51.030980 | controller | Tuesday 24 February 2026 08:56:50 +0000 (0:00:00.039) 0:03:05.827 ****** 2026-02-24 08:56:51.030992 | controller | changed: [instance] 2026-02-24 08:56:51.031011 | controller | 2026-02-24 08:56:51.031019 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-24 08:56:51.849524 | controller | Tuesday 24 February 2026 08:56:51 +0000 (0:00:00.769) 0:03:06.597 ****** 2026-02-24 08:56:51.849583 | controller | changed: [instance] 2026-02-24 08:56:51.849605 | controller | 2026-02-24 08:56:51.849721 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-24 08:56:51.849842 | controller | Tuesday 24 February 2026 08:56:51 +0000 (0:00:00.815) 0:03:07.412 ****** 2026-02-24 08:56:51.901287 | controller | skipping: [instance] 2026-02-24 08:56:51.978045 | controller | 2026-02-24 08:56:51.978074 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-24 08:56:51.978083 | controller | Tuesday 24 February 2026 08:56:51 +0000 (0:00:00.055) 0:03:07.467 ****** 2026-02-24 08:56:51.978094 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-24 08:56:52.035508 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-24 08:56:52.035538 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-24 08:56:52.035546 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-24 08:56:52.035552 | controller | 2026-02-24 08:56:52.035558 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-24 08:56:52.035564 | controller | Tuesday 24 February 2026 08:56:51 +0000 (0:00:00.076) 0:03:07.544 ****** 2026-02-24 08:56:52.035580 | controller | skipping: [instance] 2026-02-24 08:56:52.086556 | controller | 2026-02-24 08:56:52.086583 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-24 08:56:52.086591 | controller | Tuesday 24 February 2026 08:56:52 +0000 (0:00:00.057) 0:03:07.601 ****** 2026-02-24 08:56:52.086606 | controller | skipping: [instance] 2026-02-24 08:56:52.132528 | controller | 2026-02-24 08:56:52.132562 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-24 08:56:52.132570 | controller | Tuesday 24 February 2026 08:56:52 +0000 (0:00:00.050) 0:03:07.652 ****** 2026-02-24 08:56:52.132580 | controller | skipping: [instance] 2026-02-24 08:56:52.132597 | controller | 2026-02-24 08:56:52.132610 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-24 08:56:52.132626 | controller | Tuesday 24 February 2026 08:56:52 +0000 (0:00:00.046) 0:03:07.699 ****** 2026-02-24 08:56:52.179226 | controller | skipping: [instance] 2026-02-24 08:56:52.179278 | controller | 2026-02-24 08:56:52.179378 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-24 08:56:52.179498 | controller | Tuesday 24 February 2026 08:56:52 +0000 (0:00:00.046) 0:03:07.745 ****** 2026-02-24 08:56:52.873557 | controller | changed: [instance] 2026-02-24 08:56:52.873642 | controller | 2026-02-24 08:56:52.873654 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-24 08:56:52.873664 | controller | Tuesday 24 February 2026 08:56:52 +0000 (0:00:00.691) 0:03:08.437 ****** 2026-02-24 08:56:52.919797 | controller | skipping: [instance] 2026-02-24 08:56:52.919983 | controller | 2026-02-24 08:56:52.920132 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-24 08:56:52.920266 | controller | Tuesday 24 February 2026 08:56:52 +0000 (0:00:00.048) 0:03:08.486 ****** 2026-02-24 08:56:52.964561 | controller | skipping: [instance] 2026-02-24 08:56:53.006297 | controller | 2026-02-24 08:56:53.006338 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-24 08:56:53.006347 | controller | Tuesday 24 February 2026 08:56:52 +0000 (0:00:00.044) 0:03:08.530 ****** 2026-02-24 08:56:53.006358 | controller | skipping: [instance] 2026-02-24 08:56:53.006377 | controller | 2026-02-24 08:56:53.006479 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 08:56:53.006587 | controller | Tuesday 24 February 2026 08:56:53 +0000 (0:00:00.042) 0:03:08.573 ****** 2026-02-24 08:56:53.046237 | controller | skipping: [instance] 2026-02-24 08:56:53.085936 | controller | 2026-02-24 08:56:53.085958 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 08:56:53.085965 | controller | Tuesday 24 February 2026 08:56:53 +0000 (0:00:00.039) 0:03:08.612 ****** 2026-02-24 08:56:53.085975 | controller | skipping: [instance] 2026-02-24 08:56:53.131775 | controller | 2026-02-24 08:56:53.131808 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 08:56:53.131816 | controller | Tuesday 24 February 2026 08:56:53 +0000 (0:00:00.039) 0:03:08.652 ****** 2026-02-24 08:56:53.131827 | controller | skipping: [instance] 2026-02-24 08:56:53.167703 | controller | 2026-02-24 08:56:53.167733 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 08:56:53.167742 | controller | Tuesday 24 February 2026 08:56:53 +0000 (0:00:00.045) 0:03:08.698 ****** 2026-02-24 08:56:53.167754 | controller | skipping: [instance] 2026-02-24 08:56:53.202674 | controller | 2026-02-24 08:56:53.202703 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 08:56:53.202712 | controller | Tuesday 24 February 2026 08:56:53 +0000 (0:00:00.035) 0:03:08.734 ****** 2026-02-24 08:56:53.202722 | controller | skipping: [instance] 2026-02-24 08:56:53.243126 | controller | 2026-02-24 08:56:53.243148 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 08:56:53.243155 | controller | Tuesday 24 February 2026 08:56:53 +0000 (0:00:00.035) 0:03:08.769 ****** 2026-02-24 08:56:53.243164 | controller | skipping: [instance] 2026-02-24 08:56:53.298873 | controller | 2026-02-24 08:56:53.298913 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 08:56:53.298921 | controller | Tuesday 24 February 2026 08:56:53 +0000 (0:00:00.040) 0:03:08.809 ****** 2026-02-24 08:56:53.298932 | controller | skipping: [instance] 2026-02-24 08:56:53.345657 | controller | 2026-02-24 08:56:53.345721 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-24 08:56:53.345746 | controller | Tuesday 24 February 2026 08:56:53 +0000 (0:00:00.055) 0:03:08.865 ****** 2026-02-24 08:56:53.345760 | controller | skipping: [instance] 2026-02-24 08:56:53.346621 | controller | 2026-02-24 08:56:53.346648 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-24 08:56:53.346791 | controller | Tuesday 24 February 2026 08:56:53 +0000 (0:00:00.042) 0:03:08.907 ****** 2026-02-24 08:56:53.499818 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-24 08:56:55.117321 | controller | 2026-02-24 08:56:55.117389 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 08:56:55.117399 | controller | Tuesday 24 February 2026 08:56:53 +0000 (0:00:00.158) 0:03:09.065 ****** 2026-02-24 08:56:55.117432 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 08:56:55.117553 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 08:56:55.117562 | controller | 2026-02-24 08:56:55.117568 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-24 08:56:55.117575 | controller | Tuesday 24 February 2026 08:56:55 +0000 (0:00:01.610) 0:03:10.676 ****** 2026-02-24 08:56:55.135624 | controller | skipping: [instance] 2026-02-24 08:56:55.135785 | controller | 2026-02-24 08:56:55.135812 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 08:56:55.135942 | controller | Tuesday 24 February 2026 08:56:55 +0000 (0:00:00.026) 0:03:10.702 ****** 2026-02-24 08:56:55.816544 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:56:55.816647 | controller | 2026-02-24 08:56:55.816662 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 08:56:55.858662 | controller | Tuesday 24 February 2026 08:56:55 +0000 (0:00:00.680) 0:03:11.382 ****** 2026-02-24 08:56:55.858745 | controller | skipping: [instance] 2026-02-24 08:56:55.858796 | controller | 2026-02-24 08:56:55.858809 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 08:56:55.858958 | controller | Tuesday 24 February 2026 08:56:55 +0000 (0:00:00.042) 0:03:11.424 ****** 2026-02-24 08:56:55.903792 | controller | skipping: [instance] 2026-02-24 08:56:55.945545 | controller | 2026-02-24 08:56:55.945608 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 08:56:55.945619 | controller | Tuesday 24 February 2026 08:56:55 +0000 (0:00:00.043) 0:03:11.468 ****** 2026-02-24 08:56:55.945634 | controller | skipping: [instance] 2026-02-24 08:56:55.996830 | controller | 2026-02-24 08:56:55.996859 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 08:56:55.996869 | controller | Tuesday 24 February 2026 08:56:55 +0000 (0:00:00.042) 0:03:11.511 ****** 2026-02-24 08:56:55.996882 | controller | skipping: [instance] 2026-02-24 08:56:55.997057 | controller | 2026-02-24 08:56:55.997267 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-24 08:56:55.997506 | controller | Tuesday 24 February 2026 08:56:55 +0000 (0:00:00.051) 0:03:11.563 ****** 2026-02-24 08:56:56.039023 | controller | skipping: [instance] 2026-02-24 08:56:56.039250 | controller | 2026-02-24 08:56:56.039497 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-24 08:56:56.039729 | controller | Tuesday 24 February 2026 08:56:56 +0000 (0:00:00.042) 0:03:11.605 ****** 2026-02-24 08:56:56.080601 | controller | skipping: [instance] 2026-02-24 08:56:56.080801 | controller | 2026-02-24 08:56:56.080917 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-24 08:56:56.081024 | controller | Tuesday 24 February 2026 08:56:56 +0000 (0:00:00.041) 0:03:11.647 ****** 2026-02-24 08:56:56.121989 | controller | skipping: [instance] 2026-02-24 08:56:56.122097 | controller | 2026-02-24 08:56:56.122204 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-24 08:56:56.122314 | controller | Tuesday 24 February 2026 08:56:56 +0000 (0:00:00.041) 0:03:11.688 ****** 2026-02-24 08:56:56.165901 | controller | skipping: [instance] 2026-02-24 08:56:56.166105 | controller | 2026-02-24 08:56:56.166319 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-24 08:56:56.166583 | controller | Tuesday 24 February 2026 08:56:56 +0000 (0:00:00.043) 0:03:11.732 ****** 2026-02-24 08:56:57.356732 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:56:58.644829 | controller | 2026-02-24 08:56:58.644904 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-24 08:56:58.644915 | controller | Tuesday 24 February 2026 08:56:57 +0000 (0:00:01.189) 0:03:12.922 ****** 2026-02-24 08:56:58.644930 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:56:58.644980 | controller | 2026-02-24 08:56:58.644992 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-24 08:56:58.645059 | controller | Tuesday 24 February 2026 08:56:58 +0000 (0:00:01.287) 0:03:14.210 ****** 2026-02-24 08:56:59.411982 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:00.464147 | controller | 2026-02-24 08:57:00.464184 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-24 08:57:00.464198 | controller | Tuesday 24 February 2026 08:56:59 +0000 (0:00:00.767) 0:03:14.977 ****** 2026-02-24 08:57:00.464208 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:01.745204 | controller | 2026-02-24 08:57:01.745242 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-24 08:57:01.745250 | controller | Tuesday 24 February 2026 08:57:00 +0000 (0:00:01.052) 0:03:16.029 ****** 2026-02-24 08:57:01.745261 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 08:57:02.470975 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 08:57:02.471004 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 08:57:02.471011 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 08:57:02.471017 | controller | 2026-02-24 08:57:02.471035 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-24 08:57:02.471041 | controller | Tuesday 24 February 2026 08:57:01 +0000 (0:00:01.281) 0:03:17.310 ****** 2026-02-24 08:57:02.471051 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 08:57:04.432573 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 08:57:04.432633 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 08:57:04.432642 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 08:57:04.432648 | controller | 2026-02-24 08:57:04.432653 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-24 08:57:04.432659 | controller | Tuesday 24 February 2026 08:57:02 +0000 (0:00:00.724) 0:03:18.035 ****** 2026-02-24 08:57:04.432675 | controller | skipping: [instance] => (item=instance) 2026-02-24 08:57:04.432694 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-24 08:57:04.432699 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-24 08:57:04.432705 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-24 08:57:04.432713 | controller | 2026-02-24 08:57:04.432790 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-24 08:57:04.432801 | controller | Tuesday 24 February 2026 08:57:04 +0000 (0:00:01.961) 0:03:19.997 ****** 2026-02-24 08:57:05.100977 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:05.101041 | controller | 2026-02-24 08:57:05.101138 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-24 08:57:05.101149 | controller | Tuesday 24 February 2026 08:57:05 +0000 (0:00:00.669) 0:03:20.667 ****** 2026-02-24 08:57:06.161918 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:07.305400 | controller | 2026-02-24 08:57:07.305489 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-24 08:57:07.305500 | controller | Tuesday 24 February 2026 08:57:06 +0000 (0:00:01.056) 0:03:21.723 ****** 2026-02-24 08:57:07.305514 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:07.348629 | controller | 2026-02-24 08:57:07.348694 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-24 08:57:07.348703 | controller | Tuesday 24 February 2026 08:57:07 +0000 (0:00:01.147) 0:03:22.870 ****** 2026-02-24 08:57:07.348721 | controller | skipping: [instance] 2026-02-24 08:57:08.014855 | controller | 2026-02-24 08:57:08.014911 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-24 08:57:08.014920 | controller | Tuesday 24 February 2026 08:57:07 +0000 (0:00:00.043) 0:03:22.914 ****** 2026-02-24 08:57:08.014934 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:08.717138 | controller | 2026-02-24 08:57:08.717197 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-24 08:57:08.717206 | controller | Tuesday 24 February 2026 08:57:08 +0000 (0:00:00.665) 0:03:23.580 ****** 2026-02-24 08:57:08.717219 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:08.770593 | controller | 2026-02-24 08:57:08.770626 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-24 08:57:08.770636 | controller | Tuesday 24 February 2026 08:57:08 +0000 (0:00:00.702) 0:03:24.282 ****** 2026-02-24 08:57:08.770649 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:08.850078 | controller | 2026-02-24 08:57:08.850105 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-24 08:57:08.850113 | controller | Tuesday 24 February 2026 08:57:08 +0000 (0:00:00.054) 0:03:24.336 ****** 2026-02-24 08:57:08.850124 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-24 08:57:08.916905 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-24 08:57:08.916951 | controller | 2026-02-24 08:57:08.916961 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 08:57:08.916969 | controller | Tuesday 24 February 2026 08:57:08 +0000 (0:00:00.079) 0:03:24.416 ****** 2026-02-24 08:57:08.916981 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 08:57:08.972935 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-24 08:57:08.972971 | controller | 2026-02-24 08:57:08.972980 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 08:57:08.972988 | controller | Tuesday 24 February 2026 08:57:08 +0000 (0:00:00.066) 0:03:24.482 ****** 2026-02-24 08:57:08.973000 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 08:57:09.033284 | controller | _secret_file: '' 2026-02-24 08:57:09.033324 | controller | 2026-02-24 08:57:09.033333 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 08:57:09.033341 | controller | Tuesday 24 February 2026 08:57:08 +0000 (0:00:00.056) 0:03:24.538 ****** 2026-02-24 08:57:09.033352 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 08:57:09.033534 | controller | _secret_content: my-default-location-place 2026-02-24 08:57:09.033661 | controller | 2026-02-24 08:57:09.033784 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 08:57:09.033917 | controller | Tuesday 24 February 2026 08:57:09 +0000 (0:00:00.060) 0:03:24.599 ****** 2026-02-24 08:57:09.086641 | controller | skipping: [instance] 2026-02-24 08:57:09.086775 | controller | 2026-02-24 08:57:09.086899 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 08:57:09.087021 | controller | Tuesday 24 February 2026 08:57:09 +0000 (0:00:00.053) 0:03:24.653 ****** 2026-02-24 08:57:09.145620 | controller | skipping: [instance] 2026-02-24 08:57:09.145845 | controller | 2026-02-24 08:57:09.146011 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 08:57:09.146170 | controller | Tuesday 24 February 2026 08:57:09 +0000 (0:00:00.058) 0:03:24.712 ****** 2026-02-24 08:57:09.207109 | controller | skipping: [instance] 2026-02-24 08:57:09.207273 | controller | 2026-02-24 08:57:09.207402 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 08:57:09.207574 | controller | Tuesday 24 February 2026 08:57:09 +0000 (0:00:00.061) 0:03:24.773 ****** 2026-02-24 08:57:10.459931 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:10.528205 | controller | 2026-02-24 08:57:10.528235 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 08:57:10.528243 | controller | Tuesday 24 February 2026 08:57:10 +0000 (0:00:01.252) 0:03:26.025 ****** 2026-02-24 08:57:10.528253 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 08:57:10.595162 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-24 08:57:10.595196 | controller | 2026-02-24 08:57:10.595205 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 08:57:10.595211 | controller | Tuesday 24 February 2026 08:57:10 +0000 (0:00:00.068) 0:03:26.094 ****** 2026-02-24 08:57:10.595220 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 08:57:10.647991 | controller | _secret_file: /tmp/ipmi-things 2026-02-24 08:57:10.648011 | controller | 2026-02-24 08:57:10.648018 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 08:57:10.648024 | controller | Tuesday 24 February 2026 08:57:10 +0000 (0:00:00.066) 0:03:26.161 ****** 2026-02-24 08:57:10.648033 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 08:57:10.720746 | controller | _secret_content: '' 2026-02-24 08:57:10.720765 | controller | 2026-02-24 08:57:10.720772 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 08:57:10.720779 | controller | Tuesday 24 February 2026 08:57:10 +0000 (0:00:00.053) 0:03:26.214 ****** 2026-02-24 08:57:10.720788 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-24 08:57:11.484712 | controller | msg: All assertions passed 2026-02-24 08:57:11.484783 | controller | 2026-02-24 08:57:11.484794 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 08:57:11.484802 | controller | Tuesday 24 February 2026 08:57:10 +0000 (0:00:00.072) 0:03:26.286 ****** 2026-02-24 08:57:11.484814 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:12.732576 | controller | 2026-02-24 08:57:12.732628 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 08:57:12.732637 | controller | Tuesday 24 February 2026 08:57:11 +0000 (0:00:00.763) 0:03:27.050 ****** 2026-02-24 08:57:12.732648 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:12.797140 | controller | 2026-02-24 08:57:12.797167 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 08:57:12.797177 | controller | Tuesday 24 February 2026 08:57:12 +0000 (0:00:01.247) 0:03:28.298 ****** 2026-02-24 08:57:12.797189 | controller | skipping: [instance] 2026-02-24 08:57:12.797485 | controller | 2026-02-24 08:57:12.797656 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-24 08:57:12.797777 | controller | Tuesday 24 February 2026 08:57:12 +0000 (0:00:00.065) 0:03:28.363 ****** 2026-02-24 08:57:13.544531 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:14.263739 | controller | 2026-02-24 08:57:14.263774 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-24 08:57:14.263782 | controller | Tuesday 24 February 2026 08:57:13 +0000 (0:00:00.746) 0:03:29.110 ****** 2026-02-24 08:57:14.263793 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:54.100153 | controller | 2026-02-24 08:57:54.100213 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-24 08:57:54.100222 | controller | Tuesday 24 February 2026 08:57:14 +0000 (0:00:00.719) 0:03:29.829 ****** 2026-02-24 08:57:54.100236 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-24 08:57:54.840030 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-24 08:57:54.840197 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-24 08:57:54.840210 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-24 08:57:54.840217 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-24 08:57:54.840234 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-24 08:57:54.840240 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-24 08:57:54.840247 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:54.840254 | controller | 2026-02-24 08:57:54.840261 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-24 08:57:54.840268 | controller | Tuesday 24 February 2026 08:57:54 +0000 (0:00:39.834) 0:04:09.664 ****** 2026-02-24 08:57:54.840284 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:57.686769 | controller | 2026-02-24 08:57:57.686832 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-24 08:57:57.686843 | controller | Tuesday 24 February 2026 08:57:54 +0000 (0:00:00.736) 0:04:10.401 ****** 2026-02-24 08:57:57.686856 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:57.744753 | controller | 2026-02-24 08:57:57.744795 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-24 08:57:57.744804 | controller | Tuesday 24 February 2026 08:57:57 +0000 (0:00:02.847) 0:04:13.248 ****** 2026-02-24 08:57:57.744818 | controller | skipping: [instance] 2026-02-24 08:57:57.809238 | controller | 2026-02-24 08:57:57.809277 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-24 08:57:57.809285 | controller | Tuesday 24 February 2026 08:57:57 +0000 (0:00:00.062) 0:04:13.310 ****** 2026-02-24 08:57:57.809296 | controller | skipping: [instance] 2026-02-24 08:57:58.636305 | controller | 2026-02-24 08:57:58.636358 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-24 08:57:58.636367 | controller | Tuesday 24 February 2026 08:57:57 +0000 (0:00:00.064) 0:04:13.375 ****** 2026-02-24 08:57:58.636379 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:58.636504 | controller | 2026-02-24 08:57:58.636519 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-24 08:57:58.636528 | controller | Tuesday 24 February 2026 08:57:58 +0000 (0:00:00.826) 0:04:14.202 ****** 2026-02-24 08:57:59.378342 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:57:59.734225 | controller | 2026-02-24 08:57:59.734276 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-24 08:57:59.734286 | controller | Tuesday 24 February 2026 08:57:59 +0000 (0:00:00.742) 0:04:14.944 ****** 2026-02-24 08:57:59.734299 | controller | changed: [instance] 2026-02-24 08:58:00.422873 | controller | 2026-02-24 08:58:00.422923 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-24 08:58:00.422931 | controller | Tuesday 24 February 2026 08:57:59 +0000 (0:00:00.355) 0:04:15.299 ****** 2026-02-24 08:58:00.422943 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:01.599508 | controller | 2026-02-24 08:58:01.599556 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-24 08:58:01.599564 | controller | Tuesday 24 February 2026 08:58:00 +0000 (0:00:00.689) 0:04:15.988 ****** 2026-02-24 08:58:01.599576 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:01.649928 | controller | 2026-02-24 08:58:01.649972 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 08:58:01.649982 | controller | Tuesday 24 February 2026 08:58:01 +0000 (0:00:01.176) 0:04:17.165 ****** 2026-02-24 08:58:01.649995 | controller | skipping: [instance] 2026-02-24 08:58:01.699680 | controller | 2026-02-24 08:58:01.699717 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 08:58:01.699732 | controller | Tuesday 24 February 2026 08:58:01 +0000 (0:00:00.050) 0:04:17.216 ****** 2026-02-24 08:58:01.699742 | controller | skipping: [instance] 2026-02-24 08:58:01.741769 | controller | 2026-02-24 08:58:01.741796 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 08:58:01.741804 | controller | Tuesday 24 February 2026 08:58:01 +0000 (0:00:00.049) 0:04:17.265 ****** 2026-02-24 08:58:01.741814 | controller | skipping: [instance] 2026-02-24 08:58:01.798652 | controller | 2026-02-24 08:58:01.798678 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-24 08:58:01.798685 | controller | Tuesday 24 February 2026 08:58:01 +0000 (0:00:00.042) 0:04:17.308 ****** 2026-02-24 08:58:01.798695 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:01.840335 | controller | 2026-02-24 08:58:01.840359 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-24 08:58:01.840367 | controller | Tuesday 24 February 2026 08:58:01 +0000 (0:00:00.056) 0:04:17.365 ****** 2026-02-24 08:58:01.840376 | controller | skipping: [instance] 2026-02-24 08:58:01.881722 | controller | 2026-02-24 08:58:01.881749 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-24 08:58:01.881758 | controller | Tuesday 24 February 2026 08:58:01 +0000 (0:00:00.041) 0:04:17.406 ****** 2026-02-24 08:58:01.881769 | controller | skipping: [instance] 2026-02-24 08:58:01.921546 | controller | 2026-02-24 08:58:01.921568 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-24 08:58:01.921575 | controller | Tuesday 24 February 2026 08:58:01 +0000 (0:00:00.041) 0:04:17.448 ****** 2026-02-24 08:58:01.921590 | controller | skipping: [instance] 2026-02-24 08:58:01.921716 | controller | 2026-02-24 08:58:01.921841 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-24 08:58:01.921961 | controller | Tuesday 24 February 2026 08:58:01 +0000 (0:00:00.039) 0:04:17.488 ****** 2026-02-24 08:58:02.593197 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:02.701406 | controller | 2026-02-24 08:58:02.701462 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-24 08:58:02.701470 | controller | Tuesday 24 February 2026 08:58:02 +0000 (0:00:00.670) 0:04:18.158 ****** 2026-02-24 08:58:02.701481 | controller | skipping: [instance] => (item=secret) 2026-02-24 08:58:03.751157 | controller | skipping: [instance] => (item=configmap) 2026-02-24 08:58:03.751210 | controller | skipping: [instance] => (item=pod) 2026-02-24 08:58:03.751217 | controller | skipping: [instance] => (item=service) 2026-02-24 08:58:03.751224 | controller | skipping: [instance] => (item=route) 2026-02-24 08:58:03.751229 | controller | skipping: [instance] 2026-02-24 08:58:03.751236 | controller | 2026-02-24 08:58:03.751242 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-24 08:58:03.751248 | controller | Tuesday 24 February 2026 08:58:02 +0000 (0:00:00.108) 0:04:18.267 ****** 2026-02-24 08:58:03.751259 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:04.895528 | controller | 2026-02-24 08:58:04.895575 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-24 08:58:04.895583 | controller | Tuesday 24 February 2026 08:58:03 +0000 (0:00:01.049) 0:04:19.316 ****** 2026-02-24 08:58:04.895595 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:04.940378 | controller | 2026-02-24 08:58:04.940451 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-24 08:58:04.940460 | controller | Tuesday 24 February 2026 08:58:04 +0000 (0:00:01.144) 0:04:20.461 ****** 2026-02-24 08:58:04.940472 | controller | skipping: [instance] 2026-02-24 08:58:04.985349 | controller | 2026-02-24 08:58:04.985434 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-24 08:58:04.985447 | controller | Tuesday 24 February 2026 08:58:04 +0000 (0:00:00.045) 0:04:20.506 ****** 2026-02-24 08:58:04.985461 | controller | skipping: [instance] 2026-02-24 08:58:05.066451 | controller | 2026-02-24 08:58:05.066504 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-24 08:58:05.066514 | controller | Tuesday 24 February 2026 08:58:04 +0000 (0:00:00.044) 0:04:20.551 ****** 2026-02-24 08:58:05.066526 | controller | skipping: [instance] => (item=secret) 2026-02-24 08:58:05.109901 | controller | skipping: [instance] => (item=configmap) 2026-02-24 08:58:05.109955 | controller | skipping: [instance] => (item=service) 2026-02-24 08:58:05.109963 | controller | skipping: [instance] => (item=route) 2026-02-24 08:58:05.109969 | controller | skipping: [instance] 2026-02-24 08:58:05.109976 | controller | 2026-02-24 08:58:05.109982 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-24 08:58:05.109989 | controller | Tuesday 24 February 2026 08:58:05 +0000 (0:00:00.080) 0:04:20.632 ****** 2026-02-24 08:58:05.110001 | controller | skipping: [instance] 2026-02-24 08:58:05.110144 | controller | 2026-02-24 08:58:05.110291 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-24 08:58:05.110454 | controller | Tuesday 24 February 2026 08:58:05 +0000 (0:00:00.043) 0:04:20.676 ****** 2026-02-24 08:58:06.748592 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:07.627298 | controller | 2026-02-24 08:58:07.627352 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-24 08:58:07.627362 | controller | Tuesday 24 February 2026 08:58:06 +0000 (0:00:01.638) 0:04:22.314 ****** 2026-02-24 08:58:07.627375 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:07.685601 | controller | 2026-02-24 08:58:07.685621 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-24 08:58:07.685629 | controller | Tuesday 24 February 2026 08:58:07 +0000 (0:00:00.878) 0:04:23.193 ****** 2026-02-24 08:58:07.685638 | controller | skipping: [instance] 2026-02-24 08:58:07.734316 | controller | 2026-02-24 08:58:07.734336 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-24 08:58:07.734343 | controller | Tuesday 24 February 2026 08:58:07 +0000 (0:00:00.058) 0:04:23.251 ****** 2026-02-24 08:58:07.734352 | controller | skipping: [instance] 2026-02-24 08:58:07.791141 | controller | 2026-02-24 08:58:07.791159 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-24 08:58:07.791166 | controller | Tuesday 24 February 2026 08:58:07 +0000 (0:00:00.048) 0:04:23.300 ****** 2026-02-24 08:58:07.791174 | controller | skipping: [instance] 2026-02-24 08:58:19.228509 | controller | 2026-02-24 08:58:19.228565 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-24 08:58:19.228574 | controller | Tuesday 24 February 2026 08:58:07 +0000 (0:00:00.056) 0:04:23.357 ****** 2026-02-24 08:58:19.228586 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:20.699553 | controller | 2026-02-24 08:58:20.699616 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-24 08:58:20.699627 | controller | Tuesday 24 February 2026 08:58:19 +0000 (0:00:11.428) 0:04:34.786 ****** 2026-02-24 08:58:20.699644 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:21.912298 | controller | 2026-02-24 08:58:21.912351 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 08:58:21.912369 | controller | Tuesday 24 February 2026 08:58:20 +0000 (0:00:01.478) 0:04:36.264 ****** 2026-02-24 08:58:21.912394 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 08:58:21.955305 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 08:58:21.955339 | controller | 2026-02-24 08:58:21.955346 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-24 08:58:21.955353 | controller | Tuesday 24 February 2026 08:58:21 +0000 (0:00:01.212) 0:04:37.477 ****** 2026-02-24 08:58:21.955363 | controller | skipping: [instance] 2026-02-24 08:58:22.545627 | controller | 2026-02-24 08:58:22.545669 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-24 08:58:22.545678 | controller | Tuesday 24 February 2026 08:58:21 +0000 (0:00:00.043) 0:04:37.521 ****** 2026-02-24 08:58:22.545691 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:22.582928 | controller | 2026-02-24 08:58:22.582960 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-24 08:58:22.582968 | controller | Tuesday 24 February 2026 08:58:22 +0000 (0:00:00.589) 0:04:38.111 ****** 2026-02-24 08:58:22.582980 | controller | skipping: [instance] 2026-02-24 08:58:22.631200 | controller | 2026-02-24 08:58:22.631234 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-24 08:58:22.631243 | controller | Tuesday 24 February 2026 08:58:22 +0000 (0:00:00.037) 0:04:38.149 ****** 2026-02-24 08:58:22.631253 | controller | skipping: [instance] 2026-02-24 08:58:22.675948 | controller | 2026-02-24 08:58:22.675986 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 08:58:22.675995 | controller | Tuesday 24 February 2026 08:58:22 +0000 (0:00:00.048) 0:04:38.197 ****** 2026-02-24 08:58:22.676007 | controller | skipping: [instance] 2026-02-24 08:58:22.676428 | controller | 2026-02-24 08:58:22.716394 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 08:58:22.716435 | controller | Tuesday 24 February 2026 08:58:22 +0000 (0:00:00.044) 0:04:38.242 ****** 2026-02-24 08:58:22.716449 | controller | skipping: [instance] 2026-02-24 08:58:22.849396 | controller | 2026-02-24 08:58:22.849436 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-24 08:58:22.849445 | controller | Tuesday 24 February 2026 08:58:22 +0000 (0:00:00.040) 0:04:38.282 ****** 2026-02-24 08:58:22.849455 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-24 08:58:23.981219 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-24 08:58:23.981261 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-24 08:58:23.981269 | controller | 2026-02-24 08:58:23.981276 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-24 08:58:23.981282 | controller | Tuesday 24 February 2026 08:58:22 +0000 (0:00:00.132) 0:04:38.415 ****** 2026-02-24 08:58:23.981293 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:24.030486 | controller | 2026-02-24 08:58:24.030522 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-24 08:58:24.030531 | controller | Tuesday 24 February 2026 08:58:23 +0000 (0:00:01.131) 0:04:39.547 ****** 2026-02-24 08:58:24.030542 | controller | skipping: [instance] 2026-02-24 08:58:24.030850 | controller | 2026-02-24 08:58:24.173449 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-24 08:58:24.173479 | controller | Tuesday 24 February 2026 08:58:24 +0000 (0:00:00.049) 0:04:39.596 ****** 2026-02-24 08:58:24.173491 | controller | 2026-02-24 08:58:24.228320 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-24 08:58:24.228343 | controller | Tuesday 24 February 2026 08:58:24 +0000 (0:00:00.142) 0:04:39.739 ****** 2026-02-24 08:58:24.228357 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:24.280512 | controller | 2026-02-24 08:58:24.280540 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 08:58:24.280551 | controller | Tuesday 24 February 2026 08:58:24 +0000 (0:00:00.055) 0:04:39.794 ****** 2026-02-24 08:58:24.280563 | controller | skipping: [instance] 2026-02-24 08:58:24.328935 | controller | 2026-02-24 08:58:24.328958 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 08:58:24.328966 | controller | Tuesday 24 February 2026 08:58:24 +0000 (0:00:00.052) 0:04:39.846 ****** 2026-02-24 08:58:24.328976 | controller | skipping: [instance] 2026-02-24 08:58:25.847960 | controller | 2026-02-24 08:58:25.848013 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-24 08:58:25.848030 | controller | Tuesday 24 February 2026 08:58:24 +0000 (0:00:00.048) 0:04:39.895 ****** 2026-02-24 08:58:25.848044 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:34.189607 | controller | 2026-02-24 08:58:34.190439 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-02-24 08:58:34.190458 | controller | Tuesday 24 February 2026 08:58:25 +0000 (0:00:01.518) 0:04:41.413 ****** 2026-02-24 08:58:34.190473 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-02-24 08:58:34.308122 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-02-24 08:58:34.308157 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-02-24 08:58:34.308165 | controller | 2026-02-24 08:58:34.308172 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-02-24 08:58:34.308178 | controller | Tuesday 24 February 2026 08:58:34 +0000 (0:00:08.338) 0:04:49.752 ****** 2026-02-24 08:58:34.308189 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-02-24 08:58:34.567800 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-02-24 08:58:34.567839 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-02-24 08:58:34.567848 | controller | 2026-02-24 08:58:34.567860 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-02-24 08:58:34.567866 | controller | Tuesday 24 February 2026 08:58:34 +0000 (0:00:00.122) 0:04:49.874 ****** 2026-02-24 08:58:34.567878 | controller | ok: [instance -> localhost] 2026-02-24 08:58:36.885281 | controller | 2026-02-24 08:58:36.885325 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-02-24 08:58:36.885335 | controller | Tuesday 24 February 2026 08:58:34 +0000 (0:00:00.259) 0:04:50.133 ****** 2026-02-24 08:58:36.885346 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-02-24 08:58:37.577289 | controller | 2026-02-24 08:58:37.577341 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-02-24 08:58:37.577350 | controller | Tuesday 24 February 2026 08:58:36 +0000 (0:00:02.315) 0:04:52.449 ****** 2026-02-24 08:58:37.577363 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:38.396208 | controller | 2026-02-24 08:58:38.396248 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-02-24 08:58:38.396256 | controller | Tuesday 24 February 2026 08:58:37 +0000 (0:00:00.693) 0:04:53.143 ****** 2026-02-24 08:58:38.396270 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:39.687492 | controller | 2026-02-24 08:58:39.687544 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-02-24 08:58:39.687553 | controller | Tuesday 24 February 2026 08:58:38 +0000 (0:00:00.819) 0:04:53.962 ****** 2026-02-24 08:58:39.687567 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:40.431453 | controller | 2026-02-24 08:58:40.431500 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-02-24 08:58:40.431509 | controller | Tuesday 24 February 2026 08:58:39 +0000 (0:00:01.290) 0:04:55.252 ****** 2026-02-24 08:58:40.431521 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:41.616265 | controller | 2026-02-24 08:58:41.616315 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-02-24 08:58:41.616323 | controller | Tuesday 24 February 2026 08:58:40 +0000 (0:00:00.742) 0:04:55.995 ****** 2026-02-24 08:58:41.616336 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:42.337300 | controller | 2026-02-24 08:58:42.337351 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-02-24 08:58:42.337360 | controller | Tuesday 24 February 2026 08:58:41 +0000 (0:00:01.186) 0:04:57.181 ****** 2026-02-24 08:58:42.337383 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:43.023148 | controller | 2026-02-24 08:58:43.023198 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-02-24 08:58:43.023207 | controller | Tuesday 24 February 2026 08:58:42 +0000 (0:00:00.720) 0:04:57.902 ****** 2026-02-24 08:58:43.023219 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:44.548577 | controller | 2026-02-24 08:58:44.548647 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-02-24 08:58:44.548657 | controller | Tuesday 24 February 2026 08:58:43 +0000 (0:00:00.685) 0:04:58.588 ****** 2026-02-24 08:58:44.548673 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-24 08:58:44.589564 | controller | 2026-02-24 08:58:44.589602 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 08:58:44.589622 | controller | Tuesday 24 February 2026 08:58:44 +0000 (0:00:01.525) 0:05:00.114 ****** 2026-02-24 08:58:44.589637 | controller | skipping: [instance] 2026-02-24 08:58:44.589663 | controller | 2026-02-24 08:58:44.589780 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 08:58:44.589886 | controller | Tuesday 24 February 2026 08:58:44 +0000 (0:00:00.041) 0:05:00.155 ****** 2026-02-24 08:58:44.631334 | controller | skipping: [instance] 2026-02-24 08:58:44.631447 | controller | 2026-02-24 08:58:44.631554 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 08:58:44.631645 | controller | Tuesday 24 February 2026 08:58:44 +0000 (0:00:00.042) 0:05:00.197 ****** 2026-02-24 08:58:44.677249 | controller | skipping: [instance] 2026-02-24 08:58:44.677347 | controller | 2026-02-24 08:58:44.677508 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 08:58:44.677619 | controller | Tuesday 24 February 2026 08:58:44 +0000 (0:00:00.045) 0:05:00.243 ****** 2026-02-24 08:58:44.717982 | controller | skipping: [instance] 2026-02-24 08:58:44.718061 | controller | 2026-02-24 08:58:44.718167 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 08:58:44.718264 | controller | Tuesday 24 February 2026 08:58:44 +0000 (0:00:00.040) 0:05:00.284 ****** 2026-02-24 08:58:44.756331 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:44.756441 | controller | 2026-02-24 08:58:44.756558 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 08:58:44.756666 | controller | Tuesday 24 February 2026 08:58:44 +0000 (0:00:00.038) 0:05:00.323 ****** 2026-02-24 08:58:44.873166 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-24 08:58:44.873259 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-02-24 08:58:44.873352 | controller | 2026-02-24 08:58:44.873474 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 08:58:44.873577 | controller | Tuesday 24 February 2026 08:58:44 +0000 (0:00:00.116) 0:05:00.439 ****** 2026-02-24 08:58:44.926953 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-02-24 08:58:44.927042 | controller | 2026-02-24 08:58:44.927156 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-02-24 08:58:44.927243 | controller | Tuesday 24 February 2026 08:58:44 +0000 (0:00:00.053) 0:05:00.493 ****** 2026-02-24 08:58:48.733052 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-24 08:58:48.733119 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-02-24 08:58:48.733149 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-24 08:58:48.733251 | controller | 2026-02-24 08:58:48.733342 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-02-24 08:58:48.733477 | controller | Tuesday 24 February 2026 08:58:48 +0000 (0:00:03.805) 0:05:04.299 ****** 2026-02-24 08:58:50.075973 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:50.076053 | controller | 2026-02-24 08:58:50.076167 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 08:58:50.076179 | controller | Tuesday 24 February 2026 08:58:50 +0000 (0:00:01.342) 0:05:05.642 ****** 2026-02-24 08:58:50.621982 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:50.622060 | controller | 2026-02-24 08:58:50.622154 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 08:58:50.622165 | controller | Tuesday 24 February 2026 08:58:50 +0000 (0:00:00.545) 0:05:06.188 ****** 2026-02-24 08:58:51.753051 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:51.860673 | controller | 2026-02-24 08:58:51.860713 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 08:58:51.860722 | controller | Tuesday 24 February 2026 08:58:51 +0000 (0:00:01.130) 0:05:07.318 ****** 2026-02-24 08:58:51.860733 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:51.931942 | controller | 2026-02-24 08:58:51.931978 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 08:58:51.931987 | controller | Tuesday 24 February 2026 08:58:51 +0000 (0:00:00.107) 0:05:07.426 ****** 2026-02-24 08:58:51.931998 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:53.048363 | controller | 2026-02-24 08:58:53.048438 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 08:58:53.048450 | controller | Tuesday 24 February 2026 08:58:51 +0000 (0:00:00.071) 0:05:07.498 ****** 2026-02-24 08:58:53.048462 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:58:54.016117 | controller | 2026-02-24 08:58:54.016160 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-02-24 08:58:54.016169 | controller | Tuesday 24 February 2026 08:58:53 +0000 (0:00:01.115) 0:05:08.613 ****** 2026-02-24 08:58:54.016181 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:00.107386 | controller | 2026-02-24 08:59:00.107518 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-02-24 08:59:00.107529 | controller | Tuesday 24 February 2026 08:58:54 +0000 (0:00:00.968) 0:05:09.581 ****** 2026-02-24 08:59:00.107542 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-02-24 08:59:00.312038 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:00.312067 | controller | 2026-02-24 08:59:00.312074 | controller | TASK [Configure ntp service] *************************************************** 2026-02-24 08:59:00.312080 | controller | Tuesday 24 February 2026 08:59:00 +0000 (0:00:06.090) 0:05:15.672 ****** 2026-02-24 08:59:00.312091 | controller | 2026-02-24 08:59:01.347526 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-02-24 08:59:01.347587 | controller | Tuesday 24 February 2026 08:59:00 +0000 (0:00:00.206) 0:05:15.878 ****** 2026-02-24 08:59:01.347601 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:02.460890 | controller | 2026-02-24 08:59:02.460951 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-02-24 08:59:02.460960 | controller | Tuesday 24 February 2026 08:59:01 +0000 (0:00:01.034) 0:05:16.913 ****** 2026-02-24 08:59:02.460973 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-02-24 08:59:03.543442 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-02-24 08:59:03.543504 | controller | 2026-02-24 08:59:03.543512 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-02-24 08:59:03.543519 | controller | Tuesday 24 February 2026 08:59:02 +0000 (0:00:01.111) 0:05:18.024 ****** 2026-02-24 08:59:03.543531 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:04.266119 | controller | 2026-02-24 08:59:04.266174 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-02-24 08:59:04.266182 | controller | Tuesday 24 February 2026 08:59:03 +0000 (0:00:01.083) 0:05:19.109 ****** 2026-02-24 08:59:04.266204 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:04.266382 | controller | 2026-02-24 08:59:04.266560 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-02-24 08:59:04.266698 | controller | Tuesday 24 February 2026 08:59:04 +0000 (0:00:00.723) 0:05:19.832 ****** 2026-02-24 08:59:04.420258 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-02-24 08:59:04.420462 | controller | 2026-02-24 08:59:04.420626 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-02-24 08:59:04.420762 | controller | Tuesday 24 February 2026 08:59:04 +0000 (0:00:00.154) 0:05:19.986 ****** 2026-02-24 08:59:04.980725 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:04.981862 | controller | 2026-02-24 08:59:04.982053 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-02-24 08:59:04.982196 | controller | Tuesday 24 February 2026 08:59:04 +0000 (0:00:00.559) 0:05:20.546 ****** 2026-02-24 08:59:05.496643 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-24 08:59:06.292861 | controller | 2026-02-24 08:59:06.292904 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-02-24 08:59:06.292912 | controller | Tuesday 24 February 2026 08:59:05 +0000 (0:00:00.515) 0:05:21.062 ****** 2026-02-24 08:59:06.292923 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 08:59:06.906495 | controller | 2026-02-24 08:59:06.906540 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-02-24 08:59:06.906550 | controller | Tuesday 24 February 2026 08:59:06 +0000 (0:00:00.796) 0:05:21.858 ****** 2026-02-24 08:59:06.906563 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 08:59:06.963327 | controller | 2026-02-24 08:59:06.963381 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-02-24 08:59:06.963407 | controller | Tuesday 24 February 2026 08:59:06 +0000 (0:00:00.613) 0:05:22.472 ****** 2026-02-24 08:59:06.963439 | controller | 2026-02-24 08:59:07.456506 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-02-24 08:59:07.456564 | controller | Tuesday 24 February 2026 08:59:06 +0000 (0:00:00.057) 0:05:22.529 ****** 2026-02-24 08:59:07.456579 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-24 08:59:08.289484 | controller | 2026-02-24 08:59:08.289540 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-02-24 08:59:08.289549 | controller | Tuesday 24 February 2026 08:59:07 +0000 (0:00:00.492) 0:05:23.021 ****** 2026-02-24 08:59:08.289562 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-24 08:59:08.335279 | controller | 2026-02-24 08:59:08.335317 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-02-24 08:59:08.335326 | controller | Tuesday 24 February 2026 08:59:08 +0000 (0:00:00.833) 0:05:23.855 ****** 2026-02-24 08:59:08.335336 | controller | skipping: [instance] 2026-02-24 08:59:08.384941 | controller | 2026-02-24 08:59:08.384966 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-02-24 08:59:08.384974 | controller | Tuesday 24 February 2026 08:59:08 +0000 (0:00:00.046) 0:05:23.901 ****** 2026-02-24 08:59:08.384984 | controller | skipping: [instance] 2026-02-24 08:59:08.667276 | controller | 2026-02-24 08:59:08.667323 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-02-24 08:59:08.667331 | controller | Tuesday 24 February 2026 08:59:08 +0000 (0:00:00.049) 0:05:23.950 ****** 2026-02-24 08:59:08.667342 | controller | changed: [instance] 2026-02-24 08:59:08.750404 | controller | 2026-02-24 08:59:08.750442 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-02-24 08:59:08.750450 | controller | Tuesday 24 February 2026 08:59:08 +0000 (0:00:00.282) 0:05:24.233 ****** 2026-02-24 08:59:08.750459 | controller | skipping: [instance] => (item=) 2026-02-24 08:59:08.791572 | controller | 2026-02-24 08:59:08.791591 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-02-24 08:59:08.791598 | controller | Tuesday 24 February 2026 08:59:08 +0000 (0:00:00.083) 0:05:24.316 ****** 2026-02-24 08:59:08.791606 | controller | ok: [instance] 2026-02-24 08:59:08.876209 | controller | 2026-02-24 08:59:08.876229 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 08:59:08.876236 | controller | Tuesday 24 February 2026 08:59:08 +0000 (0:00:00.041) 0:05:24.358 ****** 2026-02-24 08:59:08.876244 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-24 08:59:09.213870 | controller | 2026-02-24 08:59:09.213915 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 08:59:09.213924 | controller | Tuesday 24 February 2026 08:59:08 +0000 (0:00:00.084) 0:05:24.442 ****** 2026-02-24 08:59:09.213937 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-24 08:59:09.269634 | controller | 2026-02-24 08:59:09.269665 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-02-24 08:59:09.269680 | controller | Tuesday 24 February 2026 08:59:09 +0000 (0:00:00.333) 0:05:24.775 ****** 2026-02-24 08:59:09.269691 | controller | 2026-02-24 08:59:09.340996 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 08:59:09.341023 | controller | Tuesday 24 February 2026 08:59:09 +0000 (0:00:00.059) 0:05:24.835 ****** 2026-02-24 08:59:09.341035 | controller | ok: [instance] 2026-02-24 08:59:09.409955 | controller | 2026-02-24 08:59:09.409983 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 08:59:09.409991 | controller | Tuesday 24 February 2026 08:59:09 +0000 (0:00:00.071) 0:05:24.907 ****** 2026-02-24 08:59:09.410002 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 08:59:09.729441 | controller | 2026-02-24 08:59:09.729485 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 08:59:09.729493 | controller | Tuesday 24 February 2026 08:59:09 +0000 (0:00:00.068) 0:05:24.976 ****** 2026-02-24 08:59:09.729504 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 08:59:09.797404 | controller | 2026-02-24 08:59:09.797444 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 08:59:09.797452 | controller | Tuesday 24 February 2026 08:59:09 +0000 (0:00:00.318) 0:05:25.295 ****** 2026-02-24 08:59:09.797467 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-24 08:59:10.283994 | controller | skipping: [instance] 2026-02-24 08:59:10.284039 | controller | 2026-02-24 08:59:10.284047 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-02-24 08:59:10.284054 | controller | Tuesday 24 February 2026 08:59:09 +0000 (0:00:00.068) 0:05:25.363 ****** 2026-02-24 08:59:10.284065 | controller | changed: [instance] 2026-02-24 08:59:11.004315 | controller | 2026-02-24 08:59:11.004387 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-24 08:59:11.004396 | controller | Tuesday 24 February 2026 08:59:10 +0000 (0:00:00.470) 0:05:25.834 ****** 2026-02-24 08:59:11.004402 | controller | 2026-02-24 08:59:11.004422 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-02-24 08:59:11.004433 | controller | Tuesday 24 February 2026 08:59:10 +0000 (0:00:00.015) 0:05:25.849 ****** 2026-02-24 08:59:11.004445 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:11.434400 | controller | 2026-02-24 08:59:11.434468 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 08:59:11.434477 | controller | Tuesday 24 February 2026 08:59:11 +0000 (0:00:00.720) 0:05:26.569 ****** 2026-02-24 08:59:11.434489 | controller | changed: [instance] 2026-02-24 08:59:11.617811 | controller | 2026-02-24 08:59:11.617843 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-02-24 08:59:11.617851 | controller | Tuesday 24 February 2026 08:59:11 +0000 (0:00:00.429) 0:05:26.999 ****** 2026-02-24 08:59:11.617861 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 08:59:13.177630 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 08:59:13.177678 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-02-24 08:59:13.177687 | controller | 2026-02-24 08:59:13.177693 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-02-24 08:59:13.177700 | controller | Tuesday 24 February 2026 08:59:11 +0000 (0:00:00.183) 0:05:27.183 ****** 2026-02-24 08:59:13.177711 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-02-24 08:59:13.177730 | controller | 2026-02-24 08:59:13.177811 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-24 08:59:13.177903 | controller | Tuesday 24 February 2026 08:59:13 +0000 (0:00:01.559) 0:05:28.742 ****** 2026-02-24 08:59:13.198513 | controller | skipping: [instance] 2026-02-24 08:59:13.765338 | controller | 2026-02-24 08:59:13.765463 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 08:59:13.765489 | controller | Tuesday 24 February 2026 08:59:13 +0000 (0:00:00.022) 0:05:28.764 ****** 2026-02-24 08:59:13.765517 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-02-24 08:59:13.765627 | controller | 2026-02-24 08:59:13.765648 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 08:59:13.765661 | controller | Tuesday 24 February 2026 08:59:13 +0000 (0:00:00.566) 0:05:29.331 ****** 2026-02-24 08:59:13.816647 | controller | skipping: [instance] 2026-02-24 08:59:13.816753 | controller | 2026-02-24 08:59:13.816871 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 08:59:13.816981 | controller | Tuesday 24 February 2026 08:59:13 +0000 (0:00:00.051) 0:05:29.382 ****** 2026-02-24 08:59:13.875137 | controller | skipping: [instance] 2026-02-24 08:59:13.875205 | controller | 2026-02-24 08:59:13.875301 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 08:59:13.875406 | controller | Tuesday 24 February 2026 08:59:13 +0000 (0:00:00.057) 0:05:29.440 ****** 2026-02-24 08:59:13.921892 | controller | skipping: [instance] 2026-02-24 08:59:13.921937 | controller | 2026-02-24 08:59:13.922043 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 08:59:13.922136 | controller | Tuesday 24 February 2026 08:59:13 +0000 (0:00:00.047) 0:05:29.488 ****** 2026-02-24 08:59:13.976144 | controller | skipping: [instance] 2026-02-24 08:59:13.976201 | controller | 2026-02-24 08:59:13.976313 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-02-24 08:59:13.976432 | controller | Tuesday 24 February 2026 08:59:13 +0000 (0:00:00.054) 0:05:29.542 ****** 2026-02-24 08:59:14.186987 | controller | skipping: [instance] 2026-02-24 08:59:14.187038 | controller | 2026-02-24 08:59:14.187183 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-02-24 08:59:14.187297 | controller | Tuesday 24 February 2026 08:59:14 +0000 (0:00:00.210) 0:05:29.753 ****** 2026-02-24 08:59:14.213938 | controller | skipping: [instance] 2026-02-24 08:59:14.214041 | controller | 2026-02-24 08:59:14.214053 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-02-24 08:59:14.214064 | controller | Tuesday 24 February 2026 08:59:14 +0000 (0:00:00.025) 0:05:29.778 ****** 2026-02-24 08:59:14.252023 | controller | skipping: [instance] 2026-02-24 08:59:14.252058 | controller | 2026-02-24 08:59:14.252194 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-02-24 08:59:14.252299 | controller | Tuesday 24 February 2026 08:59:14 +0000 (0:00:00.039) 0:05:29.818 ****** 2026-02-24 08:59:14.317305 | controller | ok: [instance] 2026-02-24 08:59:14.317385 | controller | 2026-02-24 08:59:14.317510 | controller | TASK [reproducer : Push local code] ******************************************** 2026-02-24 08:59:14.317605 | controller | Tuesday 24 February 2026 08:59:14 +0000 (0:00:00.065) 0:05:29.884 ****** 2026-02-24 08:59:14.423699 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-02-24 08:59:14.423779 | controller | 2026-02-24 08:59:14.423888 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-02-24 08:59:14.423982 | controller | Tuesday 24 February 2026 08:59:14 +0000 (0:00:00.106) 0:05:29.990 ****** 2026-02-24 08:59:14.478371 | controller | skipping: [instance] 2026-02-24 08:59:14.478461 | controller | 2026-02-24 08:59:14.478591 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-02-24 08:59:14.478700 | controller | Tuesday 24 February 2026 08:59:14 +0000 (0:00:00.054) 0:05:30.044 ****** 2026-02-24 08:59:14.534589 | controller | skipping: [instance] 2026-02-24 08:59:14.534687 | controller | 2026-02-24 08:59:14.534807 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-02-24 08:59:14.534926 | controller | Tuesday 24 February 2026 08:59:14 +0000 (0:00:00.056) 0:05:30.101 ****** 2026-02-24 08:59:14.588962 | controller | skipping: [instance] 2026-02-24 08:59:14.589010 | controller | 2026-02-24 08:59:14.589141 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-02-24 08:59:14.589242 | controller | Tuesday 24 February 2026 08:59:14 +0000 (0:00:00.054) 0:05:30.155 ****** 2026-02-24 08:59:14.641174 | controller | skipping: [instance] 2026-02-24 08:59:14.641255 | controller | 2026-02-24 08:59:14.641354 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-02-24 08:59:14.641490 | controller | Tuesday 24 February 2026 08:59:14 +0000 (0:00:00.052) 0:05:30.207 ****** 2026-02-24 08:59:14.686798 | controller | skipping: [instance] 2026-02-24 08:59:14.686919 | controller | 2026-02-24 08:59:14.687039 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-02-24 08:59:14.687070 | controller | Tuesday 24 February 2026 08:59:14 +0000 (0:00:00.045) 0:05:30.253 ****** 2026-02-24 08:59:15.280694 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-02-24 08:59:15.280763 | controller | 2026-02-24 08:59:15.280895 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-02-24 08:59:15.281008 | controller | Tuesday 24 February 2026 08:59:15 +0000 (0:00:00.587) 0:05:30.841 ****** 2026-02-24 08:59:15.979948 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-02-24 08:59:15.980081 | controller | 2026-02-24 08:59:15.980241 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-02-24 08:59:15.980391 | controller | Tuesday 24 February 2026 08:59:15 +0000 (0:00:00.700) 0:05:31.541 ****** 2026-02-24 08:59:16.031679 | controller | skipping: [instance] => (item=ci-framework) 2026-02-24 08:59:16.031821 | controller | skipping: [instance] 2026-02-24 08:59:16.031976 | controller | 2026-02-24 08:59:16.032102 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-02-24 08:59:16.032227 | controller | Tuesday 24 February 2026 08:59:16 +0000 (0:00:00.056) 0:05:31.598 ****** 2026-02-24 08:59:16.120979 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-02-24 08:59:16.121153 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-02-24 08:59:16.121281 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-02-24 08:59:16.121436 | controller | 2026-02-24 08:59:16.121594 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-02-24 08:59:16.121728 | controller | Tuesday 24 February 2026 08:59:16 +0000 (0:00:00.089) 0:05:31.687 ****** 2026-02-24 08:59:16.663644 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:16.663704 | controller | 2026-02-24 08:59:16.663715 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-02-24 08:59:16.663729 | controller | Tuesday 24 February 2026 08:59:16 +0000 (0:00:00.542) 0:05:32.229 ****** 2026-02-24 08:59:16.715266 | controller | skipping: [instance] 2026-02-24 08:59:16.715540 | controller | 2026-02-24 08:59:16.715562 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-02-24 08:59:16.715587 | controller | Tuesday 24 February 2026 08:59:16 +0000 (0:00:00.051) 0:05:32.281 ****** 2026-02-24 08:59:17.312476 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:17.312546 | controller | 2026-02-24 08:59:17.312663 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-02-24 08:59:17.312745 | controller | Tuesday 24 February 2026 08:59:17 +0000 (0:00:00.597) 0:05:32.878 ****** 2026-02-24 08:59:17.361740 | controller | skipping: [instance] 2026-02-24 08:59:17.361834 | controller | 2026-02-24 08:59:17.361976 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-02-24 08:59:17.362120 | controller | Tuesday 24 February 2026 08:59:17 +0000 (0:00:00.049) 0:05:32.928 ****** 2026-02-24 08:59:17.931371 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:20.458464 | controller | 2026-02-24 08:59:20.458512 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-02-24 08:59:20.458521 | controller | Tuesday 24 February 2026 08:59:17 +0000 (0:00:00.568) 0:05:33.496 ****** 2026-02-24 08:59:20.458533 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:41.272325 | controller | 2026-02-24 08:59:41.272383 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-02-24 08:59:41.272393 | controller | Tuesday 24 February 2026 08:59:20 +0000 (0:00:02.526) 0:05:36.023 ****** 2026-02-24 08:59:41.272404 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:42.390505 | controller | 2026-02-24 08:59:42.390561 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-02-24 08:59:42.390570 | controller | Tuesday 24 February 2026 08:59:41 +0000 (0:00:20.815) 0:05:56.838 ****** 2026-02-24 08:59:42.390589 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:42.500733 | controller | 2026-02-24 08:59:42.500796 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-02-24 08:59:42.500806 | controller | Tuesday 24 February 2026 08:59:42 +0000 (0:00:01.117) 0:05:57.956 ****** 2026-02-24 08:59:42.500821 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-02-24 08:59:43.018261 | controller | 2026-02-24 08:59:43.018319 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-02-24 08:59:43.018368 | controller | Tuesday 24 February 2026 08:59:42 +0000 (0:00:00.110) 0:05:58.066 ****** 2026-02-24 08:59:43.018384 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:43.061810 | controller | 2026-02-24 08:59:43.061835 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-02-24 08:59:43.061842 | controller | Tuesday 24 February 2026 08:59:43 +0000 (0:00:00.517) 0:05:58.583 ****** 2026-02-24 08:59:43.061851 | controller | skipping: [instance] 2026-02-24 08:59:43.120923 | controller | 2026-02-24 08:59:43.120983 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-02-24 08:59:43.120996 | controller | Tuesday 24 February 2026 08:59:43 +0000 (0:00:00.044) 0:05:58.628 ****** 2026-02-24 08:59:43.121010 | controller | skipping: [instance] 2026-02-24 08:59:43.121160 | controller | 2026-02-24 08:59:43.230436 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-02-24 08:59:43.230472 | controller | Tuesday 24 February 2026 08:59:43 +0000 (0:00:00.059) 0:05:58.687 ****** 2026-02-24 08:59:43.230486 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:43.726110 | controller | 2026-02-24 08:59:43.726163 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 08:59:43.726172 | controller | Tuesday 24 February 2026 08:59:43 +0000 (0:00:00.109) 0:05:58.796 ****** 2026-02-24 08:59:43.726184 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:43.778884 | controller | 2026-02-24 08:59:43.778926 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 08:59:43.778937 | controller | Tuesday 24 February 2026 08:59:43 +0000 (0:00:00.494) 0:05:59.291 ****** 2026-02-24 08:59:43.778952 | controller | skipping: [instance] 2026-02-24 08:59:43.826189 | controller | 2026-02-24 08:59:43.826223 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 08:59:43.826231 | controller | Tuesday 24 February 2026 08:59:43 +0000 (0:00:00.053) 0:05:59.344 ****** 2026-02-24 08:59:43.826242 | controller | skipping: [instance] 2026-02-24 08:59:43.872229 | controller | 2026-02-24 08:59:43.872262 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 08:59:43.872271 | controller | Tuesday 24 February 2026 08:59:43 +0000 (0:00:00.047) 0:05:59.392 ****** 2026-02-24 08:59:43.872282 | controller | skipping: [instance] 2026-02-24 08:59:43.923257 | controller | 2026-02-24 08:59:43.923287 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 08:59:43.923321 | controller | Tuesday 24 February 2026 08:59:43 +0000 (0:00:00.045) 0:05:59.438 ****** 2026-02-24 08:59:43.923331 | controller | skipping: [instance] 2026-02-24 08:59:45.531725 | controller | 2026-02-24 08:59:45.531766 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-24 08:59:45.531775 | controller | Tuesday 24 February 2026 08:59:43 +0000 (0:00:00.051) 0:05:59.489 ****** 2026-02-24 08:59:45.531787 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 08:59:45.531797 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 08:59:45.531804 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 08:59:45.531809 | controller | changed: [instance -> controller-0] 2026-02-24 08:59:45.531816 | controller | 2026-02-24 08:59:45.531822 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-24 08:59:45.531836 | controller | Tuesday 24 February 2026 08:59:45 +0000 (0:00:01.607) 0:06:01.097 ****** 2026-02-24 08:59:46.602199 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:47.916141 | controller | 2026-02-24 08:59:47.916199 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-24 08:59:47.916210 | controller | Tuesday 24 February 2026 08:59:46 +0000 (0:00:01.070) 0:06:02.167 ****** 2026-02-24 08:59:47.916230 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:55.889599 | controller | 2026-02-24 08:59:55.889649 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-24 08:59:55.889676 | controller | Tuesday 24 February 2026 08:59:47 +0000 (0:00:01.313) 0:06:03.481 ****** 2026-02-24 08:59:55.889689 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:55.889743 | controller | 2026-02-24 08:59:55.889758 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-24 08:59:56.930040 | controller | Tuesday 24 February 2026 08:59:55 +0000 (0:00:07.973) 0:06:11.455 ****** 2026-02-24 08:59:56.930115 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:56.930126 | controller | 2026-02-24 08:59:56.930304 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-24 08:59:56.930650 | controller | Tuesday 24 February 2026 08:59:56 +0000 (0:00:01.040) 0:06:12.495 ****** 2026-02-24 08:59:56.983523 | controller | skipping: [instance] 2026-02-24 08:59:56.983570 | controller | 2026-02-24 08:59:56.983679 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-24 08:59:56.983762 | controller | Tuesday 24 February 2026 08:59:56 +0000 (0:00:00.053) 0:06:12.549 ****** 2026-02-24 08:59:58.209353 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:58.209452 | controller | 2026-02-24 08:59:58.209602 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-24 08:59:58.209651 | controller | Tuesday 24 February 2026 08:59:58 +0000 (0:00:01.225) 0:06:13.775 ****** 2026-02-24 08:59:58.274229 | controller | skipping: [instance] 2026-02-24 08:59:58.331219 | controller | 2026-02-24 08:59:58.331242 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-24 08:59:58.331253 | controller | Tuesday 24 February 2026 08:59:58 +0000 (0:00:00.064) 0:06:13.840 ****** 2026-02-24 08:59:58.331263 | controller | skipping: [instance] 2026-02-24 08:59:58.388655 | controller | 2026-02-24 08:59:58.388706 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-24 08:59:58.388717 | controller | Tuesday 24 February 2026 08:59:58 +0000 (0:00:00.057) 0:06:13.897 ****** 2026-02-24 08:59:58.388729 | controller | skipping: [instance] 2026-02-24 08:59:58.388737 | controller | 2026-02-24 08:59:58.388746 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-24 08:59:58.388850 | controller | Tuesday 24 February 2026 08:59:58 +0000 (0:00:00.057) 0:06:13.955 ****** 2026-02-24 08:59:59.329837 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 08:59:59.329918 | controller | 2026-02-24 08:59:59.329930 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-24 08:59:59.329955 | controller | Tuesday 24 February 2026 08:59:59 +0000 (0:00:00.940) 0:06:14.895 ****** 2026-02-24 09:00:00.392357 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:00.443063 | controller | 2026-02-24 09:00:00.443101 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-24 09:00:00.443110 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:01.062) 0:06:15.957 ****** 2026-02-24 09:00:00.443122 | controller | skipping: [instance] 2026-02-24 09:00:00.491621 | controller | 2026-02-24 09:00:00.491716 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-24 09:00:00.491729 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.051) 0:06:16.009 ****** 2026-02-24 09:00:00.491754 | controller | skipping: [instance] 2026-02-24 09:00:00.540580 | controller | 2026-02-24 09:00:00.540603 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-24 09:00:00.540635 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.048) 0:06:16.058 ****** 2026-02-24 09:00:00.540646 | controller | skipping: [instance] 2026-02-24 09:00:00.540673 | controller | 2026-02-24 09:00:00.540679 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-24 09:00:00.540686 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.048) 0:06:16.107 ****** 2026-02-24 09:00:00.604611 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:00.604678 | controller | 2026-02-24 09:00:00.604687 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-24 09:00:00.604697 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.063) 0:06:16.170 ****** 2026-02-24 09:00:00.649545 | controller | skipping: [instance] 2026-02-24 09:00:00.649682 | controller | 2026-02-24 09:00:00.649720 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-24 09:00:00.649735 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.045) 0:06:16.215 ****** 2026-02-24 09:00:00.700766 | controller | skipping: [instance] 2026-02-24 09:00:00.700972 | controller | 2026-02-24 09:00:00.701010 | controller | TASK [Download the RPM] ******************************************************** 2026-02-24 09:00:00.746623 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.051) 0:06:16.267 ****** 2026-02-24 09:00:00.746659 | controller | skipping: [instance] 2026-02-24 09:00:00.746925 | controller | 2026-02-24 09:00:00.746978 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-24 09:00:00.794632 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.045) 0:06:16.312 ****** 2026-02-24 09:00:00.794684 | controller | skipping: [instance] 2026-02-24 09:00:00.794978 | controller | 2026-02-24 09:00:00.845555 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-24 09:00:00.845600 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.048) 0:06:16.361 ****** 2026-02-24 09:00:00.845614 | controller | skipping: [instance] 2026-02-24 09:00:00.845637 | controller | 2026-02-24 09:00:00.845738 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-24 09:00:00.845749 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.050) 0:06:16.411 ****** 2026-02-24 09:00:00.894264 | controller | skipping: [instance] 2026-02-24 09:00:00.937380 | controller | 2026-02-24 09:00:00.937433 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-24 09:00:00.937448 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.048) 0:06:16.460 ****** 2026-02-24 09:00:00.937461 | controller | skipping: [instance] 2026-02-24 09:00:01.424305 | controller | 2026-02-24 09:00:01.424388 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-24 09:00:01.424399 | controller | Tuesday 24 February 2026 09:00:00 +0000 (0:00:00.043) 0:06:16.503 ****** 2026-02-24 09:00:01.424432 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:01.424460 | controller | 2026-02-24 09:00:01.424468 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-24 09:00:01.424477 | controller | Tuesday 24 February 2026 09:00:01 +0000 (0:00:00.486) 0:06:16.990 ****** 2026-02-24 09:00:01.493699 | controller | skipping: [instance] 2026-02-24 09:00:01.555485 | controller | 2026-02-24 09:00:01.555524 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-24 09:00:01.555533 | controller | Tuesday 24 February 2026 09:00:01 +0000 (0:00:00.069) 0:06:17.059 ****** 2026-02-24 09:00:01.555545 | controller | skipping: [instance] 2026-02-24 09:00:01.605260 | controller | 2026-02-24 09:00:01.605287 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-24 09:00:01.605296 | controller | Tuesday 24 February 2026 09:00:01 +0000 (0:00:00.061) 0:06:17.121 ****** 2026-02-24 09:00:01.605305 | controller | skipping: [instance] 2026-02-24 09:00:01.666783 | controller | 2026-02-24 09:00:01.666839 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-24 09:00:01.666850 | controller | Tuesday 24 February 2026 09:00:01 +0000 (0:00:00.050) 0:06:17.171 ****** 2026-02-24 09:00:01.666874 | controller | skipping: [instance] 2026-02-24 09:00:01.666914 | controller | 2026-02-24 09:00:01.667070 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-24 09:00:01.667103 | controller | Tuesday 24 February 2026 09:00:01 +0000 (0:00:00.061) 0:06:17.233 ****** 2026-02-24 09:00:01.731947 | controller | skipping: [instance] 2026-02-24 09:00:01.797593 | controller | 2026-02-24 09:00:01.797644 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-24 09:00:01.797655 | controller | Tuesday 24 February 2026 09:00:01 +0000 (0:00:00.064) 0:06:17.297 ****** 2026-02-24 09:00:01.797670 | controller | skipping: [instance] 2026-02-24 09:00:01.797679 | controller | 2026-02-24 09:00:01.797689 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-24 09:00:01.797699 | controller | Tuesday 24 February 2026 09:00:01 +0000 (0:00:00.066) 0:06:17.364 ****** 2026-02-24 09:00:01.860098 | controller | skipping: [instance] 2026-02-24 09:00:01.860183 | controller | 2026-02-24 09:00:01.860345 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-24 09:00:01.860569 | controller | Tuesday 24 February 2026 09:00:01 +0000 (0:00:00.062) 0:06:17.426 ****** 2026-02-24 09:00:01.918539 | controller | skipping: [instance] 2026-02-24 09:00:01.918650 | controller | 2026-02-24 09:00:01.918801 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-24 09:00:01.918918 | controller | Tuesday 24 February 2026 09:00:01 +0000 (0:00:00.058) 0:06:17.485 ****** 2026-02-24 09:00:02.526438 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:02.526486 | controller | 2026-02-24 09:00:02.526594 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-24 09:00:02.526677 | controller | Tuesday 24 February 2026 09:00:02 +0000 (0:00:00.607) 0:06:18.092 ****** 2026-02-24 09:00:03.635675 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:03.635740 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:03.635827 | controller | changed: [instance -> controller-0] 2026-02-24 09:00:03.635913 | controller | 2026-02-24 09:00:03.636005 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-24 09:00:03.636090 | controller | Tuesday 24 February 2026 09:00:03 +0000 (0:00:01.109) 0:06:19.201 ****** 2026-02-24 09:00:04.421076 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:04.421132 | controller | 2026-02-24 09:00:04.421302 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-24 09:00:04.421340 | controller | Tuesday 24 February 2026 09:00:04 +0000 (0:00:00.785) 0:06:19.987 ****** 2026-02-24 09:00:05.022722 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:05.022772 | controller | 2026-02-24 09:00:05.023005 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-24 09:00:05.096716 | controller | Tuesday 24 February 2026 09:00:05 +0000 (0:00:00.601) 0:06:20.588 ****** 2026-02-24 09:00:05.096754 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:05.096833 | controller | ok: [instance -> controller-0] 2026-02-24 09:00:05.096938 | controller | 2026-02-24 09:00:05.097033 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-24 09:00:05.097136 | controller | Tuesday 24 February 2026 09:00:05 +0000 (0:00:00.074) 0:06:20.663 ****** 2026-02-24 09:00:05.153078 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:05.153129 | controller | 2026-02-24 09:00:05.153233 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-24 09:00:05.153839 | controller | Tuesday 24 February 2026 09:00:05 +0000 (0:00:00.056) 0:06:20.719 ****** 2026-02-24 09:00:36.245067 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:36.779843 | controller | 2026-02-24 09:00:36.779916 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-24 09:00:36.779929 | controller | Tuesday 24 February 2026 09:00:36 +0000 (0:00:31.084) 0:06:51.803 ****** 2026-02-24 09:00:36.779958 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:37.317093 | controller | 2026-02-24 09:00:37.317132 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-24 09:00:37.317141 | controller | Tuesday 24 February 2026 09:00:36 +0000 (0:00:00.541) 0:06:52.345 ****** 2026-02-24 09:00:37.317156 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:43.556598 | controller | 2026-02-24 09:00:43.556682 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-24 09:00:43.556692 | controller | Tuesday 24 February 2026 09:00:37 +0000 (0:00:00.536) 0:06:52.882 ****** 2026-02-24 09:00:43.556715 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:43.618833 | controller | 2026-02-24 09:00:43.618875 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-24 09:00:43.618885 | controller | Tuesday 24 February 2026 09:00:43 +0000 (0:00:06.239) 0:06:59.122 ****** 2026-02-24 09:00:43.618901 | controller | skipping: [instance] 2026-02-24 09:00:44.290110 | controller | 2026-02-24 09:00:44.290226 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-24 09:00:44.290239 | controller | Tuesday 24 February 2026 09:00:43 +0000 (0:00:00.062) 0:06:59.184 ****** 2026-02-24 09:00:44.290264 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:44.815399 | controller | 2026-02-24 09:00:44.815493 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-24 09:00:44.815503 | controller | Tuesday 24 February 2026 09:00:44 +0000 (0:00:00.670) 0:06:59.855 ****** 2026-02-24 09:00:44.815530 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:44.815686 | controller | 2026-02-24 09:00:44.815747 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-24 09:00:44.864701 | controller | Tuesday 24 February 2026 09:00:44 +0000 (0:00:00.525) 0:07:00.381 ****** 2026-02-24 09:00:44.864796 | controller | skipping: [instance] 2026-02-24 09:00:44.864846 | controller | 2026-02-24 09:00:44.865006 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-24 09:00:44.865042 | controller | Tuesday 24 February 2026 09:00:44 +0000 (0:00:00.049) 0:07:00.431 ****** 2026-02-24 09:00:44.914447 | controller | skipping: [instance] 2026-02-24 09:00:44.963930 | controller | 2026-02-24 09:00:44.963983 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-24 09:00:44.964005 | controller | Tuesday 24 February 2026 09:00:44 +0000 (0:00:00.049) 0:07:00.480 ****** 2026-02-24 09:00:44.964019 | controller | skipping: [instance] 2026-02-24 09:00:44.964039 | controller | 2026-02-24 09:00:44.964048 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-24 09:00:45.013224 | controller | Tuesday 24 February 2026 09:00:44 +0000 (0:00:00.049) 0:07:00.530 ****** 2026-02-24 09:00:45.013261 | controller | skipping: [instance] 2026-02-24 09:00:45.053402 | controller | 2026-02-24 09:00:45.053445 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-24 09:00:45.053453 | controller | Tuesday 24 February 2026 09:00:45 +0000 (0:00:00.049) 0:07:00.579 ****** 2026-02-24 09:00:45.053462 | controller | skipping: [instance] 2026-02-24 09:00:45.096540 | controller | 2026-02-24 09:00:45.096582 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-24 09:00:45.096591 | controller | Tuesday 24 February 2026 09:00:45 +0000 (0:00:00.040) 0:07:00.619 ****** 2026-02-24 09:00:45.096603 | controller | skipping: [instance] 2026-02-24 09:00:45.096623 | controller | 2026-02-24 09:00:45.096629 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-24 09:00:45.096636 | controller | Tuesday 24 February 2026 09:00:45 +0000 (0:00:00.043) 0:07:00.663 ****** 2026-02-24 09:00:47.940579 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:47.940660 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:47.940670 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:47.940687 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:47.940704 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:47.940783 | controller | changed: [instance -> controller-0] 2026-02-24 09:00:47.940863 | controller | 2026-02-24 09:00:47.940955 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-02-24 09:00:47.941083 | controller | Tuesday 24 February 2026 09:00:47 +0000 (0:00:02.843) 0:07:03.506 ****** 2026-02-24 09:00:48.101636 | controller | 2026-02-24 09:00:48.101727 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-02-24 09:00:48.101843 | controller | Tuesday 24 February 2026 09:00:48 +0000 (0:00:00.161) 0:07:03.667 ****** 2026-02-24 09:00:49.733621 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:49.733712 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:49.733722 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:49.733730 | controller | changed: [instance -> controller-0] 2026-02-24 09:00:49.733947 | controller | 2026-02-24 09:00:49.733996 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-02-24 09:00:49.799275 | controller | Tuesday 24 February 2026 09:00:49 +0000 (0:00:01.631) 0:07:05.299 ****** 2026-02-24 09:00:49.799312 | controller | 2026-02-24 09:00:49.851128 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-02-24 09:00:49.851152 | controller | Tuesday 24 February 2026 09:00:49 +0000 (0:00:00.066) 0:07:05.365 ****** 2026-02-24 09:00:49.851164 | controller | skipping: [instance] 2026-02-24 09:00:49.905249 | controller | 2026-02-24 09:00:49.905297 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-02-24 09:00:49.905308 | controller | Tuesday 24 February 2026 09:00:49 +0000 (0:00:00.051) 0:07:05.417 ****** 2026-02-24 09:00:49.905322 | controller | skipping: [instance] 2026-02-24 09:00:49.977757 | controller | 2026-02-24 09:00:49.977782 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-02-24 09:00:49.977793 | controller | Tuesday 24 February 2026 09:00:49 +0000 (0:00:00.054) 0:07:05.471 ****** 2026-02-24 09:00:49.977804 | controller | 2026-02-24 09:00:50.020534 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 09:00:50.020560 | controller | Tuesday 24 February 2026 09:00:49 +0000 (0:00:00.072) 0:07:05.544 ****** 2026-02-24 09:00:50.020572 | controller | skipping: [instance] 2026-02-24 09:00:50.063481 | controller | 2026-02-24 09:00:50.063564 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 09:00:50.063577 | controller | Tuesday 24 February 2026 09:00:50 +0000 (0:00:00.042) 0:07:05.587 ****** 2026-02-24 09:00:50.063597 | controller | skipping: [instance] 2026-02-24 09:00:50.063635 | controller | 2026-02-24 09:00:50.063784 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 09:00:50.063800 | controller | Tuesday 24 February 2026 09:00:50 +0000 (0:00:00.042) 0:07:05.630 ****** 2026-02-24 09:00:50.106015 | controller | skipping: [instance] 2026-02-24 09:00:50.106082 | controller | 2026-02-24 09:00:50.106174 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-24 09:00:50.106270 | controller | Tuesday 24 February 2026 09:00:50 +0000 (0:00:00.042) 0:07:05.672 ****** 2026-02-24 09:00:50.152728 | controller | skipping: [instance] 2026-02-24 09:00:50.152780 | controller | 2026-02-24 09:00:50.152907 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-02-24 09:00:50.152998 | controller | Tuesday 24 February 2026 09:00:50 +0000 (0:00:00.046) 0:07:05.719 ****** 2026-02-24 09:00:50.325146 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-24 09:00:50.325215 | controller | ok: [instance -> controller-0] 2026-02-24 09:00:50.325250 | controller | 2026-02-24 09:00:50.325339 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-02-24 09:00:50.325471 | controller | Tuesday 24 February 2026 09:00:50 +0000 (0:00:00.172) 0:07:05.891 ****** 2026-02-24 09:00:50.395054 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:50.395126 | controller | 2026-02-24 09:00:50.395223 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-02-24 09:00:50.395327 | controller | Tuesday 24 February 2026 09:00:50 +0000 (0:00:00.069) 0:07:05.961 ****** 2026-02-24 09:00:51.435218 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:51.435316 | controller | 2026-02-24 09:00:51.435422 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-02-24 09:00:51.435439 | controller | Tuesday 24 February 2026 09:00:51 +0000 (0:00:01.039) 0:07:07.001 ****** 2026-02-24 09:00:51.482327 | controller | skipping: [instance] 2026-02-24 09:00:51.482434 | controller | 2026-02-24 09:00:51.482598 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-02-24 09:00:51.482731 | controller | Tuesday 24 February 2026 09:00:51 +0000 (0:00:00.047) 0:07:07.048 ****** 2026-02-24 09:00:51.532718 | controller | skipping: [instance] 2026-02-24 09:00:51.532792 | controller | 2026-02-24 09:00:51.532893 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-02-24 09:00:51.532982 | controller | Tuesday 24 February 2026 09:00:51 +0000 (0:00:00.050) 0:07:07.099 ****** 2026-02-24 09:00:51.802118 | controller | skipping: [instance] 2026-02-24 09:00:51.802182 | controller | 2026-02-24 09:00:51.802276 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-02-24 09:00:51.802385 | controller | Tuesday 24 February 2026 09:00:51 +0000 (0:00:00.269) 0:07:07.368 ****** 2026-02-24 09:00:51.872134 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:51.872175 | controller | 2026-02-24 09:00:51.872307 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-02-24 09:00:51.872530 | controller | Tuesday 24 February 2026 09:00:51 +0000 (0:00:00.070) 0:07:07.438 ****** 2026-02-24 09:00:51.924856 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:51.924927 | controller | 2026-02-24 09:00:51.925025 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-02-24 09:00:51.925121 | controller | Tuesday 24 February 2026 09:00:51 +0000 (0:00:00.052) 0:07:07.491 ****** 2026-02-24 09:00:52.003290 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:52.003673 | controller | 2026-02-24 09:00:52.668112 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-02-24 09:00:52.668219 | controller | Tuesday 24 February 2026 09:00:52 +0000 (0:00:00.078) 0:07:07.569 ****** 2026-02-24 09:00:52.668248 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:52.668560 | controller | 2026-02-24 09:00:52.668587 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-02-24 09:00:52.668602 | controller | Tuesday 24 February 2026 09:00:52 +0000 (0:00:00.664) 0:07:08.233 ****** 2026-02-24 09:00:52.728912 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:52.728967 | controller | 2026-02-24 09:00:52.729099 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-02-24 09:00:52.729236 | controller | Tuesday 24 February 2026 09:00:52 +0000 (0:00:00.061) 0:07:08.295 ****** 2026-02-24 09:00:53.794323 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:53.794431 | controller | 2026-02-24 09:00:53.794561 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-02-24 09:00:53.794573 | controller | Tuesday 24 February 2026 09:00:53 +0000 (0:00:01.064) 0:07:09.360 ****** 2026-02-24 09:00:53.851572 | controller | skipping: [instance] 2026-02-24 09:00:53.851606 | controller | 2026-02-24 09:00:53.851617 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-24 09:00:53.851726 | controller | Tuesday 24 February 2026 09:00:53 +0000 (0:00:00.057) 0:07:09.417 ****** 2026-02-24 09:00:54.737323 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:54.737385 | controller | 2026-02-24 09:00:54.737514 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-24 09:00:54.737612 | controller | Tuesday 24 February 2026 09:00:54 +0000 (0:00:00.885) 0:07:10.303 ****** 2026-02-24 09:00:54.798765 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:54.798840 | controller | 2026-02-24 09:00:54.798940 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-02-24 09:00:54.799035 | controller | Tuesday 24 February 2026 09:00:54 +0000 (0:00:00.061) 0:07:10.365 ****** 2026-02-24 09:00:55.879186 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:55.879257 | controller | 2026-02-24 09:00:55.879538 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-02-24 09:00:56.470301 | controller | Tuesday 24 February 2026 09:00:55 +0000 (0:00:01.080) 0:07:11.445 ****** 2026-02-24 09:00:56.470353 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 09:00:56.652125 | controller | 2026-02-24 09:00:56.652170 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-02-24 09:00:56.652189 | controller | Tuesday 24 February 2026 09:00:56 +0000 (0:00:00.590) 0:07:12.036 ****** 2026-02-24 09:00:56.652202 | controller | 2026-02-24 09:00:57.971523 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-02-24 09:00:57.971580 | controller | Tuesday 24 February 2026 09:00:56 +0000 (0:00:00.181) 0:07:12.217 ****** 2026-02-24 09:00:57.971596 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-24 09:00:57.974239 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-24 09:00:57.974307 | controller | module_stderr: |- 2026-02-24 09:00:57.974319 | controller | Shared connection to controller-0.utility closed. 2026-02-24 09:00:57.974360 | controller | module_stdout: |- 2026-02-24 09:00:57.975322 | controller | Traceback (most recent call last): 2026-02-24 09:00:57.975379 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen 2026-02-24 09:00:57.975388 | controller | httplib_response = self._make_request( 2026-02-24 09:00:57.975394 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request 2026-02-24 09:00:57.975400 | controller | self._validate_conn(conn) 2026-02-24 09:00:57.975422 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn 2026-02-24 09:00:57.975432 | controller | conn.connect() 2026-02-24 09:00:57.975438 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect 2026-02-24 09:00:57.975443 | controller | self.sock = ssl_wrap_socket( 2026-02-24 09:00:57.975449 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket 2026-02-24 09:00:57.975456 | controller | ssl_sock = _ssl_wrap_socket_impl( 2026-02-24 09:00:57.975482 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl 2026-02-24 09:00:57.975678 | controller | return ssl_context.wrap_socket(sock, server_hostname=server_hostname) 2026-02-24 09:00:57.975706 | controller | File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket 2026-02-24 09:00:57.975715 | controller | return self.sslsocket_class._create( 2026-02-24 09:00:57.976317 | controller | File "/usr/lib64/python3.9/ssl.py", line 1076, in _create 2026-02-24 09:00:57.976462 | controller | self.do_handshake() 2026-02-24 09:00:57.976477 | controller | File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake 2026-02-24 09:00:57.976484 | controller | self._sslobj.do_handshake() 2026-02-24 09:00:57.976490 | controller | ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147) 2026-02-24 09:00:57.976501 | controller | 2026-02-24 09:00:57.976507 | controller | During handling of the above exception, another exception occurred: 2026-02-24 09:00:57.976513 | controller | 2026-02-24 09:00:57.976520 | controller | Traceback (most recent call last): 2026-02-24 09:00:57.976635 | controller | File "/tmp/ansible-tmp-1771923656.7063131-28679-70711430863568/AnsiballZ_k8s_info.py", line 107, in 2026-02-24 09:00:57.977176 | controller | _ansiballz_main() 2026-02-24 09:00:57.977190 | controller | File "/tmp/ansible-tmp-1771923656.7063131-28679-70711430863568/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main 2026-02-24 09:00:57.977199 | controller | invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS) 2026-02-24 09:00:57.977284 | controller | File "/tmp/ansible-tmp-1771923656.7063131-28679-70711430863568/AnsiballZ_k8s_info.py", line 47, in invoke_module 2026-02-24 09:00:57.977298 | controller | runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path), 2026-02-24 09:00:57.977325 | controller | File "/usr/lib64/python3.9/runpy.py", line 225, in run_module 2026-02-24 09:00:57.977330 | controller | return _run_module_code(code, init_globals, run_name, mod_spec) 2026-02-24 09:00:57.977336 | controller | File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code 2026-02-24 09:00:57.977340 | controller | _run_code(code, mod_globals, init_globals, 2026-02-24 09:00:57.977348 | controller | File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-24 09:00:57.977370 | controller | exec(code, run_globals) 2026-02-24 09:00:57.977514 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_kodd7313/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in 2026-02-24 09:00:57.977569 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_kodd7313/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main 2026-02-24 09:00:57.977651 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_kodd7313/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client 2026-02-24 09:00:57.977770 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_kodd7313/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper 2026-02-24 09:00:57.977874 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_kodd7313/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client 2026-02-24 09:00:57.977986 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__ 2026-02-24 09:00:57.978081 | controller | self.__discoverer = discoverer(self, cache_file) 2026-02-24 09:00:57.978180 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_kodd7313/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__ 2026-02-24 09:00:57.978306 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_kodd7313/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__ 2026-02-24 09:00:57.978399 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_kodd7313/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache 2026-02-24 09:00:57.978531 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info 2026-02-24 09:00:57.978661 | controller | 'kubernetes': self.client.request('get', '/version', serializer=just_json) 2026-02-24 09:00:57.978767 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-24 09:00:57.978864 | controller | resp = func(self, *args, **kwargs) 2026-02-24 09:00:57.978963 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request 2026-02-24 09:00:57.979060 | controller | api_response = self.client.call_api( 2026-02-24 09:00:57.979159 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-24 09:00:57.979264 | controller | return self.__call_api(resource_path, method, 2026-02-24 09:00:57.979367 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-24 09:00:57.979482 | controller | response_data = self.request( 2026-02-24 09:00:57.979596 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-24 09:00:57.979694 | controller | return self.rest_client.GET(url, 2026-02-24 09:00:57.979793 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-24 09:00:57.979888 | controller | return self.request("GET", url, 2026-02-24 09:00:57.979985 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request 2026-02-24 09:00:57.980081 | controller | r = self.pool_manager.request(method, url, 2026-02-24 09:00:57.980176 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request 2026-02-24 09:00:57.980281 | controller | return self.request_encode_url( 2026-02-24 09:00:57.980379 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url 2026-02-24 09:00:57.980503 | controller | return self.urlopen(method, url, **extra_kw) 2026-02-24 09:00:57.980612 | controller | File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen 2026-02-24 09:00:57.980711 | controller | response = conn.urlopen(method, u.request_uri, **kw) 2026-02-24 09:00:57.980807 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 09:00:57.980903 | controller | return self.urlopen( 2026-02-24 09:00:57.981002 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 09:00:57.981098 | controller | return self.urlopen( 2026-02-24 09:00:57.981195 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-24 09:00:57.981302 | controller | return self.urlopen( 2026-02-24 09:00:57.981399 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen 2026-02-24 09:00:57.981515 | controller | retries = retries.increment( 2026-02-24 09:00:57.981621 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment 2026-02-24 09:00:57.981788 | controller | raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2026-02-24 09:00:57.981903 | controller | urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-24 09:00:57.982005 | controller | msg: |- 2026-02-24 09:00:57.982102 | controller | MODULE FAILURE 2026-02-24 09:00:57.982200 | controller | See stdout/stderr for the exact error 2026-02-24 09:00:57.982308 | controller | rc: 1 2026-02-24 09:00:57.984872 | controller | 2026-02-24 09:00:57.985014 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-24 09:00:57.985131 | controller | Tuesday 24 February 2026 09:00:57 +0000 (0:00:01.333) 0:07:13.551 ****** 2026-02-24 09:00:58.215597 | controller | changed: [instance] 2026-02-24 09:00:58.215668 | controller | 2026-02-24 09:00:58.215685 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-24 09:00:58.215794 | controller | Tuesday 24 February 2026 09:00:58 +0000 (0:00:00.230) 0:07:13.781 ****** 2026-02-24 09:00:58.521397 | controller | changed: [instance] 2026-02-24 09:00:59.000688 | controller | 2026-02-24 09:00:59.000741 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-24 09:00:59.000756 | controller | Tuesday 24 February 2026 09:00:58 +0000 (0:00:00.305) 0:07:14.086 ****** 2026-02-24 09:00:59.000768 | controller | changed: [instance] 2026-02-24 09:00:59.000790 | controller | 2026-02-24 09:00:59.000916 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-24 09:00:59.000927 | controller | Tuesday 24 February 2026 09:00:58 +0000 (0:00:00.479) 0:07:14.566 ****** 2026-02-24 09:00:59.591651 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 09:00:59.591719 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-24 09:00:59.591834 | controller | 2026-02-24 09:00:59.591949 | controller | TASK [Create log directory] **************************************************** 2026-02-24 09:00:59.592064 | controller | Tuesday 24 February 2026 09:00:59 +0000 (0:00:00.590) 0:07:15.157 ****** 2026-02-24 09:00:59.833756 | controller | changed: [instance] 2026-02-24 09:00:59.833810 | controller | 2026-02-24 09:00:59.833915 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-24 09:00:59.834010 | controller | Tuesday 24 February 2026 09:00:59 +0000 (0:00:00.242) 0:07:15.399 ****** 2026-02-24 09:01:00.791639 | controller | changed: [instance] 2026-02-24 09:01:00.792507 | controller | 2026-02-24 09:01:00.792547 | controller | PLAY RECAP ********************************************************************* 2026-02-24 09:01:00.792557 | controller | instance : ok=541 changed=208 unreachable=0 failed=1 skipped=229 rescued=0 ignored=0 2026-02-24 09:01:00.792570 | controller | 2026-02-24 09:01:00.793565 | controller | Tuesday 24 February 2026 09:01:00 +0000 (0:00:00.955) 0:07:16.355 ****** 2026-02-24 09:01:00.793624 | controller | =============================================================================== 2026-02-24 09:01:00.793632 | controller | reproducer : Check package install status ------------------------------ 39.83s 2026-02-24 09:01:00.793638 | controller | ci_setup : Install needed packages ------------------------------------- 31.08s 2026-02-24 09:01:00.793644 | controller | libvirt_manager : Download base image ---------------------------------- 29.92s 2026-02-24 09:01:00.793650 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.04s 2026-02-24 09:01:00.793655 | controller | reproducer : Install collections on controller-0 ----------------------- 20.82s 2026-02-24 09:01:00.793660 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.43s 2026-02-24 09:01:00.793664 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 8.34s 2026-02-24 09:01:00.793677 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.97s 2026-02-24 09:01:01.071467 | controller | libvirt_manager : Install packages required for using KVM --------------- 7.80s 2026-02-24 09:01:01.071539 | controller | ci_setup : Install openshift client ------------------------------------- 6.24s 2026-02-24 09:01:01.071550 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.09s 2026-02-24 09:01:01.071557 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.21s 2026-02-24 09:01:01.071563 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.91s 2026-02-24 09:01:01.071569 | controller | networking_mapper : Gather the facts ------------------------------------ 3.81s 2026-02-24 09:01:01.071575 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.34s 2026-02-24 09:01:01.071582 | controller | sushy_emulator : Install required packages ------------------------------ 2.85s 2026-02-24 09:01:01.071588 | controller | ci_setup : Manage directories ------------------------------------------- 2.84s 2026-02-24 09:01:01.071594 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.53s 2026-02-24 09:01:01.071600 | controller | reproducer : Restart NetworkManager ------------------------------------- 2.44s 2026-02-24 09:01:01.071606 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.32s 2026-02-24 09:01:01.071625 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-24 09:01:01.071836 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-24 09:01:01.080113 | controller | INFO Running crc_layout > cleanup 2026-02-24 09:01:01.080558 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-24 09:01:01.087843 | controller | INFO Running crc_layout > destroy 2026-02-24 09:01:01.088131 | controller | WARNING Skipping, instances are delegated. 2026-02-24 09:01:01.088459 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-24 09:01:01.089884 | controller | INFO Writing /tmp/report.html report. 2026-02-24 09:01:01.470156 | [controller] Waiting on logger 2026-02-24 09:01:06.620200 | [controller] Waiting on logger 2026-02-24 09:01:17.051882 | [controller] Waiting on logger 2026-02-24 09:01:27.484263 | [controller] Waiting on logger 2026-02-24 09:01:31.201766 | [Zuul] Log Stream did not terminate 2026-02-24 09:01:31.201990 | controller | ERROR 2026-02-24 09:01:31.202066 | controller | { 2026-02-24 09:01:31.202095 | controller | "delta": "0:09:03.053605", 2026-02-24 09:01:31.202115 | controller | "end": "2026-02-24 09:01:01.161128", 2026-02-24 09:01:31.202134 | controller | "msg": "non-zero return code", 2026-02-24 09:01:31.202149 | controller | "rc": 1, 2026-02-24 09:01:31.202164 | controller | "start": "2026-02-24 08:51:58.107523" 2026-02-24 09:01:31.202178 | controller | } failure 2026-02-24 09:01:31.250571 | 2026-02-24 09:01:31.250628 | PLAY RECAP 2026-02-24 09:01:31.250669 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-24 09:01:31.250691 | 2026-02-24 09:01:31.310261 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 09:01:31.311024 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 09:01:31.814962 | 2026-02-24 09:01:31.815057 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-24 09:01:31.834910 | 2026-02-24 09:01:31.834983 | TASK [Filter out host if needed] 2026-02-24 09:01:31.843383 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-24 09:01:31.847690 | 2026-02-24 09:01:31.847757 | TASK [Ensure file is present] 2026-02-24 09:01:32.262226 | controller | ok 2026-02-24 09:01:32.267834 | 2026-02-24 09:01:32.267902 | TASK [Manage molecule report file] 2026-02-24 09:01:32.290553 | [controller] Waiting on logger 2026-02-24 09:01:41.627982 | [controller] Waiting on logger 2026-02-24 09:01:52.060391 | [controller] Waiting on logger 2026-02-24 09:02:02.492156 | [controller] Waiting on logger 2026-02-24 09:02:02.680734 | [Zuul] Log Stream did not terminate 2026-02-24 09:02:02.680991 | controller | changed 2026-02-24 09:02:02.685738 | 2026-02-24 09:02:02.685795 | TASK [Check if we get ci-framework-data basedir] 2026-02-24 09:02:02.968632 | controller | ok 2026-02-24 09:02:02.973579 | 2026-02-24 09:02:02.973640 | TASK [Create ci-framework-data log directory for zuul] 2026-02-24 09:02:03.377468 | controller | changed 2026-02-24 09:02:03.382935 | 2026-02-24 09:02:03.383000 | TASK [Copy ci-framework interesting files] 2026-02-24 09:02:08.409079 | controller | changed 2026-02-24 09:02:08.414736 | 2026-02-24 09:02:08.414802 | TASK [Get SELinux listing] 2026-02-24 09:02:11.516041 | [controller] Waiting on logger 2026-02-24 09:02:21.948034 | [controller] Waiting on logger 2026-02-24 09:02:32.379887 | [controller] Waiting on logger 2026-02-24 09:02:38.726372 | [Zuul] Log Stream did not terminate 2026-02-24 09:02:38.726554 | controller | changed 2026-02-24 09:02:38.731933 | 2026-02-24 09:02:38.732047 | TASK [Generate log index] 2026-02-24 09:02:40.004970 | controller | changed 2026-02-24 09:02:40.009560 | 2026-02-24 09:02:40.009620 | TASK [Get some env related data] 2026-02-24 09:02:40.031516 | [controller] Waiting on logger 2026-02-24 09:02:42.812029 | [controller] Waiting on logger 2026-02-24 09:02:45.133719 | controller | changed 2026-02-24 09:02:45.139277 | 2026-02-24 09:02:45.139358 | TASK [Generate list of logs to collect in home directory] 2026-02-24 09:02:45.521898 | controller | ok: All paths examined 2026-02-24 09:02:45.526996 | 2026-02-24 09:02:45.527054 | LOOP [Copy logs from home directory] 2026-02-24 09:02:46.215608 | controller | changed: 2026-02-24 09:02:46.215805 | controller | { 2026-02-24 09:02:46.215834 | controller | "atime": 1743544925.4788878, 2026-02-24 09:02:46.215855 | controller | "ctime": 1743545329.1409318, 2026-02-24 09:02:46.215872 | controller | "dev": 64513, 2026-02-24 09:02:46.215902 | controller | "gid": 1000, 2026-02-24 09:02:46.215919 | controller | "gr_name": "zuul", 2026-02-24 09:02:46.215934 | controller | "inode": 4518807, 2026-02-24 09:02:46.215949 | controller | "isblk": false, 2026-02-24 09:02:46.215965 | controller | "ischr": false, 2026-02-24 09:02:46.215980 | controller | "isdir": false, 2026-02-24 09:02:46.215995 | controller | "isfifo": false, 2026-02-24 09:02:46.216013 | controller | "isgid": false, 2026-02-24 09:02:46.216028 | controller | "islnk": false, 2026-02-24 09:02:46.216043 | controller | "isreg": true, 2026-02-24 09:02:46.216058 | controller | "issock": false, 2026-02-24 09:02:46.216073 | controller | "isuid": false, 2026-02-24 09:02:46.216087 | controller | "mode": "0644", 2026-02-24 09:02:46.216101 | controller | "mtime": 1743545329.1409318, 2026-02-24 09:02:46.216116 | controller | "nlink": 1, 2026-02-24 09:02:46.216132 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-24 09:02:46.216147 | controller | "pw_name": "zuul", 2026-02-24 09:02:46.216161 | controller | "rgrp": true, 2026-02-24 09:02:46.216176 | controller | "roth": true, 2026-02-24 09:02:46.216190 | controller | "rusr": true, 2026-02-24 09:02:46.216203 | controller | "size": 4108, 2026-02-24 09:02:46.216217 | controller | "uid": 1000, 2026-02-24 09:02:46.216231 | controller | "wgrp": false, 2026-02-24 09:02:46.216268 | controller | "woth": false, 2026-02-24 09:02:46.216291 | controller | "wusr": true, 2026-02-24 09:02:46.216328 | controller | "xgrp": false, 2026-02-24 09:02:46.216347 | controller | "xoth": false, 2026-02-24 09:02:46.216362 | controller | "xusr": false 2026-02-24 09:02:46.216377 | controller | } 2026-02-24 09:02:46.879934 | controller | changed: 2026-02-24 09:02:46.880024 | controller | { 2026-02-24 09:02:46.880051 | controller | "atime": 1743545331.0429637, 2026-02-24 09:02:46.880071 | controller | "ctime": 1743545842.0111232, 2026-02-24 09:02:46.880088 | controller | "dev": 64513, 2026-02-24 09:02:46.880104 | controller | "gid": 1000, 2026-02-24 09:02:46.880120 | controller | "gr_name": "zuul", 2026-02-24 09:02:46.880135 | controller | "inode": 4194437, 2026-02-24 09:02:46.880151 | controller | "isblk": false, 2026-02-24 09:02:46.880166 | controller | "ischr": false, 2026-02-24 09:02:46.880181 | controller | "isdir": false, 2026-02-24 09:02:46.880195 | controller | "isfifo": false, 2026-02-24 09:02:46.880210 | controller | "isgid": false, 2026-02-24 09:02:46.880224 | controller | "islnk": false, 2026-02-24 09:02:46.880243 | controller | "isreg": true, 2026-02-24 09:02:46.880258 | controller | "issock": false, 2026-02-24 09:02:46.880272 | controller | "isuid": false, 2026-02-24 09:02:46.880285 | controller | "mode": "0644", 2026-02-24 09:02:46.880334 | controller | "mtime": 1743545842.0111232, 2026-02-24 09:02:46.880356 | controller | "nlink": 1, 2026-02-24 09:02:46.880373 | controller | "path": "/home/zuul/crc-start.log", 2026-02-24 09:02:46.880389 | controller | "pw_name": "zuul", 2026-02-24 09:02:46.880405 | controller | "rgrp": true, 2026-02-24 09:02:46.880420 | controller | "roth": true, 2026-02-24 09:02:46.880434 | controller | "rusr": true, 2026-02-24 09:02:46.880448 | controller | "size": 4023, 2026-02-24 09:02:46.880462 | controller | "uid": 1000, 2026-02-24 09:02:46.880476 | controller | "wgrp": false, 2026-02-24 09:02:46.880490 | controller | "woth": false, 2026-02-24 09:02:46.880504 | controller | "wusr": true, 2026-02-24 09:02:46.880517 | controller | "xgrp": false, 2026-02-24 09:02:46.880530 | controller | "xoth": false, 2026-02-24 09:02:46.880543 | controller | "xusr": false 2026-02-24 09:02:46.880556 | controller | } 2026-02-24 09:02:47.510219 | controller | changed: 2026-02-24 09:02:47.510320 | controller | { 2026-02-24 09:02:47.510352 | controller | "atime": 1771923099.6245015, 2026-02-24 09:02:47.510372 | controller | "ctime": 1771923115.7757652, 2026-02-24 09:02:47.510389 | controller | "dev": 64513, 2026-02-24 09:02:47.510406 | controller | "gid": 1000, 2026-02-24 09:02:47.510422 | controller | "gr_name": "zuul", 2026-02-24 09:02:47.510439 | controller | "inode": 4340279, 2026-02-24 09:02:47.510454 | controller | "isblk": false, 2026-02-24 09:02:47.510469 | controller | "ischr": false, 2026-02-24 09:02:47.510482 | controller | "isdir": false, 2026-02-24 09:02:47.510496 | controller | "isfifo": false, 2026-02-24 09:02:47.510514 | controller | "isgid": false, 2026-02-24 09:02:47.510529 | controller | "islnk": false, 2026-02-24 09:02:47.510543 | controller | "isreg": true, 2026-02-24 09:02:47.510559 | controller | "issock": false, 2026-02-24 09:02:47.510574 | controller | "isuid": false, 2026-02-24 09:02:47.510589 | controller | "mode": "0644", 2026-02-24 09:02:47.510604 | controller | "mtime": 1771923115.7757652, 2026-02-24 09:02:47.510619 | controller | "nlink": 1, 2026-02-24 09:02:47.510633 | controller | "path": "/home/zuul/ansible.log", 2026-02-24 09:02:47.510648 | controller | "pw_name": "zuul", 2026-02-24 09:02:47.510661 | controller | "rgrp": true, 2026-02-24 09:02:47.510675 | controller | "roth": true, 2026-02-24 09:02:47.510688 | controller | "rusr": true, 2026-02-24 09:02:47.510702 | controller | "size": 6749, 2026-02-24 09:02:47.510715 | controller | "uid": 1000, 2026-02-24 09:02:47.510728 | controller | "wgrp": false, 2026-02-24 09:02:47.510742 | controller | "woth": false, 2026-02-24 09:02:47.510756 | controller | "wusr": true, 2026-02-24 09:02:47.510769 | controller | "xgrp": false, 2026-02-24 09:02:47.510785 | controller | "xoth": false, 2026-02-24 09:02:47.510800 | controller | "xusr": false 2026-02-24 09:02:47.510814 | controller | } 2026-02-24 09:02:47.518683 | 2026-02-24 09:02:47.518791 | TASK [Copy crio stats log file] 2026-02-24 09:02:47.531822 | controller | skipping: Conditional result was False 2026-02-24 09:02:47.536871 | 2026-02-24 09:02:47.536946 | TASK [Get SELinux related data] 2026-02-24 09:02:48.572110 | [controller] Waiting on logger 2026-02-24 09:03:03.100091 | [controller] Waiting on logger 2026-02-24 09:03:12.480538 | [controller] Waiting on logger 2026-02-24 09:03:17.857660 | [Zuul] Log Stream did not terminate 2026-02-24 09:03:17.857891 | controller | ERROR 2026-02-24 09:03:17.858007 | controller | { 2026-02-24 09:03:17.858058 | controller | "delta": "0:00:00.012365", 2026-02-24 09:03:17.858077 | controller | "end": "2026-02-24 09:02:47.829456", 2026-02-24 09:03:17.858100 | controller | "msg": "non-zero return code", 2026-02-24 09:03:17.858123 | controller | "rc": 1, 2026-02-24 09:03:17.858140 | controller | "start": "2026-02-24 09:02:47.817091" 2026-02-24 09:03:17.858155 | controller | } 2026-02-24 09:03:17.858176 | controller | ERROR: Ignoring Errors 2026-02-24 09:03:17.863206 | 2026-02-24 09:03:17.863270 | TASK [Create system configuration directory] 2026-02-24 09:03:18.166952 | controller | changed 2026-02-24 09:03:18.171679 | 2026-02-24 09:03:18.171741 | TASK [Get some of the system configurations] 2026-02-24 09:03:18.191178 | [controller] Waiting on logger 2026-02-24 09:03:28.635807 | [controller] Waiting on logger 2026-02-24 09:03:39.067832 | [controller] Waiting on logger 2026-02-24 09:03:48.523754 | [Zuul] Log Stream did not terminate 2026-02-24 09:03:48.523981 | controller | changed 2026-02-24 09:03:48.529036 | 2026-02-24 09:03:48.529102 | TASK [Copy generated documentation if available] 2026-02-24 09:03:48.542338 | controller | skipping: Conditional result was False 2026-02-24 09:03:48.547876 | 2026-02-24 09:03:48.547950 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-24 09:03:48.561105 | controller | skipping: Conditional result was False 2026-02-24 09:03:48.566241 | 2026-02-24 09:03:48.566328 | TASK [Compress logs bigger than 2MB] 2026-02-24 09:03:48.587046 | [controller] Waiting on logger 2026-02-24 09:03:49.499981 | [controller] Waiting on logger 2026-02-24 09:04:09.211935 | [controller] Waiting on logger 2026-02-24 09:04:10.299909 | [controller] Waiting on logger 2026-02-24 09:04:18.878532 | [Zuul] Log Stream did not terminate 2026-02-24 09:04:18.878759 | controller | changed 2026-02-24 09:04:18.883939 | 2026-02-24 09:04:18.884013 | TASK [Copy files from workspace on node] 2026-02-24 09:04:18.901799 | controller | ok 2026-02-24 09:04:18.923208 | 2026-02-24 09:04:18.923276 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 09:04:18.936475 | controller | skipping: Conditional result was False 2026-02-24 09:04:18.941956 | 2026-02-24 09:04:18.942025 | TASK [fetch-output : Set log path for single node] 2026-02-24 09:04:18.969615 | controller | ok 2026-02-24 09:04:18.974482 | 2026-02-24 09:04:18.974546 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 09:04:19.164727 | controller -> localhost | ok: "/var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/logs" 2026-02-24 09:04:19.164940 | controller -> localhost | changed: All items complete 2026-02-24 09:04:19.164986 | 2026-02-24 09:04:19.336663 | controller -> localhost | changed: "/var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/artifacts" 2026-02-24 09:04:19.509042 | controller -> localhost | changed: "/var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/docs" 2026-02-24 09:04:19.521634 | 2026-02-24 09:04:19.521715 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 09:04:19.643961 | [controller] Waiting on logger 2026-02-24 09:04:20.165085 | controller | changed: 2026-02-24 09:04:20.165171 | controller | .d..t...... ./ 2026-02-24 09:04:20.165199 | controller | >f+++++++++ README.html 2026-02-24 09:04:20.165219 | controller | >f+++++++++ ansible-execution.log 2026-02-24 09:04:20.165239 | controller | >f+++++++++ ansible.log 2026-02-24 09:04:20.165257 | controller | >f+++++++++ crc-setup.log 2026-02-24 09:04:20.165274 | controller | >f+++++++++ crc-start.log 2026-02-24 09:04:20.165289 | controller | >f+++++++++ dmesg.log 2026-02-24 09:04:20.165330 | controller | >f+++++++++ installed-pkgs.log 2026-02-24 09:04:20.165349 | controller | >f+++++++++ python.log 2026-02-24 09:04:20.165365 | controller | >f+++++++++ registries.conf 2026-02-24 09:04:20.165380 | controller | >f+++++++++ report.html 2026-02-24 09:04:20.165394 | controller | >f+++++++++ selinux-denials.log 2026-02-24 09:04:20.165408 | controller | >f+++++++++ selinux-listing.log 2026-02-24 09:04:20.165422 | controller | cd+++++++++ ci-framework-data/ 2026-02-24 09:04:20.165436 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-24 09:04:20.165450 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 09:04:20.165470 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-24 09:04:20.165487 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-02-24 09:04:20.165502 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-24 09:04:20.165517 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-02-24 09:04:20.165532 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-24 09:04:20.165546 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-24 09:04:20.165560 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-24 09:04:20.165574 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-24 09:04:20.165588 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-24 09:04:20.165602 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-24 09:04:20.165617 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-24 09:04:20.165631 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-24 09:04:20.165645 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:37:b6:3b 2026-02-24 09:04:20.165660 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:85:87:d9 2026-02-24 09:04:20.165675 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:5b:81:46 2026-02-24 09:04:20.165689 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:10:66:7b 2026-02-24 09:04:20.165703 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:6c:4e:e5 2026-02-24 09:04:20.165717 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:80:f1:b1 2026-02-24 09:04:20.165731 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-24 09:04:20.165745 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-24 09:04:20.165759 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-24 09:04:20.165773 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-24 09:04:20.165786 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-24 09:04:20.165800 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-02-24 09:04:20.165813 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-24 09:04:20.165827 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-24 09:04:20.165841 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-02-24 09:04:20.165855 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 09:04:20.165869 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-02-24 09:04:20.165884 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-02-24 09:04:20.165901 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-02-24 09:04:20.165916 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-02-24 09:04:20.165930 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-02-24 09:04:20.165944 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-02-24 09:04:20.165970 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-02-24 09:04:20.165990 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-02-24 09:04:20.166006 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-02-24 09:04:20.166022 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-02-24 09:04:20.166037 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-02-24 09:04:20.166051 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-02-24 09:04:20.166066 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-02-24 09:04:20.166080 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-02-24 09:04:20.166094 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-02-24 09:04:20.166108 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-24 09:04:20.166122 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-24 09:04:20.166136 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-24 09:04:20.166150 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-24 09:04:20.166165 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-02-24 09:04:20.166178 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-24 09:04:20.166192 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-24 09:04:20.166206 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-24 09:04:20.166220 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-02-24 09:04:20.166234 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-02-24 09:04:20.166248 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-24 09:04:20.166262 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-24 09:04:20.166277 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-02-24 09:04:20.166291 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-24 09:04:20.166373 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-02-24 09:04:20.166393 | controller | cd+++++++++ registries.conf.d/ 2026-02-24 09:04:20.166410 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-24 09:04:20.166426 | controller | cd+++++++++ system-config/ 2026-02-24 09:04:20.166441 | controller | cd+++++++++ system-config/libvirt/ 2026-02-24 09:04:20.166456 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-24 09:04:20.166470 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-24 09:04:20.166485 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-24 09:04:20.166500 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-24 09:04:20.166514 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-24 09:04:20.166528 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-24 09:04:20.166545 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-24 09:04:20.166560 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-24 09:04:20.166575 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-24 09:04:20.166589 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-24 09:04:20.166602 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-24 09:04:20.166615 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-24 09:04:20.166629 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-24 09:04:20.166642 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-24 09:04:20.166657 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-24 09:04:20.166672 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-24 09:04:20.626139 | controller | changed: .d..t...... ./ 2026-02-24 09:04:21.098711 | controller | changed: .d..t...... ./ 2026-02-24 09:04:21.116240 | 2026-02-24 09:04:21.116380 | TASK [Return artifact to Zuul] 2026-02-24 09:04:21.144661 | controller | ok 2026-02-24 09:04:21.163989 | 2026-02-24 09:04:21.164048 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-24 09:04:21.164144 | 2026-02-24 09:04:21.164172 | PLAY RECAP 2026-02-24 09:04:21.164209 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-24 09:04:21.164230 | 2026-02-24 09:04:21.240883 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 09:04:21.241581 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 09:04:21.726045 | 2026-02-24 09:04:21.726138 | PLAY [all] 2026-02-24 09:04:21.742891 | 2026-02-24 09:04:21.742966 | TASK [include_role : fetch-output] 2026-02-24 09:04:21.771479 | controller | ok 2026-02-24 09:04:21.787795 | 2026-02-24 09:04:21.787873 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 09:04:21.822217 | controller | skipping: Conditional result was False 2026-02-24 09:04:21.827937 | 2026-02-24 09:04:21.828017 | TASK [fetch-output : Set log path for single node] 2026-02-24 09:04:21.856270 | controller | ok 2026-02-24 09:04:21.861584 | 2026-02-24 09:04:21.861658 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 09:04:22.167459 | controller -> localhost | ok: "/var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/logs" 2026-02-24 09:04:22.349102 | controller -> localhost | ok: "/var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/artifacts" 2026-02-24 09:04:22.525619 | controller -> localhost | ok: "/var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/docs" 2026-02-24 09:04:22.539247 | 2026-02-24 09:04:22.539370 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 09:04:23.145595 | controller | ok 2026-02-24 09:04:23.145777 | controller | ok: All items complete 2026-02-24 09:04:23.145807 | 2026-02-24 09:04:23.619125 | controller | ok 2026-02-24 09:04:24.093074 | controller | ok 2026-02-24 09:04:24.112579 | 2026-02-24 09:04:24.112688 | TASK [include_role : fetch-output-openshift] 2026-02-24 09:04:24.125713 | controller | skipping: Conditional result was False 2026-02-24 09:04:24.131248 | 2026-02-24 09:04:24.131342 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-24 09:04:24.453979 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006754 2026-02-24 09:04:24.634026 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006333 2026-02-24 09:04:24.665717 | 2026-02-24 09:04:24.665791 | PLAY [all] 2026-02-24 09:04:24.679402 | 2026-02-24 09:04:24.679488 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-24 09:04:25.206308 | controller | changed 2026-02-24 09:04:25.227432 | 2026-02-24 09:04:25.227483 | PLAY RECAP 2026-02-24 09:04:25.227528 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-24 09:04:25.227556 | 2026-02-24 09:04:25.295727 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 09:04:25.296447 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-24 09:04:25.824837 | 2026-02-24 09:04:25.824943 | PLAY [localhost] 2026-02-24 09:04:25.841832 | 2026-02-24 09:04:25.841909 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-24 09:04:26.142721 | localhost | changed 2026-02-24 09:04:26.147386 | 2026-02-24 09:04:26.147477 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-24 09:04:26.165419 | localhost | ok 2026-02-24 09:04:26.173157 | 2026-02-24 09:04:26.173229 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-24 09:04:26.453386 | localhost | changed 2026-02-24 09:04:26.459044 | 2026-02-24 09:04:26.459126 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-24 09:04:26.982762 | localhost | changed 2026-02-24 09:04:26.987905 | 2026-02-24 09:04:26.987992 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-24 09:04:27.318907 | localhost | Identity added: /var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/tmp/ansible.fjxfhfq6 (/var/lib/zuul/builds/fd11f156221145ff90b8e6847847a6b1/work/tmp/ansible.fjxfhfq6) 2026-02-24 09:04:27.319088 | localhost | ok: Runtime: 0:00:00.006297 2026-02-24 09:04:27.323249 | 2026-02-24 09:04:27.323337 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-24 09:04:27.532549 | localhost | ok: Runtime: 0:00:00.004329 2026-02-24 09:04:27.537234 | 2026-02-24 09:04:27.537319 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-24 09:04:27.585366 | localhost | changed 2026-02-24 09:04:27.590140 | 2026-02-24 09:04:27.590206 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-24 09:04:27.890797 | localhost | changed 2026-02-24 09:04:27.909232 | 2026-02-24 09:04:27.909286 | PLAY [localhost] 2026-02-24 09:04:27.920210 | 2026-02-24 09:04:27.920272 | TASK [Generate bulk log download script] 2026-02-24 09:04:27.937943 | localhost | ok 2026-02-24 09:04:27.948769 | 2026-02-24 09:04:27.948837 | TASK [local-log-download : Check API endpoint is defined] 2026-02-24 09:04:27.976748 | localhost | ok: All assertions passed 2026-02-24 09:04:27.981010 | 2026-02-24 09:04:27.981074 | TASK [local-log-download : Create download script] 2026-02-24 09:04:28.318282 | localhost -> localhost | changed 2026-02-24 09:04:28.326822 | 2026-02-24 09:04:28.326897 | TASK [Register quick-download link] 2026-02-24 09:04:28.343677 | localhost | ok 2026-02-24 09:04:28.378655 | 2026-02-24 09:04:28.378718 | PLAY [logserver.rdoproject.org] 2026-02-24 09:04:28.388032 | 2026-02-24 09:04:28.388093 | TASK [Set zuul-log-path fact] 2026-02-24 09:04:28.403565 | logserver.rdoproject.org | ok 2026-02-24 09:04:28.412101 | 2026-02-24 09:04:28.412169 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 09:04:28.438045 | logserver.rdoproject.org | ok 2026-02-24 09:04:28.443139 | 2026-02-24 09:04:28.443201 | TASK [upload-logs : Create log directories] 2026-02-24 09:04:30.239022 | logserver.rdoproject.org | changed 2026-02-24 09:04:30.242043 | 2026-02-24 09:04:30.242108 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-24 09:04:30.457792 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005084 2026-02-24 09:04:30.462096 | 2026-02-24 09:04:30.462170 | TASK [upload-logs : Upload logs to log server] 2026-02-24 09:04:31.960792 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-24 09:04:31.963683 | 2026-02-24 09:04:31.963757 | LOOP [upload-logs : Compress console log and json output] 2026-02-24 09:04:32.000723 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 09:04:32.008648 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 09:04:32.021241 | 2026-02-24 09:04:32.021352 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-24 09:04:32.054688 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 09:04:32.054896 | 2026-02-24 09:04:32.057849 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 09:04:32.069039 | 2026-02-24 09:04:32.069120 | LOOP [upload-logs : Upload console log and json output]