2026-03-09 15:40:12.988195 | Job console starting... 2026-03-09 15:40:13.204255 | Updating repositories 2026-03-09 15:40:13.946255 | Preparing job workspace 2026-03-09 15:40:20.702955 | Running Ansible setup... 2026-03-09 15:40:24.178318 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-03-09 15:40:24.644911 | 2026-03-09 15:40:24.644998 | PLAY [localhost] 2026-03-09 15:40:24.652617 | 2026-03-09 15:40:24.652681 | TASK [Gathering Facts] 2026-03-09 15:40:25.415790 | localhost | ok 2026-03-09 15:40:25.427424 | 2026-03-09 15:40:25.427497 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-09 15:40:25.714918 | localhost -> localhost | changed 2026-03-09 15:40:25.720004 | 2026-03-09 15:40:25.720082 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-09 15:40:26.388229 | localhost -> localhost | changed 2026-03-09 15:40:26.397669 | 2026-03-09 15:40:26.397774 | TASK [Setup log path fact] 2026-03-09 15:40:26.414373 | localhost | ok 2026-03-09 15:40:26.424783 | 2026-03-09 15:40:26.424848 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-09 15:40:26.441702 | localhost | ok 2026-03-09 15:40:26.448703 | 2026-03-09 15:40:26.448768 | TASK [emit-job-header : Print job information] 2026-03-09 15:40:26.475203 | # Job Information 2026-03-09 15:40:26.475356 | Ansible Version: 2.15.12 2026-03-09 15:40:26.475389 | Job: cifmw-molecule-reproducer 2026-03-09 15:40:26.475410 | Pipeline: github-check 2026-03-09 15:40:26.475429 | Executor: ibm-bm3-ze.softwarefactory-project.io 2026-03-09 15:40:26.475447 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3739 2026-03-09 15:40:26.475465 | Log URL (when completed): https://logserver.rdoproject.org/eba/rdoproject.org/eba07298365f4debb40bc2133a0c74c1/ 2026-03-09 15:40:26.475483 | Event ID: 1fb080f0-1bce-11f1-8c83-ae8662d51160 2026-03-09 15:40:26.479013 | 2026-03-09 15:40:26.479077 | LOOP [emit-job-header : Print node information] 2026-03-09 15:40:26.561037 | localhost | ok: 2026-03-09 15:40:26.561176 | localhost | # Node Information 2026-03-09 15:40:26.561205 | localhost | Inventory Hostname: controller 2026-03-09 15:40:26.561230 | localhost | Hostname: np0005642589 2026-03-09 15:40:26.561251 | localhost | Username: zuul 2026-03-09 15:40:26.561304 | localhost | Distro: CentOS 9 2026-03-09 15:40:26.561329 | localhost | Provider: ibm-bm3-nodepool 2026-03-09 15:40:26.561348 | localhost | Region: regionOne 2026-03-09 15:40:26.561367 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-03-09 15:40:26.561386 | localhost | Product Name: OpenStack Compute 2026-03-09 15:40:26.561403 | localhost | Interface IP: 192.168.25.38 2026-03-09 15:40:26.579570 | 2026-03-09 15:40:26.579630 | PLAY [all] 2026-03-09 15:40:26.585125 | 2026-03-09 15:40:26.585184 | TASK [Gather network facts] 2026-03-09 15:40:27.019127 | controller | ok 2026-03-09 15:40:27.033932 | 2026-03-09 15:40:27.033996 | TASK [include_role : start-zuul-console] 2026-03-09 15:40:27.051940 | controller | ok 2026-03-09 15:40:27.064694 | 2026-03-09 15:40:27.064783 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-03-09 15:40:27.445931 | controller | ok 2026-03-09 15:40:27.453512 | 2026-03-09 15:40:27.453571 | TASK [include_role : add-build-sshkey] 2026-03-09 15:40:27.470448 | controller | ok 2026-03-09 15:40:27.482462 | 2026-03-09 15:40:27.482525 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-09 15:40:27.657581 | controller -> localhost | ok 2026-03-09 15:40:27.663731 | 2026-03-09 15:40:27.663799 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-09 15:40:27.682206 | controller | ok 2026-03-09 15:40:27.694291 | controller | included: /var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-09 15:40:27.702448 | 2026-03-09 15:40:27.702510 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-09 15:40:28.292904 | controller -> localhost | Generating public/private rsa key pair. 2026-03-09 15:40:28.293070 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/eba07298365f4debb40bc2133a0c74c1_id_rsa. 2026-03-09 15:40:28.293104 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/eba07298365f4debb40bc2133a0c74c1_id_rsa.pub. 2026-03-09 15:40:28.293129 | controller -> localhost | The key fingerprint is: 2026-03-09 15:40:28.293150 | controller -> localhost | SHA256:myL7ifXzCRKRJxb5FCrYZsBf402RFoOzBPo4RpLW2VY zuul-build-sshkey 2026-03-09 15:40:28.293169 | controller -> localhost | The key's randomart image is: 2026-03-09 15:40:28.293188 | controller -> localhost | +---[RSA 3072]----+ 2026-03-09 15:40:28.293207 | controller -> localhost | | .. ...E== | 2026-03-09 15:40:28.293225 | controller -> localhost | | .o=o O+=. | 2026-03-09 15:40:28.293243 | controller -> localhost | |o.++=**X. | 2026-03-09 15:40:28.293262 | controller -> localhost | |.o =ooo+o | 2026-03-09 15:40:28.293352 | controller -> localhost | | + . . S | 2026-03-09 15:40:28.293376 | controller -> localhost | | . . . o | 2026-03-09 15:40:28.293395 | controller -> localhost | | . + + | 2026-03-09 15:40:28.293415 | controller -> localhost | | = =.. . | 2026-03-09 15:40:28.293433 | controller -> localhost | | o.o .oo | 2026-03-09 15:40:28.293450 | controller -> localhost | +----[SHA256]-----+ 2026-03-09 15:40:28.293493 | controller -> localhost | ok: Runtime: 0:00:00.270099 2026-03-09 15:40:28.298387 | 2026-03-09 15:40:28.298444 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-09 15:40:28.315437 | controller | ok 2026-03-09 15:40:28.324420 | controller | included: /var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-09 15:40:28.331900 | 2026-03-09 15:40:28.331962 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-09 15:40:28.344964 | controller | skipping: Conditional result was False 2026-03-09 15:40:28.349525 | 2026-03-09 15:40:28.349584 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-09 15:40:28.813327 | controller | changed 2026-03-09 15:40:28.817569 | 2026-03-09 15:40:28.817629 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-09 15:40:29.089560 | controller | ok 2026-03-09 15:40:29.094102 | 2026-03-09 15:40:29.094162 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-09 15:40:30.310767 | controller | changed 2026-03-09 15:40:30.315476 | 2026-03-09 15:40:30.315543 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-09 15:40:31.529315 | controller | changed 2026-03-09 15:40:31.533975 | 2026-03-09 15:40:31.534039 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-09 15:40:31.547343 | controller | skipping: Conditional result was False 2026-03-09 15:40:31.552570 | 2026-03-09 15:40:31.552634 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-09 15:40:31.828889 | controller -> localhost | changed 2026-03-09 15:40:31.837970 | 2026-03-09 15:40:31.838062 | TASK [add-build-sshkey : Add back temp key] 2026-03-09 15:40:32.053825 | controller -> localhost | Identity added: /var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/eba07298365f4debb40bc2133a0c74c1_id_rsa (zuul-build-sshkey) 2026-03-09 15:40:32.053996 | controller -> localhost | ok: Runtime: 0:00:00.007968 2026-03-09 15:40:32.059083 | 2026-03-09 15:40:32.059145 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-09 15:40:32.411914 | controller | ok 2026-03-09 15:40:32.415933 | 2026-03-09 15:40:32.415991 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-09 15:40:32.439415 | controller | skipping: Conditional result was False 2026-03-09 15:40:32.447290 | 2026-03-09 15:40:32.447359 | TASK [include_role : validate-host] 2026-03-09 15:40:32.464300 | controller | ok 2026-03-09 15:40:32.482720 | 2026-03-09 15:40:32.482785 | TASK [validate-host : Define zuul_info_dir fact] 2026-03-09 15:40:32.520743 | controller | ok 2026-03-09 15:40:32.524762 | 2026-03-09 15:40:32.524820 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-03-09 15:40:32.709456 | controller -> localhost | ok 2026-03-09 15:40:32.715892 | 2026-03-09 15:40:32.715956 | TASK [validate-host : Collect information about the host] 2026-03-09 15:40:33.445639 | controller | ok 2026-03-09 15:40:33.453317 | 2026-03-09 15:40:33.453380 | TASK [validate-host : Sanitize hostname] 2026-03-09 15:40:33.500841 | controller | ok 2026-03-09 15:40:33.505384 | 2026-03-09 15:40:33.505449 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-03-09 15:40:33.861953 | controller -> localhost | changed 2026-03-09 15:40:33.867258 | 2026-03-09 15:40:33.867362 | TASK [validate-host : Collect information about zuul worker] 2026-03-09 15:40:34.240083 | controller | ok 2026-03-09 15:40:34.244671 | 2026-03-09 15:40:34.244745 | TASK [validate-host : Write out all zuul information for each host] 2026-03-09 15:40:34.611596 | controller -> localhost | changed 2026-03-09 15:40:34.620558 | 2026-03-09 15:40:34.620624 | TASK [include_role : prepare-workspace-openshift] 2026-03-09 15:40:34.633920 | controller | skipping: Conditional result was False 2026-03-09 15:40:34.638427 | 2026-03-09 15:40:34.638494 | TASK [include_role : remove-zuul-sshkey] 2026-03-09 15:40:34.651589 | controller | skipping: Conditional result was False 2026-03-09 15:40:34.656772 | 2026-03-09 15:40:34.656838 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-09 15:40:34.903973 | controller | ok: "logs" 2026-03-09 15:40:34.904184 | controller | ok: All items complete 2026-03-09 15:40:34.904216 | 2026-03-09 15:40:35.132658 | controller | ok: "artifacts" 2026-03-09 15:40:35.375212 | controller | ok: "docs" 2026-03-09 15:40:35.385345 | 2026-03-09 15:40:35.385413 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-09 15:40:35.651196 | controller | changed: "logs" 2026-03-09 15:40:35.892528 | controller | changed: "artifacts" 2026-03-09 15:40:36.140062 | controller | changed: "docs" 2026-03-09 15:40:36.169100 | 2026-03-09 15:40:36.169157 | PLAY RECAP 2026-03-09 15:40:36.169201 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-03-09 15:40:36.169230 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-09 15:40:36.169250 | 2026-03-09 15:40:36.242446 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-03-09 15:40:36.243187 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-03-09 15:40:36.746661 | 2026-03-09 15:40:36.746789 | PLAY [all] 2026-03-09 15:40:36.764597 | 2026-03-09 15:40:36.764664 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-03-09 15:40:36.813517 | controller | ok 2026-03-09 15:40:36.818212 | 2026-03-09 15:40:36.818320 | TASK [mirror-info-fork : Create /etc/ci] 2026-03-09 15:40:37.231581 | controller | changed 2026-03-09 15:40:37.236975 | 2026-03-09 15:40:37.237046 | TASK [mirror-info-fork : Install ci_mirror script] 2026-03-09 15:40:38.582240 | controller | changed 2026-03-09 15:40:38.591905 | 2026-03-09 15:40:38.591982 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-03-09 15:40:39.045055 | controller | changed: 2026-03-09 15:40:39.045201 | controller | { 2026-03-09 15:40:39.045230 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-03-09 15:40:39.045260 | controller | } 2026-03-09 15:40:39.341216 | controller | changed: 2026-03-09 15:40:39.341299 | controller | { 2026-03-09 15:40:39.341333 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-03-09 15:40:39.341357 | controller | } 2026-03-09 15:40:39.658211 | controller | changed: 2026-03-09 15:40:39.658302 | controller | { 2026-03-09 15:40:39.658337 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-03-09 15:40:39.658360 | controller | } 2026-03-09 15:40:39.951701 | controller | changed: 2026-03-09 15:40:39.951763 | controller | { 2026-03-09 15:40:39.951790 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-03-09 15:40:39.951810 | controller | } 2026-03-09 15:40:40.260478 | controller | changed: 2026-03-09 15:40:40.261009 | controller | { 2026-03-09 15:40:40.261043 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-03-09 15:40:40.261067 | controller | } 2026-03-09 15:40:40.541451 | controller | changed: 2026-03-09 15:40:40.541519 | controller | { 2026-03-09 15:40:40.541545 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-03-09 15:40:40.541565 | controller | } 2026-03-09 15:40:40.831913 | controller | changed: 2026-03-09 15:40:40.831984 | controller | { 2026-03-09 15:40:40.832009 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-03-09 15:40:40.832030 | controller | } 2026-03-09 15:40:41.134504 | controller | changed: 2026-03-09 15:40:41.134586 | controller | { 2026-03-09 15:40:41.134611 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-03-09 15:40:41.134629 | controller | } 2026-03-09 15:40:41.428123 | controller | changed: 2026-03-09 15:40:41.428219 | controller | { 2026-03-09 15:40:41.428248 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-03-09 15:40:41.428288 | controller | } 2026-03-09 15:40:41.744811 | controller | changed: 2026-03-09 15:40:41.744898 | controller | { 2026-03-09 15:40:41.744925 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-03-09 15:40:41.744946 | controller | } 2026-03-09 15:40:42.024500 | controller | changed: 2026-03-09 15:40:42.024568 | controller | { 2026-03-09 15:40:42.024595 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-03-09 15:40:42.024615 | controller | } 2026-03-09 15:40:42.315853 | controller | changed: 2026-03-09 15:40:42.315907 | controller | { 2026-03-09 15:40:42.315931 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-03-09 15:40:42.315948 | controller | } 2026-03-09 15:40:42.603721 | controller | changed: 2026-03-09 15:40:42.603789 | controller | { 2026-03-09 15:40:42.603815 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-03-09 15:40:42.603834 | controller | } 2026-03-09 15:40:42.896286 | controller | changed: 2026-03-09 15:40:42.896339 | controller | { 2026-03-09 15:40:42.896362 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-03-09 15:40:42.896380 | controller | } 2026-03-09 15:40:43.204837 | controller | changed: 2026-03-09 15:40:43.204920 | controller | { 2026-03-09 15:40:43.204946 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-03-09 15:40:43.204966 | controller | } 2026-03-09 15:40:43.508375 | controller | changed: 2026-03-09 15:40:43.508438 | controller | { 2026-03-09 15:40:43.508462 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-03-09 15:40:43.508480 | controller | } 2026-03-09 15:40:43.810501 | controller | changed: 2026-03-09 15:40:43.810554 | controller | { 2026-03-09 15:40:43.810580 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-03-09 15:40:43.810601 | controller | } 2026-03-09 15:40:44.115841 | controller | changed: 2026-03-09 15:40:44.115993 | controller | { 2026-03-09 15:40:44.116029 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-03-09 15:40:44.116059 | controller | } 2026-03-09 15:40:44.401446 | controller | changed: 2026-03-09 15:40:44.401502 | controller | { 2026-03-09 15:40:44.401527 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-03-09 15:40:44.401545 | controller | } 2026-03-09 15:40:44.707242 | controller | changed: 2026-03-09 15:40:44.707323 | controller | { 2026-03-09 15:40:44.707352 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-03-09 15:40:44.707373 | controller | } 2026-03-09 15:40:45.005732 | controller | changed: 2026-03-09 15:40:45.005834 | controller | { 2026-03-09 15:40:45.005862 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-03-09 15:40:45.005883 | controller | } 2026-03-09 15:40:45.313070 | controller | changed: 2026-03-09 15:40:45.313223 | controller | { 2026-03-09 15:40:45.313260 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-03-09 15:40:45.313311 | controller | } 2026-03-09 15:40:45.629842 | controller | changed: 2026-03-09 15:40:45.629933 | controller | { 2026-03-09 15:40:45.629962 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-03-09 15:40:45.629984 | controller | } 2026-03-09 15:40:45.939383 | controller | changed: 2026-03-09 15:40:45.939469 | controller | { 2026-03-09 15:40:45.939496 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-03-09 15:40:45.939523 | controller | } 2026-03-09 15:40:46.241768 | controller | changed: 2026-03-09 15:40:46.241827 | controller | { 2026-03-09 15:40:46.241852 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-03-09 15:40:46.241871 | controller | } 2026-03-09 15:40:46.553285 | controller | changed: 2026-03-09 15:40:46.553352 | controller | { 2026-03-09 15:40:46.553378 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-03-09 15:40:46.553396 | controller | } 2026-03-09 15:40:46.568729 | 2026-03-09 15:40:46.568821 | TASK [Set timezone to UTC] 2026-03-09 15:40:47.072163 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-03-09 15:40:47.076918 | 2026-03-09 15:40:47.076989 | TASK [Create nodepool directory] 2026-03-09 15:40:47.369865 | controller | changed 2026-03-09 15:40:47.375488 | 2026-03-09 15:40:47.375565 | TASK [Create nodepool sub_nodes file] 2026-03-09 15:40:48.415302 | controller | changed 2026-03-09 15:40:48.420114 | 2026-03-09 15:40:48.420187 | TASK [Create nodepool sub_nodes_private file] 2026-03-09 15:40:49.480941 | controller | changed 2026-03-09 15:40:49.486241 | 2026-03-09 15:40:49.487052 | LOOP [Populate nodepool sub_nodes file] 2026-03-09 15:40:49.515509 | 2026-03-09 15:40:49.515705 | LOOP [Populate nodepool sub_nodes_private file] 2026-03-09 15:40:49.545859 | 2026-03-09 15:40:49.545980 | TASK [Create nodepool primary file] 2026-03-09 15:40:49.568802 | controller | skipping: Conditional result was False 2026-03-09 15:40:49.574194 | 2026-03-09 15:40:49.574284 | TASK [Create nodepool node_private for this node] 2026-03-09 15:40:50.650744 | controller | changed 2026-03-09 15:40:50.659973 | 2026-03-09 15:40:50.663321 | LOOP [Copy ssh keys to nodepool directory] 2026-03-09 15:40:51.070041 | controller | ok: Item: id_rsa Runtime: 0:00:00.006160 2026-03-09 15:40:51.070213 | 2026-03-09 15:40:51.313620 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005375 2026-03-09 15:40:51.320101 | 2026-03-09 15:40:51.320204 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-03-09 15:40:52.415871 | controller | changed 2026-03-09 15:40:52.420554 | 2026-03-09 15:40:52.420617 | TASK [Validate sudoers config after edits] 2026-03-09 15:40:52.710077 | controller | /etc/sudoers: parsed OK 2026-03-09 15:40:52.710154 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-03-09 15:40:52.710171 | controller | /etc/sudoers.d/zuul: parsed OK 2026-03-09 15:40:52.710177 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-03-09 15:40:52.946600 | controller | ok: Runtime: 0:00:00.005027 2026-03-09 15:40:52.951503 | 2026-03-09 15:40:52.951561 | TASK [Show the environment passed in to job shell scripts] 2026-03-09 15:40:53.228315 | controller | SHELL=/bin/bash 2026-03-09 15:40:53.228360 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-03-09 15:40:53.228370 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-03-09 15:40:53.228378 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/39/3739/d915625887780838e3d10cca376c6044ef3ed8e8 2026-03-09 15:40:53.228384 | controller | PWD=/home/zuul 2026-03-09 15:40:53.228389 | controller | ZUUL_PIPELINE=github-check 2026-03-09 15:40:53.228395 | controller | LOGNAME=zuul 2026-03-09 15:40:53.228400 | controller | XDG_SESSION_TYPE=tty 2026-03-09 15:40:53.228406 | controller | _=/usr/bin/env 2026-03-09 15:40:53.228411 | controller | MOTD_SHOWN=pam 2026-03-09 15:40:53.228453 | controller | HOME=/home/zuul 2026-03-09 15:40:53.228461 | controller | LANG=en_US.UTF-8 2026-03-09 15:40:53.228466 | controller | SSH_CONNECTION=192.168.25.12 57718 192.168.25.38 22 2026-03-09 15:40:53.228472 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-03-09 15:40:53.228480 | controller | ZUUL_CHANGE_IDS=3739,d915625887780838e3d10cca376c6044ef3ed8e8 2026-03-09 15:40:53.228486 | controller | WORKSPACE=/home/zuul/workspace 2026-03-09 15:40:53.228491 | controller | XDG_SESSION_CLASS=user 2026-03-09 15:40:53.228497 | controller | SELINUX_ROLE_REQUESTED= 2026-03-09 15:40:53.228503 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-03-09 15:40:53.228508 | controller | USER=zuul 2026-03-09 15:40:53.228514 | controller | ZUUL_VOTING=True 2026-03-09 15:40:53.228519 | controller | BUILD_TIMEOUT=5400000 2026-03-09 15:40:53.228524 | controller | SELINUX_USE_CURRENT_RANGE= 2026-03-09 15:40:53.228530 | controller | SHLVL=1 2026-03-09 15:40:53.228535 | controller | ZUUL_PATCHSET=d915625887780838e3d10cca376c6044ef3ed8e8 2026-03-09 15:40:53.228541 | controller | XDG_SESSION_ID=1 2026-03-09 15:40:53.228546 | controller | ZUUL_BRANCH=main 2026-03-09 15:40:53.228551 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-03-09 15:40:53.228556 | controller | SSH_CLIENT=192.168.25.12 57718 22 2026-03-09 15:40:53.228563 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-03-09 15:40:53.228568 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-03-09 15:40:53.228574 | controller | which_declare=declare -f 2026-03-09 15:40:53.228579 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-03-09 15:40:53.228585 | controller | SELINUX_LEVEL_REQUESTED= 2026-03-09 15:40:53.228590 | controller | ZUUL_CHANGE=3739 2026-03-09 15:40:53.228595 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-03-09 15:40:53.228601 | controller | ZUUL_UUID=eba07298365f4debb40bc2133a0c74c1 2026-03-09 15:40:53.228606 | controller | BASH_FUNC_which%%=() { ( alias; 2026-03-09 15:40:53.228611 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-03-09 15:40:53.228617 | controller | } 2026-03-09 15:40:53.475756 | controller | ok: Runtime: 0:00:00.007378 2026-03-09 15:40:53.480551 | 2026-03-09 15:40:53.480611 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-03-09 15:40:53.493241 | controller | skipping: Conditional result was False 2026-03-09 15:40:53.498109 | 2026-03-09 15:40:53.498172 | TASK [Symlink /home/zuul-worker/workspace] 2026-03-09 15:40:54.041570 | controller | skipping: Conditional result was False 2026-03-09 15:40:54.047424 | 2026-03-09 15:40:54.047494 | TASK [Ensure legacy workspace directory] 2026-03-09 15:40:54.299138 | controller | changed 2026-03-09 15:40:54.316745 | 2026-03-09 15:40:54.316807 | PLAY RECAP 2026-03-09 15:40:54.316857 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-03-09 15:40:54.316888 | 2026-03-09 15:40:54.383305 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-03-09 15:40:54.384003 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-03-09 15:40:54.839371 | 2026-03-09 15:40:54.839476 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-03-09 15:40:54.857888 | 2026-03-09 15:40:54.857953 | TASK [Create zuul-output directory] 2026-03-09 15:40:55.222920 | controller | changed 2026-03-09 15:40:55.227576 | 2026-03-09 15:40:55.227649 | TASK [Slurp Zuul inventory test] 2026-03-09 15:40:55.473955 | controller -> localhost | ok 2026-03-09 15:40:55.479318 | 2026-03-09 15:40:55.479381 | TASK [Save zuul inventory] 2026-03-09 15:40:56.736411 | controller | changed 2026-03-09 15:40:56.741234 | 2026-03-09 15:40:56.741316 | TASK [Save zuul vars without the change_message] 2026-03-09 15:40:57.865534 | controller | changed 2026-03-09 15:40:57.882618 | 2026-03-09 15:40:57.882670 | PLAY RECAP 2026-03-09 15:40:57.882711 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-09 15:40:57.882732 | 2026-03-09 15:40:57.942686 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-03-09 15:40:57.943430 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-03-09 15:40:58.436402 | 2026-03-09 15:40:58.436492 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-03-09 15:40:58.454589 | 2026-03-09 15:40:58.454653 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-03-09 15:40:58.472141 | controller | ok 2026-03-09 15:40:58.486996 | 2026-03-09 15:40:58.487068 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-03-09 15:40:58.510036 | controller | skipping: Conditional result was False 2026-03-09 15:40:58.515518 | 2026-03-09 15:40:58.515586 | TASK [mirror-info-fork : Create /etc/ci] 2026-03-09 15:40:58.887799 | controller | ok 2026-03-09 15:40:58.893141 | 2026-03-09 15:40:58.893207 | TASK [mirror-info-fork : Install ci_mirror script] 2026-03-09 15:40:59.867695 | controller | ok 2026-03-09 15:40:59.876093 | 2026-03-09 15:40:59.876150 | TASK [Prepare workspace] 2026-03-09 15:40:59.892876 | controller | ok 2026-03-09 15:40:59.907581 | 2026-03-09 15:40:59.907645 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-09 15:41:00.270402 | controller | ok 2026-03-09 15:41:00.275496 | 2026-03-09 15:41:00.275554 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-09 15:41:02.654226 | controller | Output suppressed because no_log was given 2026-03-09 15:41:02.663112 | 2026-03-09 15:41:02.663175 | LOOP [Create zuul-output directory] 2026-03-09 15:41:02.936726 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-03-09 15:41:03.169651 | controller | ok: "/home/zuul/zuul-output/logs" 2026-03-09 15:41:03.181748 | 2026-03-09 15:41:03.181812 | TASK [Install required packages] 2026-03-09 15:41:31.627517 | controller | ok: Nothing to do 2026-03-09 15:41:31.632019 | 2026-03-09 15:41:31.632081 | TASK [Install venv] 2026-03-09 15:42:32.863141 | controller | changed 2026-03-09 15:42:32.884728 | 2026-03-09 15:42:32.884785 | PLAY RECAP 2026-03-09 15:42:32.884828 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-09 15:42:32.884850 | 2026-03-09 15:42:32.948543 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-03-09 15:42:32.949288 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-03-09 15:42:33.419477 | 2026-03-09 15:42:33.419568 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-03-09 15:42:33.438325 | 2026-03-09 15:42:33.438403 | TASK [Gather required facts] 2026-03-09 15:42:33.956071 | controller | ok 2026-03-09 15:42:33.960908 | 2026-03-09 15:42:33.960976 | TASK [Load environment var if instructed to] 2026-03-09 15:42:33.974798 | controller | skipping: Conditional result was False 2026-03-09 15:42:33.980408 | 2026-03-09 15:42:33.980480 | TASK [Ensure group_vars dir exists] 2026-03-09 15:42:34.324567 | controller | ok 2026-03-09 15:42:34.330178 | 2026-03-09 15:42:34.330252 | TASK [Print related variables] 2026-03-09 15:42:34.358167 | controller | ok: 2026-03-09 15:42:34.358293 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-03-09 15:42:34.358328 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-03-09 15:42:34.362850 | 2026-03-09 15:42:34.362913 | TASK [Run molecule] 2026-03-09 15:42:35.305394 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-03-09 15:42:35.559198 | controller | INFO Performing prerun with role_name_check=0... 2026-03-09 15:42:53.438149 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.438569 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.438989 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.439383 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.439814 | controller | WARNING Another version of 'cifmw.general' 1.0.0+222de7d6 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+222de7d6 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.440206 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.440598 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.441000 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.441383 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.441795 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.442161 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.442545 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.442951 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.443339 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.443741 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-03-09 15:42:53.452287 | controller | INFO Running crc_layout > prepare 2026-03-09 15:42:54.074335 | controller | 2026-03-09 15:42:54.074412 | controller | PLAY [Prepare] ***************************************************************** 2026-03-09 15:42:54.074485 | controller | 2026-03-09 15:42:54.074601 | controller | TASK [Gathering Facts] ********************************************************* 2026-03-09 15:42:54.074726 | controller | Monday 09 March 2026 15:42:54 +0000 (0:00:00.018) 0:00:00.018 ********** 2026-03-09 15:42:54.890712 | controller | ok: [instance] 2026-03-09 15:42:54.890774 | controller | 2026-03-09 15:42:54.890914 | controller | TASK [Create custom basedir] *************************************************** 2026-03-09 15:42:54.890991 | controller | Monday 09 March 2026 15:42:54 +0000 (0:00:00.816) 0:00:00.835 ********** 2026-03-09 15:42:55.197255 | controller | changed: [instance] 2026-03-09 15:42:55.197351 | controller | 2026-03-09 15:42:55.197480 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-03-09 15:42:55.197611 | controller | Monday 09 March 2026 15:42:55 +0000 (0:00:00.306) 0:00:01.141 ********** 2026-03-09 15:42:55.214144 | controller | skipping: [instance] 2026-03-09 15:42:55.214233 | controller | 2026-03-09 15:42:55.214380 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-03-09 15:42:55.214476 | controller | Monday 09 March 2026 15:42:55 +0000 (0:00:00.017) 0:00:01.158 ********** 2026-03-09 15:42:55.254804 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-03-09 15:42:55.254834 | controller | 2026-03-09 15:42:55.254954 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-03-09 15:42:55.255049 | controller | Monday 09 March 2026 15:42:55 +0000 (0:00:00.040) 0:00:01.199 ********** 2026-03-09 15:42:55.528614 | controller | ok: [instance] 2026-03-09 15:42:55.528665 | controller | 2026-03-09 15:42:55.528849 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-03-09 15:42:55.528908 | controller | Monday 09 March 2026 15:42:55 +0000 (0:00:00.273) 0:00:01.473 ********** 2026-03-09 15:42:55.733207 | controller | ok: [instance] 2026-03-09 15:42:55.733246 | controller | 2026-03-09 15:42:55.733358 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-03-09 15:42:55.733470 | controller | Monday 09 March 2026 15:42:55 +0000 (0:00:00.204) 0:00:01.677 ********** 2026-03-09 15:42:56.401375 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-03-09 15:42:56.401444 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-03-09 15:42:56.401575 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-03-09 15:42:56.401697 | controller | 2026-03-09 15:42:56.401775 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-03-09 15:42:56.401859 | controller | Monday 09 March 2026 15:42:56 +0000 (0:00:00.667) 0:00:02.345 ********** 2026-03-09 15:42:56.461686 | controller | 2026-03-09 15:42:56.461781 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-03-09 15:42:56.461877 | controller | Monday 09 March 2026 15:42:56 +0000 (0:00:00.060) 0:00:02.406 ********** 2026-03-09 15:42:56.970847 | controller | changed: [instance] => (item=tmp) 2026-03-09 15:42:56.970926 | controller | changed: [instance] => (item=artifacts/repositories) 2026-03-09 15:42:56.971017 | controller | changed: [instance] => (item=venv/repo_setup) 2026-03-09 15:42:56.971103 | controller | 2026-03-09 15:42:56.971188 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-03-09 15:42:56.971272 | controller | Monday 09 March 2026 15:42:56 +0000 (0:00:00.508) 0:00:02.915 ********** 2026-03-09 15:42:57.789222 | controller | ok: [instance] 2026-03-09 15:42:57.789275 | controller | 2026-03-09 15:42:57.789542 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-03-09 15:43:00.327244 | controller | Monday 09 March 2026 15:42:57 +0000 (0:00:00.818) 0:00:03.733 ********** 2026-03-09 15:43:00.327279 | controller | changed: [instance] 2026-03-09 15:43:07.575800 | controller | 2026-03-09 15:43:07.575852 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-03-09 15:43:07.575862 | controller | Monday 09 March 2026 15:43:00 +0000 (0:00:02.537) 0:00:06.271 ********** 2026-03-09 15:43:07.575875 | controller | changed: [instance] 2026-03-09 15:43:08.245701 | controller | 2026-03-09 15:43:08.245732 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-03-09 15:43:08.245740 | controller | Monday 09 March 2026 15:43:07 +0000 (0:00:07.248) 0:00:13.520 ********** 2026-03-09 15:43:08.245750 | controller | changed: [instance] 2026-03-09 15:43:08.245775 | controller | 2026-03-09 15:43:08.246020 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-03-09 15:43:08.267174 | controller | Monday 09 March 2026 15:43:08 +0000 (0:00:00.670) 0:00:14.190 ********** 2026-03-09 15:43:08.267200 | controller | skipping: [instance] 2026-03-09 15:43:09.067713 | controller | 2026-03-09 15:43:09.067744 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-03-09 15:43:09.067753 | controller | Monday 09 March 2026 15:43:08 +0000 (0:00:00.021) 0:00:14.211 ********** 2026-03-09 15:43:09.067763 | controller | changed: [instance] 2026-03-09 15:43:09.067788 | controller | 2026-03-09 15:43:09.067990 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-03-09 15:43:09.105401 | controller | Monday 09 March 2026 15:43:09 +0000 (0:00:00.800) 0:00:15.012 ********** 2026-03-09 15:43:09.105431 | controller | skipping: [instance] 2026-03-09 15:43:09.141742 | controller | 2026-03-09 15:43:09.141784 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-03-09 15:43:09.141793 | controller | Monday 09 March 2026 15:43:09 +0000 (0:00:00.037) 0:00:15.049 ********** 2026-03-09 15:43:09.141805 | controller | skipping: [instance] 2026-03-09 15:43:09.141842 | controller | 2026-03-09 15:43:09.141853 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-03-09 15:43:09.141895 | controller | Monday 09 March 2026 15:43:09 +0000 (0:00:00.036) 0:00:15.086 ********** 2026-03-09 15:43:09.177747 | controller | skipping: [instance] 2026-03-09 15:43:09.705148 | controller | 2026-03-09 15:43:09.705171 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-03-09 15:43:09.705179 | controller | Monday 09 March 2026 15:43:09 +0000 (0:00:00.036) 0:00:15.122 ********** 2026-03-09 15:43:09.705188 | controller | changed: [instance] 2026-03-09 15:43:10.128412 | controller | 2026-03-09 15:43:10.128448 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-03-09 15:43:10.128461 | controller | Monday 09 March 2026 15:43:09 +0000 (0:00:00.527) 0:00:15.649 ********** 2026-03-09 15:43:10.128477 | controller | changed: [instance] 2026-03-09 15:43:10.157541 | controller | 2026-03-09 15:43:10.157574 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-03-09 15:43:10.157587 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.423) 0:00:16.072 ********** 2026-03-09 15:43:10.157602 | controller | skipping: [instance] 2026-03-09 15:43:10.186772 | controller | 2026-03-09 15:43:10.186823 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-03-09 15:43:10.186837 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.029) 0:00:16.101 ********** 2026-03-09 15:43:10.186859 | controller | skipping: [instance] 2026-03-09 15:43:10.214775 | controller | 2026-03-09 15:43:10.214822 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-03-09 15:43:10.214833 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.029) 0:00:16.131 ********** 2026-03-09 15:43:10.214847 | controller | skipping: [instance] 2026-03-09 15:43:10.251772 | controller | 2026-03-09 15:43:10.251795 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-03-09 15:43:10.251805 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.027) 0:00:16.158 ********** 2026-03-09 15:43:10.251816 | controller | ok: [instance] 2026-03-09 15:43:10.251961 | controller | 2026-03-09 15:43:10.251992 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-03-09 15:43:10.252011 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.037) 0:00:16.196 ********** 2026-03-09 15:43:10.278582 | controller | skipping: [instance] 2026-03-09 15:43:10.304230 | controller | 2026-03-09 15:43:10.304279 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-03-09 15:43:10.304293 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.026) 0:00:16.222 ********** 2026-03-09 15:43:10.304309 | controller | skipping: [instance] 2026-03-09 15:43:10.304441 | controller | 2026-03-09 15:43:10.304687 | controller | TASK [Download the RPM] ******************************************************** 2026-03-09 15:43:10.304917 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.026) 0:00:16.248 ********** 2026-03-09 15:43:10.331726 | controller | skipping: [instance] 2026-03-09 15:43:10.331873 | controller | 2026-03-09 15:43:10.332012 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-03-09 15:43:10.332124 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.027) 0:00:16.276 ********** 2026-03-09 15:43:10.380077 | controller | skipping: [instance] 2026-03-09 15:43:10.380283 | controller | 2026-03-09 15:43:10.380444 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-03-09 15:43:10.380508 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.048) 0:00:16.324 ********** 2026-03-09 15:43:10.405925 | controller | skipping: [instance] 2026-03-09 15:43:10.406038 | controller | 2026-03-09 15:43:10.406196 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-03-09 15:43:10.406345 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.025) 0:00:16.350 ********** 2026-03-09 15:43:10.433821 | controller | skipping: [instance] 2026-03-09 15:43:10.434044 | controller | 2026-03-09 15:43:10.434265 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-03-09 15:43:10.434471 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.027) 0:00:16.378 ********** 2026-03-09 15:43:10.459186 | controller | skipping: [instance] 2026-03-09 15:43:10.459293 | controller | 2026-03-09 15:43:10.459895 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-03-09 15:43:10.636967 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.025) 0:00:16.404 ********** 2026-03-09 15:43:10.636992 | controller | ok: [instance] 2026-03-09 15:43:10.637185 | controller | 2026-03-09 15:43:10.637416 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-03-09 15:43:10.637620 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.177) 0:00:16.581 ********** 2026-03-09 15:43:10.838281 | controller | changed: [instance] 2026-03-09 15:43:11.055681 | controller | 2026-03-09 15:43:11.055709 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-03-09 15:43:11.055717 | controller | Monday 09 March 2026 15:43:10 +0000 (0:00:00.201) 0:00:16.782 ********** 2026-03-09 15:43:11.055727 | controller | changed: [instance] 2026-03-09 15:43:11.076492 | controller | 2026-03-09 15:43:11.076514 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-03-09 15:43:11.076524 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.217) 0:00:17.000 ********** 2026-03-09 15:43:11.076535 | controller | skipping: [instance] 2026-03-09 15:43:11.097235 | controller | 2026-03-09 15:43:11.097268 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-03-09 15:43:11.097277 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.020) 0:00:17.021 ********** 2026-03-09 15:43:11.097289 | controller | skipping: [instance] 2026-03-09 15:43:11.117332 | controller | 2026-03-09 15:43:11.117353 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-03-09 15:43:11.117362 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.020) 0:00:17.041 ********** 2026-03-09 15:43:11.117373 | controller | skipping: [instance] 2026-03-09 15:43:11.139713 | controller | 2026-03-09 15:43:11.139767 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-03-09 15:43:11.139778 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.020) 0:00:17.061 ********** 2026-03-09 15:43:11.139793 | controller | skipping: [instance] 2026-03-09 15:43:11.161657 | controller | 2026-03-09 15:43:11.161684 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-03-09 15:43:11.161702 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.022) 0:00:17.084 ********** 2026-03-09 15:43:11.161715 | controller | skipping: [instance] 2026-03-09 15:43:11.184080 | controller | 2026-03-09 15:43:11.184101 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-03-09 15:43:11.184110 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.021) 0:00:17.106 ********** 2026-03-09 15:43:11.184122 | controller | skipping: [instance] 2026-03-09 15:43:11.201231 | controller | 2026-03-09 15:43:11.201265 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-03-09 15:43:11.201274 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.022) 0:00:17.128 ********** 2026-03-09 15:43:11.201285 | controller | skipping: [instance] 2026-03-09 15:43:11.201456 | controller | 2026-03-09 15:43:11.201665 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-03-09 15:43:11.201859 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.017) 0:00:17.146 ********** 2026-03-09 15:43:11.231174 | controller | skipping: [instance] 2026-03-09 15:43:11.231369 | controller | 2026-03-09 15:43:11.231551 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-03-09 15:43:11.231774 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.029) 0:00:17.176 ********** 2026-03-09 15:43:11.247912 | controller | skipping: [instance] 2026-03-09 15:43:11.248069 | controller | 2026-03-09 15:43:11.248226 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-03-09 15:43:11.248401 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.016) 0:00:17.192 ********** 2026-03-09 15:43:11.270896 | controller | skipping: [instance] 2026-03-09 15:43:11.271031 | controller | 2026-03-09 15:43:11.271162 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-03-09 15:43:11.271304 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.023) 0:00:17.215 ********** 2026-03-09 15:43:11.300097 | controller | skipping: [instance] 2026-03-09 15:43:11.300381 | controller | 2026-03-09 15:43:11.300663 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-03-09 15:43:11.300928 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.028) 0:00:17.244 ********** 2026-03-09 15:43:11.327522 | controller | skipping: [instance] 2026-03-09 15:43:11.327825 | controller | 2026-03-09 15:43:11.328076 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-03-09 15:43:11.328211 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.027) 0:00:17.272 ********** 2026-03-09 15:43:11.355603 | controller | skipping: [instance] 2026-03-09 15:43:11.355900 | controller | 2026-03-09 15:43:11.356164 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-03-09 15:43:11.356297 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.028) 0:00:17.300 ********** 2026-03-09 15:43:11.384061 | controller | skipping: [instance] 2026-03-09 15:43:11.384247 | controller | 2026-03-09 15:43:11.384396 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-03-09 15:43:11.384531 | controller | Monday 09 March 2026 15:43:11 +0000 (0:00:00.028) 0:00:17.328 ********** 2026-03-09 15:44:03.451127 | controller | ok: [instance] 2026-03-09 15:44:04.671755 | controller | 2026-03-09 15:44:04.671792 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-03-09 15:44:04.671802 | controller | Monday 09 March 2026 15:44:03 +0000 (0:00:52.066) 0:01:09.395 ********** 2026-03-09 15:44:04.671815 | controller | ok: [instance] 2026-03-09 15:44:04.671843 | controller | 2026-03-09 15:44:04.671853 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-03-09 15:44:04.671880 | controller | Monday 09 March 2026 15:44:04 +0000 (0:00:01.220) 0:01:10.616 ********** 2026-03-09 15:44:04.703803 | controller | skipping: [instance] 2026-03-09 15:44:04.703861 | controller | 2026-03-09 15:44:04.703874 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-03-09 15:44:04.703900 | controller | Monday 09 March 2026 15:44:04 +0000 (0:00:00.032) 0:01:10.648 ********** 2026-03-09 15:44:04.744738 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-03-09 15:44:04.744811 | controller | 2026-03-09 15:44:04.744834 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-03-09 15:44:04.744844 | controller | Monday 09 March 2026 15:44:04 +0000 (0:00:00.040) 0:01:10.689 ********** 2026-03-09 15:44:04.765766 | controller | ok: [instance] => 2026-03-09 15:44:09.731698 | controller | cifmw_ci_setup_packages: 2026-03-09 15:44:09.731730 | controller | - bash-completion 2026-03-09 15:44:09.731737 | controller | - ca-certificates 2026-03-09 15:44:09.731743 | controller | - git-core 2026-03-09 15:44:09.731749 | controller | - make 2026-03-09 15:44:09.731759 | controller | - tar 2026-03-09 15:44:09.731765 | controller | - tmux 2026-03-09 15:44:09.731772 | controller | - python3-pip 2026-03-09 15:44:09.731777 | controller | 2026-03-09 15:44:09.731783 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-03-09 15:44:09.731789 | controller | Monday 09 March 2026 15:44:04 +0000 (0:00:00.020) 0:01:10.709 ********** 2026-03-09 15:44:09.731799 | controller | changed: [instance] 2026-03-09 15:44:09.731822 | controller | 2026-03-09 15:44:09.731830 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-03-09 15:44:09.731894 | controller | Monday 09 March 2026 15:44:09 +0000 (0:00:04.966) 0:01:15.676 ********** 2026-03-09 15:44:10.297708 | controller | ok: [instance] 2026-03-09 15:44:10.297736 | controller | 2026-03-09 15:44:10.297744 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-03-09 15:44:10.297753 | controller | Monday 09 March 2026 15:44:10 +0000 (0:00:00.565) 0:01:16.242 ********** 2026-03-09 15:44:10.491449 | controller | changed: [instance] 2026-03-09 15:44:16.462287 | controller | 2026-03-09 15:44:16.462318 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-03-09 15:44:16.462326 | controller | Monday 09 March 2026 15:44:10 +0000 (0:00:00.193) 0:01:16.435 ********** 2026-03-09 15:44:16.462336 | controller | changed: [instance] 2026-03-09 15:44:16.497771 | controller | 2026-03-09 15:44:16.497816 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-03-09 15:44:16.497826 | controller | Monday 09 March 2026 15:44:16 +0000 (0:00:05.970) 0:01:22.406 ********** 2026-03-09 15:44:16.497840 | controller | ok: [instance] 2026-03-09 15:44:16.754615 | controller | 2026-03-09 15:44:16.754661 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-03-09 15:44:16.754670 | controller | Monday 09 March 2026 15:44:16 +0000 (0:00:00.035) 0:01:22.442 ********** 2026-03-09 15:44:16.754680 | controller | changed: [instance] 2026-03-09 15:44:17.013091 | controller | 2026-03-09 15:44:17.013114 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-03-09 15:44:17.013121 | controller | Monday 09 March 2026 15:44:16 +0000 (0:00:00.257) 0:01:22.699 ********** 2026-03-09 15:44:17.013130 | controller | changed: [instance] 2026-03-09 15:44:17.030593 | controller | 2026-03-09 15:44:17.030615 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-03-09 15:44:17.030623 | controller | Monday 09 March 2026 15:44:17 +0000 (0:00:00.258) 0:01:22.957 ********** 2026-03-09 15:44:17.030653 | controller | skipping: [instance] 2026-03-09 15:44:17.047797 | controller | 2026-03-09 15:44:17.047842 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-03-09 15:44:17.047856 | controller | Monday 09 March 2026 15:44:17 +0000 (0:00:00.017) 0:01:22.975 ********** 2026-03-09 15:44:17.047873 | controller | skipping: [instance] 2026-03-09 15:44:17.047919 | controller | 2026-03-09 15:44:17.048138 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-03-09 15:44:17.065344 | controller | Monday 09 March 2026 15:44:17 +0000 (0:00:00.017) 0:01:22.992 ********** 2026-03-09 15:44:17.065365 | controller | skipping: [instance] 2026-03-09 15:44:17.080748 | controller | 2026-03-09 15:44:17.080783 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-03-09 15:44:17.080792 | controller | Monday 09 March 2026 15:44:17 +0000 (0:00:00.017) 0:01:23.009 ********** 2026-03-09 15:44:17.080803 | controller | skipping: [instance] 2026-03-09 15:44:17.080833 | controller | 2026-03-09 15:44:17.080842 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-03-09 15:44:17.080876 | controller | Monday 09 March 2026 15:44:17 +0000 (0:00:00.015) 0:01:23.025 ********** 2026-03-09 15:44:17.096623 | controller | skipping: [instance] 2026-03-09 15:44:17.115970 | controller | 2026-03-09 15:44:17.116020 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-03-09 15:44:17.116034 | controller | Monday 09 March 2026 15:44:17 +0000 (0:00:00.015) 0:01:23.040 ********** 2026-03-09 15:44:17.116050 | controller | skipping: [instance] 2026-03-09 15:44:17.116250 | controller | 2026-03-09 15:44:17.116373 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-03-09 15:44:17.116493 | controller | Monday 09 March 2026 15:44:17 +0000 (0:00:00.019) 0:01:23.060 ********** 2026-03-09 15:44:18.028465 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-03-09 15:44:18.351742 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-03-09 15:44:18.351772 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-03-09 15:44:18.351780 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-03-09 15:44:18.351786 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-03-09 15:44:18.351791 | controller | 2026-03-09 15:44:18.351797 | controller | TASK [Create secret file] ****************************************************** 2026-03-09 15:44:18.351803 | controller | Monday 09 March 2026 15:44:18 +0000 (0:00:00.911) 0:01:23.972 ********** 2026-03-09 15:44:18.351812 | controller | changed: [instance] 2026-03-09 15:44:18.351839 | controller | 2026-03-09 15:44:18.351846 | controller | PLAY RECAP ********************************************************************* 2026-03-09 15:44:18.351852 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-03-09 15:44:18.351857 | controller | 2026-03-09 15:44:18.351868 | controller | Monday 09 March 2026 15:44:18 +0000 (0:00:00.322) 0:01:24.295 ********** 2026-03-09 15:44:18.351873 | controller | =============================================================================== 2026-03-09 15:44:18.351879 | controller | test_deps : Install selinux python libs -------------------------------- 52.07s 2026-03-09 15:44:18.351884 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.25s 2026-03-09 15:44:18.351891 | controller | ci_setup : Install openshift client ------------------------------------- 5.97s 2026-03-09 15:44:18.353248 | controller | ci_setup : Install needed packages -------------------------------------- 4.97s 2026-03-09 15:44:18.353283 | controller | repo_setup : Get repo-setup repository ---------------------------------- 2.54s 2026-03-09 15:44:18.408724 | controller | test_deps : Install python yaml libs ------------------------------------ 1.22s 2026-03-09 15:44:18.408743 | controller | ci_setup : Manage directories ------------------------------------------- 0.91s 2026-03-09 15:44:18.408750 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.82s 2026-03-09 15:44:18.408755 | controller | Gathering Facts --------------------------------------------------------- 0.82s 2026-03-09 15:44:18.408760 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.80s 2026-03-09 15:44:18.408765 | controller | repo_setup : Install repo-setup package --------------------------------- 0.67s 2026-03-09 15:44:18.408770 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.67s 2026-03-09 15:44:18.408775 | controller | ci_setup : Gather version of openshift client --------------------------- 0.57s 2026-03-09 15:44:18.408780 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s 2026-03-09 15:44:18.408785 | controller | repo_setup : Ensure directories are present ----------------------------- 0.51s 2026-03-09 15:44:18.408790 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.42s 2026-03-09 15:44:18.408795 | controller | Create secret file ------------------------------------------------------ 0.32s 2026-03-09 15:44:18.408799 | controller | Create custom basedir --------------------------------------------------- 0.31s 2026-03-09 15:44:18.408804 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.27s 2026-03-09 15:44:18.408814 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.26s 2026-03-09 15:44:18.408822 | controller | INFO Running crc_layout > converge 2026-03-09 15:44:19.003485 | controller | 2026-03-09 15:44:19.003731 | controller | PLAY [Converge] **************************************************************** 2026-03-09 15:44:19.003864 | controller | 2026-03-09 15:44:19.004008 | controller | TASK [Gathering Facts] ********************************************************* 2026-03-09 15:44:19.004139 | controller | Monday 09 March 2026 15:44:19 +0000 (0:00:00.027) 0:00:00.027 ********** 2026-03-09 15:44:19.816451 | controller | ok: [instance] 2026-03-09 15:44:19.838386 | controller | 2026-03-09 15:44:19.838404 | controller | TASK [Load networking definition from scenario file] *************************** 2026-03-09 15:44:19.838411 | controller | Monday 09 March 2026 15:44:19 +0000 (0:00:00.813) 0:00:00.840 ********** 2026-03-09 15:44:19.838420 | controller | ok: [instance] 2026-03-09 15:44:21.642096 | controller | 2026-03-09 15:44:21.642125 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-03-09 15:44:21.642132 | controller | Monday 09 March 2026 15:44:19 +0000 (0:00:00.022) 0:00:00.862 ********** 2026-03-09 15:44:21.642141 | controller | changed: [instance] 2026-03-09 15:44:21.668737 | controller | 2026-03-09 15:44:21.668771 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-03-09 15:44:21.668780 | controller | Monday 09 March 2026 15:44:21 +0000 (0:00:01.803) 0:00:02.666 ********** 2026-03-09 15:44:21.668798 | controller | ok: [instance] 2026-03-09 15:44:21.689407 | controller | 2026-03-09 15:44:21.689437 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-03-09 15:44:21.689447 | controller | Monday 09 March 2026 15:44:21 +0000 (0:00:00.026) 0:00:02.693 ********** 2026-03-09 15:44:21.689458 | controller | skipping: [instance] 2026-03-09 15:44:21.733349 | controller | 2026-03-09 15:44:21.733379 | controller | TASK [Build final libvirt layout] ********************************************** 2026-03-09 15:44:21.733392 | controller | Monday 09 March 2026 15:44:21 +0000 (0:00:00.020) 0:00:02.713 ********** 2026-03-09 15:44:21.733406 | controller | 2026-03-09 15:44:21.809566 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-03-09 15:44:21.809588 | controller | Monday 09 March 2026 15:44:21 +0000 (0:00:00.043) 0:00:02.757 ********** 2026-03-09 15:44:21.809600 | controller | ok: [instance] 2026-03-09 15:44:21.872261 | controller | 2026-03-09 15:44:21.872284 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-03-09 15:44:21.872291 | controller | Monday 09 March 2026 15:44:21 +0000 (0:00:00.076) 0:00:02.834 ********** 2026-03-09 15:44:21.872300 | controller | skipping: [instance] 2026-03-09 15:44:21.907506 | controller | 2026-03-09 15:44:21.907533 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-03-09 15:44:21.907542 | controller | Monday 09 March 2026 15:44:21 +0000 (0:00:00.062) 0:00:02.896 ********** 2026-03-09 15:44:21.907553 | controller | ok: [instance] 2026-03-09 15:44:21.907749 | controller | 2026-03-09 15:44:21.907924 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-03-09 15:44:21.908099 | controller | Monday 09 March 2026 15:44:21 +0000 (0:00:00.035) 0:00:02.932 ********** 2026-03-09 15:44:21.932207 | controller | ok: [instance] => changed=false 2026-03-09 15:44:21.932371 | controller | msg: All assertions passed 2026-03-09 15:44:21.932498 | controller | 2026-03-09 15:44:21.932651 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-03-09 15:44:21.932797 | controller | Monday 09 March 2026 15:44:21 +0000 (0:00:00.024) 0:00:02.956 ********** 2026-03-09 15:44:21.976285 | controller | ok: [instance] 2026-03-09 15:44:21.976450 | controller | 2026-03-09 15:44:21.976603 | controller | TASK [reproducer : Register current host as controller-0] ********************** 2026-03-09 15:44:21.976746 | controller | Monday 09 March 2026 15:44:21 +0000 (0:00:00.044) 0:00:03.001 ********** 2026-03-09 15:44:22.002558 | controller | skipping: [instance] 2026-03-09 15:44:22.002832 | controller | 2026-03-09 15:44:22.003084 | controller | TASK [reproducer : Set minimal libvirt layout for bare metal OCP] ************** 2026-03-09 15:44:22.003299 | controller | Monday 09 March 2026 15:44:22 +0000 (0:00:00.026) 0:00:03.027 ********** 2026-03-09 15:44:22.029787 | controller | skipping: [instance] 2026-03-09 15:44:22.029986 | controller | 2026-03-09 15:44:22.030158 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-03-09 15:44:22.030319 | controller | Monday 09 March 2026 15:44:22 +0000 (0:00:00.027) 0:00:03.054 ********** 2026-03-09 15:44:22.480745 | controller | ok: [instance] => (item=artifacts) 2026-03-09 15:44:22.481367 | controller | ok: [instance] => (item=logs) 2026-03-09 15:44:22.546378 | controller | 2026-03-09 15:44:22.546407 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-03-09 15:44:22.546415 | controller | Monday 09 March 2026 15:44:22 +0000 (0:00:00.450) 0:00:03.505 ********** 2026-03-09 15:44:22.546424 | controller | 2026-03-09 15:44:22.733459 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-03-09 15:44:22.733492 | controller | Monday 09 March 2026 15:44:22 +0000 (0:00:00.065) 0:00:03.570 ********** 2026-03-09 15:44:22.733511 | controller | ok: [instance] 2026-03-09 15:44:23.008740 | controller | 2026-03-09 15:44:23.008776 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-03-09 15:44:23.008784 | controller | Monday 09 March 2026 15:44:22 +0000 (0:00:00.186) 0:00:03.757 ********** 2026-03-09 15:44:23.008795 | controller | changed: [instance] 2026-03-09 15:44:23.008820 | controller | 2026-03-09 15:44:23.008978 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-03-09 15:44:23.009055 | controller | Monday 09 March 2026 15:44:23 +0000 (0:00:00.275) 0:00:04.033 ********** 2026-03-09 15:44:23.280723 | controller | ok: [instance] 2026-03-09 15:44:23.280802 | controller | 2026-03-09 15:44:23.280817 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-03-09 15:44:23.280832 | controller | Monday 09 March 2026 15:44:23 +0000 (0:00:00.271) 0:00:04.304 ********** 2026-03-09 15:44:23.309756 | controller | skipping: [instance] 2026-03-09 15:44:23.309843 | controller | 2026-03-09 15:44:23.310051 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-03-09 15:44:23.327390 | controller | Monday 09 March 2026 15:44:23 +0000 (0:00:00.029) 0:00:04.334 ********** 2026-03-09 15:44:23.327432 | controller | skipping: [instance] 2026-03-09 15:44:23.347394 | controller | 2026-03-09 15:44:23.347416 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-03-09 15:44:23.347424 | controller | Monday 09 March 2026 15:44:23 +0000 (0:00:00.017) 0:00:04.351 ********** 2026-03-09 15:44:23.347433 | controller | ok: [instance] 2026-03-09 15:44:23.375453 | controller | 2026-03-09 15:44:23.375473 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-03-09 15:44:23.375480 | controller | Monday 09 March 2026 15:44:23 +0000 (0:00:00.020) 0:00:04.371 ********** 2026-03-09 15:44:23.375489 | controller | skipping: [instance] 2026-03-09 15:44:34.188433 | controller | 2026-03-09 15:44:34.188462 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-03-09 15:44:34.188471 | controller | Monday 09 March 2026 15:44:23 +0000 (0:00:00.028) 0:00:04.399 ********** 2026-03-09 15:44:34.188481 | controller | changed: [instance] 2026-03-09 15:44:34.188818 | controller | 2026-03-09 15:44:34.188858 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-03-09 15:44:34.402263 | controller | Monday 09 March 2026 15:44:34 +0000 (0:00:10.812) 0:00:15.212 ********** 2026-03-09 15:44:34.402298 | controller | changed: [instance] 2026-03-09 15:44:34.402323 | controller | 2026-03-09 15:44:34.402331 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-03-09 15:44:34.402468 | controller | Monday 09 March 2026 15:44:34 +0000 (0:00:00.213) 0:00:15.426 ********** 2026-03-09 15:44:34.917416 | controller | changed: [instance] 2026-03-09 15:44:35.505449 | controller | 2026-03-09 15:44:35.505481 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-03-09 15:44:35.505489 | controller | Monday 09 March 2026 15:44:34 +0000 (0:00:00.514) 0:00:15.941 ********** 2026-03-09 15:44:35.505499 | controller | changed: [instance] 2026-03-09 15:44:35.699273 | controller | 2026-03-09 15:44:35.699315 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-03-09 15:44:35.699330 | controller | Monday 09 March 2026 15:44:35 +0000 (0:00:00.587) 0:00:16.529 ********** 2026-03-09 15:44:35.699340 | controller | ok: [instance] 2026-03-09 15:44:36.354065 | controller | 2026-03-09 15:44:36.354099 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-03-09 15:44:36.354107 | controller | Monday 09 March 2026 15:44:35 +0000 (0:00:00.194) 0:00:16.723 ********** 2026-03-09 15:44:36.354117 | controller | ok: [instance] 2026-03-09 15:44:37.095152 | controller | 2026-03-09 15:44:37.095183 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-03-09 15:44:37.095191 | controller | Monday 09 March 2026 15:44:36 +0000 (0:00:00.654) 0:00:17.378 ********** 2026-03-09 15:44:37.095201 | controller | changed: [instance] 2026-03-09 15:44:37.199799 | controller | 2026-03-09 15:44:37.199840 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-03-09 15:44:37.199851 | controller | Monday 09 March 2026 15:44:37 +0000 (0:00:00.741) 0:00:18.119 ********** 2026-03-09 15:44:37.199872 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-03-09 15:44:37.199896 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-03-09 15:44:37.199906 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-03-09 15:44:37.200674 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-03-09 15:44:37.520384 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-03-09 15:44:37.520414 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-03-09 15:44:37.520422 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-03-09 15:44:37.520428 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-03-09 15:44:37.520433 | controller | 2026-03-09 15:44:37.520439 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-03-09 15:44:37.520445 | controller | Monday 09 March 2026 15:44:37 +0000 (0:00:00.105) 0:00:18.224 ********** 2026-03-09 15:44:37.520455 | controller | ok: [instance] 2026-03-09 15:44:37.837322 | controller | 2026-03-09 15:44:37.837348 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-03-09 15:44:37.837355 | controller | Monday 09 March 2026 15:44:37 +0000 (0:00:00.320) 0:00:18.544 ********** 2026-03-09 15:44:37.837365 | controller | ok: [instance] 2026-03-09 15:44:38.148450 | controller | 2026-03-09 15:44:38.148475 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-03-09 15:44:38.148482 | controller | Monday 09 March 2026 15:44:37 +0000 (0:00:00.317) 0:00:18.861 ********** 2026-03-09 15:44:38.148492 | controller | ok: [instance] 2026-03-09 15:44:38.462460 | controller | 2026-03-09 15:44:38.462488 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-03-09 15:44:38.462496 | controller | Monday 09 March 2026 15:44:38 +0000 (0:00:00.311) 0:00:19.172 ********** 2026-03-09 15:44:38.462506 | controller | ok: [instance] 2026-03-09 15:44:38.778213 | controller | 2026-03-09 15:44:38.778238 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-03-09 15:44:38.778246 | controller | Monday 09 March 2026 15:44:38 +0000 (0:00:00.313) 0:00:19.486 ********** 2026-03-09 15:44:38.778255 | controller | ok: [instance] 2026-03-09 15:44:39.092498 | controller | 2026-03-09 15:44:39.092530 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-03-09 15:44:39.092544 | controller | Monday 09 March 2026 15:44:38 +0000 (0:00:00.315) 0:00:19.802 ********** 2026-03-09 15:44:39.092561 | controller | ok: [instance] 2026-03-09 15:44:39.409688 | controller | 2026-03-09 15:44:39.409716 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-03-09 15:44:39.409725 | controller | Monday 09 March 2026 15:44:39 +0000 (0:00:00.314) 0:00:20.116 ********** 2026-03-09 15:44:39.409734 | controller | ok: [instance] 2026-03-09 15:44:39.409853 | controller | 2026-03-09 15:44:39.409863 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-03-09 15:44:39.409871 | controller | Monday 09 March 2026 15:44:39 +0000 (0:00:00.317) 0:00:20.434 ********** 2026-03-09 15:44:39.722316 | controller | ok: [instance] 2026-03-09 15:44:40.036134 | controller | 2026-03-09 15:44:40.036162 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-03-09 15:44:40.036170 | controller | Monday 09 March 2026 15:44:39 +0000 (0:00:00.312) 0:00:20.746 ********** 2026-03-09 15:44:40.036180 | controller | ok: [instance] 2026-03-09 15:44:40.357260 | controller | 2026-03-09 15:44:40.357322 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-03-09 15:44:40.357331 | controller | Monday 09 March 2026 15:44:40 +0000 (0:00:00.313) 0:00:21.060 ********** 2026-03-09 15:44:40.357343 | controller | ok: [instance] 2026-03-09 15:44:40.677735 | controller | 2026-03-09 15:44:40.677777 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-03-09 15:44:40.677785 | controller | Monday 09 March 2026 15:44:40 +0000 (0:00:00.318) 0:00:21.379 ********** 2026-03-09 15:44:40.677797 | controller | ok: [instance] 2026-03-09 15:44:41.009748 | controller | 2026-03-09 15:44:41.009783 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-03-09 15:44:41.009794 | controller | Monday 09 March 2026 15:44:40 +0000 (0:00:00.322) 0:00:21.701 ********** 2026-03-09 15:44:41.009807 | controller | ok: [instance] 2026-03-09 15:44:41.331176 | controller | 2026-03-09 15:44:41.331208 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-03-09 15:44:41.331216 | controller | Monday 09 March 2026 15:44:41 +0000 (0:00:00.332) 0:00:22.033 ********** 2026-03-09 15:44:41.331227 | controller | ok: [instance] 2026-03-09 15:44:41.660675 | controller | 2026-03-09 15:44:41.660710 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-03-09 15:44:41.660718 | controller | Monday 09 March 2026 15:44:41 +0000 (0:00:00.321) 0:00:22.355 ********** 2026-03-09 15:44:41.660729 | controller | ok: [instance] 2026-03-09 15:44:41.978282 | controller | 2026-03-09 15:44:41.978319 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-03-09 15:44:41.978327 | controller | Monday 09 March 2026 15:44:41 +0000 (0:00:00.329) 0:00:22.684 ********** 2026-03-09 15:44:41.978338 | controller | ok: [instance] 2026-03-09 15:44:42.290781 | controller | 2026-03-09 15:44:42.290820 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-03-09 15:44:42.290831 | controller | Monday 09 March 2026 15:44:41 +0000 (0:00:00.317) 0:00:23.002 ********** 2026-03-09 15:44:42.290844 | controller | ok: [instance] 2026-03-09 15:44:42.290864 | controller | 2026-03-09 15:44:42.290874 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-03-09 15:44:42.608391 | controller | Monday 09 March 2026 15:44:42 +0000 (0:00:00.312) 0:00:23.315 ********** 2026-03-09 15:44:42.608432 | controller | ok: [instance] 2026-03-09 15:44:42.924728 | controller | 2026-03-09 15:44:42.924772 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-03-09 15:44:42.924783 | controller | Monday 09 March 2026 15:44:42 +0000 (0:00:00.317) 0:00:23.632 ********** 2026-03-09 15:44:42.924798 | controller | ok: [instance] 2026-03-09 15:44:42.924831 | controller | 2026-03-09 15:44:42.924970 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-03-09 15:44:42.925002 | controller | Monday 09 March 2026 15:44:42 +0000 (0:00:00.316) 0:00:23.949 ********** 2026-03-09 15:44:43.244576 | controller | ok: [instance] 2026-03-09 15:44:43.565332 | controller | 2026-03-09 15:44:43.565363 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-03-09 15:44:43.565371 | controller | Monday 09 March 2026 15:44:43 +0000 (0:00:00.319) 0:00:24.268 ********** 2026-03-09 15:44:43.565388 | controller | ok: [instance] 2026-03-09 15:44:43.880067 | controller | 2026-03-09 15:44:43.880091 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-03-09 15:44:43.880098 | controller | Monday 09 March 2026 15:44:43 +0000 (0:00:00.320) 0:00:24.589 ********** 2026-03-09 15:44:43.880114 | controller | ok: [instance] 2026-03-09 15:44:44.189567 | controller | 2026-03-09 15:44:44.189590 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-03-09 15:44:44.189599 | controller | Monday 09 March 2026 15:44:43 +0000 (0:00:00.315) 0:00:24.904 ********** 2026-03-09 15:44:44.189608 | controller | ok: [instance] 2026-03-09 15:44:44.503606 | controller | 2026-03-09 15:44:44.503689 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-03-09 15:44:44.503700 | controller | Monday 09 March 2026 15:44:44 +0000 (0:00:00.309) 0:00:25.213 ********** 2026-03-09 15:44:44.503713 | controller | ok: [instance] 2026-03-09 15:44:44.815565 | controller | 2026-03-09 15:44:44.815595 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-03-09 15:44:44.815603 | controller | Monday 09 March 2026 15:44:44 +0000 (0:00:00.313) 0:00:25.527 ********** 2026-03-09 15:44:44.815613 | controller | ok: [instance] 2026-03-09 15:44:44.835417 | controller | 2026-03-09 15:44:44.835436 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-03-09 15:44:44.835444 | controller | Monday 09 March 2026 15:44:44 +0000 (0:00:00.312) 0:00:25.839 ********** 2026-03-09 15:44:44.835452 | controller | skipping: [instance] 2026-03-09 15:44:45.150191 | controller | 2026-03-09 15:44:45.150214 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-03-09 15:44:45.150222 | controller | Monday 09 March 2026 15:44:44 +0000 (0:00:00.020) 0:00:25.859 ********** 2026-03-09 15:44:45.150231 | controller | ok: [instance] 2026-03-09 15:44:45.517268 | controller | 2026-03-09 15:44:45.517297 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-03-09 15:44:45.517305 | controller | Monday 09 March 2026 15:44:45 +0000 (0:00:00.314) 0:00:26.174 ********** 2026-03-09 15:44:45.517315 | controller | ok: [instance] 2026-03-09 15:44:45.823279 | controller | 2026-03-09 15:44:45.823306 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-03-09 15:44:45.823314 | controller | Monday 09 March 2026 15:44:45 +0000 (0:00:00.366) 0:00:26.541 ********** 2026-03-09 15:44:45.823324 | controller | changed: [instance] 2026-03-09 15:44:46.111356 | controller | 2026-03-09 15:44:46.111382 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-03-09 15:44:46.111390 | controller | Monday 09 March 2026 15:44:45 +0000 (0:00:00.305) 0:00:26.847 ********** 2026-03-09 15:44:46.111400 | controller | [WARNING]: Reset is not implemented for this connection 2026-03-09 15:44:46.121812 | controller | changed: [instance] 2026-03-09 15:44:46.121848 | controller | 2026-03-09 15:44:46.121857 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-03-09 15:44:46.121865 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.282) 0:00:27.130 ********** 2026-03-09 15:44:46.121872 | controller | 2026-03-09 15:44:46.121879 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-03-09 15:44:46.121888 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.015) 0:00:27.145 ********** 2026-03-09 15:44:46.190448 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-03-09 15:44:46.256804 | controller | 2026-03-09 15:44:46.256839 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-03-09 15:44:46.256848 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.068) 0:00:27.214 ********** 2026-03-09 15:44:46.256859 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-03-09 15:44:46.304437 | controller | 2026-03-09 15:44:46.304460 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-09 15:44:46.304468 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.066) 0:00:27.281 ********** 2026-03-09 15:44:46.304485 | controller | ok: [instance] => (item=compute) 2026-03-09 15:44:46.346253 | controller | ok: [instance] => (item=controller) 2026-03-09 15:44:46.346273 | controller | ok: [instance] => (item=crc) 2026-03-09 15:44:46.346280 | controller | 2026-03-09 15:44:46.346286 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-09 15:44:46.346291 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.047) 0:00:27.328 ********** 2026-03-09 15:44:46.346300 | controller | ok: [instance] 2026-03-09 15:44:46.389265 | controller | 2026-03-09 15:44:46.389287 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-03-09 15:44:46.389296 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.042) 0:00:27.370 ********** 2026-03-09 15:44:46.389308 | controller | ok: [instance] => changed=false 2026-03-09 15:44:46.432001 | controller | msg: All assertions passed 2026-03-09 15:44:46.432023 | controller | 2026-03-09 15:44:46.432032 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-03-09 15:44:46.432039 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.042) 0:00:27.413 ********** 2026-03-09 15:44:46.432049 | controller | 2026-03-09 15:44:46.432229 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-03-09 15:44:46.432398 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.043) 0:00:27.456 ********** 2026-03-09 15:44:46.511234 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.54', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-03-09 15:44:46.511483 | controller | ok: [instance] => (item={}) 2026-03-09 15:44:46.511726 | controller | 2026-03-09 15:44:46.511873 | controller | TASK [devscripts : Check if num_masters is equal to 1 when cifmw_devscripts_sno] *** 2026-03-09 15:44:46.512013 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.079) 0:00:27.535 ********** 2026-03-09 15:44:46.541273 | controller | skipping: [instance] 2026-03-09 15:44:46.541448 | controller | 2026-03-09 15:44:46.541612 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-03-09 15:44:46.541783 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.030) 0:00:27.565 ********** 2026-03-09 15:44:46.558797 | controller | skipping: [instance] 2026-03-09 15:44:46.558988 | controller | 2026-03-09 15:44:46.559161 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-03-09 15:44:46.559319 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.017) 0:00:27.583 ********** 2026-03-09 15:44:46.771380 | controller | ok: [instance] 2026-03-09 15:44:46.771556 | controller | 2026-03-09 15:44:46.771756 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-03-09 15:44:46.771931 | controller | Monday 09 March 2026 15:44:46 +0000 (0:00:00.212) 0:00:27.795 ********** 2026-03-09 15:44:47.122815 | controller | changed: [instance] 2026-03-09 15:44:47.855498 | controller | 2026-03-09 15:44:47.855529 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-03-09 15:44:47.855537 | controller | Monday 09 March 2026 15:44:47 +0000 (0:00:00.351) 0:00:28.147 ********** 2026-03-09 15:44:47.855548 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-03-09 15:44:47.880686 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-03-09 15:44:47.880725 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-03-09 15:44:47.880736 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-03-09 15:44:47.880746 | controller | 2026-03-09 15:44:47.880755 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-03-09 15:44:47.880774 | controller | Monday 09 March 2026 15:44:47 +0000 (0:00:00.732) 0:00:28.879 ********** 2026-03-09 15:44:47.880789 | controller | skipping: [instance] 2026-03-09 15:44:48.238717 | controller | 2026-03-09 15:44:48.238763 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-03-09 15:44:48.238773 | controller | Monday 09 March 2026 15:44:47 +0000 (0:00:00.025) 0:00:28.904 ********** 2026-03-09 15:44:48.238788 | controller | changed: [instance] 2026-03-09 15:44:48.238827 | controller | 2026-03-09 15:44:48.238834 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-03-09 15:44:48.238841 | controller | Monday 09 March 2026 15:44:48 +0000 (0:00:00.349) 0:00:29.254 ********** 2026-03-09 15:44:48.238850 | controller | 2026-03-09 15:44:48.238877 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-03-09 15:44:48.239008 | controller | Monday 09 March 2026 15:44:48 +0000 (0:00:00.008) 0:00:29.262 ********** 2026-03-09 15:44:48.663973 | controller | changed: [instance] 2026-03-09 15:44:48.664064 | controller | 2026-03-09 15:44:48.664219 | controller | TASK [Ensure no default networks exists] *************************************** 2026-03-09 15:44:48.664327 | controller | Monday 09 March 2026 15:44:48 +0000 (0:00:00.425) 0:00:29.688 ********** 2026-03-09 15:44:48.738209 | controller | 2026-03-09 15:44:49.945080 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-03-09 15:44:49.945113 | controller | Monday 09 March 2026 15:44:48 +0000 (0:00:00.074) 0:00:29.762 ********** 2026-03-09 15:44:49.945126 | controller | ok: [instance] 2026-03-09 15:44:50.173367 | controller | 2026-03-09 15:44:50.173392 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-03-09 15:44:50.173400 | controller | Monday 09 March 2026 15:44:49 +0000 (0:00:01.206) 0:00:30.969 ********** 2026-03-09 15:44:50.173411 | controller | ok: [instance] 2026-03-09 15:44:50.696336 | controller | 2026-03-09 15:44:50.696363 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-03-09 15:44:50.696370 | controller | Monday 09 March 2026 15:44:50 +0000 (0:00:00.228) 0:00:31.197 ********** 2026-03-09 15:44:50.696380 | controller | ok: [instance] 2026-03-09 15:44:50.941135 | controller | 2026-03-09 15:44:50.941167 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-03-09 15:44:50.941183 | controller | Monday 09 March 2026 15:44:50 +0000 (0:00:00.522) 0:00:31.720 ********** 2026-03-09 15:44:50.941194 | controller | ok: [instance] 2026-03-09 15:44:52.204709 | controller | 2026-03-09 15:44:52.204751 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-03-09 15:44:52.204760 | controller | Monday 09 March 2026 15:44:50 +0000 (0:00:00.244) 0:00:31.965 ********** 2026-03-09 15:44:52.204771 | controller | ok: [instance] 2026-03-09 15:44:52.204796 | controller | 2026-03-09 15:44:52.205016 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-03-09 15:44:52.542111 | controller | Monday 09 March 2026 15:44:52 +0000 (0:00:01.264) 0:00:33.229 ********** 2026-03-09 15:44:52.542142 | controller | ok: [instance] 2026-03-09 15:44:52.874752 | controller | 2026-03-09 15:44:52.874771 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-03-09 15:44:52.874779 | controller | Monday 09 March 2026 15:44:52 +0000 (0:00:00.337) 0:00:33.566 ********** 2026-03-09 15:44:52.874788 | controller | changed: [instance] 2026-03-09 15:44:53.196668 | controller | 2026-03-09 15:44:53.196692 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-03-09 15:44:53.196702 | controller | Monday 09 March 2026 15:44:52 +0000 (0:00:00.332) 0:00:33.899 ********** 2026-03-09 15:44:53.196713 | controller | changed: [instance] 2026-03-09 15:44:53.755242 | controller | 2026-03-09 15:44:53.755288 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-03-09 15:44:53.755303 | controller | Monday 09 March 2026 15:44:53 +0000 (0:00:00.321) 0:00:34.220 ********** 2026-03-09 15:44:53.755321 | controller | changed: [instance] => (item=arptables) 2026-03-09 15:44:54.062111 | controller | changed: [instance] => (item=iptables) 2026-03-09 15:44:54.062151 | controller | changed: [instance] => (item=ip6tables) 2026-03-09 15:44:54.062160 | controller | 2026-03-09 15:44:54.062173 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-03-09 15:44:54.062180 | controller | Monday 09 March 2026 15:44:53 +0000 (0:00:00.557) 0:00:34.778 ********** 2026-03-09 15:44:54.062190 | controller | ok: [instance] 2026-03-09 15:44:54.062210 | controller | 2026-03-09 15:44:54.062266 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-03-09 15:44:54.062359 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.307) 0:00:35.086 ********** 2026-03-09 15:44:54.177977 | controller | ok: [instance] 2026-03-09 15:44:54.178088 | controller | 2026-03-09 15:44:54.178173 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-03-09 15:44:54.178261 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.115) 0:00:35.202 ********** 2026-03-09 15:44:54.220984 | controller | 2026-03-09 15:44:54.221071 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-03-09 15:44:54.221165 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.043) 0:00:35.245 ********** 2026-03-09 15:44:54.254327 | controller | skipping: [instance] 2026-03-09 15:44:54.291085 | controller | 2026-03-09 15:44:54.291106 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-03-09 15:44:54.291114 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.030) 0:00:35.276 ********** 2026-03-09 15:44:54.291123 | controller | skipping: [instance] 2026-03-09 15:44:54.291184 | controller | 2026-03-09 15:44:54.291309 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-03-09 15:44:54.291414 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.039) 0:00:35.315 ********** 2026-03-09 15:44:54.314169 | controller | skipping: [instance] 2026-03-09 15:44:54.314265 | controller | 2026-03-09 15:44:54.314382 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-03-09 15:44:54.314476 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.023) 0:00:35.338 ********** 2026-03-09 15:44:54.345071 | controller | skipping: [instance] 2026-03-09 15:44:54.345137 | controller | 2026-03-09 15:44:54.345241 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-03-09 15:44:54.345333 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.030) 0:00:35.369 ********** 2026-03-09 15:44:54.384919 | controller | ok: [instance] 2026-03-09 15:44:54.385089 | controller | 2026-03-09 15:44:54.385265 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-03-09 15:44:54.385426 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.039) 0:00:35.409 ********** 2026-03-09 15:44:54.419568 | controller | skipping: [instance] 2026-03-09 15:44:54.419698 | controller | 2026-03-09 15:44:54.419794 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-03-09 15:44:54.419892 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.034) 0:00:35.444 ********** 2026-03-09 15:44:54.442587 | controller | skipping: [instance] 2026-03-09 15:44:54.442685 | controller | 2026-03-09 15:44:54.442781 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-03-09 15:44:54.442872 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.023) 0:00:35.467 ********** 2026-03-09 15:44:54.499493 | controller | ok: [instance] 2026-03-09 15:44:54.499681 | controller | 2026-03-09 15:44:54.499866 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-03-09 15:44:54.500104 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.056) 0:00:35.524 ********** 2026-03-09 15:44:54.522099 | controller | skipping: [instance] 2026-03-09 15:44:54.522258 | controller | 2026-03-09 15:44:54.522432 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-03-09 15:44:54.522591 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.022) 0:00:35.546 ********** 2026-03-09 15:44:54.573447 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-03-09 15:44:54.573495 | controller | 2026-03-09 15:44:54.573587 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-03-09 15:44:54.573700 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.051) 0:00:35.597 ********** 2026-03-09 15:44:54.900128 | controller | ok: [instance -> localhost] 2026-03-09 15:44:54.900250 | controller | 2026-03-09 15:44:54.900436 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-03-09 15:44:54.900571 | controller | Monday 09 March 2026 15:44:54 +0000 (0:00:00.326) 0:00:35.924 ********** 2026-03-09 15:45:00.799560 | controller | changed: [instance -> localhost] 2026-03-09 15:45:00.981654 | controller | 2026-03-09 15:45:00.981690 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-03-09 15:45:00.981700 | controller | Monday 09 March 2026 15:45:00 +0000 (0:00:05.899) 0:00:41.823 ********** 2026-03-09 15:45:00.981713 | controller | changed: [instance] 2026-03-09 15:45:01.318735 | controller | 2026-03-09 15:45:01.318767 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-03-09 15:45:01.318775 | controller | Monday 09 March 2026 15:45:00 +0000 (0:00:00.181) 0:00:42.005 ********** 2026-03-09 15:45:01.318786 | controller | changed: [instance] 2026-03-09 15:45:02.900730 | controller | 2026-03-09 15:45:02.900767 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-03-09 15:45:02.900777 | controller | Monday 09 March 2026 15:45:01 +0000 (0:00:00.336) 0:00:42.342 ********** 2026-03-09 15:45:02.900790 | controller | changed: [instance -> localhost] 2026-03-09 15:45:02.900821 | controller | 2026-03-09 15:45:02.900987 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-03-09 15:45:03.239715 | controller | Monday 09 March 2026 15:45:02 +0000 (0:00:01.582) 0:00:43.924 ********** 2026-03-09 15:45:03.239769 | controller | changed: [instance] 2026-03-09 15:45:03.239814 | controller | 2026-03-09 15:45:03.239825 | controller | TASK [reproducer : Select right domain] **************************************** 2026-03-09 15:45:03.239915 | controller | Monday 09 March 2026 15:45:03 +0000 (0:00:00.339) 0:00:44.264 ********** 2026-03-09 15:45:03.271326 | controller | ok: [instance] 2026-03-09 15:45:03.381611 | controller | 2026-03-09 15:45:03.381651 | controller | TASK [Create the virtual networks] ********************************************* 2026-03-09 15:45:03.381663 | controller | Monday 09 March 2026 15:45:03 +0000 (0:00:00.031) 0:00:44.295 ********** 2026-03-09 15:45:03.381674 | controller | 2026-03-09 15:45:03.399678 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-03-09 15:45:03.399698 | controller | Monday 09 March 2026 15:45:03 +0000 (0:00:00.110) 0:00:44.406 ********** 2026-03-09 15:45:03.399709 | controller | ok: [instance] 2026-03-09 15:45:03.580126 | controller | 2026-03-09 15:45:03.580161 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-03-09 15:45:03.580169 | controller | Monday 09 March 2026 15:45:03 +0000 (0:00:00.017) 0:00:44.424 ********** 2026-03-09 15:45:03.580180 | controller | ok: [instance] 2026-03-09 15:45:03.608674 | controller | 2026-03-09 15:45:03.608694 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-03-09 15:45:03.608702 | controller | Monday 09 March 2026 15:45:03 +0000 (0:00:00.180) 0:00:44.604 ********** 2026-03-09 15:45:03.608711 | controller | skipping: [instance] 2026-03-09 15:45:03.608740 | controller | 2026-03-09 15:45:03.608747 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-03-09 15:45:03.608754 | controller | Monday 09 March 2026 15:45:03 +0000 (0:00:00.028) 0:00:44.633 ********** 2026-03-09 15:45:03.636624 | controller | skipping: [instance] 2026-03-09 15:45:03.636740 | controller | 2026-03-09 15:45:03.636834 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-03-09 15:45:03.636948 | controller | Monday 09 March 2026 15:45:03 +0000 (0:00:00.028) 0:00:44.661 ********** 2026-03-09 15:45:03.689475 | controller | ok: [instance] 2026-03-09 15:45:03.689560 | controller | 2026-03-09 15:45:03.689791 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-03-09 15:45:03.831677 | controller | Monday 09 March 2026 15:45:03 +0000 (0:00:00.052) 0:00:44.714 ********** 2026-03-09 15:45:03.831719 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-03-09 15:45:03.831757 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-03-09 15:45:03.831773 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-03-09 15:45:03.831779 | controller | 2026-03-09 15:45:03.831788 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-03-09 15:45:03.831818 | controller | Monday 09 March 2026 15:45:03 +0000 (0:00:00.141) 0:00:44.855 ********** 2026-03-09 15:45:03.866649 | controller | skipping: [instance] 2026-03-09 15:45:04.197794 | controller | 2026-03-09 15:45:04.197832 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-03-09 15:45:04.197842 | controller | Monday 09 March 2026 15:45:03 +0000 (0:00:00.034) 0:00:44.890 ********** 2026-03-09 15:45:04.197854 | controller | changed: [instance] 2026-03-09 15:45:04.285550 | controller | 2026-03-09 15:45:04.285583 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-03-09 15:45:04.285591 | controller | Monday 09 March 2026 15:45:04 +0000 (0:00:00.330) 0:00:45.221 ********** 2026-03-09 15:45:04.285601 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-03-09 15:45:04.337404 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-03-09 15:45:04.337435 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-03-09 15:45:04.337444 | controller | 2026-03-09 15:45:04.337450 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-03-09 15:45:04.337456 | controller | Monday 09 March 2026 15:45:04 +0000 (0:00:00.087) 0:00:45.309 ********** 2026-03-09 15:45:04.337467 | controller | changed: [instance] 2026-03-09 15:45:04.612416 | controller | 2026-03-09 15:45:04.612450 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-03-09 15:45:04.612458 | controller | Monday 09 March 2026 15:45:04 +0000 (0:00:00.051) 0:00:45.361 ********** 2026-03-09 15:45:04.612469 | controller | changed: [instance] 2026-03-09 15:45:04.820780 | controller | 2026-03-09 15:45:04.820815 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-03-09 15:45:04.820825 | controller | Monday 09 March 2026 15:45:04 +0000 (0:00:00.274) 0:00:45.636 ********** 2026-03-09 15:45:04.820838 | controller | changed: [instance] 2026-03-09 15:45:04.820879 | controller | 2026-03-09 15:45:04.820890 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-03-09 15:45:04.821048 | controller | Monday 09 March 2026 15:45:04 +0000 (0:00:00.208) 0:00:45.845 ********** 2026-03-09 15:45:04.870300 | controller | changed: [instance] 2026-03-09 15:45:05.066324 | controller | 2026-03-09 15:45:05.066363 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-03-09 15:45:05.066373 | controller | Monday 09 March 2026 15:45:04 +0000 (0:00:00.049) 0:00:45.894 ********** 2026-03-09 15:45:05.066386 | controller | changed: [instance] 2026-03-09 15:45:05.275767 | controller | 2026-03-09 15:45:05.275818 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-03-09 15:45:05.275829 | controller | Monday 09 March 2026 15:45:05 +0000 (0:00:00.195) 0:00:46.090 ********** 2026-03-09 15:45:05.275842 | controller | changed: [instance] 2026-03-09 15:45:05.275888 | controller | 2026-03-09 15:45:05.275900 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-03-09 15:45:05.275985 | controller | Monday 09 March 2026 15:45:05 +0000 (0:00:00.209) 0:00:46.300 ********** 2026-03-09 15:45:05.326780 | controller | changed: [instance] 2026-03-09 15:45:05.326815 | controller | 2026-03-09 15:45:05.326825 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-03-09 15:45:05.326835 | controller | Monday 09 March 2026 15:45:05 +0000 (0:00:00.051) 0:00:46.351 ********** 2026-03-09 15:45:05.525785 | controller | changed: [instance] 2026-03-09 15:45:05.526003 | controller | 2026-03-09 15:45:05.526022 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-03-09 15:45:05.734622 | controller | Monday 09 March 2026 15:45:05 +0000 (0:00:00.198) 0:00:46.550 ********** 2026-03-09 15:45:05.734661 | controller | changed: [instance] 2026-03-09 15:45:05.734853 | controller | 2026-03-09 15:45:05.734888 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-03-09 15:45:05.921539 | controller | Monday 09 March 2026 15:45:05 +0000 (0:00:00.208) 0:00:46.759 ********** 2026-03-09 15:45:05.921569 | controller | ok: [instance] 2026-03-09 15:45:06.421774 | controller | 2026-03-09 15:45:06.421812 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-03-09 15:45:06.421822 | controller | Monday 09 March 2026 15:45:05 +0000 (0:00:00.186) 0:00:46.945 ********** 2026-03-09 15:45:06.421842 | controller | changed: [instance] 2026-03-09 15:45:06.421886 | controller | 2026-03-09 15:45:06.422093 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-03-09 15:45:06.595620 | controller | Monday 09 March 2026 15:45:06 +0000 (0:00:00.500) 0:00:47.446 ********** 2026-03-09 15:45:06.595672 | controller | changed: [instance] 2026-03-09 15:45:06.619319 | controller | 2026-03-09 15:45:06.619342 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-03-09 15:45:06.619351 | controller | Monday 09 March 2026 15:45:06 +0000 (0:00:00.173) 0:00:47.619 ********** 2026-03-09 15:45:06.619362 | controller | skipping: [instance] 2026-03-09 15:45:06.643143 | controller | 2026-03-09 15:45:06.643166 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-03-09 15:45:06.643174 | controller | Monday 09 March 2026 15:45:06 +0000 (0:00:00.023) 0:00:47.643 ********** 2026-03-09 15:45:06.643186 | controller | skipping: [instance] 2026-03-09 15:45:06.667244 | controller | 2026-03-09 15:45:06.667269 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-03-09 15:45:06.667279 | controller | Monday 09 March 2026 15:45:06 +0000 (0:00:00.023) 0:00:47.667 ********** 2026-03-09 15:45:06.667290 | controller | skipping: [instance] 2026-03-09 15:45:06.691312 | controller | 2026-03-09 15:45:06.691333 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-03-09 15:45:06.691342 | controller | Monday 09 March 2026 15:45:06 +0000 (0:00:00.024) 0:00:47.691 ********** 2026-03-09 15:45:06.691352 | controller | skipping: [instance] 2026-03-09 15:45:06.709752 | controller | 2026-03-09 15:45:06.709775 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-03-09 15:45:06.709785 | controller | Monday 09 March 2026 15:45:06 +0000 (0:00:00.024) 0:00:47.715 ********** 2026-03-09 15:45:06.709795 | controller | ok: [instance] 2026-03-09 15:45:06.709944 | controller | 2026-03-09 15:45:06.709963 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-03-09 15:45:06.792802 | controller | Monday 09 March 2026 15:45:06 +0000 (0:00:00.018) 0:00:47.734 ********** 2026-03-09 15:45:06.792838 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-03-09 15:45:06.793040 | controller | 2026-03-09 15:45:06.793208 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-03-09 15:45:06.793338 | controller | Monday 09 March 2026 15:45:06 +0000 (0:00:00.083) 0:00:47.817 ********** 2026-03-09 15:45:06.809975 | controller | skipping: [instance] 2026-03-09 15:45:06.810156 | controller | 2026-03-09 15:45:06.810322 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-03-09 15:45:06.810477 | controller | Monday 09 March 2026 15:45:06 +0000 (0:00:00.017) 0:00:47.834 ********** 2026-03-09 15:45:07.004401 | controller | changed: [instance] 2026-03-09 15:45:07.381521 | controller | 2026-03-09 15:45:07.381556 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-03-09 15:45:07.381566 | controller | Monday 09 March 2026 15:45:07 +0000 (0:00:00.193) 0:00:48.028 ********** 2026-03-09 15:45:07.381579 | controller | changed: [instance] 2026-03-09 15:45:07.438688 | controller | 2026-03-09 15:45:07.438719 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-03-09 15:45:07.438729 | controller | Monday 09 March 2026 15:45:07 +0000 (0:00:00.376) 0:00:48.405 ********** 2026-03-09 15:45:07.438741 | controller | ok: [instance] 2026-03-09 15:45:07.467714 | controller | 2026-03-09 15:45:07.467749 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-03-09 15:45:07.467758 | controller | Monday 09 March 2026 15:45:07 +0000 (0:00:00.057) 0:00:48.462 ********** 2026-03-09 15:45:07.467769 | controller | ok: [instance] 2026-03-09 15:45:07.467793 | controller | 2026-03-09 15:45:07.467801 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-03-09 15:45:07.467903 | controller | Monday 09 March 2026 15:45:07 +0000 (0:00:00.029) 0:00:48.492 ********** 2026-03-09 15:45:07.830748 | controller | changed: [instance] 2026-03-09 15:45:07.830806 | controller | 2026-03-09 15:45:07.830817 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-03-09 15:45:07.830827 | controller | Monday 09 March 2026 15:45:07 +0000 (0:00:00.362) 0:00:48.854 ********** 2026-03-09 15:45:07.912761 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-03-09 15:45:07.912795 | controller | 2026-03-09 15:45:07.912804 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-03-09 15:45:07.912814 | controller | Monday 09 March 2026 15:45:07 +0000 (0:00:00.082) 0:00:48.937 ********** 2026-03-09 15:45:07.959717 | controller | ok: [instance] => (item=public) 2026-03-09 15:45:07.959750 | controller | ok: [instance] => (item=osp_trunk) 2026-03-09 15:45:07.959759 | controller | 2026-03-09 15:45:07.959765 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-03-09 15:45:07.959780 | controller | Monday 09 March 2026 15:45:07 +0000 (0:00:00.046) 0:00:48.983 ********** 2026-03-09 15:45:08.393644 | controller | changed: [instance] => (item=cifmw-public) 2026-03-09 15:45:08.945669 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:45:08.945704 | controller | 2026-03-09 15:45:08.945712 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-03-09 15:45:08.945718 | controller | Monday 09 March 2026 15:45:08 +0000 (0:00:00.433) 0:00:49.417 ********** 2026-03-09 15:45:08.945734 | controller | ok: [instance] => (item=cifmw-public) 2026-03-09 15:45:09.361485 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:45:09.361523 | controller | 2026-03-09 15:45:09.361532 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-03-09 15:45:09.361540 | controller | Monday 09 March 2026 15:45:08 +0000 (0:00:00.551) 0:00:49.969 ********** 2026-03-09 15:45:09.361552 | controller | ok: [instance] => (item=cifmw-public) 2026-03-09 15:45:09.791751 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:45:09.791788 | controller | 2026-03-09 15:45:09.791798 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-03-09 15:45:09.791805 | controller | Monday 09 March 2026 15:45:09 +0000 (0:00:00.415) 0:00:50.385 ********** 2026-03-09 15:45:09.791818 | controller | changed: [instance] => (item=cifmw-public) 2026-03-09 15:45:09.791847 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:45:09.791855 | controller | 2026-03-09 15:45:09.791879 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-03-09 15:45:09.791963 | controller | Monday 09 March 2026 15:45:09 +0000 (0:00:00.430) 0:00:50.816 ********** 2026-03-09 15:45:09.850668 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-03-09 15:45:10.025176 | controller | 2026-03-09 15:45:10.025205 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-03-09 15:45:10.025213 | controller | Monday 09 March 2026 15:45:09 +0000 (0:00:00.058) 0:00:50.874 ********** 2026-03-09 15:45:10.025222 | controller | ok: [instance] 2026-03-09 15:45:10.388510 | controller | 2026-03-09 15:45:10.388546 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-03-09 15:45:10.388555 | controller | Monday 09 March 2026 15:45:10 +0000 (0:00:00.174) 0:00:51.049 ********** 2026-03-09 15:45:10.388567 | controller | ok: [instance] => (item=cifmw-public) 2026-03-09 15:45:10.456519 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:45:10.456557 | controller | 2026-03-09 15:45:10.456569 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-03-09 15:45:10.456579 | controller | Monday 09 March 2026 15:45:10 +0000 (0:00:00.363) 0:00:51.412 ********** 2026-03-09 15:45:10.456594 | controller | 2026-03-09 15:45:10.493140 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-03-09 15:45:10.493158 | controller | Monday 09 March 2026 15:45:10 +0000 (0:00:00.068) 0:00:51.480 ********** 2026-03-09 15:45:10.493168 | controller | skipping: [instance] 2026-03-09 15:45:11.720009 | controller | 2026-03-09 15:45:11.720042 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-03-09 15:45:11.720050 | controller | Monday 09 March 2026 15:45:10 +0000 (0:00:00.036) 0:00:51.517 ********** 2026-03-09 15:45:11.720060 | controller | ok: [instance] 2026-03-09 15:45:11.903534 | controller | 2026-03-09 15:45:11.903568 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-03-09 15:45:11.903575 | controller | Monday 09 March 2026 15:45:11 +0000 (0:00:01.227) 0:00:52.744 ********** 2026-03-09 15:45:11.903586 | controller | ok: [instance] 2026-03-09 15:45:12.266418 | controller | 2026-03-09 15:45:12.266449 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-03-09 15:45:12.266457 | controller | Monday 09 March 2026 15:45:11 +0000 (0:00:00.183) 0:00:52.927 ********** 2026-03-09 15:45:12.266468 | controller | changed: [instance] 2026-03-09 15:45:13.885418 | controller | 2026-03-09 15:45:13.885448 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-03-09 15:45:13.885457 | controller | Monday 09 March 2026 15:45:12 +0000 (0:00:00.362) 0:00:53.290 ********** 2026-03-09 15:45:13.885467 | controller | changed: [instance] 2026-03-09 15:45:14.252809 | controller | 2026-03-09 15:45:14.252846 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-03-09 15:45:14.252873 | controller | Monday 09 March 2026 15:45:13 +0000 (0:00:01.619) 0:00:54.909 ********** 2026-03-09 15:45:14.252886 | controller | changed: [instance] 2026-03-09 15:45:14.252921 | controller | 2026-03-09 15:45:14.252932 | controller | TASK [Create extra network configuration] ************************************** 2026-03-09 15:45:14.252985 | controller | Monday 09 March 2026 15:45:14 +0000 (0:00:00.367) 0:00:55.277 ********** 2026-03-09 15:45:14.284421 | controller | skipping: [instance] 2026-03-09 15:45:14.313252 | controller | 2026-03-09 15:45:14.313268 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-03-09 15:45:14.313275 | controller | Monday 09 March 2026 15:45:14 +0000 (0:00:00.031) 0:00:55.308 ********** 2026-03-09 15:45:14.313289 | controller | skipping: [instance] 2026-03-09 15:45:14.733674 | controller | 2026-03-09 15:45:14.733740 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-03-09 15:45:14.733750 | controller | Monday 09 March 2026 15:45:14 +0000 (0:00:00.028) 0:00:55.337 ********** 2026-03-09 15:45:14.733763 | controller | ok: [instance] 2026-03-09 15:45:14.870723 | controller | 2026-03-09 15:45:14.870756 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-03-09 15:45:14.870765 | controller | Monday 09 March 2026 15:45:14 +0000 (0:00:00.420) 0:00:55.757 ********** 2026-03-09 15:45:14.870777 | controller | ok: [instance] => (item=cifmw-public) 2026-03-09 15:45:14.870802 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:45:14.870812 | controller | 2026-03-09 15:45:14.871029 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-03-09 15:45:16.061726 | controller | Monday 09 March 2026 15:45:14 +0000 (0:00:00.137) 0:00:55.895 ********** 2026-03-09 15:45:16.061763 | controller | ok: [instance] 2026-03-09 15:45:16.061786 | controller | 2026-03-09 15:45:16.061793 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-03-09 15:45:16.061800 | controller | Monday 09 March 2026 15:45:16 +0000 (0:00:01.190) 0:00:57.085 ********** 2026-03-09 15:45:19.690213 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-03-09 15:45:19.898197 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-03-09 15:45:19.898232 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-03-09 15:45:19.898242 | controller | 2026-03-09 15:45:19.898250 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-03-09 15:45:19.898257 | controller | Monday 09 March 2026 15:45:19 +0000 (0:00:03.628) 0:01:00.714 ********** 2026-03-09 15:45:19.898269 | controller | changed: [instance] 2026-03-09 15:45:20.258561 | controller | 2026-03-09 15:45:20.258590 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-03-09 15:45:20.258598 | controller | Monday 09 March 2026 15:45:19 +0000 (0:00:00.208) 0:01:00.922 ********** 2026-03-09 15:45:20.258608 | controller | changed: [instance] 2026-03-09 15:45:20.642153 | controller | 2026-03-09 15:45:20.642185 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-03-09 15:45:20.642193 | controller | Monday 09 March 2026 15:45:20 +0000 (0:00:00.360) 0:01:01.282 ********** 2026-03-09 15:45:20.642203 | controller | changed: [instance] 2026-03-09 15:45:20.674710 | controller | 2026-03-09 15:45:20.674754 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-03-09 15:45:20.674764 | controller | Monday 09 March 2026 15:45:20 +0000 (0:00:00.383) 0:01:01.666 ********** 2026-03-09 15:45:20.674779 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-03-09 15:45:20.674964 | controller | 2026-03-09 15:45:20.674999 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-03-09 15:45:21.090209 | controller | Monday 09 March 2026 15:45:20 +0000 (0:00:00.032) 0:01:01.699 ********** 2026-03-09 15:45:21.090245 | controller | changed: [instance] 2026-03-09 15:45:21.108439 | controller | 2026-03-09 15:45:21.108462 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-03-09 15:45:21.108469 | controller | Monday 09 March 2026 15:45:21 +0000 (0:00:00.415) 0:01:02.114 ********** 2026-03-09 15:45:21.108479 | controller | skipping: [instance] 2026-03-09 15:45:21.141085 | controller | 2026-03-09 15:45:21.141104 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-03-09 15:45:21.141112 | controller | Monday 09 March 2026 15:45:21 +0000 (0:00:00.018) 0:01:02.132 ********** 2026-03-09 15:45:21.141121 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-03-09 15:45:21.504918 | controller | 2026-03-09 15:45:21.504957 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-03-09 15:45:21.504966 | controller | Monday 09 March 2026 15:45:21 +0000 (0:00:00.032) 0:01:02.165 ********** 2026-03-09 15:45:21.504977 | controller | changed: [instance] 2026-03-09 15:45:21.524641 | controller | 2026-03-09 15:45:21.524662 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-03-09 15:45:21.524671 | controller | Monday 09 March 2026 15:45:21 +0000 (0:00:00.363) 0:01:02.529 ********** 2026-03-09 15:45:21.524681 | controller | skipping: [instance] 2026-03-09 15:45:21.734433 | controller | 2026-03-09 15:45:21.734458 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-03-09 15:45:21.734467 | controller | Monday 09 March 2026 15:45:21 +0000 (0:00:00.019) 0:01:02.549 ********** 2026-03-09 15:45:21.734476 | controller | ok: [instance] => (item=127.0.0.2) 2026-03-09 15:45:22.387091 | controller | 2026-03-09 15:45:22.387126 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-03-09 15:45:22.387136 | controller | Monday 09 March 2026 15:45:21 +0000 (0:00:00.209) 0:01:02.758 ********** 2026-03-09 15:45:22.387149 | controller | changed: [instance] 2026-03-09 15:45:22.406588 | controller | 2026-03-09 15:45:22.406609 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-03-09 15:45:22.406623 | controller | Monday 09 March 2026 15:45:22 +0000 (0:00:00.652) 0:01:03.411 ********** 2026-03-09 15:45:22.406653 | controller | skipping: [instance] 2026-03-09 15:45:22.426645 | controller | 2026-03-09 15:45:22.426664 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-03-09 15:45:22.426671 | controller | Monday 09 March 2026 15:45:22 +0000 (0:00:00.019) 0:01:03.430 ********** 2026-03-09 15:45:22.426680 | controller | skipping: [instance] 2026-03-09 15:45:22.457741 | controller | 2026-03-09 15:45:22.457783 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-03-09 15:45:22.457793 | controller | Monday 09 March 2026 15:45:22 +0000 (0:00:00.019) 0:01:03.450 ********** 2026-03-09 15:45:22.457808 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-03-09 15:45:22.457981 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-03-09 15:45:22.458001 | controller | skipping: [instance] 2026-03-09 15:45:22.458012 | controller | 2026-03-09 15:45:22.571253 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-03-09 15:45:22.571275 | controller | Monday 09 March 2026 15:45:22 +0000 (0:00:00.031) 0:01:03.481 ********** 2026-03-09 15:45:22.571287 | controller | 2026-03-09 15:45:22.600609 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-03-09 15:45:22.600649 | controller | Monday 09 March 2026 15:45:22 +0000 (0:00:00.113) 0:01:03.595 ********** 2026-03-09 15:45:22.600664 | controller | ok: [instance] => changed=false 2026-03-09 15:45:22.636155 | controller | msg: All assertions passed 2026-03-09 15:45:22.636176 | controller | 2026-03-09 15:45:22.636185 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-03-09 15:45:22.636192 | controller | Monday 09 March 2026 15:45:22 +0000 (0:00:00.029) 0:01:03.624 ********** 2026-03-09 15:45:22.636202 | controller | ok: [instance] => changed=false 2026-03-09 15:45:22.636356 | controller | msg: All assertions passed 2026-03-09 15:45:22.636494 | controller | 2026-03-09 15:45:22.636666 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-03-09 15:45:22.636823 | controller | Monday 09 March 2026 15:45:22 +0000 (0:00:00.035) 0:01:03.660 ********** 2026-03-09 15:45:23.075020 | controller | changed: [instance] 2026-03-09 15:45:23.095663 | controller | 2026-03-09 15:45:23.095690 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-03-09 15:45:23.095705 | controller | Monday 09 March 2026 15:45:23 +0000 (0:00:00.438) 0:01:04.099 ********** 2026-03-09 15:45:23.095716 | controller | skipping: [instance] 2026-03-09 15:45:23.122107 | controller | 2026-03-09 15:45:23.122128 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-03-09 15:45:23.122137 | controller | Monday 09 March 2026 15:45:23 +0000 (0:00:00.020) 0:01:04.119 ********** 2026-03-09 15:45:23.122147 | controller | skipping: [instance] 2026-03-09 15:45:23.152773 | controller | 2026-03-09 15:45:23.152833 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-03-09 15:45:23.152867 | controller | Monday 09 March 2026 15:45:23 +0000 (0:00:00.026) 0:01:04.146 ********** 2026-03-09 15:45:23.152888 | controller | ok: [instance] => changed=false 2026-03-09 15:45:23.190830 | controller | msg: All assertions passed 2026-03-09 15:45:23.190879 | controller | 2026-03-09 15:45:23.190893 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-03-09 15:45:23.190904 | controller | Monday 09 March 2026 15:45:23 +0000 (0:00:00.030) 0:01:04.176 ********** 2026-03-09 15:45:23.190933 | controller | ok: [instance] => changed=false 2026-03-09 15:45:23.617190 | controller | msg: All assertions passed 2026-03-09 15:45:23.617223 | controller | 2026-03-09 15:45:23.617230 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-03-09 15:45:23.617236 | controller | Monday 09 March 2026 15:45:23 +0000 (0:00:00.038) 0:01:04.215 ********** 2026-03-09 15:45:23.617246 | controller | changed: [instance] 2026-03-09 15:45:23.636958 | controller | 2026-03-09 15:45:23.636984 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-03-09 15:45:23.636991 | controller | Monday 09 March 2026 15:45:23 +0000 (0:00:00.426) 0:01:04.641 ********** 2026-03-09 15:45:23.637001 | controller | skipping: [instance] 2026-03-09 15:45:23.662523 | controller | 2026-03-09 15:45:23.662553 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-03-09 15:45:23.662566 | controller | Monday 09 March 2026 15:45:23 +0000 (0:00:00.020) 0:01:04.661 ********** 2026-03-09 15:45:23.662580 | controller | skipping: [instance] 2026-03-09 15:45:23.693573 | controller | 2026-03-09 15:45:23.693599 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-03-09 15:45:23.693608 | controller | Monday 09 March 2026 15:45:23 +0000 (0:00:00.025) 0:01:04.686 ********** 2026-03-09 15:45:23.693620 | controller | skipping: [instance] 2026-03-09 15:45:24.182611 | controller | 2026-03-09 15:45:24.182658 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-03-09 15:45:24.182667 | controller | Monday 09 March 2026 15:45:23 +0000 (0:00:00.031) 0:01:04.717 ********** 2026-03-09 15:45:24.182683 | controller | changed: [instance] => (item=cifmw-public) 2026-03-09 15:45:24.218666 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:45:24.218693 | controller | 2026-03-09 15:45:24.218703 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-03-09 15:45:24.218710 | controller | Monday 09 March 2026 15:45:24 +0000 (0:00:00.488) 0:01:05.206 ********** 2026-03-09 15:45:24.218723 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-03-09 15:45:24.540699 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-03-09 15:45:24.540730 | controller | 2026-03-09 15:45:24.540738 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-03-09 15:45:24.540745 | controller | Monday 09 March 2026 15:45:24 +0000 (0:00:00.035) 0:01:05.242 ********** 2026-03-09 15:45:24.540756 | controller | ok: [instance] 2026-03-09 15:45:24.577476 | controller | 2026-03-09 15:45:24.577501 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-03-09 15:45:24.577510 | controller | Monday 09 March 2026 15:45:24 +0000 (0:00:00.322) 0:01:05.564 ********** 2026-03-09 15:45:24.577521 | controller | ok: [instance] 2026-03-09 15:45:24.785732 | controller | 2026-03-09 15:45:24.785767 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-03-09 15:45:24.785783 | controller | Monday 09 March 2026 15:45:24 +0000 (0:00:00.035) 0:01:05.600 ********** 2026-03-09 15:45:24.785796 | controller | ok: [instance] 2026-03-09 15:45:24.785825 | controller | 2026-03-09 15:45:24.785833 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-03-09 15:45:24.785855 | controller | Monday 09 March 2026 15:45:24 +0000 (0:00:00.209) 0:01:05.809 ********** 2026-03-09 15:45:24.820701 | controller | ok: [instance] 2026-03-09 15:45:24.821073 | controller | 2026-03-09 15:45:25.166733 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-03-09 15:45:25.166767 | controller | Monday 09 March 2026 15:45:24 +0000 (0:00:00.035) 0:01:05.845 ********** 2026-03-09 15:45:25.166782 | controller | changed: [instance] 2026-03-09 15:45:25.166810 | controller | 2026-03-09 15:45:25.166820 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-03-09 15:45:25.166920 | controller | Monday 09 March 2026 15:45:25 +0000 (0:00:00.345) 0:01:06.191 ********** 2026-03-09 15:45:25.506617 | controller | changed: [instance] 2026-03-09 15:45:25.849216 | controller | 2026-03-09 15:45:25.849242 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-03-09 15:45:25.849250 | controller | Monday 09 March 2026 15:45:25 +0000 (0:00:00.339) 0:01:06.530 ********** 2026-03-09 15:45:25.849259 | controller | changed: [instance] 2026-03-09 15:45:25.945385 | controller | 2026-03-09 15:45:25.945403 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-03-09 15:45:25.945411 | controller | Monday 09 March 2026 15:45:25 +0000 (0:00:00.342) 0:01:06.873 ********** 2026-03-09 15:45:25.945420 | controller | ok: [instance] 2026-03-09 15:45:26.289350 | controller | 2026-03-09 15:45:26.289383 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-03-09 15:45:26.289391 | controller | Monday 09 March 2026 15:45:25 +0000 (0:00:00.095) 0:01:06.969 ********** 2026-03-09 15:45:26.289402 | controller | changed: [instance] 2026-03-09 15:45:26.314584 | controller | 2026-03-09 15:45:26.314604 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-03-09 15:45:26.314613 | controller | Monday 09 March 2026 15:45:26 +0000 (0:00:00.343) 0:01:07.313 ********** 2026-03-09 15:45:26.314624 | controller | skipping: [instance] 2026-03-09 15:45:26.339792 | controller | 2026-03-09 15:45:26.339830 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-03-09 15:45:26.339849 | controller | Monday 09 March 2026 15:45:26 +0000 (0:00:00.025) 0:01:07.338 ********** 2026-03-09 15:45:26.339862 | controller | skipping: [instance] 2026-03-09 15:45:26.366250 | controller | 2026-03-09 15:45:26.366274 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-03-09 15:45:26.366283 | controller | Monday 09 March 2026 15:45:26 +0000 (0:00:00.025) 0:01:07.364 ********** 2026-03-09 15:45:26.366294 | controller | skipping: [instance] 2026-03-09 15:45:26.391783 | controller | 2026-03-09 15:45:26.391822 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-03-09 15:45:26.391849 | controller | Monday 09 March 2026 15:45:26 +0000 (0:00:00.026) 0:01:07.390 ********** 2026-03-09 15:45:26.391862 | controller | skipping: [instance] 2026-03-09 15:45:26.391895 | controller | 2026-03-09 15:45:26.391905 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-03-09 15:45:26.391977 | controller | Monday 09 March 2026 15:45:26 +0000 (0:00:00.025) 0:01:07.416 ********** 2026-03-09 15:45:26.411722 | controller | ok: [instance] 2026-03-09 15:45:26.411776 | controller | 2026-03-09 15:45:26.412016 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-03-09 15:45:26.506461 | controller | Monday 09 March 2026 15:45:26 +0000 (0:00:00.020) 0:01:07.436 ********** 2026-03-09 15:45:26.506489 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-03-09 15:45:26.525828 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-03-09 15:45:26.525866 | controller | 2026-03-09 15:45:26.525876 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-03-09 15:45:26.525883 | controller | Monday 09 March 2026 15:45:26 +0000 (0:00:00.094) 0:01:07.530 ********** 2026-03-09 15:45:26.525893 | controller | skipping: [instance] 2026-03-09 15:45:26.526059 | controller | 2026-03-09 15:45:26.526213 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-03-09 15:45:26.526341 | controller | Monday 09 March 2026 15:45:26 +0000 (0:00:00.019) 0:01:07.550 ********** 2026-03-09 15:45:26.729557 | controller | ok: [instance] 2026-03-09 15:45:27.158723 | controller | 2026-03-09 15:45:27.158762 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-03-09 15:45:27.158770 | controller | Monday 09 March 2026 15:45:26 +0000 (0:00:00.203) 0:01:07.753 ********** 2026-03-09 15:45:27.158782 | controller | changed: [instance] 2026-03-09 15:45:27.158807 | controller | 2026-03-09 15:45:27.159057 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-03-09 15:45:27.239448 | controller | Monday 09 March 2026 15:45:27 +0000 (0:00:00.429) 0:01:08.182 ********** 2026-03-09 15:45:27.239490 | controller | ok: [instance] 2026-03-09 15:45:27.282395 | controller | 2026-03-09 15:45:27.282420 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-03-09 15:45:27.282429 | controller | Monday 09 March 2026 15:45:27 +0000 (0:00:00.080) 0:01:08.263 ********** 2026-03-09 15:45:27.282440 | controller | ok: [instance] 2026-03-09 15:45:27.740181 | controller | 2026-03-09 15:45:27.740216 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-03-09 15:45:27.740224 | controller | Monday 09 March 2026 15:45:27 +0000 (0:00:00.043) 0:01:08.306 ********** 2026-03-09 15:45:27.740235 | controller | changed: [instance] 2026-03-09 15:45:27.778546 | controller | 2026-03-09 15:45:27.778565 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-03-09 15:45:27.778577 | controller | Monday 09 March 2026 15:45:27 +0000 (0:00:00.457) 0:01:08.764 ********** 2026-03-09 15:45:27.778586 | controller | ok: [instance] 2026-03-09 15:45:27.805284 | controller | 2026-03-09 15:45:27.805306 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-03-09 15:45:27.805315 | controller | Monday 09 March 2026 15:45:27 +0000 (0:00:00.038) 0:01:08.802 ********** 2026-03-09 15:45:27.805326 | controller | ok: [instance] 2026-03-09 15:45:27.833287 | controller | 2026-03-09 15:45:27.833305 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-03-09 15:45:27.833312 | controller | Monday 09 March 2026 15:45:27 +0000 (0:00:00.026) 0:01:08.829 ********** 2026-03-09 15:45:27.833320 | controller | ok: [instance] 2026-03-09 15:45:27.917845 | controller | 2026-03-09 15:45:27.917891 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-03-09 15:45:27.917901 | controller | Monday 09 March 2026 15:45:27 +0000 (0:00:00.028) 0:01:08.857 ********** 2026-03-09 15:45:27.917916 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-03-09 15:45:28.067611 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-03-09 15:45:28.067652 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-03-09 15:45:28.067662 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-03-09 15:45:28.067668 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-03-09 15:45:28.067674 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-03-09 15:45:28.067679 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-03-09 15:45:28.067684 | controller | 2026-03-09 15:45:28.067690 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-09 15:45:28.067696 | controller | Monday 09 March 2026 15:45:27 +0000 (0:00:00.083) 0:01:08.941 ********** 2026-03-09 15:45:28.067705 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-03-09 15:45:28.161963 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-03-09 15:45:28.161998 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-03-09 15:45:28.162011 | controller | 2026-03-09 15:45:28.162021 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-09 15:45:28.162032 | controller | Monday 09 March 2026 15:45:28 +0000 (0:00:00.149) 0:01:09.091 ********** 2026-03-09 15:45:28.162046 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-03-09 15:45:28.162303 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-03-09 15:45:28.162442 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-03-09 15:45:28.162568 | controller | skipping: [instance] 2026-03-09 15:45:28.162725 | controller | 2026-03-09 15:45:28.162871 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-09 15:45:28.162999 | controller | Monday 09 March 2026 15:45:28 +0000 (0:00:00.094) 0:01:09.186 ********** 2026-03-09 15:45:28.255369 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-03-09 15:45:28.255596 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-03-09 15:45:28.255742 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-03-09 15:45:28.255881 | controller | skipping: [instance] 2026-03-09 15:45:28.256001 | controller | 2026-03-09 15:45:28.256147 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-09 15:45:28.256270 | controller | Monday 09 March 2026 15:45:28 +0000 (0:00:00.093) 0:01:09.279 ********** 2026-03-09 15:45:28.351091 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-03-09 15:45:28.351254 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-03-09 15:45:28.351383 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-03-09 15:45:28.351507 | controller | skipping: [instance] 2026-03-09 15:45:28.351648 | controller | 2026-03-09 15:45:28.351803 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-09 15:45:28.351945 | controller | Monday 09 March 2026 15:45:28 +0000 (0:00:00.095) 0:01:09.375 ********** 2026-03-09 15:45:28.450691 | controller | skipping: [instance] => (item=compute-0 - external) 2026-03-09 15:45:28.450884 | controller | skipping: [instance] => (item=controller-0 - external) 2026-03-09 15:45:28.451019 | controller | skipping: [instance] => (item=crc-0 - external) 2026-03-09 15:45:28.451145 | controller | skipping: [instance] 2026-03-09 15:45:28.451263 | controller | 2026-03-09 15:45:28.451389 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-09 15:45:28.451511 | controller | Monday 09 March 2026 15:45:28 +0000 (0:00:00.099) 0:01:09.475 ********** 2026-03-09 15:45:28.551963 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-03-09 15:45:28.552163 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-03-09 15:45:28.552350 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-03-09 15:45:28.552532 | controller | skipping: [instance] 2026-03-09 15:45:28.552746 | controller | 2026-03-09 15:45:28.552943 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-03-09 15:45:28.553097 | controller | Monday 09 March 2026 15:45:28 +0000 (0:00:00.101) 0:01:09.576 ********** 2026-03-09 15:45:28.703678 | controller | ok: [instance] => (item=compute-0 - public) 2026-03-09 15:45:28.703895 | controller | ok: [instance] => (item=controller-0 - public) 2026-03-09 15:45:28.704061 | controller | ok: [instance] => (item=crc-0 - public) 2026-03-09 15:45:28.704208 | controller | 2026-03-09 15:45:28.704361 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-03-09 15:45:28.704511 | controller | Monday 09 March 2026 15:45:28 +0000 (0:00:00.151) 0:01:09.728 ********** 2026-03-09 15:45:28.819988 | controller | 2026-03-09 15:45:28.820276 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-03-09 15:45:28.820514 | controller | Monday 09 March 2026 15:45:28 +0000 (0:00:00.116) 0:01:09.844 ********** 2026-03-09 15:45:28.872351 | controller | ok: [instance] 2026-03-09 15:45:28.872493 | controller | 2026-03-09 15:45:28.872649 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-03-09 15:45:28.872795 | controller | Monday 09 March 2026 15:45:28 +0000 (0:00:00.052) 0:01:09.897 ********** 2026-03-09 15:45:28.985460 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:a0:9e:91', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-03-09 15:45:28.985784 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:ac:6a:84', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-03-09 15:45:28.985989 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:b0:04:56', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-03-09 15:45:28.986121 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6d:91:ec', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-03-09 15:45:28.986248 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:8c:ac:23', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-03-09 15:45:28.986372 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:39:3f:eb', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-03-09 15:45:28.986486 | controller | 2026-03-09 15:45:28.986608 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-03-09 15:45:28.986753 | controller | Monday 09 March 2026 15:45:28 +0000 (0:00:00.112) 0:01:10.009 ********** 2026-03-09 15:45:29.051276 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-03-09 15:45:29.051441 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-03-09 15:45:29.051565 | controller | 2026-03-09 15:45:29.051720 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-03-09 15:45:29.051866 | controller | Monday 09 March 2026 15:45:29 +0000 (0:00:00.066) 0:01:10.075 ********** 2026-03-09 15:45:29.264849 | controller | ok: [instance] 2026-03-09 15:45:29.264928 | controller | 2026-03-09 15:45:29.264937 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-03-09 15:45:29.264946 | controller | Monday 09 March 2026 15:45:29 +0000 (0:00:00.213) 0:01:10.289 ********** 2026-03-09 15:45:29.296233 | controller | ok: [instance] 2026-03-09 15:45:29.296401 | controller | 2026-03-09 15:45:29.296574 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-03-09 15:45:29.296675 | controller | Monday 09 March 2026 15:45:29 +0000 (0:00:00.031) 0:01:10.320 ********** 2026-03-09 15:45:29.509272 | controller | ok: [instance] 2026-03-09 15:45:29.509382 | controller | 2026-03-09 15:45:29.509397 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-03-09 15:45:29.509495 | controller | Monday 09 March 2026 15:45:29 +0000 (0:00:00.212) 0:01:10.533 ********** 2026-03-09 15:45:29.545752 | controller | ok: [instance] 2026-03-09 15:45:29.545846 | controller | 2026-03-09 15:45:29.545958 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-03-09 15:45:29.546057 | controller | Monday 09 March 2026 15:45:29 +0000 (0:00:00.036) 0:01:10.570 ********** 2026-03-09 15:45:29.575376 | controller | ok: [instance] 2026-03-09 15:45:29.575438 | controller | 2026-03-09 15:45:29.575613 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-03-09 15:45:29.575724 | controller | Monday 09 March 2026 15:45:29 +0000 (0:00:00.029) 0:01:10.599 ********** 2026-03-09 15:45:29.763991 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:a0:9e:91', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-03-09 15:45:29.764093 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:ac:6a:84', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-03-09 15:45:29.764249 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:b0:04:56', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-03-09 15:45:29.764319 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6d:91:ec', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-03-09 15:45:29.764430 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:8c:ac:23', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-03-09 15:45:29.764509 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:39:3f:eb', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-03-09 15:45:29.764602 | controller | 2026-03-09 15:45:29.764712 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-03-09 15:45:29.764801 | controller | Monday 09 March 2026 15:45:29 +0000 (0:00:00.188) 0:01:10.788 ********** 2026-03-09 15:45:29.811695 | controller | ok: [instance] 2026-03-09 15:45:29.811776 | controller | 2026-03-09 15:45:29.811889 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-03-09 15:45:29.811995 | controller | Monday 09 March 2026 15:45:29 +0000 (0:00:00.047) 0:01:10.836 ********** 2026-03-09 15:45:32.134156 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:a0:9e:91', 'entry': 'set:compute,52:54:00:a0:9e:91,192.168.140.100,compute-0', 'state': 'present'}) 2026-03-09 15:45:32.134228 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:ac:6a:84', 'entry': 'set:controller,52:54:01:ac:6a:84,192.168.140.9,controller-0', 'state': 'present'}) 2026-03-09 15:45:32.134262 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:b0:04:56', 'entry': 'set:ocp,52:54:02:b0:04:56,192.168.140.10,crc-0', 'state': 'present'}) 2026-03-09 15:45:32.134854 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:6d:91:ec', 'entry': 'set:compute,52:54:00:6d:91:ec,192.168.101.100,compute-0', 'state': 'present'}) 2026-03-09 15:45:32.134914 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:8c:ac:23', 'entry': 'set:controller,52:54:01:8c:ac:23,192.168.101.9,controller-0', 'state': 'present'}) 2026-03-09 15:45:32.134923 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:39:3f:eb', 'entry': 'set:ocp,52:54:02:39:3f:eb,192.168.101.10,crc-0', 'state': 'present'}) 2026-03-09 15:45:32.134933 | controller | 2026-03-09 15:45:32.134941 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-03-09 15:45:32.134951 | controller | Monday 09 March 2026 15:45:32 +0000 (0:00:02.321) 0:01:13.158 ********** 2026-03-09 15:45:32.168791 | controller | skipping: [instance] 2026-03-09 15:45:32.168860 | controller | 2026-03-09 15:45:32.168871 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-03-09 15:45:32.168893 | controller | Monday 09 March 2026 15:45:32 +0000 (0:00:00.034) 0:01:13.192 ********** 2026-03-09 15:45:32.392718 | controller | ok: [instance] => (item=compute-0) 2026-03-09 15:45:32.563573 | controller | ok: [instance] => (item=controller-0) 2026-03-09 15:45:32.563606 | controller | ok: [instance] => (item=crc-0) 2026-03-09 15:45:32.563622 | controller | 2026-03-09 15:45:32.563682 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-03-09 15:45:32.563690 | controller | Monday 09 March 2026 15:45:32 +0000 (0:00:00.223) 0:01:13.416 ********** 2026-03-09 15:45:32.563700 | controller | 2026-03-09 15:45:32.607895 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-03-09 15:45:32.607936 | controller | Monday 09 March 2026 15:45:32 +0000 (0:00:00.171) 0:01:13.587 ********** 2026-03-09 15:45:32.607956 | controller | ok: [instance] 2026-03-09 15:45:32.608013 | controller | 2026-03-09 15:45:32.608039 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-03-09 15:45:32.811421 | controller | Monday 09 March 2026 15:45:32 +0000 (0:00:00.044) 0:01:13.632 ********** 2026-03-09 15:45:32.811463 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-09 15:45:32.811770 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-09 15:45:32.812044 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:32.812209 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-03-09 15:45:32.812336 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:32.812509 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:32.812659 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:32.812832 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-09 15:45:32.812969 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-09 15:45:32.813102 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-03-09 15:45:32.813240 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-09 15:45:32.813363 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-09 15:45:32.813484 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-03-09 15:45:32.813607 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-03-09 15:45:32.813752 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-03-09 15:45:32.813890 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-03-09 15:45:32.814005 | controller | 2026-03-09 15:45:32.814124 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-03-09 15:45:32.814242 | controller | Monday 09 March 2026 15:45:32 +0000 (0:00:00.203) 0:01:13.835 ********** 2026-03-09 15:45:36.312545 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.354795 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.354848 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.354858 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.354865 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.354872 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.354878 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.354885 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-09 15:45:36.354892 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-09 15:45:36.354898 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-03-09 15:45:36.354904 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.354911 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.354917 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.354923 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.354936 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.354943 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.354949 | controller | 2026-03-09 15:45:36.354956 | controller | TASK [dnsmasq : Remove crc.testing from host_records] ************************** 2026-03-09 15:45:36.354963 | controller | Monday 09 March 2026 15:45:36 +0000 (0:00:03.499) 0:01:17.334 ********** 2026-03-09 15:45:36.354976 | controller | skipping: [instance] 2026-03-09 15:45:36.355013 | controller | 2026-03-09 15:45:36.355043 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-03-09 15:45:36.355053 | controller | Monday 09 March 2026 15:45:36 +0000 (0:00:00.044) 0:01:17.379 ********** 2026-03-09 15:45:36.747783 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.747868 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.747880 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.748698 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.748715 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.748741 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.748747 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-03-09 15:45:36.748753 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-09 15:45:36.748759 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-09 15:45:36.748765 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-03-09 15:45:36.748770 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.748775 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.748781 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.748789 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.749252 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.776854 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-03-09 15:45:36.776914 | controller | 2026-03-09 15:45:36.776925 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-03-09 15:45:36.776939 | controller | Monday 09 March 2026 15:45:36 +0000 (0:00:00.391) 0:01:17.771 ********** 2026-03-09 15:45:36.776953 | controller | ok: [instance] 2026-03-09 15:45:36.833797 | controller | 2026-03-09 15:45:36.833847 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-03-09 15:45:36.833858 | controller | Monday 09 March 2026 15:45:36 +0000 (0:00:00.029) 0:01:17.801 ********** 2026-03-09 15:45:36.833873 | controller | skipping: [instance] => (item=compute) 2026-03-09 15:45:36.888042 | controller | skipping: [instance] => (item=controller) 2026-03-09 15:45:36.888071 | controller | skipping: [instance] => (item=crc) 2026-03-09 15:45:36.888080 | controller | skipping: [instance] 2026-03-09 15:45:36.888088 | controller | 2026-03-09 15:45:36.888097 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-03-09 15:45:36.888104 | controller | Monday 09 March 2026 15:45:36 +0000 (0:00:00.056) 0:01:17.857 ********** 2026-03-09 15:45:36.888116 | controller | skipping: [instance] 2026-03-09 15:45:37.316801 | controller | 2026-03-09 15:45:37.316875 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-03-09 15:45:37.316887 | controller | Monday 09 March 2026 15:45:36 +0000 (0:00:00.054) 0:01:17.912 ********** 2026-03-09 15:45:37.316905 | controller | changed: [instance] 2026-03-09 15:45:38.054201 | controller | 2026-03-09 15:45:38.054241 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-03-09 15:45:38.054249 | controller | Monday 09 March 2026 15:45:37 +0000 (0:00:00.417) 0:01:18.329 ********** 2026-03-09 15:45:38.054255 | controller | 2026-03-09 15:45:38.054260 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-03-09 15:45:38.054266 | controller | Monday 09 March 2026 15:45:37 +0000 (0:00:00.011) 0:01:18.340 ********** 2026-03-09 15:45:38.054276 | controller | changed: [instance] 2026-03-09 15:45:38.483493 | controller | 2026-03-09 15:45:38.483536 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-03-09 15:45:38.483545 | controller | Monday 09 March 2026 15:45:38 +0000 (0:00:00.737) 0:01:19.077 ********** 2026-03-09 15:45:38.483556 | controller | changed: [instance] 2026-03-09 15:45:38.885437 | controller | 2026-03-09 15:45:38.885476 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-03-09 15:45:38.885485 | controller | Monday 09 March 2026 15:45:38 +0000 (0:00:00.429) 0:01:19.507 ********** 2026-03-09 15:45:38.885496 | controller | changed: [instance] 2026-03-09 15:45:39.302548 | controller | 2026-03-09 15:45:39.302585 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-03-09 15:45:39.302593 | controller | Monday 09 March 2026 15:45:38 +0000 (0:00:00.402) 0:01:19.909 ********** 2026-03-09 15:45:39.302602 | controller | changed: [instance] 2026-03-09 15:45:39.721165 | controller | 2026-03-09 15:45:39.721204 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-03-09 15:45:39.721212 | controller | Monday 09 March 2026 15:45:39 +0000 (0:00:00.417) 0:01:20.326 ********** 2026-03-09 15:45:39.721241 | controller | changed: [instance] 2026-03-09 15:45:39.763817 | controller | 2026-03-09 15:45:39.763873 | controller | TASK [Build utility records dataset] ******************************************* 2026-03-09 15:45:39.763883 | controller | Monday 09 March 2026 15:45:39 +0000 (0:00:00.418) 0:01:20.745 ********** 2026-03-09 15:45:39.763895 | controller | 2026-03-09 15:45:39.763917 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-03-09 15:45:39.867420 | controller | Monday 09 March 2026 15:45:39 +0000 (0:00:00.043) 0:01:20.788 ********** 2026-03-09 15:45:39.867480 | controller | ok: [instance] 2026-03-09 15:45:39.867504 | controller | 2026-03-09 15:45:39.867514 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-03-09 15:45:39.867602 | controller | Monday 09 March 2026 15:45:39 +0000 (0:00:00.103) 0:01:20.891 ********** 2026-03-09 15:45:39.977898 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-03-09 15:45:39.978015 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-09 15:45:39.978051 | controller | 2026-03-09 15:45:39.978084 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-03-09 15:45:39.978215 | controller | Monday 09 March 2026 15:45:39 +0000 (0:00:00.110) 0:01:21.001 ********** 2026-03-09 15:45:40.495506 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-03-09 15:45:40.536276 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-09 15:45:40.536301 | controller | 2026-03-09 15:45:40.536313 | controller | TASK [dnsmasq : Remove crc.testing from host_records] ************************** 2026-03-09 15:45:40.536322 | controller | Monday 09 March 2026 15:45:40 +0000 (0:00:00.517) 0:01:21.519 ********** 2026-03-09 15:45:40.536334 | controller | skipping: [instance] 2026-03-09 15:45:40.854581 | controller | 2026-03-09 15:45:40.854602 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-03-09 15:45:40.854610 | controller | Monday 09 March 2026 15:45:40 +0000 (0:00:00.041) 0:01:21.560 ********** 2026-03-09 15:45:40.854620 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-03-09 15:45:41.354577 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-03-09 15:45:41.354608 | controller | 2026-03-09 15:45:41.354616 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-03-09 15:45:41.354622 | controller | Monday 09 March 2026 15:45:40 +0000 (0:00:00.307) 0:01:21.867 ********** 2026-03-09 15:45:41.354649 | controller | 2026-03-09 15:45:41.354655 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-03-09 15:45:41.354661 | controller | Monday 09 March 2026 15:45:40 +0000 (0:00:00.010) 0:01:21.878 ********** 2026-03-09 15:45:41.354671 | controller | changed: [instance] 2026-03-09 15:45:41.759618 | controller | 2026-03-09 15:45:41.759697 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-03-09 15:45:41.759706 | controller | Monday 09 March 2026 15:45:41 +0000 (0:00:00.500) 0:01:22.378 ********** 2026-03-09 15:45:41.759719 | controller | changed: [instance] 2026-03-09 15:45:41.801574 | controller | 2026-03-09 15:45:41.801596 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-03-09 15:45:41.801605 | controller | Monday 09 March 2026 15:45:41 +0000 (0:00:00.404) 0:01:22.783 ********** 2026-03-09 15:45:41.801617 | controller | skipping: [instance] 2026-03-09 15:45:41.879420 | controller | 2026-03-09 15:45:41.879441 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-03-09 15:45:41.879450 | controller | Monday 09 March 2026 15:45:41 +0000 (0:00:00.042) 0:01:22.825 ********** 2026-03-09 15:45:41.879462 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-03-09 15:45:42.098094 | controller | 2026-03-09 15:45:42.098118 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-03-09 15:45:42.098127 | controller | Monday 09 March 2026 15:45:41 +0000 (0:00:00.077) 0:01:22.903 ********** 2026-03-09 15:45:42.098139 | controller | ok: [instance] 2026-03-09 15:45:42.127386 | controller | 2026-03-09 15:45:42.127409 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-03-09 15:45:42.127418 | controller | Monday 09 March 2026 15:45:42 +0000 (0:00:00.218) 0:01:23.122 ********** 2026-03-09 15:45:42.127429 | controller | skipping: [instance] 2026-03-09 15:45:42.555437 | controller | 2026-03-09 15:45:42.555482 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-03-09 15:45:42.555493 | controller | Monday 09 March 2026 15:45:42 +0000 (0:00:00.029) 0:01:23.151 ********** 2026-03-09 15:45:42.555507 | controller | ok: [instance] 2026-03-09 15:45:42.815903 | controller | 2026-03-09 15:45:42.815987 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-03-09 15:45:42.816013 | controller | Monday 09 March 2026 15:45:42 +0000 (0:00:00.427) 0:01:23.579 ********** 2026-03-09 15:45:42.816037 | controller | ok: [instance] 2026-03-09 15:45:43.059611 | controller | 2026-03-09 15:45:43.059671 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-03-09 15:45:43.059684 | controller | Monday 09 March 2026 15:45:42 +0000 (0:00:00.260) 0:01:23.839 ********** 2026-03-09 15:45:43.059695 | controller | ok: [instance] 2026-03-09 15:45:43.302256 | controller | 2026-03-09 15:45:43.302314 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-03-09 15:45:43.302325 | controller | Monday 09 March 2026 15:45:43 +0000 (0:00:00.243) 0:01:24.083 ********** 2026-03-09 15:45:43.302341 | controller | ok: [instance] 2026-03-09 15:45:43.548706 | controller | 2026-03-09 15:45:43.548762 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-03-09 15:45:43.548773 | controller | Monday 09 March 2026 15:45:43 +0000 (0:00:00.241) 0:01:24.325 ********** 2026-03-09 15:45:43.548787 | controller | ok: [instance] 2026-03-09 15:45:43.594042 | controller | 2026-03-09 15:45:43.594078 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-03-09 15:45:43.594086 | controller | Monday 09 March 2026 15:45:43 +0000 (0:00:00.246) 0:01:24.572 ********** 2026-03-09 15:45:43.594098 | controller | 2026-03-09 15:45:43.827698 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-03-09 15:45:43.827743 | controller | Monday 09 March 2026 15:45:43 +0000 (0:00:00.046) 0:01:24.618 ********** 2026-03-09 15:45:43.827756 | controller | ok: [instance] 2026-03-09 15:45:43.850276 | controller | 2026-03-09 15:45:43.850298 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-03-09 15:45:43.850307 | controller | Monday 09 March 2026 15:45:43 +0000 (0:00:00.233) 0:01:24.851 ********** 2026-03-09 15:45:43.850317 | controller | ok: [instance] 2026-03-09 15:45:43.875395 | controller | 2026-03-09 15:45:43.875419 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-03-09 15:45:43.875428 | controller | Monday 09 March 2026 15:45:43 +0000 (0:00:00.023) 0:01:24.874 ********** 2026-03-09 15:45:43.875439 | controller | skipping: [instance] 2026-03-09 15:45:44.195312 | controller | 2026-03-09 15:45:44.195353 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-03-09 15:45:44.195362 | controller | Monday 09 March 2026 15:45:43 +0000 (0:00:00.025) 0:01:24.899 ********** 2026-03-09 15:45:44.195373 | controller | ok: [instance] 2026-03-09 15:45:44.448621 | controller | 2026-03-09 15:45:44.448683 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-03-09 15:45:44.448691 | controller | Monday 09 March 2026 15:45:44 +0000 (0:00:00.318) 0:01:25.218 ********** 2026-03-09 15:45:44.448703 | controller | ok: [instance] 2026-03-09 15:45:44.644127 | controller | 2026-03-09 15:45:44.644176 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-03-09 15:45:44.644185 | controller | Monday 09 March 2026 15:45:44 +0000 (0:00:00.253) 0:01:25.472 ********** 2026-03-09 15:45:44.644199 | controller | ok: [instance] 2026-03-09 15:45:44.709960 | controller | 2026-03-09 15:45:44.709989 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-03-09 15:45:44.710001 | controller | Monday 09 March 2026 15:45:44 +0000 (0:00:00.195) 0:01:25.667 ********** 2026-03-09 15:45:44.710011 | controller | 2026-03-09 15:45:44.764796 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-03-09 15:45:44.764828 | controller | Monday 09 March 2026 15:45:44 +0000 (0:00:00.066) 0:01:25.734 ********** 2026-03-09 15:45:44.764841 | controller | ok: [instance] => changed=false 2026-03-09 15:45:44.764850 | controller | msg: All assertions passed 2026-03-09 15:45:44.764857 | controller | 2026-03-09 15:45:44.764864 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-03-09 15:45:44.764872 | controller | Monday 09 March 2026 15:45:44 +0000 (0:00:00.054) 0:01:25.789 ********** 2026-03-09 15:45:44.966506 | controller | ok: [instance] 2026-03-09 15:45:45.179707 | controller | 2026-03-09 15:45:45.179753 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-03-09 15:45:45.179775 | controller | Monday 09 March 2026 15:45:44 +0000 (0:00:00.201) 0:01:25.990 ********** 2026-03-09 15:45:45.179787 | controller | ok: [instance] 2026-03-09 15:45:45.210757 | controller | 2026-03-09 15:45:45.210782 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-03-09 15:45:45.210791 | controller | Monday 09 March 2026 15:45:45 +0000 (0:00:00.213) 0:01:26.203 ********** 2026-03-09 15:45:45.210802 | controller | ok: [instance] => changed=false 2026-03-09 15:45:45.211072 | controller | msg: All assertions passed 2026-03-09 15:45:45.211090 | controller | 2026-03-09 15:45:45.419610 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-03-09 15:45:45.419674 | controller | Monday 09 March 2026 15:45:45 +0000 (0:00:00.031) 0:01:26.235 ********** 2026-03-09 15:45:45.419695 | controller | ok: [instance] 2026-03-09 15:45:45.630149 | controller | 2026-03-09 15:45:45.630182 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-03-09 15:45:45.630191 | controller | Monday 09 March 2026 15:45:45 +0000 (0:00:00.208) 0:01:26.443 ********** 2026-03-09 15:45:45.630202 | controller | ok: [instance] 2026-03-09 15:45:45.688794 | controller | 2026-03-09 15:45:45.688856 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-03-09 15:45:45.688867 | controller | Monday 09 March 2026 15:45:45 +0000 (0:00:00.210) 0:01:26.654 ********** 2026-03-09 15:45:45.688884 | controller | ok: [instance] 2026-03-09 15:45:46.122611 | controller | 2026-03-09 15:45:46.122674 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-03-09 15:45:46.122683 | controller | Monday 09 March 2026 15:45:45 +0000 (0:00:00.058) 0:01:26.712 ********** 2026-03-09 15:45:46.122696 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-03-09 15:45:46.148092 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-03-09 15:45:46.148112 | controller | 2026-03-09 15:45:46.148121 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-03-09 15:45:46.148128 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.433) 0:01:27.146 ********** 2026-03-09 15:45:46.148139 | controller | skipping: [instance] 2026-03-09 15:45:46.188582 | controller | 2026-03-09 15:45:46.188604 | controller | TASK [reproducer : Consume dev-scripts for bare metal OCP SNO] ***************** 2026-03-09 15:45:46.188613 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.026) 0:01:27.172 ********** 2026-03-09 15:45:46.188644 | controller | skipping: [instance] 2026-03-09 15:45:46.229205 | controller | 2026-03-09 15:45:46.229272 | controller | TASK [reproducer : Slurp kubeconfig from dev-scripts] ************************** 2026-03-09 15:45:46.229288 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.040) 0:01:27.212 ********** 2026-03-09 15:45:46.229308 | controller | skipping: [instance] 2026-03-09 15:45:46.266293 | controller | 2026-03-09 15:45:46.266323 | controller | TASK [reproducer : Slurp kubeadmin-password from dev-scripts] ****************** 2026-03-09 15:45:46.266333 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.040) 0:01:27.253 ********** 2026-03-09 15:45:46.266344 | controller | skipping: [instance] 2026-03-09 15:45:46.305197 | controller | 2026-03-09 15:45:46.305222 | controller | TASK [reproducer : Ensure .kube directory exists] ****************************** 2026-03-09 15:45:46.305229 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.037) 0:01:27.290 ********** 2026-03-09 15:45:46.305238 | controller | skipping: [instance] 2026-03-09 15:45:46.342210 | controller | 2026-03-09 15:45:46.342231 | controller | TASK [reproducer : Copy kubeconfig to local ~/.kube/config] ******************** 2026-03-09 15:45:46.342238 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.038) 0:01:27.329 ********** 2026-03-09 15:45:46.342247 | controller | skipping: [instance] 2026-03-09 15:45:46.380240 | controller | 2026-03-09 15:45:46.380261 | controller | TASK [reproducer : Copy kubeadmin-password] ************************************ 2026-03-09 15:45:46.380269 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.037) 0:01:27.366 ********** 2026-03-09 15:45:46.380280 | controller | skipping: [instance] 2026-03-09 15:45:46.380429 | controller | 2026-03-09 15:45:46.380577 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-03-09 15:45:46.380760 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.038) 0:01:27.404 ********** 2026-03-09 15:45:46.415292 | controller | skipping: [instance] 2026-03-09 15:45:46.415451 | controller | 2026-03-09 15:45:46.415598 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-03-09 15:45:46.415778 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.034) 0:01:27.439 ********** 2026-03-09 15:45:46.449778 | controller | skipping: [instance] 2026-03-09 15:45:46.449953 | controller | 2026-03-09 15:45:46.450101 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-03-09 15:45:46.450275 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.034) 0:01:27.474 ********** 2026-03-09 15:45:46.484748 | controller | skipping: [instance] 2026-03-09 15:45:46.484843 | controller | 2026-03-09 15:45:46.485012 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-03-09 15:45:46.485148 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.034) 0:01:27.509 ********** 2026-03-09 15:45:46.525022 | controller | skipping: [instance] 2026-03-09 15:45:46.525145 | controller | 2026-03-09 15:45:46.525317 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-03-09 15:45:46.525428 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.040) 0:01:27.549 ********** 2026-03-09 15:45:46.561050 | controller | skipping: [instance] 2026-03-09 15:45:46.561173 | controller | 2026-03-09 15:45:46.561344 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-03-09 15:45:46.561458 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.036) 0:01:27.585 ********** 2026-03-09 15:45:46.600690 | controller | skipping: [instance] 2026-03-09 15:45:46.600901 | controller | 2026-03-09 15:45:46.601018 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-03-09 15:45:46.601186 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.039) 0:01:27.625 ********** 2026-03-09 15:45:46.649604 | controller | skipping: [instance] 2026-03-09 15:45:46.649703 | controller | 2026-03-09 15:45:46.649923 | controller | TASK [reproducer : Set wait for OCP cluster flag] ****************************** 2026-03-09 15:45:46.649958 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.048) 0:01:27.674 ********** 2026-03-09 15:45:46.684185 | controller | skipping: [instance] 2026-03-09 15:45:46.684258 | controller | 2026-03-09 15:45:46.684473 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-03-09 15:45:46.684543 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.034) 0:01:27.708 ********** 2026-03-09 15:45:46.711022 | controller | skipping: [instance] 2026-03-09 15:45:46.711066 | controller | 2026-03-09 15:45:46.711188 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-03-09 15:45:46.711300 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.026) 0:01:27.735 ********** 2026-03-09 15:45:46.808617 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-03-09 15:45:46.808716 | controller | 2026-03-09 15:45:46.808931 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-03-09 15:45:46.809000 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.098) 0:01:27.833 ********** 2026-03-09 15:45:46.837712 | controller | skipping: [instance] 2026-03-09 15:45:46.837853 | controller | 2026-03-09 15:45:46.838006 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-03-09 15:45:46.838134 | controller | Monday 09 March 2026 15:45:46 +0000 (0:00:00.029) 0:01:27.862 ********** 2026-03-09 15:45:47.304758 | controller | changed: [instance] 2026-03-09 15:45:47.304805 | controller | 2026-03-09 15:45:47.304822 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-03-09 15:45:47.304832 | controller | Monday 09 March 2026 15:45:47 +0000 (0:00:00.465) 0:01:28.328 ********** 2026-03-09 15:45:47.903831 | controller | changed: [instance] 2026-03-09 15:45:48.389900 | controller | 2026-03-09 15:45:48.389954 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-03-09 15:45:48.389965 | controller | Monday 09 March 2026 15:45:47 +0000 (0:00:00.587) 0:01:28.915 ********** 2026-03-09 15:45:48.389978 | controller | 2026-03-09 15:45:48.389984 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-03-09 15:45:48.389990 | controller | Monday 09 March 2026 15:45:47 +0000 (0:00:00.011) 0:01:28.927 ********** 2026-03-09 15:45:48.390002 | controller | changed: [instance] 2026-03-09 15:45:49.133472 | controller | 2026-03-09 15:45:49.133522 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-03-09 15:45:49.133530 | controller | Monday 09 March 2026 15:45:48 +0000 (0:00:00.485) 0:01:29.413 ********** 2026-03-09 15:45:49.133542 | controller | changed: [instance] 2026-03-09 15:45:49.169765 | controller | 2026-03-09 15:45:49.169848 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-03-09 15:45:49.169857 | controller | Monday 09 March 2026 15:45:49 +0000 (0:00:00.743) 0:01:30.157 ********** 2026-03-09 15:45:49.169872 | controller | skipping: [instance] 2026-03-09 15:45:49.169922 | controller | 2026-03-09 15:45:49.169930 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-03-09 15:45:49.210826 | controller | Monday 09 March 2026 15:45:49 +0000 (0:00:00.036) 0:01:30.193 ********** 2026-03-09 15:45:49.210897 | controller | skipping: [instance] 2026-03-09 15:45:49.859982 | controller | 2026-03-09 15:45:49.860038 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-03-09 15:45:49.860048 | controller | Monday 09 March 2026 15:45:49 +0000 (0:00:00.040) 0:01:30.234 ********** 2026-03-09 15:45:49.860061 | controller | changed: [instance] => (item=workload) 2026-03-09 15:45:50.359216 | controller | changed: [instance] => (item=reproducer-inventory) 2026-03-09 15:45:50.359257 | controller | ok: [instance] => (item=volumes) 2026-03-09 15:45:50.359272 | controller | 2026-03-09 15:45:50.359278 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-03-09 15:45:50.359284 | controller | Monday 09 March 2026 15:45:49 +0000 (0:00:00.648) 0:01:30.883 ********** 2026-03-09 15:45:50.359296 | controller | changed: [instance] => (item=workload) 2026-03-09 15:45:50.464393 | controller | changed: [instance] => (item=volumes) 2026-03-09 15:45:50.464444 | controller | 2026-03-09 15:45:50.464452 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-03-09 15:45:50.464459 | controller | Monday 09 March 2026 15:45:50 +0000 (0:00:00.499) 0:01:31.382 ********** 2026-03-09 15:45:50.464475 | controller | skipping: [instance] 2026-03-09 15:45:51.597846 | controller | 2026-03-09 15:45:51.597886 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-03-09 15:45:51.597894 | controller | Monday 09 March 2026 15:45:50 +0000 (0:00:00.105) 0:01:31.488 ********** 2026-03-09 15:45:51.597905 | controller | changed: [instance] => (item=compute) 2026-03-09 15:45:51.597938 | controller | changed: [instance] => (item=controller) 2026-03-09 15:45:51.597944 | controller | changed: [instance] => (item=crc) 2026-03-09 15:45:51.597949 | controller | 2026-03-09 15:45:51.597956 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-03-09 15:45:51.636574 | controller | Monday 09 March 2026 15:45:51 +0000 (0:00:01.133) 0:01:32.621 ********** 2026-03-09 15:45:51.636665 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-03-09 15:45:51.841889 | controller | 2026-03-09 15:45:51.841958 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-03-09 15:45:51.841968 | controller | Monday 09 March 2026 15:45:51 +0000 (0:00:00.039) 0:01:32.660 ********** 2026-03-09 15:45:51.841986 | controller | ok: [instance] 2026-03-09 15:45:51.868779 | controller | 2026-03-09 15:45:51.868832 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-03-09 15:45:51.868842 | controller | Monday 09 March 2026 15:45:51 +0000 (0:00:00.203) 0:01:32.864 ********** 2026-03-09 15:45:51.868856 | controller | skipping: [instance] 2026-03-09 15:45:52.278826 | controller | 2026-03-09 15:45:52.278879 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-03-09 15:45:52.278888 | controller | Monday 09 March 2026 15:45:51 +0000 (0:00:00.028) 0:01:32.893 ********** 2026-03-09 15:45:52.278908 | controller | changed: [instance] 2026-03-09 15:45:52.304210 | controller | 2026-03-09 15:45:52.304232 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-03-09 15:45:52.304242 | controller | Monday 09 March 2026 15:45:52 +0000 (0:00:00.409) 0:01:33.302 ********** 2026-03-09 15:45:52.304254 | controller | skipping: [instance] 2026-03-09 15:45:52.329183 | controller | 2026-03-09 15:45:52.329205 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-03-09 15:45:52.329214 | controller | Monday 09 March 2026 15:45:52 +0000 (0:00:00.026) 0:01:33.328 ********** 2026-03-09 15:45:52.329225 | controller | skipping: [instance] 2026-03-09 15:45:52.373818 | controller | 2026-03-09 15:45:52.373869 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-03-09 15:45:52.373879 | controller | Monday 09 March 2026 15:45:52 +0000 (0:00:00.024) 0:01:33.353 ********** 2026-03-09 15:45:52.373894 | controller | skipping: [instance] 2026-03-09 15:45:52.373929 | controller | 2026-03-09 15:45:52.373939 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-03-09 15:45:52.373979 | controller | Monday 09 March 2026 15:45:52 +0000 (0:00:00.044) 0:01:33.398 ********** 2026-03-09 15:45:52.447676 | controller | skipping: [instance] => (item=crc) 2026-03-09 15:45:52.685927 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-03-09 15:45:52.685990 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-03-09 15:45:52.686003 | controller | 2026-03-09 15:45:52.686015 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-03-09 15:45:52.686025 | controller | Monday 09 March 2026 15:45:52 +0000 (0:00:00.073) 0:01:33.471 ********** 2026-03-09 15:45:52.686045 | controller | changed: [instance] 2026-03-09 15:45:52.890571 | controller | 2026-03-09 15:45:52.890604 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-03-09 15:45:52.890612 | controller | Monday 09 March 2026 15:45:52 +0000 (0:00:00.238) 0:01:33.710 ********** 2026-03-09 15:45:52.890622 | controller | ok: [instance] 2026-03-09 15:46:24.896437 | controller | 2026-03-09 15:46:24.896476 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-03-09 15:46:24.896484 | controller | Monday 09 March 2026 15:45:52 +0000 (0:00:00.204) 0:01:33.914 ********** 2026-03-09 15:46:24.896495 | controller | changed: [instance] 2026-03-09 15:46:25.119610 | controller | 2026-03-09 15:46:25.119650 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-03-09 15:46:25.119660 | controller | Monday 09 March 2026 15:46:24 +0000 (0:00:32.004) 0:02:05.919 ********** 2026-03-09 15:46:25.119669 | controller | ok: [instance] 2026-03-09 15:46:25.171465 | controller | 2026-03-09 15:46:25.171486 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-03-09 15:46:25.171495 | controller | Monday 09 March 2026 15:46:25 +0000 (0:00:00.224) 0:02:06.143 ********** 2026-03-09 15:46:25.171506 | controller | ok: [instance] => changed=false 2026-03-09 15:46:25.404937 | controller | msg: All assertions passed 2026-03-09 15:46:25.404986 | controller | 2026-03-09 15:46:25.404995 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-03-09 15:46:25.405004 | controller | Monday 09 March 2026 15:46:25 +0000 (0:00:00.051) 0:02:06.195 ********** 2026-03-09 15:46:25.405017 | controller | changed: [instance] 2026-03-09 15:46:25.649767 | controller | 2026-03-09 15:46:25.649836 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-03-09 15:46:25.649855 | controller | Monday 09 March 2026 15:46:25 +0000 (0:00:00.233) 0:02:06.428 ********** 2026-03-09 15:46:25.649872 | controller | ok: [instance] 2026-03-09 15:46:25.649931 | controller | 2026-03-09 15:46:25.650052 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-03-09 15:46:25.650103 | controller | Monday 09 March 2026 15:46:25 +0000 (0:00:00.245) 0:02:06.674 ********** 2026-03-09 15:46:25.877737 | controller | ok: [instance] 2026-03-09 15:46:25.909592 | controller | 2026-03-09 15:46:25.909662 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-03-09 15:46:25.909693 | controller | Monday 09 March 2026 15:46:25 +0000 (0:00:00.227) 0:02:06.901 ********** 2026-03-09 15:46:25.909710 | controller | skipping: [instance] 2026-03-09 15:46:26.148331 | controller | 2026-03-09 15:46:26.148402 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-03-09 15:46:26.148411 | controller | Monday 09 March 2026 15:46:25 +0000 (0:00:00.031) 0:02:06.933 ********** 2026-03-09 15:46:26.148423 | controller | ok: [instance] 2026-03-09 15:46:26.148557 | controller | 2026-03-09 15:46:26.202607 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-03-09 15:46:26.202679 | controller | Monday 09 March 2026 15:46:26 +0000 (0:00:00.239) 0:02:07.172 ********** 2026-03-09 15:46:26.202695 | controller | ok: [instance] => changed=false 2026-03-09 15:46:26.486060 | controller | msg: All assertions passed 2026-03-09 15:46:26.486137 | controller | 2026-03-09 15:46:26.486148 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-03-09 15:46:26.486155 | controller | Monday 09 March 2026 15:46:26 +0000 (0:00:00.053) 0:02:07.226 ********** 2026-03-09 15:46:26.486173 | controller | ok: [instance] 2026-03-09 15:46:26.722487 | controller | 2026-03-09 15:46:26.722539 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-03-09 15:46:26.722548 | controller | Monday 09 March 2026 15:46:26 +0000 (0:00:00.283) 0:02:07.509 ********** 2026-03-09 15:46:26.722561 | controller | ok: [instance] 2026-03-09 15:46:27.182705 | controller | 2026-03-09 15:46:27.182764 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-03-09 15:46:27.182772 | controller | Monday 09 March 2026 15:46:26 +0000 (0:00:00.236) 0:02:07.746 ********** 2026-03-09 15:46:27.182799 | controller | changed: [instance] 2026-03-09 15:46:27.382674 | controller | 2026-03-09 15:46:27.382724 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-03-09 15:46:27.382739 | controller | Monday 09 March 2026 15:46:27 +0000 (0:00:00.460) 0:02:08.206 ********** 2026-03-09 15:46:27.382757 | controller | ok: [instance] 2026-03-09 15:46:27.576253 | controller | 2026-03-09 15:46:27.576273 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-03-09 15:46:27.576281 | controller | Monday 09 March 2026 15:46:27 +0000 (0:00:00.199) 0:02:08.406 ********** 2026-03-09 15:46:27.576289 | controller | ok: [instance] 2026-03-09 15:46:28.008055 | controller | 2026-03-09 15:46:28.008079 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-03-09 15:46:28.008087 | controller | Monday 09 March 2026 15:46:27 +0000 (0:00:00.194) 0:02:08.600 ********** 2026-03-09 15:46:28.008095 | controller | changed: [instance] 2026-03-09 15:46:28.035869 | controller | 2026-03-09 15:46:28.035928 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-03-09 15:46:28.035941 | controller | Monday 09 March 2026 15:46:28 +0000 (0:00:00.431) 0:02:09.032 ********** 2026-03-09 15:46:28.035960 | controller | ok: [instance] 2026-03-09 15:46:28.036141 | controller | 2026-03-09 15:46:28.036163 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-03-09 15:46:28.272541 | controller | Monday 09 March 2026 15:46:28 +0000 (0:00:00.027) 0:02:09.060 ********** 2026-03-09 15:46:28.272565 | controller | ok: [instance] 2026-03-09 15:46:28.797714 | controller | 2026-03-09 15:46:28.797766 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-03-09 15:46:28.797775 | controller | Monday 09 March 2026 15:46:28 +0000 (0:00:00.236) 0:02:09.296 ********** 2026-03-09 15:46:28.797797 | controller | ok: [instance] 2026-03-09 15:46:28.924772 | controller | 2026-03-09 15:46:28.924834 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-03-09 15:46:28.924844 | controller | Monday 09 March 2026 15:46:28 +0000 (0:00:00.524) 0:02:09.821 ********** 2026-03-09 15:46:28.924860 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-03-09 15:46:29.197713 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-03-09 15:46:29.197756 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-03-09 15:46:29.197766 | controller | 2026-03-09 15:46:29.197772 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-03-09 15:46:29.197778 | controller | Monday 09 March 2026 15:46:28 +0000 (0:00:00.127) 0:02:09.948 ********** 2026-03-09 15:46:29.197804 | controller | changed: [instance] 2026-03-09 15:46:29.197859 | controller | 2026-03-09 15:46:29.197889 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-03-09 15:46:29.197902 | controller | Monday 09 March 2026 15:46:29 +0000 (0:00:00.273) 0:02:10.222 ********** 2026-03-09 15:46:29.522117 | controller | changed: [instance] 2026-03-09 15:46:29.845866 | controller | 2026-03-09 15:46:29.845913 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-03-09 15:46:29.845922 | controller | Monday 09 March 2026 15:46:29 +0000 (0:00:00.323) 0:02:10.545 ********** 2026-03-09 15:46:29.845935 | controller | changed: [instance] 2026-03-09 15:46:29.882060 | controller | 2026-03-09 15:46:29.882085 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-03-09 15:46:29.882094 | controller | Monday 09 March 2026 15:46:29 +0000 (0:00:00.323) 0:02:10.869 ********** 2026-03-09 15:46:29.882106 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-03-09 15:46:29.938408 | controller | 2026-03-09 15:46:29.938430 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-03-09 15:46:29.938439 | controller | Monday 09 March 2026 15:46:29 +0000 (0:00:00.036) 0:02:10.906 ********** 2026-03-09 15:46:29.938450 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-03-09 15:46:30.193754 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-03-09 15:46:30.193821 | controller | 2026-03-09 15:46:30.193829 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-09 15:46:30.193835 | controller | Monday 09 March 2026 15:46:29 +0000 (0:00:00.056) 0:02:10.962 ********** 2026-03-09 15:46:30.193850 | controller | ok: [instance] 2026-03-09 15:46:30.242616 | controller | 2026-03-09 15:46:30.242668 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-09 15:46:30.242676 | controller | Monday 09 March 2026 15:46:30 +0000 (0:00:00.255) 0:02:11.218 ********** 2026-03-09 15:46:30.242688 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:46:30.488669 | controller | ok: [instance] => (item=cifmw-public) 2026-03-09 15:46:30.488713 | controller | 2026-03-09 15:46:30.488721 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-09 15:46:30.488727 | controller | Monday 09 March 2026 15:46:30 +0000 (0:00:00.048) 0:02:11.266 ********** 2026-03-09 15:46:30.488739 | controller | ok: [instance] 2026-03-09 15:46:30.707330 | controller | 2026-03-09 15:46:30.707390 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-09 15:46:30.707398 | controller | Monday 09 March 2026 15:46:30 +0000 (0:00:00.245) 0:02:11.512 ********** 2026-03-09 15:46:30.707411 | controller | ok: [instance] 2026-03-09 15:46:31.023569 | controller | 2026-03-09 15:46:31.023615 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-03-09 15:46:31.023623 | controller | Monday 09 March 2026 15:46:30 +0000 (0:00:00.218) 0:02:11.730 ********** 2026-03-09 15:46:31.023655 | controller | changed: [instance] 2026-03-09 15:46:31.272127 | controller | 2026-03-09 15:46:31.272166 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-09 15:46:31.272174 | controller | Monday 09 March 2026 15:46:31 +0000 (0:00:00.316) 0:02:12.047 ********** 2026-03-09 15:46:31.272186 | controller | ok: [instance] 2026-03-09 15:46:31.323347 | controller | 2026-03-09 15:46:31.323363 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-09 15:46:31.323370 | controller | Monday 09 March 2026 15:46:31 +0000 (0:00:00.248) 0:02:12.296 ********** 2026-03-09 15:46:31.323379 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:46:31.559587 | controller | ok: [instance] => (item=cifmw-public) 2026-03-09 15:46:31.559613 | controller | 2026-03-09 15:46:31.559621 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-09 15:46:31.559642 | controller | Monday 09 March 2026 15:46:31 +0000 (0:00:00.051) 0:02:12.347 ********** 2026-03-09 15:46:31.559656 | controller | ok: [instance] 2026-03-09 15:46:31.764265 | controller | 2026-03-09 15:46:31.764296 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-09 15:46:31.764307 | controller | Monday 09 March 2026 15:46:31 +0000 (0:00:00.236) 0:02:12.583 ********** 2026-03-09 15:46:31.764319 | controller | ok: [instance] 2026-03-09 15:46:32.063126 | controller | 2026-03-09 15:46:32.063169 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-03-09 15:46:32.063177 | controller | Monday 09 March 2026 15:46:31 +0000 (0:00:00.204) 0:02:12.788 ********** 2026-03-09 15:46:32.063190 | controller | changed: [instance] 2026-03-09 15:46:32.087235 | controller | 2026-03-09 15:46:32.087257 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-03-09 15:46:32.087266 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.298) 0:02:13.087 ********** 2026-03-09 15:46:32.087276 | controller | skipping: [instance] 2026-03-09 15:46:32.118395 | controller | 2026-03-09 15:46:32.118416 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-03-09 15:46:32.118431 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.024) 0:02:13.111 ********** 2026-03-09 15:46:32.118442 | controller | skipping: [instance] 2026-03-09 15:46:32.150753 | controller | 2026-03-09 15:46:32.150774 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-03-09 15:46:32.150802 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.031) 0:02:13.142 ********** 2026-03-09 15:46:32.150813 | controller | skipping: [instance] 2026-03-09 15:46:32.150846 | controller | 2026-03-09 15:46:32.150860 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-03-09 15:46:32.150870 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.032) 0:02:13.175 ********** 2026-03-09 15:46:32.181500 | controller | skipping: [instance] 2026-03-09 15:46:32.417410 | controller | 2026-03-09 15:46:32.417439 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-03-09 15:46:32.417447 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.030) 0:02:13.205 ********** 2026-03-09 15:46:32.417457 | controller | changed: [instance] 2026-03-09 15:46:32.460323 | controller | 2026-03-09 15:46:32.460342 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-03-09 15:46:32.460350 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.235) 0:02:13.441 ********** 2026-03-09 15:46:32.460359 | controller | ok: [instance] 2026-03-09 15:46:32.519290 | controller | 2026-03-09 15:46:32.519316 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-03-09 15:46:32.519325 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.043) 0:02:13.484 ********** 2026-03-09 15:46:32.519343 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-03-09 15:46:32.724476 | controller | 2026-03-09 15:46:32.724515 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-03-09 15:46:32.724523 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.059) 0:02:13.543 ********** 2026-03-09 15:46:32.724536 | controller | ok: [instance] 2026-03-09 15:46:32.790888 | controller | 2026-03-09 15:46:32.790915 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-03-09 15:46:32.790923 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.204) 0:02:13.748 ********** 2026-03-09 15:46:32.790933 | controller | ok: [instance] 2026-03-09 15:46:32.841100 | controller | 2026-03-09 15:46:32.841124 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-03-09 15:46:32.841132 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.066) 0:02:13.815 ********** 2026-03-09 15:46:32.841140 | controller | ok: [instance] 2026-03-09 15:46:32.890250 | controller | 2026-03-09 15:46:32.890266 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-03-09 15:46:32.890273 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.050) 0:02:13.865 ********** 2026-03-09 15:46:32.890281 | controller | skipping: [instance] 2026-03-09 15:46:32.936847 | controller | 2026-03-09 15:46:32.936878 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-03-09 15:46:32.936887 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.048) 0:02:13.914 ********** 2026-03-09 15:46:32.936899 | controller | skipping: [instance] 2026-03-09 15:46:33.002775 | controller | 2026-03-09 15:46:33.002809 | controller | TASK [Call the config_drive role] ********************************************** 2026-03-09 15:46:33.002819 | controller | Monday 09 March 2026 15:46:32 +0000 (0:00:00.046) 0:02:13.961 ********** 2026-03-09 15:46:33.002830 | controller | 2026-03-09 15:46:33.425793 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-03-09 15:46:33.425839 | controller | Monday 09 March 2026 15:46:33 +0000 (0:00:00.066) 0:02:14.027 ********** 2026-03-09 15:46:33.425856 | controller | ok: [instance] => (item=artifacts) 2026-03-09 15:46:34.740719 | controller | ok: [instance] => (item=logs) 2026-03-09 15:46:34.740762 | controller | 2026-03-09 15:46:34.740771 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-03-09 15:46:34.740787 | controller | Monday 09 March 2026 15:46:33 +0000 (0:00:00.422) 0:02:14.449 ********** 2026-03-09 15:46:34.740800 | controller | ok: [instance] 2026-03-09 15:46:34.965440 | controller | 2026-03-09 15:46:34.965475 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-03-09 15:46:34.965484 | controller | Monday 09 March 2026 15:46:34 +0000 (0:00:01.315) 0:02:15.764 ********** 2026-03-09 15:46:34.965495 | controller | changed: [instance] 2026-03-09 15:46:35.338373 | controller | 2026-03-09 15:46:35.338413 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-03-09 15:46:35.338421 | controller | Monday 09 March 2026 15:46:34 +0000 (0:00:00.224) 0:02:15.989 ********** 2026-03-09 15:46:35.338437 | controller | changed: [instance] 2026-03-09 15:46:35.720366 | controller | 2026-03-09 15:46:35.720407 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-03-09 15:46:35.720416 | controller | Monday 09 March 2026 15:46:35 +0000 (0:00:00.372) 0:02:16.362 ********** 2026-03-09 15:46:35.720427 | controller | changed: [instance] 2026-03-09 15:46:35.769852 | controller | 2026-03-09 15:46:35.769908 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-03-09 15:46:35.769923 | controller | Monday 09 March 2026 15:46:35 +0000 (0:00:00.381) 0:02:16.744 ********** 2026-03-09 15:46:35.769942 | controller | skipping: [instance] 2026-03-09 15:46:35.770013 | controller | 2026-03-09 15:46:35.770052 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-03-09 15:46:35.984101 | controller | Monday 09 March 2026 15:46:35 +0000 (0:00:00.049) 0:02:16.794 ********** 2026-03-09 15:46:35.984145 | controller | ok: [instance] 2026-03-09 15:46:36.032762 | controller | 2026-03-09 15:46:36.032802 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-03-09 15:46:36.032812 | controller | Monday 09 March 2026 15:46:35 +0000 (0:00:00.213) 0:02:17.007 ********** 2026-03-09 15:46:36.032824 | controller | skipping: [instance] 2026-03-09 15:46:36.032854 | controller | 2026-03-09 15:46:36.033061 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-03-09 15:46:36.298712 | controller | Monday 09 March 2026 15:46:36 +0000 (0:00:00.049) 0:02:17.057 ********** 2026-03-09 15:46:36.298750 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-03-09 15:46:36.601563 | controller | changed: [instance] 2026-03-09 15:46:36.601596 | controller | 2026-03-09 15:46:36.601604 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-03-09 15:46:36.601614 | controller | Monday 09 March 2026 15:46:36 +0000 (0:00:00.265) 0:02:17.322 ********** 2026-03-09 15:46:36.601659 | controller | changed: [instance] 2026-03-09 15:46:36.649618 | controller | 2026-03-09 15:46:36.649665 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-03-09 15:46:36.649675 | controller | Monday 09 March 2026 15:46:36 +0000 (0:00:00.302) 0:02:17.625 ********** 2026-03-09 15:46:36.649687 | controller | skipping: [instance] 2026-03-09 15:46:36.682105 | controller | 2026-03-09 15:46:36.682129 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-03-09 15:46:36.682138 | controller | Monday 09 March 2026 15:46:36 +0000 (0:00:00.048) 0:02:17.673 ********** 2026-03-09 15:46:36.682149 | controller | skipping: [instance] 2026-03-09 15:46:36.936378 | controller | 2026-03-09 15:46:36.936416 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-03-09 15:46:36.936424 | controller | Monday 09 March 2026 15:46:36 +0000 (0:00:00.032) 0:02:17.706 ********** 2026-03-09 15:46:36.936436 | controller | changed: [instance] 2026-03-09 15:46:37.162364 | controller | 2026-03-09 15:46:37.162399 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-03-09 15:46:37.162406 | controller | Monday 09 March 2026 15:46:36 +0000 (0:00:00.254) 0:02:17.960 ********** 2026-03-09 15:46:37.162418 | controller | changed: [instance] 2026-03-09 15:46:37.498341 | controller | 2026-03-09 15:46:37.498385 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-03-09 15:46:37.498393 | controller | Monday 09 March 2026 15:46:37 +0000 (0:00:00.225) 0:02:18.186 ********** 2026-03-09 15:46:37.498405 | controller | changed: [instance] 2026-03-09 15:46:37.529667 | controller | 2026-03-09 15:46:37.529697 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-03-09 15:46:37.529706 | controller | Monday 09 March 2026 15:46:37 +0000 (0:00:00.335) 0:02:18.522 ********** 2026-03-09 15:46:37.529719 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-03-09 15:46:37.576741 | controller | 2026-03-09 15:46:37.576761 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-03-09 15:46:37.576769 | controller | Monday 09 March 2026 15:46:37 +0000 (0:00:00.031) 0:02:18.553 ********** 2026-03-09 15:46:37.576789 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-03-09 15:46:37.576997 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-03-09 15:46:37.577011 | controller | 2026-03-09 15:46:37.577020 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-09 15:46:37.817311 | controller | Monday 09 March 2026 15:46:37 +0000 (0:00:00.047) 0:02:18.601 ********** 2026-03-09 15:46:37.817361 | controller | ok: [instance] 2026-03-09 15:46:37.817675 | controller | 2026-03-09 15:46:37.817693 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-09 15:46:37.817704 | controller | Monday 09 March 2026 15:46:37 +0000 (0:00:00.239) 0:02:18.840 ********** 2026-03-09 15:46:37.875033 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:46:38.122805 | controller | ok: [instance] => (item=cifmw-public) 2026-03-09 15:46:38.122844 | controller | 2026-03-09 15:46:38.122852 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-09 15:46:38.122859 | controller | Monday 09 March 2026 15:46:37 +0000 (0:00:00.058) 0:02:18.898 ********** 2026-03-09 15:46:38.122870 | controller | ok: [instance] 2026-03-09 15:46:38.326698 | controller | 2026-03-09 15:46:38.326747 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-09 15:46:38.326755 | controller | Monday 09 March 2026 15:46:38 +0000 (0:00:00.248) 0:02:19.146 ********** 2026-03-09 15:46:38.326766 | controller | ok: [instance] 2026-03-09 15:46:38.619747 | controller | 2026-03-09 15:46:38.619797 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-03-09 15:46:38.619814 | controller | Monday 09 March 2026 15:46:38 +0000 (0:00:00.203) 0:02:19.350 ********** 2026-03-09 15:46:38.619828 | controller | changed: [instance] 2026-03-09 15:46:38.855499 | controller | 2026-03-09 15:46:38.855535 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-09 15:46:38.855543 | controller | Monday 09 March 2026 15:46:38 +0000 (0:00:00.293) 0:02:19.643 ********** 2026-03-09 15:46:38.855554 | controller | ok: [instance] 2026-03-09 15:46:38.900743 | controller | 2026-03-09 15:46:38.900789 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-09 15:46:38.900799 | controller | Monday 09 March 2026 15:46:38 +0000 (0:00:00.235) 0:02:19.879 ********** 2026-03-09 15:46:38.900817 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:46:39.131427 | controller | ok: [instance] => (item=cifmw-public) 2026-03-09 15:46:39.131462 | controller | 2026-03-09 15:46:39.131470 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-09 15:46:39.131476 | controller | Monday 09 March 2026 15:46:38 +0000 (0:00:00.045) 0:02:19.924 ********** 2026-03-09 15:46:39.131487 | controller | ok: [instance] 2026-03-09 15:46:39.336274 | controller | 2026-03-09 15:46:39.336314 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-09 15:46:39.336322 | controller | Monday 09 March 2026 15:46:39 +0000 (0:00:00.230) 0:02:20.155 ********** 2026-03-09 15:46:39.336334 | controller | ok: [instance] 2026-03-09 15:46:39.627255 | controller | 2026-03-09 15:46:39.627290 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-03-09 15:46:39.627298 | controller | Monday 09 March 2026 15:46:39 +0000 (0:00:00.204) 0:02:20.360 ********** 2026-03-09 15:46:39.627309 | controller | changed: [instance] 2026-03-09 15:46:39.651706 | controller | 2026-03-09 15:46:39.651737 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-03-09 15:46:39.651745 | controller | Monday 09 March 2026 15:46:39 +0000 (0:00:00.290) 0:02:20.651 ********** 2026-03-09 15:46:39.651755 | controller | skipping: [instance] 2026-03-09 15:46:39.651827 | controller | 2026-03-09 15:46:39.651846 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-03-09 15:46:39.651855 | controller | Monday 09 March 2026 15:46:39 +0000 (0:00:00.024) 0:02:20.676 ********** 2026-03-09 15:46:39.682079 | controller | skipping: [instance] 2026-03-09 15:46:39.711423 | controller | 2026-03-09 15:46:39.711447 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-03-09 15:46:39.711456 | controller | Monday 09 March 2026 15:46:39 +0000 (0:00:00.030) 0:02:20.706 ********** 2026-03-09 15:46:39.711467 | controller | skipping: [instance] 2026-03-09 15:46:39.739794 | controller | 2026-03-09 15:46:39.739819 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-03-09 15:46:39.739828 | controller | Monday 09 March 2026 15:46:39 +0000 (0:00:00.029) 0:02:20.735 ********** 2026-03-09 15:46:39.739846 | controller | skipping: [instance] 2026-03-09 15:46:39.962609 | controller | 2026-03-09 15:46:39.962660 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-03-09 15:46:39.962668 | controller | Monday 09 March 2026 15:46:39 +0000 (0:00:00.028) 0:02:20.764 ********** 2026-03-09 15:46:39.962679 | controller | changed: [instance] 2026-03-09 15:46:40.002369 | controller | 2026-03-09 15:46:40.002397 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-03-09 15:46:40.002404 | controller | Monday 09 March 2026 15:46:39 +0000 (0:00:00.222) 0:02:20.986 ********** 2026-03-09 15:46:40.002415 | controller | ok: [instance] 2026-03-09 15:46:40.058140 | controller | 2026-03-09 15:46:40.058174 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-03-09 15:46:40.058183 | controller | Monday 09 March 2026 15:46:39 +0000 (0:00:00.039) 0:02:21.026 ********** 2026-03-09 15:46:40.058197 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-03-09 15:46:40.254658 | controller | 2026-03-09 15:46:40.254696 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-03-09 15:46:40.254711 | controller | Monday 09 March 2026 15:46:40 +0000 (0:00:00.055) 0:02:21.082 ********** 2026-03-09 15:46:40.254729 | controller | ok: [instance] 2026-03-09 15:46:40.320459 | controller | 2026-03-09 15:46:40.320489 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-03-09 15:46:40.320497 | controller | Monday 09 March 2026 15:46:40 +0000 (0:00:00.196) 0:02:21.278 ********** 2026-03-09 15:46:40.320508 | controller | ok: [instance] 2026-03-09 15:46:40.369757 | controller | 2026-03-09 15:46:40.369798 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-03-09 15:46:40.369809 | controller | Monday 09 March 2026 15:46:40 +0000 (0:00:00.066) 0:02:21.344 ********** 2026-03-09 15:46:40.369822 | controller | ok: [instance] 2026-03-09 15:46:40.417728 | controller | 2026-03-09 15:46:40.417745 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-03-09 15:46:40.417753 | controller | Monday 09 March 2026 15:46:40 +0000 (0:00:00.049) 0:02:21.393 ********** 2026-03-09 15:46:40.417764 | controller | skipping: [instance] 2026-03-09 15:46:40.417920 | controller | 2026-03-09 15:46:40.417932 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-03-09 15:46:40.417942 | controller | Monday 09 March 2026 15:46:40 +0000 (0:00:00.048) 0:02:21.442 ********** 2026-03-09 15:46:40.467818 | controller | skipping: [instance] 2026-03-09 15:46:40.467940 | controller | 2026-03-09 15:46:40.468057 | controller | TASK [Call the config_drive role] ********************************************** 2026-03-09 15:46:40.468169 | controller | Monday 09 March 2026 15:46:40 +0000 (0:00:00.050) 0:02:21.492 ********** 2026-03-09 15:46:40.531236 | controller | 2026-03-09 15:46:40.531401 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-03-09 15:46:40.531512 | controller | Monday 09 March 2026 15:46:40 +0000 (0:00:00.063) 0:02:21.555 ********** 2026-03-09 15:46:40.949245 | controller | ok: [instance] => (item=artifacts) 2026-03-09 15:46:42.198812 | controller | ok: [instance] => (item=logs) 2026-03-09 15:46:42.198859 | controller | 2026-03-09 15:46:42.198869 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-03-09 15:46:42.198877 | controller | Monday 09 March 2026 15:46:40 +0000 (0:00:00.417) 0:02:21.973 ********** 2026-03-09 15:46:42.198891 | controller | ok: [instance] 2026-03-09 15:46:42.414940 | controller | 2026-03-09 15:46:42.414976 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-03-09 15:46:42.414984 | controller | Monday 09 March 2026 15:46:42 +0000 (0:00:01.249) 0:02:23.222 ********** 2026-03-09 15:46:42.414996 | controller | changed: [instance] 2026-03-09 15:46:42.787717 | controller | 2026-03-09 15:46:42.787753 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-03-09 15:46:42.787761 | controller | Monday 09 March 2026 15:46:42 +0000 (0:00:00.216) 0:02:23.438 ********** 2026-03-09 15:46:42.787783 | controller | changed: [instance] 2026-03-09 15:46:42.787809 | controller | 2026-03-09 15:46:42.794234 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-03-09 15:46:43.159457 | controller | Monday 09 March 2026 15:46:42 +0000 (0:00:00.372) 0:02:23.811 ********** 2026-03-09 15:46:43.159497 | controller | changed: [instance] 2026-03-09 15:46:43.206419 | controller | 2026-03-09 15:46:43.206448 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-03-09 15:46:43.206457 | controller | Monday 09 March 2026 15:46:43 +0000 (0:00:00.371) 0:02:24.183 ********** 2026-03-09 15:46:43.206469 | controller | skipping: [instance] 2026-03-09 15:46:43.399529 | controller | 2026-03-09 15:46:43.399564 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-03-09 15:46:43.399572 | controller | Monday 09 March 2026 15:46:43 +0000 (0:00:00.047) 0:02:24.230 ********** 2026-03-09 15:46:43.399583 | controller | ok: [instance] 2026-03-09 15:46:43.441532 | controller | 2026-03-09 15:46:43.441555 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-03-09 15:46:43.441564 | controller | Monday 09 March 2026 15:46:43 +0000 (0:00:00.192) 0:02:24.422 ********** 2026-03-09 15:46:43.441575 | controller | skipping: [instance] 2026-03-09 15:46:43.673428 | controller | 2026-03-09 15:46:43.673461 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-03-09 15:46:43.673472 | controller | Monday 09 March 2026 15:46:43 +0000 (0:00:00.042) 0:02:24.465 ********** 2026-03-09 15:46:43.673483 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-03-09 15:46:43.949602 | controller | changed: [instance] 2026-03-09 15:46:43.949654 | controller | 2026-03-09 15:46:43.949666 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-03-09 15:46:43.949678 | controller | Monday 09 March 2026 15:46:43 +0000 (0:00:00.231) 0:02:24.697 ********** 2026-03-09 15:46:43.949689 | controller | changed: [instance] 2026-03-09 15:46:43.997071 | controller | 2026-03-09 15:46:43.997096 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-03-09 15:46:43.997104 | controller | Monday 09 March 2026 15:46:43 +0000 (0:00:00.276) 0:02:24.973 ********** 2026-03-09 15:46:43.997115 | controller | skipping: [instance] 2026-03-09 15:46:44.025840 | controller | 2026-03-09 15:46:44.025897 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-03-09 15:46:44.025911 | controller | Monday 09 March 2026 15:46:43 +0000 (0:00:00.047) 0:02:25.021 ********** 2026-03-09 15:46:44.025929 | controller | skipping: [instance] 2026-03-09 15:46:44.269390 | controller | 2026-03-09 15:46:44.269427 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-03-09 15:46:44.269435 | controller | Monday 09 March 2026 15:46:44 +0000 (0:00:00.028) 0:02:25.049 ********** 2026-03-09 15:46:44.269447 | controller | changed: [instance] 2026-03-09 15:46:44.491555 | controller | 2026-03-09 15:46:44.491591 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-03-09 15:46:44.491599 | controller | Monday 09 March 2026 15:46:44 +0000 (0:00:00.243) 0:02:25.293 ********** 2026-03-09 15:46:44.491611 | controller | changed: [instance] 2026-03-09 15:46:44.785235 | controller | 2026-03-09 15:46:44.785271 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-03-09 15:46:44.785279 | controller | Monday 09 March 2026 15:46:44 +0000 (0:00:00.222) 0:02:25.515 ********** 2026-03-09 15:46:44.785291 | controller | changed: [instance] 2026-03-09 15:46:44.815342 | controller | 2026-03-09 15:46:44.815366 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-03-09 15:46:44.815373 | controller | Monday 09 March 2026 15:46:44 +0000 (0:00:00.293) 0:02:25.809 ********** 2026-03-09 15:46:44.815383 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-03-09 15:46:44.860161 | controller | 2026-03-09 15:46:44.860182 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-03-09 15:46:44.860190 | controller | Monday 09 March 2026 15:46:44 +0000 (0:00:00.030) 0:02:25.839 ********** 2026-03-09 15:46:44.860200 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-03-09 15:46:45.093372 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-03-09 15:46:45.093403 | controller | 2026-03-09 15:46:45.093412 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-09 15:46:45.093418 | controller | Monday 09 March 2026 15:46:44 +0000 (0:00:00.044) 0:02:25.884 ********** 2026-03-09 15:46:45.093429 | controller | ok: [instance] 2026-03-09 15:46:45.136729 | controller | 2026-03-09 15:46:45.136778 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-09 15:46:45.136789 | controller | Monday 09 March 2026 15:46:45 +0000 (0:00:00.233) 0:02:26.117 ********** 2026-03-09 15:46:45.136803 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:46:45.136824 | controller | ok: [instance] => (item=cifmw-public) 2026-03-09 15:46:45.136831 | controller | 2026-03-09 15:46:45.136840 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-09 15:46:45.136915 | controller | Monday 09 March 2026 15:46:45 +0000 (0:00:00.043) 0:02:26.161 ********** 2026-03-09 15:46:45.372685 | controller | ok: [instance] 2026-03-09 15:46:45.569464 | controller | 2026-03-09 15:46:45.569497 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-09 15:46:45.569505 | controller | Monday 09 March 2026 15:46:45 +0000 (0:00:00.235) 0:02:26.396 ********** 2026-03-09 15:46:45.569516 | controller | ok: [instance] 2026-03-09 15:46:45.906126 | controller | 2026-03-09 15:46:45.906160 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-03-09 15:46:45.906168 | controller | Monday 09 March 2026 15:46:45 +0000 (0:00:00.196) 0:02:26.593 ********** 2026-03-09 15:46:45.906179 | controller | changed: [instance] 2026-03-09 15:46:46.137560 | controller | 2026-03-09 15:46:46.137594 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-03-09 15:46:46.137602 | controller | Monday 09 March 2026 15:46:45 +0000 (0:00:00.336) 0:02:26.930 ********** 2026-03-09 15:46:46.137613 | controller | ok: [instance] 2026-03-09 15:46:46.180781 | controller | 2026-03-09 15:46:46.180815 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-03-09 15:46:46.180824 | controller | Monday 09 March 2026 15:46:46 +0000 (0:00:00.231) 0:02:27.161 ********** 2026-03-09 15:46:46.180837 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-03-09 15:46:46.180866 | controller | ok: [instance] => (item=cifmw-public) 2026-03-09 15:46:46.180876 | controller | 2026-03-09 15:46:46.181117 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-03-09 15:46:46.430281 | controller | Monday 09 March 2026 15:46:46 +0000 (0:00:00.043) 0:02:27.205 ********** 2026-03-09 15:46:46.430328 | controller | ok: [instance] 2026-03-09 15:46:46.627399 | controller | 2026-03-09 15:46:46.627434 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-03-09 15:46:46.627442 | controller | Monday 09 March 2026 15:46:46 +0000 (0:00:00.249) 0:02:27.454 ********** 2026-03-09 15:46:46.627454 | controller | ok: [instance] 2026-03-09 15:46:46.910073 | controller | 2026-03-09 15:46:46.910106 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-03-09 15:46:46.910114 | controller | Monday 09 March 2026 15:46:46 +0000 (0:00:00.197) 0:02:27.651 ********** 2026-03-09 15:46:46.910125 | controller | changed: [instance] 2026-03-09 15:46:46.930157 | controller | 2026-03-09 15:46:46.930182 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-03-09 15:46:46.930189 | controller | Monday 09 March 2026 15:46:46 +0000 (0:00:00.282) 0:02:27.934 ********** 2026-03-09 15:46:46.930199 | controller | skipping: [instance] 2026-03-09 15:46:46.956418 | controller | 2026-03-09 15:46:46.956443 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-03-09 15:46:46.956451 | controller | Monday 09 March 2026 15:46:46 +0000 (0:00:00.020) 0:02:27.954 ********** 2026-03-09 15:46:46.956462 | controller | skipping: [instance] 2026-03-09 15:46:46.984077 | controller | 2026-03-09 15:46:46.984096 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-03-09 15:46:46.984103 | controller | Monday 09 March 2026 15:46:46 +0000 (0:00:00.026) 0:02:27.980 ********** 2026-03-09 15:46:46.984113 | controller | skipping: [instance] 2026-03-09 15:46:47.010762 | controller | 2026-03-09 15:46:47.010810 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-03-09 15:46:47.010823 | controller | Monday 09 March 2026 15:46:46 +0000 (0:00:00.027) 0:02:28.008 ********** 2026-03-09 15:46:47.010837 | controller | skipping: [instance] 2026-03-09 15:46:47.222151 | controller | 2026-03-09 15:46:47.222188 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-03-09 15:46:47.222196 | controller | Monday 09 March 2026 15:46:47 +0000 (0:00:00.026) 0:02:28.035 ********** 2026-03-09 15:46:47.222208 | controller | changed: [instance] 2026-03-09 15:46:47.259754 | controller | 2026-03-09 15:46:47.259798 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-03-09 15:46:47.259808 | controller | Monday 09 March 2026 15:46:47 +0000 (0:00:00.210) 0:02:28.246 ********** 2026-03-09 15:46:47.259821 | controller | ok: [instance] 2026-03-09 15:46:47.259849 | controller | 2026-03-09 15:46:47.259857 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-03-09 15:46:47.259872 | controller | Monday 09 March 2026 15:46:47 +0000 (0:00:00.037) 0:02:28.284 ********** 2026-03-09 15:46:47.289549 | controller | skipping: [instance] 2026-03-09 15:46:47.317588 | controller | 2026-03-09 15:46:47.317613 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-03-09 15:46:47.317620 | controller | Monday 09 March 2026 15:46:47 +0000 (0:00:00.029) 0:02:28.313 ********** 2026-03-09 15:46:47.317647 | controller | skipping: [instance] 2026-03-09 15:46:47.362224 | controller | 2026-03-09 15:46:47.362249 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-03-09 15:46:47.362258 | controller | Monday 09 March 2026 15:46:47 +0000 (0:00:00.028) 0:02:28.341 ********** 2026-03-09 15:46:47.362269 | controller | skipping: [instance] 2026-03-09 15:46:47.386781 | controller | 2026-03-09 15:46:47.386808 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-03-09 15:46:47.386826 | controller | Monday 09 March 2026 15:46:47 +0000 (0:00:00.044) 0:02:28.386 ********** 2026-03-09 15:46:47.386838 | controller | skipping: [instance] 2026-03-09 15:46:47.387031 | controller | 2026-03-09 15:46:47.387053 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-03-09 15:46:47.448752 | controller | Monday 09 March 2026 15:46:47 +0000 (0:00:00.024) 0:02:28.411 ********** 2026-03-09 15:46:47.448803 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-03-09 15:46:47.692707 | controller | 2026-03-09 15:46:47.692742 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-03-09 15:46:47.692750 | controller | Monday 09 March 2026 15:46:47 +0000 (0:00:00.061) 0:02:28.472 ********** 2026-03-09 15:46:47.692762 | controller | ok: [instance] => (item=crc) 2026-03-09 15:46:47.692800 | controller | 2026-03-09 15:46:47.692920 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-03-09 15:46:47.692939 | controller | Monday 09 March 2026 15:46:47 +0000 (0:00:00.244) 0:02:28.717 ********** 2026-03-09 15:46:49.761255 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-03-09 15:46:50.312978 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-03-09 15:46:50.313014 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-03-09 15:46:50.313023 | controller | 2026-03-09 15:46:50.313031 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-03-09 15:46:50.313043 | controller | Monday 09 March 2026 15:46:49 +0000 (0:00:02.068) 0:02:30.785 ********** 2026-03-09 15:46:50.313055 | controller | changed: [instance] 2026-03-09 15:46:50.786593 | controller | 2026-03-09 15:46:50.786641 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-03-09 15:46:50.786652 | controller | Monday 09 March 2026 15:46:50 +0000 (0:00:00.551) 0:02:31.337 ********** 2026-03-09 15:46:50.786664 | controller | changed: [instance] 2026-03-09 15:46:51.289487 | controller | 2026-03-09 15:46:51.289525 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-03-09 15:46:51.289534 | controller | Monday 09 March 2026 15:46:50 +0000 (0:00:00.473) 0:02:31.810 ********** 2026-03-09 15:46:51.289545 | controller | changed: [instance] 2026-03-09 15:46:52.021746 | controller | 2026-03-09 15:46:52.021791 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-03-09 15:46:52.021799 | controller | Monday 09 March 2026 15:46:51 +0000 (0:00:00.502) 0:02:32.313 ********** 2026-03-09 15:46:52.021811 | controller | changed: [instance] => (item=compute-0.utility) 2026-03-09 15:46:52.022369 | controller | changed: [instance] => (item=controller-0.utility) 2026-03-09 15:47:14.989877 | controller | changed: [instance] => (item=crc-0.utility) 2026-03-09 15:47:14.989919 | controller | 2026-03-09 15:47:14.989929 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-03-09 15:47:14.989941 | controller | Monday 09 March 2026 15:46:52 +0000 (0:00:00.732) 0:02:33.046 ********** 2026-03-09 15:47:14.989953 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-03-09 15:47:14.989970 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-03-09 15:47:14.989976 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-03-09 15:47:14.989982 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-03-09 15:47:14.989987 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-03-09 15:47:14.989994 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-03-09 15:47:14.990027 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-03-09 15:47:14.990140 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j999027915172.22171', 'results_file': '/home/zuul/.ansible_async/j999027915172.22171', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-03-09 15:47:14.990257 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j260799483681.22188', 'results_file': '/home/zuul/.ansible_async/j260799483681.22188', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-03-09 15:47:14.990345 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j724787363308.22204', 'results_file': '/home/zuul/.ansible_async/j724787363308.22204', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-03-09 15:47:14.990440 | controller | 2026-03-09 15:47:14.990518 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-03-09 15:47:14.990647 | controller | Monday 09 March 2026 15:47:14 +0000 (0:00:22.966) 0:02:56.013 ********** 2026-03-09 15:47:15.111848 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-03-09 15:47:15.136962 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-03-09 15:47:15.136985 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-03-09 15:47:15.136993 | controller | 2026-03-09 15:47:15.136999 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-03-09 15:47:15.137006 | controller | Monday 09 March 2026 15:47:15 +0000 (0:00:00.122) 0:02:56.135 ********** 2026-03-09 15:47:15.137015 | controller | skipping: [instance] 2026-03-09 15:47:15.176448 | controller | 2026-03-09 15:47:15.176466 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-03-09 15:47:15.176474 | controller | Monday 09 March 2026 15:47:15 +0000 (0:00:00.025) 0:02:56.161 ********** 2026-03-09 15:47:15.176483 | controller | 2026-03-09 15:47:15.176567 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-03-09 15:47:15.176578 | controller | Monday 09 March 2026 15:47:15 +0000 (0:00:00.039) 0:02:56.201 ********** 2026-03-09 15:47:15.258136 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-03-09 15:47:15.496102 | controller | 2026-03-09 15:47:15.496134 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-03-09 15:47:15.496148 | controller | Monday 09 March 2026 15:47:15 +0000 (0:00:00.081) 0:02:56.282 ********** 2026-03-09 15:47:15.496159 | controller | changed: [instance] 2026-03-09 15:47:15.496307 | controller | 2026-03-09 15:47:15.496477 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-03-09 15:47:15.496610 | controller | Monday 09 March 2026 15:47:15 +0000 (0:00:00.238) 0:02:56.520 ********** 2026-03-09 15:47:15.713055 | controller | changed: [instance] 2026-03-09 15:47:16.118800 | controller | 2026-03-09 15:47:16.118835 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-03-09 15:47:16.118843 | controller | Monday 09 March 2026 15:47:15 +0000 (0:00:00.216) 0:02:56.737 ********** 2026-03-09 15:47:16.118861 | controller | changed: [instance] 2026-03-09 15:47:16.118878 | controller | 2026-03-09 15:47:16.118884 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-03-09 15:47:16.118892 | controller | Monday 09 March 2026 15:47:16 +0000 (0:00:00.405) 0:02:57.142 ********** 2026-03-09 15:47:16.146445 | controller | skipping: [instance] 2026-03-09 15:47:16.146499 | controller | 2026-03-09 15:47:16.146602 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-03-09 15:47:16.146720 | controller | Monday 09 March 2026 15:47:16 +0000 (0:00:00.027) 0:02:57.170 ********** 2026-03-09 15:47:16.174091 | controller | skipping: [instance] 2026-03-09 15:47:16.174152 | controller | 2026-03-09 15:47:16.174250 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-03-09 15:47:16.174344 | controller | Monday 09 March 2026 15:47:16 +0000 (0:00:00.027) 0:02:57.198 ********** 2026-03-09 15:47:16.221424 | controller | skipping: [instance] 2026-03-09 15:47:16.268003 | controller | 2026-03-09 15:47:16.268036 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-03-09 15:47:16.268044 | controller | Monday 09 March 2026 15:47:16 +0000 (0:00:00.047) 0:02:57.245 ********** 2026-03-09 15:47:16.268055 | controller | skipping: [instance] 2026-03-09 15:47:16.291323 | controller | 2026-03-09 15:47:16.291357 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-03-09 15:47:16.291365 | controller | Monday 09 March 2026 15:47:16 +0000 (0:00:00.046) 0:02:57.292 ********** 2026-03-09 15:47:16.291376 | controller | skipping: [instance] 2026-03-09 15:47:16.330614 | controller | 2026-03-09 15:47:16.330664 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-03-09 15:47:16.330672 | controller | Monday 09 March 2026 15:47:16 +0000 (0:00:00.023) 0:02:57.315 ********** 2026-03-09 15:47:16.330682 | controller | 2026-03-09 15:47:16.411306 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-03-09 15:47:16.411339 | controller | Monday 09 March 2026 15:47:16 +0000 (0:00:00.039) 0:02:57.354 ********** 2026-03-09 15:47:16.411356 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-03-09 15:47:16.634311 | controller | 2026-03-09 15:47:16.634342 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-03-09 15:47:16.634351 | controller | Monday 09 March 2026 15:47:16 +0000 (0:00:00.080) 0:02:57.435 ********** 2026-03-09 15:47:16.634361 | controller | ok: [instance] 2026-03-09 15:47:16.866571 | controller | 2026-03-09 15:47:16.866605 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-03-09 15:47:16.866613 | controller | Monday 09 March 2026 15:47:16 +0000 (0:00:00.223) 0:02:57.658 ********** 2026-03-09 15:47:16.866624 | controller | ok: [instance] 2026-03-09 15:47:17.258559 | controller | 2026-03-09 15:47:17.258591 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-03-09 15:47:17.258599 | controller | Monday 09 March 2026 15:47:16 +0000 (0:00:00.232) 0:02:57.890 ********** 2026-03-09 15:47:17.258615 | controller | changed: [instance] 2026-03-09 15:47:17.290011 | controller | 2026-03-09 15:47:17.290045 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-03-09 15:47:17.290053 | controller | Monday 09 March 2026 15:47:17 +0000 (0:00:00.392) 0:02:58.282 ********** 2026-03-09 15:47:17.290063 | controller | skipping: [instance] 2026-03-09 15:47:17.326980 | controller | 2026-03-09 15:47:17.327014 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-03-09 15:47:17.327022 | controller | Monday 09 March 2026 15:47:17 +0000 (0:00:00.030) 0:02:58.313 ********** 2026-03-09 15:47:17.327032 | controller | skipping: [instance] 2026-03-09 15:47:18.986954 | controller | 2026-03-09 15:47:18.986993 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-03-09 15:47:18.987001 | controller | Monday 09 March 2026 15:47:17 +0000 (0:00:00.037) 0:02:58.350 ********** 2026-03-09 15:47:18.987011 | controller | changed: [instance -> controller-0.instance] 2026-03-09 15:47:20.083344 | controller | 2026-03-09 15:47:20.083380 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-03-09 15:47:20.083389 | controller | Monday 09 March 2026 15:47:18 +0000 (0:00:01.660) 0:03:00.011 ********** 2026-03-09 15:47:20.083399 | controller | changed: [instance -> controller-0.instance] 2026-03-09 15:47:20.126040 | controller | 2026-03-09 15:47:20.126065 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-03-09 15:47:20.126072 | controller | Monday 09 March 2026 15:47:20 +0000 (0:00:01.096) 0:03:01.107 ********** 2026-03-09 15:47:20.126081 | controller | 2026-03-09 15:47:20.332306 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-03-09 15:47:20.332330 | controller | Monday 09 March 2026 15:47:20 +0000 (0:00:00.043) 0:03:01.150 ********** 2026-03-09 15:47:20.332342 | controller | ok: [instance] 2026-03-09 15:47:20.356419 | controller | 2026-03-09 15:47:20.356438 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-03-09 15:47:20.356445 | controller | Monday 09 March 2026 15:47:20 +0000 (0:00:00.205) 0:03:01.356 ********** 2026-03-09 15:47:20.356454 | controller | ok: [instance] 2026-03-09 15:47:20.384573 | controller | 2026-03-09 15:47:20.384591 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-03-09 15:47:20.384598 | controller | Monday 09 March 2026 15:47:20 +0000 (0:00:00.024) 0:03:01.380 ********** 2026-03-09 15:47:20.384607 | controller | skipping: [instance] 2026-03-09 15:47:20.433319 | controller | 2026-03-09 15:47:20.433337 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-03-09 15:47:20.433344 | controller | Monday 09 March 2026 15:47:20 +0000 (0:00:00.028) 0:03:01.408 ********** 2026-03-09 15:47:20.433353 | controller | 2026-03-09 15:47:20.516952 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-03-09 15:47:20.516989 | controller | Monday 09 March 2026 15:47:20 +0000 (0:00:00.048) 0:03:01.457 ********** 2026-03-09 15:47:20.517007 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-03-09 15:47:20.755871 | controller | 2026-03-09 15:47:20.755905 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-03-09 15:47:20.755913 | controller | Monday 09 March 2026 15:47:20 +0000 (0:00:00.083) 0:03:01.540 ********** 2026-03-09 15:47:20.755924 | controller | ok: [instance] 2026-03-09 15:47:20.986358 | controller | 2026-03-09 15:47:20.986403 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-03-09 15:47:20.986411 | controller | Monday 09 March 2026 15:47:20 +0000 (0:00:00.238) 0:03:01.779 ********** 2026-03-09 15:47:20.986422 | controller | ok: [instance] 2026-03-09 15:47:21.390083 | controller | 2026-03-09 15:47:21.390124 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-03-09 15:47:21.390146 | controller | Monday 09 March 2026 15:47:20 +0000 (0:00:00.230) 0:03:02.010 ********** 2026-03-09 15:47:21.390157 | controller | changed: [instance] 2026-03-09 15:47:22.183342 | controller | 2026-03-09 15:47:22.183373 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-03-09 15:47:22.183381 | controller | Monday 09 March 2026 15:47:21 +0000 (0:00:00.403) 0:03:02.414 ********** 2026-03-09 15:47:22.183392 | controller | changed: [instance] 2026-03-09 15:47:22.214945 | controller | 2026-03-09 15:47:22.214973 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-03-09 15:47:22.214981 | controller | Monday 09 March 2026 15:47:22 +0000 (0:00:00.793) 0:03:03.207 ********** 2026-03-09 15:47:22.214991 | controller | skipping: [instance] 2026-03-09 15:47:22.265691 | controller | 2026-03-09 15:47:22.265715 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-03-09 15:47:22.265723 | controller | Monday 09 March 2026 15:47:22 +0000 (0:00:00.031) 0:03:03.239 ********** 2026-03-09 15:47:22.265741 | controller | skipping: [instance] 2026-03-09 15:47:22.312904 | controller | 2026-03-09 15:47:22.312926 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-03-09 15:47:22.312934 | controller | Monday 09 March 2026 15:47:22 +0000 (0:00:00.050) 0:03:03.290 ********** 2026-03-09 15:47:22.312943 | controller | skipping: [instance] 2026-03-09 15:47:22.363861 | controller | 2026-03-09 15:47:22.363883 | controller | TASK [Create VBMC entity] ****************************************************** 2026-03-09 15:47:22.363891 | controller | Monday 09 March 2026 15:47:22 +0000 (0:00:00.047) 0:03:03.337 ********** 2026-03-09 15:47:22.363901 | controller | skipping: [instance] => (item=compute-0) 2026-03-09 15:47:22.605501 | controller | skipping: [instance] => (item=controller-0) 2026-03-09 15:47:22.605534 | controller | skipping: [instance] => (item=crc-0) 2026-03-09 15:47:22.605542 | controller | skipping: [instance] 2026-03-09 15:47:22.605549 | controller | 2026-03-09 15:47:22.605555 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-03-09 15:47:22.605561 | controller | Monday 09 March 2026 15:47:22 +0000 (0:00:00.050) 0:03:03.387 ********** 2026-03-09 15:47:22.605571 | controller | ok: [instance] 2026-03-09 15:47:22.984214 | controller | 2026-03-09 15:47:22.984245 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-03-09 15:47:22.984253 | controller | Monday 09 March 2026 15:47:22 +0000 (0:00:00.241) 0:03:03.629 ********** 2026-03-09 15:47:22.984263 | controller | changed: [instance] 2026-03-09 15:47:23.030200 | controller | 2026-03-09 15:47:23.030218 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-03-09 15:47:23.030225 | controller | Monday 09 March 2026 15:47:22 +0000 (0:00:00.378) 0:03:04.008 ********** 2026-03-09 15:47:23.030234 | controller | skipping: [instance] 2026-03-09 15:47:23.072220 | controller | 2026-03-09 15:47:23.072240 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-03-09 15:47:23.072248 | controller | Monday 09 March 2026 15:47:23 +0000 (0:00:00.046) 0:03:04.054 ********** 2026-03-09 15:47:23.072257 | controller | skipping: [instance] 2026-03-09 15:47:23.113058 | controller | 2026-03-09 15:47:23.113078 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-03-09 15:47:23.113085 | controller | Monday 09 March 2026 15:47:23 +0000 (0:00:00.042) 0:03:04.096 ********** 2026-03-09 15:47:23.113095 | controller | skipping: [instance] 2026-03-09 15:47:23.926209 | controller | 2026-03-09 15:47:23.926240 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-03-09 15:47:23.926247 | controller | Monday 09 March 2026 15:47:23 +0000 (0:00:00.040) 0:03:04.137 ********** 2026-03-09 15:47:23.926275 | controller | changed: [instance] 2026-03-09 15:47:24.755894 | controller | 2026-03-09 15:47:24.755926 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-03-09 15:47:24.755935 | controller | Monday 09 March 2026 15:47:23 +0000 (0:00:00.812) 0:03:04.950 ********** 2026-03-09 15:47:24.755945 | controller | changed: [instance] 2026-03-09 15:47:24.798261 | controller | 2026-03-09 15:47:24.798286 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-03-09 15:47:24.798316 | controller | Monday 09 March 2026 15:47:24 +0000 (0:00:00.829) 0:03:05.779 ********** 2026-03-09 15:47:24.798327 | controller | skipping: [instance] 2026-03-09 15:47:24.798495 | controller | 2026-03-09 15:47:24.798509 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-03-09 15:47:24.798662 | controller | Monday 09 March 2026 15:47:24 +0000 (0:00:00.042) 0:03:05.822 ********** 2026-03-09 15:47:24.860156 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-03-09 15:47:24.903282 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-03-09 15:47:24.903313 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-03-09 15:47:24.903320 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-03-09 15:47:24.903325 | controller | 2026-03-09 15:47:24.903331 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-03-09 15:47:24.903336 | controller | Monday 09 March 2026 15:47:24 +0000 (0:00:00.061) 0:03:05.884 ********** 2026-03-09 15:47:24.903344 | controller | skipping: [instance] 2026-03-09 15:47:24.938562 | controller | 2026-03-09 15:47:24.938578 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-03-09 15:47:24.938585 | controller | Monday 09 March 2026 15:47:24 +0000 (0:00:00.043) 0:03:05.927 ********** 2026-03-09 15:47:24.938594 | controller | skipping: [instance] 2026-03-09 15:47:24.974143 | controller | 2026-03-09 15:47:24.974160 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-03-09 15:47:24.974167 | controller | Monday 09 March 2026 15:47:24 +0000 (0:00:00.035) 0:03:05.963 ********** 2026-03-09 15:47:24.974175 | controller | skipping: [instance] 2026-03-09 15:47:25.011886 | controller | 2026-03-09 15:47:25.011903 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-03-09 15:47:25.011910 | controller | Monday 09 March 2026 15:47:24 +0000 (0:00:00.035) 0:03:05.998 ********** 2026-03-09 15:47:25.011918 | controller | skipping: [instance] 2026-03-09 15:47:25.653452 | controller | 2026-03-09 15:47:25.653485 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-03-09 15:47:25.653493 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.037) 0:03:06.036 ********** 2026-03-09 15:47:25.653504 | controller | changed: [instance] 2026-03-09 15:47:25.653761 | controller | 2026-03-09 15:47:25.653925 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-03-09 15:47:25.654073 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.641) 0:03:06.677 ********** 2026-03-09 15:47:25.686224 | controller | skipping: [instance] 2026-03-09 15:47:25.724007 | controller | 2026-03-09 15:47:25.724027 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-03-09 15:47:25.724034 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.032) 0:03:06.710 ********** 2026-03-09 15:47:25.724043 | controller | skipping: [instance] 2026-03-09 15:47:25.756839 | controller | 2026-03-09 15:47:25.756858 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-03-09 15:47:25.756866 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.035) 0:03:06.745 ********** 2026-03-09 15:47:25.756875 | controller | skipping: [instance] 2026-03-09 15:47:25.791648 | controller | 2026-03-09 15:47:25.791669 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-03-09 15:47:25.791676 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.035) 0:03:06.781 ********** 2026-03-09 15:47:25.791685 | controller | skipping: [instance] 2026-03-09 15:47:25.826504 | controller | 2026-03-09 15:47:25.826529 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-03-09 15:47:25.826537 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.034) 0:03:06.816 ********** 2026-03-09 15:47:25.826547 | controller | skipping: [instance] 2026-03-09 15:47:25.862998 | controller | 2026-03-09 15:47:25.863020 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-03-09 15:47:25.863027 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.034) 0:03:06.850 ********** 2026-03-09 15:47:25.863037 | controller | skipping: [instance] 2026-03-09 15:47:25.895945 | controller | 2026-03-09 15:47:25.895963 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-03-09 15:47:25.895970 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.036) 0:03:06.887 ********** 2026-03-09 15:47:25.895979 | controller | skipping: [instance] 2026-03-09 15:47:25.896303 | controller | 2026-03-09 15:47:25.932345 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-03-09 15:47:25.932364 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.033) 0:03:06.920 ********** 2026-03-09 15:47:25.932374 | controller | skipping: [instance] 2026-03-09 15:47:25.970335 | controller | 2026-03-09 15:47:25.970359 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-03-09 15:47:25.970373 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.036) 0:03:06.956 ********** 2026-03-09 15:47:25.970386 | controller | skipping: [instance] 2026-03-09 15:47:26.013757 | controller | 2026-03-09 15:47:26.013778 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-03-09 15:47:26.013786 | controller | Monday 09 March 2026 15:47:25 +0000 (0:00:00.035) 0:03:06.991 ********** 2026-03-09 15:47:26.013794 | controller | skipping: [instance] 2026-03-09 15:47:26.043302 | controller | 2026-03-09 15:47:26.043328 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-03-09 15:47:26.043336 | controller | Monday 09 March 2026 15:47:26 +0000 (0:00:00.046) 0:03:07.038 ********** 2026-03-09 15:47:26.043345 | controller | skipping: [instance] 2026-03-09 15:47:26.196056 | controller | 2026-03-09 15:47:26.196079 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-03-09 15:47:26.196087 | controller | Monday 09 March 2026 15:47:26 +0000 (0:00:00.029) 0:03:07.067 ********** 2026-03-09 15:47:26.196096 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-03-09 15:47:27.692720 | controller | 2026-03-09 15:47:27.692782 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-03-09 15:47:27.692790 | controller | Monday 09 March 2026 15:47:26 +0000 (0:00:00.152) 0:03:07.220 ********** 2026-03-09 15:47:27.692805 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-03-09 15:47:27.692893 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-03-09 15:47:27.692902 | controller | 2026-03-09 15:47:27.692910 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-03-09 15:47:27.692981 | controller | Monday 09 March 2026 15:47:27 +0000 (0:00:01.496) 0:03:08.716 ********** 2026-03-09 15:47:27.714391 | controller | skipping: [instance] 2026-03-09 15:47:27.714454 | controller | 2026-03-09 15:47:27.714557 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-03-09 15:47:27.714666 | controller | Monday 09 March 2026 15:47:27 +0000 (0:00:00.022) 0:03:08.739 ********** 2026-03-09 15:47:28.363109 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:28.363162 | controller | 2026-03-09 15:47:28.363257 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-03-09 15:47:28.363342 | controller | Monday 09 March 2026 15:47:28 +0000 (0:00:00.647) 0:03:09.386 ********** 2026-03-09 15:47:28.405337 | controller | skipping: [instance] 2026-03-09 15:47:28.405466 | controller | 2026-03-09 15:47:28.405554 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-03-09 15:47:28.405664 | controller | Monday 09 March 2026 15:47:28 +0000 (0:00:00.042) 0:03:09.429 ********** 2026-03-09 15:47:28.452417 | controller | skipping: [instance] 2026-03-09 15:47:28.452571 | controller | 2026-03-09 15:47:28.452808 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-03-09 15:47:28.452981 | controller | Monday 09 March 2026 15:47:28 +0000 (0:00:00.047) 0:03:09.476 ********** 2026-03-09 15:47:28.492102 | controller | skipping: [instance] 2026-03-09 15:47:28.492271 | controller | 2026-03-09 15:47:28.492396 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-03-09 15:47:28.492481 | controller | Monday 09 March 2026 15:47:28 +0000 (0:00:00.039) 0:03:09.516 ********** 2026-03-09 15:47:28.544191 | controller | skipping: [instance] 2026-03-09 15:47:28.544349 | controller | 2026-03-09 15:47:28.544486 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-03-09 15:47:28.544572 | controller | Monday 09 March 2026 15:47:28 +0000 (0:00:00.051) 0:03:09.568 ********** 2026-03-09 15:47:28.588338 | controller | skipping: [instance] 2026-03-09 15:47:28.588447 | controller | 2026-03-09 15:47:28.588550 | controller | TASK [reproducer : Install repos] ********************************************** 2026-03-09 15:47:28.588644 | controller | Monday 09 March 2026 15:47:28 +0000 (0:00:00.044) 0:03:09.612 ********** 2026-03-09 15:47:28.633512 | controller | skipping: [instance] 2026-03-09 15:47:28.633652 | controller | 2026-03-09 15:47:28.633768 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-03-09 15:47:28.633862 | controller | Monday 09 March 2026 15:47:28 +0000 (0:00:00.045) 0:03:09.657 ********** 2026-03-09 15:47:28.677851 | controller | skipping: [instance] 2026-03-09 15:47:28.677966 | controller | 2026-03-09 15:47:28.678217 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-03-09 15:47:28.678303 | controller | Monday 09 March 2026 15:47:28 +0000 (0:00:00.044) 0:03:09.702 ********** 2026-03-09 15:47:28.725311 | controller | skipping: [instance] 2026-03-09 15:47:28.725447 | controller | 2026-03-09 15:47:28.725671 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-03-09 15:47:28.725832 | controller | Monday 09 March 2026 15:47:28 +0000 (0:00:00.047) 0:03:09.749 ********** 2026-03-09 15:47:29.950339 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:29.950392 | controller | 2026-03-09 15:47:29.950651 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-03-09 15:47:31.057743 | controller | Monday 09 March 2026 15:47:29 +0000 (0:00:01.224) 0:03:10.974 ********** 2026-03-09 15:47:31.057796 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:31.775512 | controller | 2026-03-09 15:47:31.775545 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-03-09 15:47:31.775553 | controller | Monday 09 March 2026 15:47:31 +0000 (0:00:01.107) 0:03:12.081 ********** 2026-03-09 15:47:31.775563 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:32.736226 | controller | 2026-03-09 15:47:32.736258 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-03-09 15:47:32.736266 | controller | Monday 09 March 2026 15:47:31 +0000 (0:00:00.717) 0:03:12.799 ********** 2026-03-09 15:47:32.736276 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:33.805792 | controller | 2026-03-09 15:47:33.805827 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-03-09 15:47:33.805836 | controller | Monday 09 March 2026 15:47:32 +0000 (0:00:00.960) 0:03:13.760 ********** 2026-03-09 15:47:33.805847 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-03-09 15:47:33.805873 | controller | skipping: [instance] => (item=compute-0) 2026-03-09 15:47:33.805882 | controller | skipping: [instance] => (item=controller-0) 2026-03-09 15:47:33.806508 | controller | skipping: [instance] => (item=crc-0) 2026-03-09 15:47:34.451240 | controller | 2026-03-09 15:47:34.451279 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-03-09 15:47:34.451287 | controller | Monday 09 March 2026 15:47:33 +0000 (0:00:01.069) 0:03:14.829 ********** 2026-03-09 15:47:34.451299 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-03-09 15:47:34.451324 | controller | skipping: [instance] => (item=compute-0) 2026-03-09 15:47:34.451330 | controller | skipping: [instance] => (item=controller-0) 2026-03-09 15:47:34.451336 | controller | skipping: [instance] => (item=crc-0) 2026-03-09 15:47:34.451353 | controller | 2026-03-09 15:47:34.451551 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-03-09 15:47:36.202732 | controller | Monday 09 March 2026 15:47:34 +0000 (0:00:00.645) 0:03:15.475 ********** 2026-03-09 15:47:36.202768 | controller | skipping: [instance] => (item=instance) 2026-03-09 15:47:36.202797 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-03-09 15:47:36.203166 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-03-09 15:47:36.203280 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-03-09 15:47:36.203310 | controller | 2026-03-09 15:47:36.203318 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-03-09 15:47:36.203329 | controller | Monday 09 March 2026 15:47:36 +0000 (0:00:01.751) 0:03:17.227 ********** 2026-03-09 15:47:36.819936 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:37.785813 | controller | 2026-03-09 15:47:37.785844 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-03-09 15:47:37.785852 | controller | Monday 09 March 2026 15:47:36 +0000 (0:00:00.616) 0:03:17.843 ********** 2026-03-09 15:47:37.785862 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:38.742426 | controller | 2026-03-09 15:47:38.742473 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-03-09 15:47:38.742481 | controller | Monday 09 March 2026 15:47:37 +0000 (0:00:00.965) 0:03:18.809 ********** 2026-03-09 15:47:38.742493 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:38.776611 | controller | 2026-03-09 15:47:38.776644 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-03-09 15:47:38.776655 | controller | Monday 09 March 2026 15:47:38 +0000 (0:00:00.956) 0:03:19.766 ********** 2026-03-09 15:47:38.776664 | controller | skipping: [instance] 2026-03-09 15:47:39.342570 | controller | 2026-03-09 15:47:39.342600 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-03-09 15:47:39.342608 | controller | Monday 09 March 2026 15:47:38 +0000 (0:00:00.034) 0:03:19.801 ********** 2026-03-09 15:47:39.342618 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:39.913086 | controller | 2026-03-09 15:47:39.913120 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-03-09 15:47:39.913128 | controller | Monday 09 March 2026 15:47:39 +0000 (0:00:00.565) 0:03:20.366 ********** 2026-03-09 15:47:39.913138 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:39.954620 | controller | 2026-03-09 15:47:39.954656 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-03-09 15:47:39.954664 | controller | Monday 09 March 2026 15:47:39 +0000 (0:00:00.570) 0:03:20.937 ********** 2026-03-09 15:47:39.954673 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:40.019538 | controller | 2026-03-09 15:47:40.019556 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-03-09 15:47:40.019563 | controller | Monday 09 March 2026 15:47:39 +0000 (0:00:00.041) 0:03:20.979 ********** 2026-03-09 15:47:40.019573 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-03-09 15:47:40.075959 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-03-09 15:47:40.075978 | controller | 2026-03-09 15:47:40.075985 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-03-09 15:47:40.075995 | controller | Monday 09 March 2026 15:47:40 +0000 (0:00:00.064) 0:03:21.043 ********** 2026-03-09 15:47:40.076004 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-09 15:47:40.123676 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-03-09 15:47:40.123698 | controller | 2026-03-09 15:47:40.123705 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-03-09 15:47:40.123723 | controller | Monday 09 March 2026 15:47:40 +0000 (0:00:00.056) 0:03:21.100 ********** 2026-03-09 15:47:40.123732 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-09 15:47:40.124039 | controller | _secret_file: '' 2026-03-09 15:47:40.124053 | controller | 2026-03-09 15:47:40.180671 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-03-09 15:47:40.180690 | controller | Monday 09 March 2026 15:47:40 +0000 (0:00:00.047) 0:03:21.148 ********** 2026-03-09 15:47:40.180701 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-09 15:47:40.181150 | controller | _secret_content: my-default-location-place 2026-03-09 15:47:40.229313 | controller | 2026-03-09 15:47:40.229331 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-03-09 15:47:40.229338 | controller | Monday 09 March 2026 15:47:40 +0000 (0:00:00.057) 0:03:21.205 ********** 2026-03-09 15:47:40.229347 | controller | skipping: [instance] 2026-03-09 15:47:40.276451 | controller | 2026-03-09 15:47:40.276470 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-03-09 15:47:40.276477 | controller | Monday 09 March 2026 15:47:40 +0000 (0:00:00.048) 0:03:21.253 ********** 2026-03-09 15:47:40.276486 | controller | skipping: [instance] 2026-03-09 15:47:40.276621 | controller | 2026-03-09 15:47:40.276802 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-03-09 15:47:40.276948 | controller | Monday 09 March 2026 15:47:40 +0000 (0:00:00.047) 0:03:21.301 ********** 2026-03-09 15:47:40.326887 | controller | skipping: [instance] 2026-03-09 15:47:40.327031 | controller | 2026-03-09 15:47:40.327163 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-03-09 15:47:40.327290 | controller | Monday 09 March 2026 15:47:40 +0000 (0:00:00.050) 0:03:21.351 ********** 2026-03-09 15:47:41.280497 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:41.335317 | controller | 2026-03-09 15:47:41.335338 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-03-09 15:47:41.335346 | controller | Monday 09 March 2026 15:47:41 +0000 (0:00:00.952) 0:03:22.303 ********** 2026-03-09 15:47:41.335355 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-09 15:47:41.382678 | controller | _secret_dest: /home/zuul/ipmi-things 2026-03-09 15:47:41.382696 | controller | 2026-03-09 15:47:41.382703 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-03-09 15:47:41.382722 | controller | Monday 09 March 2026 15:47:41 +0000 (0:00:00.055) 0:03:22.359 ********** 2026-03-09 15:47:41.382731 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-09 15:47:41.382947 | controller | _secret_file: /tmp/ipmi-things 2026-03-09 15:47:41.382959 | controller | 2026-03-09 15:47:41.382967 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-03-09 15:47:41.429498 | controller | Monday 09 March 2026 15:47:41 +0000 (0:00:00.047) 0:03:22.407 ********** 2026-03-09 15:47:41.429518 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-03-09 15:47:41.484669 | controller | _secret_content: '' 2026-03-09 15:47:41.484687 | controller | 2026-03-09 15:47:41.484694 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-03-09 15:47:41.484700 | controller | Monday 09 March 2026 15:47:41 +0000 (0:00:00.046) 0:03:22.453 ********** 2026-03-09 15:47:41.484718 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-03-09 15:47:41.484792 | controller | msg: All assertions passed 2026-03-09 15:47:41.484801 | controller | 2026-03-09 15:47:41.484806 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-03-09 15:47:41.484814 | controller | Monday 09 March 2026 15:47:41 +0000 (0:00:00.055) 0:03:22.509 ********** 2026-03-09 15:47:42.059148 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:43.019779 | controller | 2026-03-09 15:47:43.019822 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-03-09 15:47:43.019836 | controller | Monday 09 March 2026 15:47:42 +0000 (0:00:00.574) 0:03:23.083 ********** 2026-03-09 15:47:43.019850 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:43.076180 | controller | 2026-03-09 15:47:43.076205 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-03-09 15:47:43.076213 | controller | Monday 09 March 2026 15:47:43 +0000 (0:00:00.959) 0:03:24.042 ********** 2026-03-09 15:47:43.076222 | controller | skipping: [instance] 2026-03-09 15:47:43.683576 | controller | 2026-03-09 15:47:43.683607 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-03-09 15:47:43.683615 | controller | Monday 09 March 2026 15:47:43 +0000 (0:00:00.057) 0:03:24.100 ********** 2026-03-09 15:47:43.683651 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:47:44.269246 | controller | 2026-03-09 15:47:44.269273 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-03-09 15:47:44.269281 | controller | Monday 09 March 2026 15:47:43 +0000 (0:00:00.607) 0:03:24.707 ********** 2026-03-09 15:47:44.269296 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:34.840217 | controller | 2026-03-09 15:48:34.840249 | controller | TASK [reproducer : Check package install status] ******************************* 2026-03-09 15:48:34.840258 | controller | Monday 09 March 2026 15:47:44 +0000 (0:00:00.585) 0:03:25.293 ********** 2026-03-09 15:48:34.840268 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-03-09 15:48:35.525918 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-03-09 15:48:35.525949 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-03-09 15:48:35.525957 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-03-09 15:48:35.525962 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-03-09 15:48:35.525968 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-03-09 15:48:35.525973 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-03-09 15:48:35.525979 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2026-03-09 15:48:35.525984 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2026-03-09 15:48:35.525990 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:35.525996 | controller | 2026-03-09 15:48:35.526001 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-03-09 15:48:35.526007 | controller | Monday 09 March 2026 15:48:34 +0000 (0:00:50.569) 0:04:15.862 ********** 2026-03-09 15:48:35.526017 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:38.042482 | controller | 2026-03-09 15:48:38.042514 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-03-09 15:48:38.042522 | controller | Monday 09 March 2026 15:48:35 +0000 (0:00:00.687) 0:04:16.550 ********** 2026-03-09 15:48:38.042533 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:38.091885 | controller | 2026-03-09 15:48:38.091906 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-03-09 15:48:38.091914 | controller | Monday 09 March 2026 15:48:38 +0000 (0:00:02.516) 0:04:19.066 ********** 2026-03-09 15:48:38.091923 | controller | skipping: [instance] 2026-03-09 15:48:38.140004 | controller | 2026-03-09 15:48:38.140023 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-03-09 15:48:38.140030 | controller | Monday 09 March 2026 15:48:38 +0000 (0:00:00.049) 0:04:19.116 ********** 2026-03-09 15:48:38.140039 | controller | skipping: [instance] 2026-03-09 15:48:38.797818 | controller | 2026-03-09 15:48:38.797850 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-03-09 15:48:38.797858 | controller | Monday 09 March 2026 15:48:38 +0000 (0:00:00.048) 0:04:19.164 ********** 2026-03-09 15:48:38.797876 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:39.381861 | controller | 2026-03-09 15:48:39.381888 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-03-09 15:48:39.381898 | controller | Monday 09 March 2026 15:48:38 +0000 (0:00:00.657) 0:04:19.821 ********** 2026-03-09 15:48:39.381910 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:39.381979 | controller | 2026-03-09 15:48:39.381987 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-03-09 15:48:39.381994 | controller | Monday 09 March 2026 15:48:39 +0000 (0:00:00.583) 0:04:20.405 ********** 2026-03-09 15:48:39.685421 | controller | changed: [instance] 2026-03-09 15:48:40.358472 | controller | 2026-03-09 15:48:40.358503 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-03-09 15:48:40.358511 | controller | Monday 09 March 2026 15:48:39 +0000 (0:00:00.304) 0:04:20.709 ********** 2026-03-09 15:48:40.358521 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:41.376855 | controller | 2026-03-09 15:48:41.376892 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-03-09 15:48:41.376900 | controller | Monday 09 March 2026 15:48:40 +0000 (0:00:00.672) 0:04:21.382 ********** 2026-03-09 15:48:41.376925 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:41.422464 | controller | 2026-03-09 15:48:41.422484 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-03-09 15:48:41.422493 | controller | Monday 09 March 2026 15:48:41 +0000 (0:00:01.018) 0:04:22.400 ********** 2026-03-09 15:48:41.422502 | controller | skipping: [instance] 2026-03-09 15:48:41.467971 | controller | 2026-03-09 15:48:41.467990 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-03-09 15:48:41.467998 | controller | Monday 09 March 2026 15:48:41 +0000 (0:00:00.045) 0:04:22.446 ********** 2026-03-09 15:48:41.468007 | controller | skipping: [instance] 2026-03-09 15:48:41.505612 | controller | 2026-03-09 15:48:41.505644 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-03-09 15:48:41.505654 | controller | Monday 09 March 2026 15:48:41 +0000 (0:00:00.045) 0:04:22.492 ********** 2026-03-09 15:48:41.505668 | controller | skipping: [instance] 2026-03-09 15:48:41.558440 | controller | 2026-03-09 15:48:41.558458 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-03-09 15:48:41.558465 | controller | Monday 09 March 2026 15:48:41 +0000 (0:00:00.037) 0:04:22.530 ********** 2026-03-09 15:48:41.558473 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:41.596817 | controller | 2026-03-09 15:48:41.596835 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-03-09 15:48:41.596842 | controller | Monday 09 March 2026 15:48:41 +0000 (0:00:00.052) 0:04:22.583 ********** 2026-03-09 15:48:41.596851 | controller | skipping: [instance] 2026-03-09 15:48:41.636308 | controller | 2026-03-09 15:48:41.636329 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-03-09 15:48:41.636336 | controller | Monday 09 March 2026 15:48:41 +0000 (0:00:00.038) 0:04:22.621 ********** 2026-03-09 15:48:41.636344 | controller | skipping: [instance] 2026-03-09 15:48:41.673768 | controller | 2026-03-09 15:48:41.673790 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-03-09 15:48:41.673798 | controller | Monday 09 March 2026 15:48:41 +0000 (0:00:00.039) 0:04:22.660 ********** 2026-03-09 15:48:41.673807 | controller | skipping: [instance] 2026-03-09 15:48:42.306734 | controller | 2026-03-09 15:48:42.306765 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-03-09 15:48:42.306773 | controller | Monday 09 March 2026 15:48:41 +0000 (0:00:00.037) 0:04:22.698 ********** 2026-03-09 15:48:42.306783 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:42.420447 | controller | 2026-03-09 15:48:42.420471 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-03-09 15:48:42.420482 | controller | Monday 09 March 2026 15:48:42 +0000 (0:00:00.632) 0:04:23.330 ********** 2026-03-09 15:48:42.420492 | controller | skipping: [instance] => (item=secret) 2026-03-09 15:48:43.566589 | controller | skipping: [instance] => (item=configmap) 2026-03-09 15:48:43.566652 | controller | skipping: [instance] => (item=pod) 2026-03-09 15:48:43.566665 | controller | skipping: [instance] => (item=service) 2026-03-09 15:48:43.566671 | controller | skipping: [instance] => (item=route) 2026-03-09 15:48:43.566677 | controller | skipping: [instance] 2026-03-09 15:48:43.566683 | controller | 2026-03-09 15:48:43.566689 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-03-09 15:48:43.566695 | controller | Monday 09 March 2026 15:48:42 +0000 (0:00:00.113) 0:04:23.444 ********** 2026-03-09 15:48:43.566704 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:44.677128 | controller | 2026-03-09 15:48:44.677160 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-03-09 15:48:44.677168 | controller | Monday 09 March 2026 15:48:43 +0000 (0:00:01.145) 0:04:24.590 ********** 2026-03-09 15:48:44.677178 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:44.720073 | controller | 2026-03-09 15:48:44.720093 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-03-09 15:48:44.720100 | controller | Monday 09 March 2026 15:48:44 +0000 (0:00:01.110) 0:04:25.701 ********** 2026-03-09 15:48:44.720109 | controller | skipping: [instance] 2026-03-09 15:48:44.761759 | controller | 2026-03-09 15:48:44.761788 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-03-09 15:48:44.761796 | controller | Monday 09 March 2026 15:48:44 +0000 (0:00:00.043) 0:04:25.744 ********** 2026-03-09 15:48:44.761807 | controller | skipping: [instance] 2026-03-09 15:48:44.836311 | controller | 2026-03-09 15:48:44.836335 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-03-09 15:48:44.836343 | controller | Monday 09 March 2026 15:48:44 +0000 (0:00:00.040) 0:04:25.785 ********** 2026-03-09 15:48:44.836352 | controller | skipping: [instance] => (item=secret) 2026-03-09 15:48:44.879352 | controller | skipping: [instance] => (item=configmap) 2026-03-09 15:48:44.879373 | controller | skipping: [instance] => (item=service) 2026-03-09 15:48:44.879381 | controller | skipping: [instance] => (item=route) 2026-03-09 15:48:44.879386 | controller | skipping: [instance] 2026-03-09 15:48:44.879393 | controller | 2026-03-09 15:48:44.879398 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-03-09 15:48:44.879404 | controller | Monday 09 March 2026 15:48:44 +0000 (0:00:00.074) 0:04:25.860 ********** 2026-03-09 15:48:44.879414 | controller | skipping: [instance] 2026-03-09 15:48:46.598592 | controller | 2026-03-09 15:48:46.598636 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-03-09 15:48:46.598648 | controller | Monday 09 March 2026 15:48:44 +0000 (0:00:00.043) 0:04:25.903 ********** 2026-03-09 15:48:46.598659 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:47.488024 | controller | 2026-03-09 15:48:47.488057 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-03-09 15:48:47.488065 | controller | Monday 09 March 2026 15:48:46 +0000 (0:00:01.718) 0:04:27.622 ********** 2026-03-09 15:48:47.488074 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:47.532235 | controller | 2026-03-09 15:48:47.532264 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-03-09 15:48:47.532272 | controller | Monday 09 March 2026 15:48:47 +0000 (0:00:00.889) 0:04:28.511 ********** 2026-03-09 15:48:47.532282 | controller | skipping: [instance] 2026-03-09 15:48:47.573100 | controller | 2026-03-09 15:48:47.573125 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-03-09 15:48:47.573136 | controller | Monday 09 March 2026 15:48:47 +0000 (0:00:00.044) 0:04:28.556 ********** 2026-03-09 15:48:47.573145 | controller | skipping: [instance] 2026-03-09 15:48:47.620994 | controller | 2026-03-09 15:48:47.621022 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-03-09 15:48:47.621029 | controller | Monday 09 March 2026 15:48:47 +0000 (0:00:00.041) 0:04:28.597 ********** 2026-03-09 15:48:47.621043 | controller | skipping: [instance] 2026-03-09 15:48:58.295860 | controller | 2026-03-09 15:48:58.295897 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-03-09 15:48:58.295906 | controller | Monday 09 March 2026 15:48:47 +0000 (0:00:00.047) 0:04:28.645 ********** 2026-03-09 15:48:58.295916 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:48:59.649337 | controller | 2026-03-09 15:48:59.649375 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-03-09 15:48:59.649383 | controller | Monday 09 March 2026 15:48:58 +0000 (0:00:10.674) 0:04:39.319 ********** 2026-03-09 15:48:59.649393 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:00.838706 | controller | 2026-03-09 15:49:00.838748 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-03-09 15:49:00.838756 | controller | Monday 09 March 2026 15:48:59 +0000 (0:00:01.353) 0:04:40.673 ********** 2026-03-09 15:49:00.838767 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-03-09 15:49:00.877229 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-03-09 15:49:00.877255 | controller | 2026-03-09 15:49:00.877262 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-03-09 15:49:00.877268 | controller | Monday 09 March 2026 15:49:00 +0000 (0:00:01.189) 0:04:41.862 ********** 2026-03-09 15:49:00.877278 | controller | skipping: [instance] 2026-03-09 15:49:01.463970 | controller | 2026-03-09 15:49:01.464005 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-03-09 15:49:01.464012 | controller | Monday 09 March 2026 15:49:00 +0000 (0:00:00.039) 0:04:41.901 ********** 2026-03-09 15:49:01.464023 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:01.507252 | controller | 2026-03-09 15:49:01.507275 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-03-09 15:49:01.507283 | controller | Monday 09 March 2026 15:49:01 +0000 (0:00:00.586) 0:04:42.487 ********** 2026-03-09 15:49:01.507292 | controller | skipping: [instance] 2026-03-09 15:49:01.551119 | controller | 2026-03-09 15:49:01.551142 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-03-09 15:49:01.551149 | controller | Monday 09 March 2026 15:49:01 +0000 (0:00:00.043) 0:04:42.531 ********** 2026-03-09 15:49:01.551159 | controller | skipping: [instance] 2026-03-09 15:49:01.596454 | controller | 2026-03-09 15:49:01.596473 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-03-09 15:49:01.596481 | controller | Monday 09 March 2026 15:49:01 +0000 (0:00:00.042) 0:04:42.574 ********** 2026-03-09 15:49:01.596490 | controller | skipping: [instance] 2026-03-09 15:49:01.632446 | controller | 2026-03-09 15:49:01.632464 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-03-09 15:49:01.632471 | controller | Monday 09 March 2026 15:49:01 +0000 (0:00:00.046) 0:04:42.620 ********** 2026-03-09 15:49:01.632479 | controller | skipping: [instance] 2026-03-09 15:49:01.759889 | controller | 2026-03-09 15:49:01.759909 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-03-09 15:49:01.759916 | controller | Monday 09 March 2026 15:49:01 +0000 (0:00:00.036) 0:04:42.657 ********** 2026-03-09 15:49:01.759926 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-03-09 15:49:01.760080 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-03-09 15:49:01.760216 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-03-09 15:49:01.760336 | controller | 2026-03-09 15:49:01.760461 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-03-09 15:49:01.760616 | controller | Monday 09 March 2026 15:49:01 +0000 (0:00:00.127) 0:04:42.784 ********** 2026-03-09 15:49:02.833172 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:02.833330 | controller | 2026-03-09 15:49:02.833454 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-03-09 15:49:02.833598 | controller | Monday 09 March 2026 15:49:02 +0000 (0:00:01.072) 0:04:43.857 ********** 2026-03-09 15:49:02.878461 | controller | skipping: [instance] 2026-03-09 15:49:02.878622 | controller | 2026-03-09 15:49:02.878789 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-03-09 15:49:02.878921 | controller | Monday 09 March 2026 15:49:02 +0000 (0:00:00.045) 0:04:43.903 ********** 2026-03-09 15:49:03.022759 | controller | 2026-03-09 15:49:03.022899 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-03-09 15:49:03.023022 | controller | Monday 09 March 2026 15:49:03 +0000 (0:00:00.144) 0:04:44.047 ********** 2026-03-09 15:49:03.149335 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:03.149473 | controller | 2026-03-09 15:49:03.149611 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-03-09 15:49:03.149755 | controller | Monday 09 March 2026 15:49:03 +0000 (0:00:00.126) 0:04:44.173 ********** 2026-03-09 15:49:03.194871 | controller | skipping: [instance] 2026-03-09 15:49:03.195002 | controller | 2026-03-09 15:49:03.195127 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-03-09 15:49:03.195260 | controller | Monday 09 March 2026 15:49:03 +0000 (0:00:00.045) 0:04:44.219 ********** 2026-03-09 15:49:03.232346 | controller | skipping: [instance] 2026-03-09 15:49:03.232476 | controller | 2026-03-09 15:49:03.232639 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-03-09 15:49:03.232790 | controller | Monday 09 March 2026 15:49:03 +0000 (0:00:00.037) 0:04:44.257 ********** 2026-03-09 15:49:04.707168 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:12.614036 | controller | 2026-03-09 15:49:12.614066 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-03-09 15:49:12.614074 | controller | Monday 09 March 2026 15:49:04 +0000 (0:00:01.473) 0:04:45.731 ********** 2026-03-09 15:49:12.614083 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-03-09 15:49:12.719040 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-03-09 15:49:12.719068 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-03-09 15:49:12.719075 | controller | 2026-03-09 15:49:12.719080 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-03-09 15:49:12.719086 | controller | Monday 09 March 2026 15:49:12 +0000 (0:00:07.906) 0:04:53.637 ********** 2026-03-09 15:49:12.719093 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-03-09 15:49:12.938530 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-03-09 15:49:12.938556 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-03-09 15:49:12.938563 | controller | 2026-03-09 15:49:12.938569 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-03-09 15:49:12.938574 | controller | Monday 09 March 2026 15:49:12 +0000 (0:00:00.105) 0:04:53.742 ********** 2026-03-09 15:49:12.938583 | controller | ok: [instance -> localhost] 2026-03-09 15:49:14.893787 | controller | 2026-03-09 15:49:14.893827 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-03-09 15:49:14.893838 | controller | Monday 09 March 2026 15:49:12 +0000 (0:00:00.220) 0:04:53.962 ********** 2026-03-09 15:49:14.893852 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-03-09 15:49:14.894087 | controller | 2026-03-09 15:49:14.894102 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-03-09 15:49:14.894113 | controller | Monday 09 March 2026 15:49:14 +0000 (0:00:01.955) 0:04:55.917 ********** 2026-03-09 15:49:15.540761 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:16.290246 | controller | 2026-03-09 15:49:16.290280 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-03-09 15:49:16.290295 | controller | Monday 09 March 2026 15:49:15 +0000 (0:00:00.646) 0:04:56.564 ********** 2026-03-09 15:49:16.290307 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:16.290324 | controller | 2026-03-09 15:49:16.290332 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-03-09 15:49:16.290421 | controller | Monday 09 March 2026 15:49:16 +0000 (0:00:00.749) 0:04:57.314 ********** 2026-03-09 15:49:17.434494 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:17.434764 | controller | 2026-03-09 15:49:18.131396 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-03-09 15:49:18.131433 | controller | Monday 09 March 2026 15:49:17 +0000 (0:00:01.134) 0:04:58.449 ********** 2026-03-09 15:49:18.131444 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:19.238308 | controller | 2026-03-09 15:49:19.238352 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-03-09 15:49:19.238361 | controller | Monday 09 March 2026 15:49:18 +0000 (0:00:00.706) 0:04:59.155 ********** 2026-03-09 15:49:19.238373 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:19.889102 | controller | 2026-03-09 15:49:19.889167 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-03-09 15:49:19.889177 | controller | Monday 09 March 2026 15:49:19 +0000 (0:00:01.106) 0:05:00.262 ********** 2026-03-09 15:49:19.889192 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:20.534215 | controller | 2026-03-09 15:49:20.534310 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-03-09 15:49:20.534319 | controller | Monday 09 March 2026 15:49:19 +0000 (0:00:00.650) 0:05:00.912 ********** 2026-03-09 15:49:20.534336 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:21.910074 | controller | 2026-03-09 15:49:21.910104 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-03-09 15:49:21.910112 | controller | Monday 09 March 2026 15:49:20 +0000 (0:00:00.645) 0:05:01.557 ********** 2026-03-09 15:49:21.910122 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-03-09 15:49:21.947155 | controller | 2026-03-09 15:49:21.947187 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-03-09 15:49:21.947196 | controller | Monday 09 March 2026 15:49:21 +0000 (0:00:01.376) 0:05:02.934 ********** 2026-03-09 15:49:21.947206 | controller | skipping: [instance] 2026-03-09 15:49:21.983871 | controller | 2026-03-09 15:49:21.983900 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-03-09 15:49:21.983908 | controller | Monday 09 March 2026 15:49:21 +0000 (0:00:00.037) 0:05:02.971 ********** 2026-03-09 15:49:21.983918 | controller | skipping: [instance] 2026-03-09 15:49:22.026398 | controller | 2026-03-09 15:49:22.026426 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-03-09 15:49:22.026434 | controller | Monday 09 March 2026 15:49:21 +0000 (0:00:00.036) 0:05:03.008 ********** 2026-03-09 15:49:22.026444 | controller | skipping: [instance] 2026-03-09 15:49:22.063052 | controller | 2026-03-09 15:49:22.063078 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-03-09 15:49:22.063085 | controller | Monday 09 March 2026 15:49:22 +0000 (0:00:00.042) 0:05:03.050 ********** 2026-03-09 15:49:22.063095 | controller | skipping: [instance] 2026-03-09 15:49:22.099312 | controller | 2026-03-09 15:49:22.099331 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-03-09 15:49:22.099338 | controller | Monday 09 March 2026 15:49:22 +0000 (0:00:00.036) 0:05:03.087 ********** 2026-03-09 15:49:22.099347 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:22.215727 | controller | 2026-03-09 15:49:22.215747 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-03-09 15:49:22.215759 | controller | Monday 09 March 2026 15:49:22 +0000 (0:00:00.036) 0:05:03.123 ********** 2026-03-09 15:49:22.215779 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-03-09 15:49:22.265385 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-03-09 15:49:22.265412 | controller | 2026-03-09 15:49:22.265420 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-03-09 15:49:22.265426 | controller | Monday 09 March 2026 15:49:22 +0000 (0:00:00.115) 0:05:03.239 ********** 2026-03-09 15:49:22.265435 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-03-09 15:49:25.626161 | controller | 2026-03-09 15:49:25.626193 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-03-09 15:49:25.626200 | controller | Monday 09 March 2026 15:49:22 +0000 (0:00:00.050) 0:05:03.289 ********** 2026-03-09 15:49:25.626210 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-03-09 15:49:26.747236 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-03-09 15:49:26.747280 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-03-09 15:49:26.747288 | controller | 2026-03-09 15:49:26.747295 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-03-09 15:49:26.747301 | controller | Monday 09 March 2026 15:49:25 +0000 (0:00:03.360) 0:05:06.650 ********** 2026-03-09 15:49:26.747311 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:27.263732 | controller | 2026-03-09 15:49:27.263763 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-03-09 15:49:27.263782 | controller | Monday 09 March 2026 15:49:26 +0000 (0:00:01.121) 0:05:07.771 ********** 2026-03-09 15:49:27.263792 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:28.246891 | controller | 2026-03-09 15:49:28.246926 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-03-09 15:49:28.246934 | controller | Monday 09 March 2026 15:49:27 +0000 (0:00:00.516) 0:05:08.287 ********** 2026-03-09 15:49:28.246944 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:28.323759 | controller | 2026-03-09 15:49:28.323782 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-03-09 15:49:28.323790 | controller | Monday 09 March 2026 15:49:28 +0000 (0:00:00.983) 0:05:09.270 ********** 2026-03-09 15:49:28.323799 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:28.379848 | controller | 2026-03-09 15:49:28.379877 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-03-09 15:49:28.379884 | controller | Monday 09 March 2026 15:49:28 +0000 (0:00:00.076) 0:05:09.347 ********** 2026-03-09 15:49:28.379894 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:29.431160 | controller | 2026-03-09 15:49:29.431192 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-03-09 15:49:29.431200 | controller | Monday 09 March 2026 15:49:28 +0000 (0:00:00.055) 0:05:09.403 ********** 2026-03-09 15:49:29.431210 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:30.526680 | controller | 2026-03-09 15:49:30.526712 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-03-09 15:49:30.526719 | controller | Monday 09 March 2026 15:49:29 +0000 (0:00:01.051) 0:05:10.455 ********** 2026-03-09 15:49:30.526730 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:36.584496 | controller | 2026-03-09 15:49:36.584533 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-03-09 15:49:36.584541 | controller | Monday 09 March 2026 15:49:30 +0000 (0:00:01.092) 0:05:11.547 ********** 2026-03-09 15:49:36.584552 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-03-09 15:49:36.797426 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:36.797478 | controller | 2026-03-09 15:49:36.797485 | controller | TASK [Configure ntp service] *************************************************** 2026-03-09 15:49:36.797491 | controller | Monday 09 March 2026 15:49:36 +0000 (0:00:06.060) 0:05:17.608 ********** 2026-03-09 15:49:36.797500 | controller | 2026-03-09 15:49:37.846245 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-03-09 15:49:37.846278 | controller | Monday 09 March 2026 15:49:36 +0000 (0:00:00.212) 0:05:17.821 ********** 2026-03-09 15:49:37.846291 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:38.807966 | controller | 2026-03-09 15:49:38.807998 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-03-09 15:49:38.808006 | controller | Monday 09 March 2026 15:49:37 +0000 (0:00:01.048) 0:05:18.870 ********** 2026-03-09 15:49:38.808020 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-03-09 15:49:39.737915 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-03-09 15:49:39.737946 | controller | 2026-03-09 15:49:39.737954 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-03-09 15:49:39.737960 | controller | Monday 09 March 2026 15:49:38 +0000 (0:00:00.961) 0:05:19.831 ********** 2026-03-09 15:49:39.737970 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:40.414606 | controller | 2026-03-09 15:49:40.414660 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-03-09 15:49:40.414668 | controller | Monday 09 March 2026 15:49:39 +0000 (0:00:00.930) 0:05:20.761 ********** 2026-03-09 15:49:40.414683 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:40.550370 | controller | 2026-03-09 15:49:40.550394 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-03-09 15:49:40.550402 | controller | Monday 09 March 2026 15:49:40 +0000 (0:00:00.676) 0:05:21.438 ********** 2026-03-09 15:49:40.550411 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-03-09 15:49:41.047863 | controller | 2026-03-09 15:49:41.047890 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-03-09 15:49:41.047897 | controller | Monday 09 March 2026 15:49:40 +0000 (0:00:00.135) 0:05:21.574 ********** 2026-03-09 15:49:41.047907 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:41.558644 | controller | 2026-03-09 15:49:41.558675 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-03-09 15:49:41.558682 | controller | Monday 09 March 2026 15:49:41 +0000 (0:00:00.497) 0:05:22.072 ********** 2026-03-09 15:49:41.558692 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-03-09 15:49:42.244410 | controller | 2026-03-09 15:49:42.244449 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-03-09 15:49:42.244456 | controller | Monday 09 March 2026 15:49:41 +0000 (0:00:00.510) 0:05:22.582 ********** 2026-03-09 15:49:42.244466 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-03-09 15:49:42.813383 | controller | 2026-03-09 15:49:42.813428 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-03-09 15:49:42.813437 | controller | Monday 09 March 2026 15:49:42 +0000 (0:00:00.685) 0:05:23.268 ********** 2026-03-09 15:49:42.813448 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-03-09 15:49:42.860611 | controller | 2026-03-09 15:49:42.860661 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-03-09 15:49:42.860672 | controller | Monday 09 March 2026 15:49:42 +0000 (0:00:00.568) 0:05:23.837 ********** 2026-03-09 15:49:42.860684 | controller | 2026-03-09 15:49:43.334932 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-03-09 15:49:43.334967 | controller | Monday 09 March 2026 15:49:42 +0000 (0:00:00.047) 0:05:23.885 ********** 2026-03-09 15:49:43.334978 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-03-09 15:49:44.130322 | controller | 2026-03-09 15:49:44.130356 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-03-09 15:49:44.130363 | controller | Monday 09 March 2026 15:49:43 +0000 (0:00:00.474) 0:05:24.359 ********** 2026-03-09 15:49:44.130373 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-03-09 15:49:44.156392 | controller | 2026-03-09 15:49:44.156425 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-03-09 15:49:44.156434 | controller | Monday 09 March 2026 15:49:44 +0000 (0:00:00.795) 0:05:25.154 ********** 2026-03-09 15:49:44.156443 | controller | skipping: [instance] 2026-03-09 15:49:44.192979 | controller | 2026-03-09 15:49:44.192998 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-03-09 15:49:44.193005 | controller | Monday 09 March 2026 15:49:44 +0000 (0:00:00.026) 0:05:25.180 ********** 2026-03-09 15:49:44.193013 | controller | skipping: [instance] 2026-03-09 15:49:44.434667 | controller | 2026-03-09 15:49:44.434694 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-03-09 15:49:44.434701 | controller | Monday 09 March 2026 15:49:44 +0000 (0:00:00.035) 0:05:25.216 ********** 2026-03-09 15:49:44.434710 | controller | changed: [instance] 2026-03-09 15:49:44.434940 | controller | 2026-03-09 15:49:44.434954 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-03-09 15:49:44.511099 | controller | Monday 09 March 2026 15:49:44 +0000 (0:00:00.242) 0:05:25.458 ********** 2026-03-09 15:49:44.511121 | controller | skipping: [instance] => (item=) 2026-03-09 15:49:44.545568 | controller | 2026-03-09 15:49:44.545586 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-03-09 15:49:44.545593 | controller | Monday 09 March 2026 15:49:44 +0000 (0:00:00.076) 0:05:25.535 ********** 2026-03-09 15:49:44.545606 | controller | ok: [instance] 2026-03-09 15:49:44.619757 | controller | 2026-03-09 15:49:44.619777 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-03-09 15:49:44.619784 | controller | Monday 09 March 2026 15:49:44 +0000 (0:00:00.034) 0:05:25.570 ********** 2026-03-09 15:49:44.619792 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-03-09 15:49:44.863975 | controller | 2026-03-09 15:49:44.863997 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-03-09 15:49:44.864004 | controller | Monday 09 March 2026 15:49:44 +0000 (0:00:00.074) 0:05:25.644 ********** 2026-03-09 15:49:44.864013 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-03-09 15:49:44.864135 | controller | 2026-03-09 15:49:44.864145 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-03-09 15:49:44.864152 | controller | Monday 09 March 2026 15:49:44 +0000 (0:00:00.244) 0:05:25.888 ********** 2026-03-09 15:49:44.916645 | controller | 2026-03-09 15:49:44.976919 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-03-09 15:49:44.976938 | controller | Monday 09 March 2026 15:49:44 +0000 (0:00:00.051) 0:05:25.940 ********** 2026-03-09 15:49:44.976949 | controller | ok: [instance] 2026-03-09 15:49:45.034048 | controller | 2026-03-09 15:49:45.034066 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-03-09 15:49:45.034074 | controller | Monday 09 March 2026 15:49:44 +0000 (0:00:00.060) 0:05:26.001 ********** 2026-03-09 15:49:45.034082 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-03-09 15:49:45.290134 | controller | 2026-03-09 15:49:45.290159 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-03-09 15:49:45.290166 | controller | Monday 09 March 2026 15:49:45 +0000 (0:00:00.057) 0:05:26.058 ********** 2026-03-09 15:49:45.290175 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-03-09 15:49:45.316946 | controller | 2026-03-09 15:49:45.316963 | controller | TASK [dnsmasq : Remove crc.testing from host_records] ************************** 2026-03-09 15:49:45.316970 | controller | Monday 09 March 2026 15:49:45 +0000 (0:00:00.255) 0:05:26.314 ********** 2026-03-09 15:49:45.316979 | controller | skipping: [instance] 2026-03-09 15:49:45.375381 | controller | 2026-03-09 15:49:45.375399 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-03-09 15:49:45.375406 | controller | Monday 09 March 2026 15:49:45 +0000 (0:00:00.027) 0:05:26.341 ********** 2026-03-09 15:49:45.375426 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-03-09 15:49:45.795708 | controller | skipping: [instance] 2026-03-09 15:49:45.795738 | controller | 2026-03-09 15:49:45.795746 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-03-09 15:49:45.795752 | controller | Monday 09 March 2026 15:49:45 +0000 (0:00:00.057) 0:05:26.399 ********** 2026-03-09 15:49:45.795762 | controller | changed: [instance] 2026-03-09 15:49:46.530188 | controller | 2026-03-09 15:49:46.530233 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-03-09 15:49:46.530242 | controller | Monday 09 March 2026 15:49:45 +0000 (0:00:00.407) 0:05:26.807 ********** 2026-03-09 15:49:46.530248 | controller | 2026-03-09 15:49:46.530253 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-03-09 15:49:46.530259 | controller | Monday 09 March 2026 15:49:45 +0000 (0:00:00.011) 0:05:26.819 ********** 2026-03-09 15:49:46.530269 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:46.950494 | controller | 2026-03-09 15:49:46.950530 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-03-09 15:49:46.950554 | controller | Monday 09 March 2026 15:49:46 +0000 (0:00:00.734) 0:05:27.553 ********** 2026-03-09 15:49:46.950574 | controller | changed: [instance] 2026-03-09 15:49:47.132849 | controller | 2026-03-09 15:49:47.132878 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-03-09 15:49:47.132887 | controller | Monday 09 March 2026 15:49:46 +0000 (0:00:00.420) 0:05:27.974 ********** 2026-03-09 15:49:47.132899 | controller | skipping: [instance] => (item=controller-0) 2026-03-09 15:49:48.671732 | controller | skipping: [instance] => (item=crc-0) 2026-03-09 15:49:48.671764 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-03-09 15:49:48.671772 | controller | 2026-03-09 15:49:48.671778 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-03-09 15:49:48.671784 | controller | Monday 09 March 2026 15:49:47 +0000 (0:00:00.182) 0:05:28.156 ********** 2026-03-09 15:49:48.671794 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-03-09 15:49:48.671817 | controller | 2026-03-09 15:49:48.671825 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-03-09 15:49:48.671893 | controller | Monday 09 March 2026 15:49:48 +0000 (0:00:01.539) 0:05:29.696 ********** 2026-03-09 15:49:48.692708 | controller | skipping: [instance] 2026-03-09 15:49:48.692756 | controller | 2026-03-09 15:49:48.692963 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-03-09 15:49:49.221793 | controller | Monday 09 March 2026 15:49:48 +0000 (0:00:00.021) 0:05:29.717 ********** 2026-03-09 15:49:49.221833 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-03-09 15:49:49.267013 | controller | 2026-03-09 15:49:49.267034 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-03-09 15:49:49.267043 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.528) 0:05:30.245 ********** 2026-03-09 15:49:49.267055 | controller | skipping: [instance] 2026-03-09 15:49:49.267091 | controller | 2026-03-09 15:49:49.267210 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-03-09 15:49:49.267318 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.045) 0:05:30.291 ********** 2026-03-09 15:49:49.307535 | controller | skipping: [instance] 2026-03-09 15:49:49.307646 | controller | 2026-03-09 15:49:49.307782 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-03-09 15:49:49.307895 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.040) 0:05:30.331 ********** 2026-03-09 15:49:49.351191 | controller | skipping: [instance] 2026-03-09 15:49:49.401043 | controller | 2026-03-09 15:49:49.401062 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-03-09 15:49:49.401069 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.043) 0:05:30.375 ********** 2026-03-09 15:49:49.401078 | controller | skipping: [instance] 2026-03-09 15:49:49.401213 | controller | 2026-03-09 15:49:49.401345 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-03-09 15:49:49.401496 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.050) 0:05:30.425 ********** 2026-03-09 15:49:49.441529 | controller | skipping: [instance] 2026-03-09 15:49:49.441733 | controller | 2026-03-09 15:49:49.441902 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-03-09 15:49:49.442056 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.040) 0:05:30.466 ********** 2026-03-09 15:49:49.463039 | controller | skipping: [instance] 2026-03-09 15:49:49.463206 | controller | 2026-03-09 15:49:49.463363 | controller | TASK [reproducer : Configure controller for bare metal OCP] ******************** 2026-03-09 15:49:49.463513 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.021) 0:05:30.487 ********** 2026-03-09 15:49:49.486950 | controller | skipping: [instance] 2026-03-09 15:49:49.487114 | controller | 2026-03-09 15:49:49.487272 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-03-09 15:49:49.487447 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.023) 0:05:30.511 ********** 2026-03-09 15:49:49.521600 | controller | skipping: [instance] 2026-03-09 15:49:49.521751 | controller | 2026-03-09 15:49:49.521878 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-03-09 15:49:49.522009 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.034) 0:05:30.546 ********** 2026-03-09 15:49:49.576158 | controller | ok: [instance] 2026-03-09 15:49:49.576311 | controller | 2026-03-09 15:49:49.576459 | controller | TASK [reproducer : Push local code] ******************************************** 2026-03-09 15:49:49.576588 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.054) 0:05:30.600 ********** 2026-03-09 15:49:49.675229 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-03-09 15:49:49.675270 | controller | 2026-03-09 15:49:49.675281 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-03-09 15:49:49.715070 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.098) 0:05:30.699 ********** 2026-03-09 15:49:49.715136 | controller | skipping: [instance] 2026-03-09 15:49:49.715162 | controller | 2026-03-09 15:49:49.715171 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-03-09 15:49:49.715181 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.039) 0:05:30.739 ********** 2026-03-09 15:49:49.756960 | controller | skipping: [instance] 2026-03-09 15:49:49.757033 | controller | 2026-03-09 15:49:49.757134 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-03-09 15:49:49.757227 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.042) 0:05:30.781 ********** 2026-03-09 15:49:49.797154 | controller | skipping: [instance] 2026-03-09 15:49:49.797199 | controller | 2026-03-09 15:49:49.797300 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-03-09 15:49:49.797385 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.039) 0:05:30.821 ********** 2026-03-09 15:49:49.844870 | controller | skipping: [instance] 2026-03-09 15:49:49.844908 | controller | 2026-03-09 15:49:49.845045 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-03-09 15:49:49.845100 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.047) 0:05:30.869 ********** 2026-03-09 15:49:49.886032 | controller | skipping: [instance] 2026-03-09 15:49:49.886089 | controller | 2026-03-09 15:49:49.886287 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-03-09 15:49:50.406710 | controller | Monday 09 March 2026 15:49:49 +0000 (0:00:00.040) 0:05:30.909 ********** 2026-03-09 15:49:50.406768 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-03-09 15:49:50.406801 | controller | 2026-03-09 15:49:50.406820 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-03-09 15:49:50.406927 | controller | Monday 09 March 2026 15:49:50 +0000 (0:00:00.521) 0:05:31.431 ********** 2026-03-09 15:49:51.050642 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-03-09 15:49:51.050720 | controller | 2026-03-09 15:49:51.050830 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-03-09 15:49:51.050843 | controller | Monday 09 March 2026 15:49:51 +0000 (0:00:00.643) 0:05:32.074 ********** 2026-03-09 15:49:51.107248 | controller | skipping: [instance] => (item=ci-framework) 2026-03-09 15:49:51.107316 | controller | skipping: [instance] 2026-03-09 15:49:51.107520 | controller | 2026-03-09 15:49:51.107606 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-03-09 15:49:51.107618 | controller | Monday 09 March 2026 15:49:51 +0000 (0:00:00.056) 0:05:32.131 ********** 2026-03-09 15:49:51.203160 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-03-09 15:49:51.203215 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-03-09 15:49:51.203301 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-03-09 15:49:51.203418 | controller | 2026-03-09 15:49:51.203509 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-03-09 15:49:51.203597 | controller | Monday 09 March 2026 15:49:51 +0000 (0:00:00.095) 0:05:32.227 ********** 2026-03-09 15:49:51.755520 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:51.755575 | controller | 2026-03-09 15:49:51.755719 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-03-09 15:49:51.755813 | controller | Monday 09 March 2026 15:49:51 +0000 (0:00:00.552) 0:05:32.779 ********** 2026-03-09 15:49:51.802296 | controller | skipping: [instance] 2026-03-09 15:49:51.802391 | controller | 2026-03-09 15:49:51.802532 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-03-09 15:49:51.802660 | controller | Monday 09 March 2026 15:49:51 +0000 (0:00:00.046) 0:05:32.826 ********** 2026-03-09 15:49:52.301459 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:52.301506 | controller | 2026-03-09 15:49:52.301613 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-03-09 15:49:52.301759 | controller | Monday 09 March 2026 15:49:52 +0000 (0:00:00.498) 0:05:33.325 ********** 2026-03-09 15:49:52.348246 | controller | skipping: [instance] 2026-03-09 15:49:52.845139 | controller | 2026-03-09 15:49:52.845173 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-03-09 15:49:52.845180 | controller | Monday 09 March 2026 15:49:52 +0000 (0:00:00.046) 0:05:33.372 ********** 2026-03-09 15:49:52.845190 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:49:55.327611 | controller | 2026-03-09 15:49:55.327662 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-03-09 15:49:55.327671 | controller | Monday 09 March 2026 15:49:52 +0000 (0:00:00.497) 0:05:33.869 ********** 2026-03-09 15:49:55.327684 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:17.733424 | controller | 2026-03-09 15:50:17.733483 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-03-09 15:50:17.733493 | controller | Monday 09 March 2026 15:49:55 +0000 (0:00:02.482) 0:05:36.351 ********** 2026-03-09 15:50:17.733507 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:18.864532 | controller | 2026-03-09 15:50:18.864565 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-03-09 15:50:18.864574 | controller | Monday 09 March 2026 15:50:17 +0000 (0:00:22.405) 0:05:58.756 ********** 2026-03-09 15:50:18.864585 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:18.864612 | controller | 2026-03-09 15:50:18.864620 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-03-09 15:50:18.864778 | controller | Monday 09 March 2026 15:50:18 +0000 (0:00:01.131) 0:05:59.888 ********** 2026-03-09 15:50:18.975794 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-03-09 15:50:19.465500 | controller | 2026-03-09 15:50:19.465549 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-03-09 15:50:19.465559 | controller | Monday 09 March 2026 15:50:18 +0000 (0:00:00.111) 0:05:59.999 ********** 2026-03-09 15:50:19.465572 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:19.465596 | controller | 2026-03-09 15:50:19.465648 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-03-09 15:50:19.465789 | controller | Monday 09 March 2026 15:50:19 +0000 (0:00:00.489) 0:06:00.489 ********** 2026-03-09 15:50:19.515567 | controller | skipping: [instance] 2026-03-09 15:50:19.515680 | controller | 2026-03-09 15:50:19.515715 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-03-09 15:50:19.515737 | controller | Monday 09 March 2026 15:50:19 +0000 (0:00:00.049) 0:06:00.539 ********** 2026-03-09 15:50:19.570722 | controller | skipping: [instance] 2026-03-09 15:50:19.570798 | controller | 2026-03-09 15:50:19.570821 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-03-09 15:50:19.570942 | controller | Monday 09 March 2026 15:50:19 +0000 (0:00:00.055) 0:06:00.594 ********** 2026-03-09 15:50:19.676612 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:19.676708 | controller | 2026-03-09 15:50:19.676819 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-03-09 15:50:19.676839 | controller | Monday 09 March 2026 15:50:19 +0000 (0:00:00.106) 0:06:00.700 ********** 2026-03-09 15:50:20.259251 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:20.259305 | controller | 2026-03-09 15:50:20.259400 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-03-09 15:50:20.259486 | controller | Monday 09 March 2026 15:50:20 +0000 (0:00:00.582) 0:06:01.283 ********** 2026-03-09 15:50:20.307991 | controller | skipping: [instance] 2026-03-09 15:50:20.308065 | controller | 2026-03-09 15:50:20.308160 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-03-09 15:50:20.308266 | controller | Monday 09 March 2026 15:50:20 +0000 (0:00:00.048) 0:06:01.332 ********** 2026-03-09 15:50:20.356401 | controller | skipping: [instance] 2026-03-09 15:50:20.356473 | controller | 2026-03-09 15:50:20.356559 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-03-09 15:50:20.356671 | controller | Monday 09 March 2026 15:50:20 +0000 (0:00:00.048) 0:06:01.380 ********** 2026-03-09 15:50:20.404605 | controller | skipping: [instance] 2026-03-09 15:50:20.404701 | controller | 2026-03-09 15:50:20.404813 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-03-09 15:50:20.404905 | controller | Monday 09 March 2026 15:50:20 +0000 (0:00:00.048) 0:06:01.428 ********** 2026-03-09 15:50:20.465301 | controller | skipping: [instance] 2026-03-09 15:50:20.465727 | controller | 2026-03-09 15:50:20.465879 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-03-09 15:50:20.465999 | controller | Monday 09 March 2026 15:50:20 +0000 (0:00:00.060) 0:06:01.489 ********** 2026-03-09 15:50:22.036952 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:50:22.037249 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:50:22.037352 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:50:22.037369 | controller | changed: [instance -> controller-0] 2026-03-09 15:50:22.037420 | controller | 2026-03-09 15:50:22.037431 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-03-09 15:50:22.037562 | controller | Monday 09 March 2026 15:50:22 +0000 (0:00:01.570) 0:06:03.061 ********** 2026-03-09 15:50:23.160754 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:23.161008 | controller | 2026-03-09 15:50:24.485822 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-03-09 15:50:24.485869 | controller | Monday 09 March 2026 15:50:23 +0000 (0:00:01.123) 0:06:04.184 ********** 2026-03-09 15:50:24.485883 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:32.118658 | controller | 2026-03-09 15:50:32.118701 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-03-09 15:50:32.118710 | controller | Monday 09 March 2026 15:50:24 +0000 (0:00:01.324) 0:06:05.509 ********** 2026-03-09 15:50:32.118721 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:32.118742 | controller | 2026-03-09 15:50:32.118818 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-03-09 15:50:32.118929 | controller | Monday 09 March 2026 15:50:32 +0000 (0:00:07.633) 0:06:13.142 ********** 2026-03-09 15:50:33.243466 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:33.243521 | controller | 2026-03-09 15:50:33.243624 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-03-09 15:50:33.243765 | controller | Monday 09 March 2026 15:50:33 +0000 (0:00:01.124) 0:06:14.267 ********** 2026-03-09 15:50:33.297585 | controller | skipping: [instance] 2026-03-09 15:50:34.571323 | controller | 2026-03-09 15:50:34.571367 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-03-09 15:50:34.571374 | controller | Monday 09 March 2026 15:50:33 +0000 (0:00:00.053) 0:06:14.321 ********** 2026-03-09 15:50:34.571391 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:34.632033 | controller | 2026-03-09 15:50:34.632079 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-03-09 15:50:34.632089 | controller | Monday 09 March 2026 15:50:34 +0000 (0:00:01.273) 0:06:15.595 ********** 2026-03-09 15:50:34.632101 | controller | skipping: [instance] 2026-03-09 15:50:34.632278 | controller | 2026-03-09 15:50:34.632316 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-03-09 15:50:34.697734 | controller | Monday 09 March 2026 15:50:34 +0000 (0:00:00.061) 0:06:15.656 ********** 2026-03-09 15:50:34.697769 | controller | skipping: [instance] 2026-03-09 15:50:34.697822 | controller | 2026-03-09 15:50:34.697832 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-03-09 15:50:34.758218 | controller | Monday 09 March 2026 15:50:34 +0000 (0:00:00.065) 0:06:15.722 ********** 2026-03-09 15:50:34.758242 | controller | skipping: [instance] 2026-03-09 15:50:34.758321 | controller | 2026-03-09 15:50:34.758432 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-03-09 15:50:34.758550 | controller | Monday 09 March 2026 15:50:34 +0000 (0:00:00.060) 0:06:15.782 ********** 2026-03-09 15:50:35.662811 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:35.662865 | controller | 2026-03-09 15:50:35.662935 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-03-09 15:50:35.663008 | controller | Monday 09 March 2026 15:50:35 +0000 (0:00:00.904) 0:06:16.687 ********** 2026-03-09 15:50:36.595197 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:36.595253 | controller | 2026-03-09 15:50:36.595382 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-03-09 15:50:36.595479 | controller | Monday 09 March 2026 15:50:36 +0000 (0:00:00.932) 0:06:17.619 ********** 2026-03-09 15:50:36.640244 | controller | skipping: [instance] 2026-03-09 15:50:36.640344 | controller | 2026-03-09 15:50:36.640437 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-03-09 15:50:36.640532 | controller | Monday 09 March 2026 15:50:36 +0000 (0:00:00.045) 0:06:17.664 ********** 2026-03-09 15:50:36.683344 | controller | skipping: [instance] 2026-03-09 15:50:36.683700 | controller | 2026-03-09 15:50:36.726155 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-03-09 15:50:36.726186 | controller | Monday 09 March 2026 15:50:36 +0000 (0:00:00.041) 0:06:17.706 ********** 2026-03-09 15:50:36.726198 | controller | skipping: [instance] 2026-03-09 15:50:36.780937 | controller | 2026-03-09 15:50:36.780971 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-03-09 15:50:36.780979 | controller | Monday 09 March 2026 15:50:36 +0000 (0:00:00.041) 0:06:17.747 ********** 2026-03-09 15:50:36.780990 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:36.827904 | controller | 2026-03-09 15:50:36.827937 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-03-09 15:50:36.827945 | controller | Monday 09 March 2026 15:50:36 +0000 (0:00:00.054) 0:06:17.802 ********** 2026-03-09 15:50:36.827956 | controller | skipping: [instance] 2026-03-09 15:50:36.867068 | controller | 2026-03-09 15:50:36.867099 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-03-09 15:50:36.867107 | controller | Monday 09 March 2026 15:50:36 +0000 (0:00:00.049) 0:06:17.852 ********** 2026-03-09 15:50:36.867118 | controller | skipping: [instance] 2026-03-09 15:50:36.918783 | controller | 2026-03-09 15:50:36.918822 | controller | TASK [Download the RPM] ******************************************************** 2026-03-09 15:50:36.918831 | controller | Monday 09 March 2026 15:50:36 +0000 (0:00:00.039) 0:06:17.891 ********** 2026-03-09 15:50:36.918841 | controller | skipping: [instance] 2026-03-09 15:50:36.962708 | controller | 2026-03-09 15:50:36.962736 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-03-09 15:50:36.962744 | controller | Monday 09 March 2026 15:50:36 +0000 (0:00:00.049) 0:06:17.940 ********** 2026-03-09 15:50:36.962760 | controller | skipping: [instance] 2026-03-09 15:50:37.011294 | controller | 2026-03-09 15:50:37.011328 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-03-09 15:50:37.011336 | controller | Monday 09 March 2026 15:50:36 +0000 (0:00:00.046) 0:06:17.986 ********** 2026-03-09 15:50:37.011346 | controller | skipping: [instance] 2026-03-09 15:50:37.057006 | controller | 2026-03-09 15:50:37.057031 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-03-09 15:50:37.057039 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.047) 0:06:18.033 ********** 2026-03-09 15:50:37.057049 | controller | skipping: [instance] 2026-03-09 15:50:37.100149 | controller | 2026-03-09 15:50:37.100175 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-03-09 15:50:37.100183 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.047) 0:06:18.081 ********** 2026-03-09 15:50:37.100193 | controller | skipping: [instance] 2026-03-09 15:50:37.584570 | controller | 2026-03-09 15:50:37.584609 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-03-09 15:50:37.584617 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.043) 0:06:18.124 ********** 2026-03-09 15:50:37.584654 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:37.635424 | controller | 2026-03-09 15:50:37.635449 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-03-09 15:50:37.635469 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.484) 0:06:18.608 ********** 2026-03-09 15:50:37.635479 | controller | skipping: [instance] 2026-03-09 15:50:37.682063 | controller | 2026-03-09 15:50:37.682087 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-03-09 15:50:37.682095 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.051) 0:06:18.659 ********** 2026-03-09 15:50:37.682110 | controller | skipping: [instance] 2026-03-09 15:50:37.723026 | controller | 2026-03-09 15:50:37.723058 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-03-09 15:50:37.723066 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.046) 0:06:18.706 ********** 2026-03-09 15:50:37.723076 | controller | skipping: [instance] 2026-03-09 15:50:37.773084 | controller | 2026-03-09 15:50:37.773111 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-03-09 15:50:37.773119 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.040) 0:06:18.747 ********** 2026-03-09 15:50:37.773129 | controller | skipping: [instance] 2026-03-09 15:50:37.836072 | controller | 2026-03-09 15:50:37.836099 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-03-09 15:50:37.836107 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.050) 0:06:18.797 ********** 2026-03-09 15:50:37.836116 | controller | skipping: [instance] 2026-03-09 15:50:37.898120 | controller | 2026-03-09 15:50:37.898150 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-03-09 15:50:37.898158 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.062) 0:06:18.860 ********** 2026-03-09 15:50:37.898175 | controller | skipping: [instance] 2026-03-09 15:50:37.952510 | controller | 2026-03-09 15:50:37.952537 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-03-09 15:50:37.952545 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.059) 0:06:18.919 ********** 2026-03-09 15:50:37.952554 | controller | skipping: [instance] 2026-03-09 15:50:38.014618 | controller | 2026-03-09 15:50:38.014660 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-03-09 15:50:38.014668 | controller | Monday 09 March 2026 15:50:37 +0000 (0:00:00.057) 0:06:18.976 ********** 2026-03-09 15:50:38.014678 | controller | skipping: [instance] 2026-03-09 15:50:38.710818 | controller | 2026-03-09 15:50:38.710854 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-03-09 15:50:38.710862 | controller | Monday 09 March 2026 15:50:38 +0000 (0:00:00.062) 0:06:19.038 ********** 2026-03-09 15:50:38.710872 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:39.821412 | controller | 2026-03-09 15:50:39.821446 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-03-09 15:50:39.821454 | controller | Monday 09 March 2026 15:50:38 +0000 (0:00:00.695) 0:06:19.734 ********** 2026-03-09 15:50:39.821465 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:50:40.665998 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:50:40.666038 | controller | changed: [instance -> controller-0] 2026-03-09 15:50:40.666049 | controller | 2026-03-09 15:50:40.666058 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-03-09 15:50:40.666066 | controller | Monday 09 March 2026 15:50:39 +0000 (0:00:01.110) 0:06:20.844 ********** 2026-03-09 15:50:40.666079 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:41.251968 | controller | 2026-03-09 15:50:41.252002 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-03-09 15:50:41.252010 | controller | Monday 09 March 2026 15:50:40 +0000 (0:00:00.844) 0:06:21.689 ********** 2026-03-09 15:50:41.252020 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:50:41.319519 | controller | 2026-03-09 15:50:41.319548 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-03-09 15:50:41.319556 | controller | Monday 09 March 2026 15:50:41 +0000 (0:00:00.586) 0:06:22.275 ********** 2026-03-09 15:50:41.319566 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:50:41.372534 | controller | ok: [instance -> controller-0] 2026-03-09 15:50:41.372565 | controller | 2026-03-09 15:50:41.372573 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-03-09 15:50:41.372579 | controller | Monday 09 March 2026 15:50:41 +0000 (0:00:00.067) 0:06:22.343 ********** 2026-03-09 15:50:41.372588 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:15.654769 | controller | 2026-03-09 15:51:15.654816 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-03-09 15:51:15.654825 | controller | Monday 09 March 2026 15:50:41 +0000 (0:00:00.052) 0:06:22.395 ********** 2026-03-09 15:51:15.654836 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:15.654866 | controller | 2026-03-09 15:51:15.654874 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-03-09 15:51:15.655070 | controller | Monday 09 March 2026 15:51:15 +0000 (0:00:34.281) 0:06:56.677 ********** 2026-03-09 15:51:16.167079 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:16.725702 | controller | 2026-03-09 15:51:16.725748 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-03-09 15:51:16.725756 | controller | Monday 09 March 2026 15:51:16 +0000 (0:00:00.512) 0:06:57.190 ********** 2026-03-09 15:51:16.725775 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:22.913682 | controller | 2026-03-09 15:51:22.913748 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-03-09 15:51:22.913766 | controller | Monday 09 March 2026 15:51:16 +0000 (0:00:00.559) 0:06:57.749 ********** 2026-03-09 15:51:22.913780 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:22.976648 | controller | 2026-03-09 15:51:22.976699 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-03-09 15:51:22.976708 | controller | Monday 09 March 2026 15:51:22 +0000 (0:00:06.187) 0:07:03.936 ********** 2026-03-09 15:51:22.976722 | controller | skipping: [instance] 2026-03-09 15:51:22.976786 | controller | 2026-03-09 15:51:22.976829 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-03-09 15:51:22.976843 | controller | Monday 09 March 2026 15:51:22 +0000 (0:00:00.063) 0:07:04.000 ********** 2026-03-09 15:51:23.685497 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:24.209721 | controller | 2026-03-09 15:51:24.209769 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-03-09 15:51:24.209778 | controller | Monday 09 March 2026 15:51:23 +0000 (0:00:00.707) 0:07:04.708 ********** 2026-03-09 15:51:24.209796 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:24.255025 | controller | 2026-03-09 15:51:24.255061 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-03-09 15:51:24.255069 | controller | Monday 09 March 2026 15:51:24 +0000 (0:00:00.524) 0:07:05.233 ********** 2026-03-09 15:51:24.255080 | controller | skipping: [instance] 2026-03-09 15:51:24.306298 | controller | 2026-03-09 15:51:24.306338 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-03-09 15:51:24.306347 | controller | Monday 09 March 2026 15:51:24 +0000 (0:00:00.045) 0:07:05.278 ********** 2026-03-09 15:51:24.306358 | controller | skipping: [instance] 2026-03-09 15:51:24.306716 | controller | 2026-03-09 15:51:24.352379 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-03-09 15:51:24.352399 | controller | Monday 09 March 2026 15:51:24 +0000 (0:00:00.051) 0:07:05.330 ********** 2026-03-09 15:51:24.352409 | controller | skipping: [instance] 2026-03-09 15:51:24.394603 | controller | 2026-03-09 15:51:24.394642 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-03-09 15:51:24.394654 | controller | Monday 09 March 2026 15:51:24 +0000 (0:00:00.046) 0:07:05.376 ********** 2026-03-09 15:51:24.394663 | controller | skipping: [instance] 2026-03-09 15:51:24.441018 | controller | 2026-03-09 15:51:24.441048 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-03-09 15:51:24.441057 | controller | Monday 09 March 2026 15:51:24 +0000 (0:00:00.042) 0:07:05.418 ********** 2026-03-09 15:51:24.441067 | controller | skipping: [instance] 2026-03-09 15:51:24.489583 | controller | 2026-03-09 15:51:24.489605 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-03-09 15:51:24.489612 | controller | Monday 09 March 2026 15:51:24 +0000 (0:00:00.046) 0:07:05.465 ********** 2026-03-09 15:51:24.489621 | controller | skipping: [instance] 2026-03-09 15:51:27.245124 | controller | 2026-03-09 15:51:27.245155 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-03-09 15:51:27.245164 | controller | Monday 09 March 2026 15:51:24 +0000 (0:00:00.048) 0:07:05.513 ********** 2026-03-09 15:51:27.245174 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:51:27.245213 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:51:27.245225 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:51:27.245233 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:51:27.245261 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:51:27.245767 | controller | changed: [instance -> controller-0] 2026-03-09 15:51:27.401755 | controller | 2026-03-09 15:51:27.401824 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-03-09 15:51:27.401833 | controller | Monday 09 March 2026 15:51:27 +0000 (0:00:02.755) 0:07:08.268 ********** 2026-03-09 15:51:27.401848 | controller | 2026-03-09 15:51:29.122642 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-03-09 15:51:29.122710 | controller | Monday 09 March 2026 15:51:27 +0000 (0:00:00.156) 0:07:08.425 ********** 2026-03-09 15:51:29.122727 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:51:29.179570 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:51:29.179601 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:51:29.179612 | controller | changed: [instance -> controller-0] 2026-03-09 15:51:29.179621 | controller | 2026-03-09 15:51:29.179659 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-03-09 15:51:29.179672 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:01.720) 0:07:10.145 ********** 2026-03-09 15:51:29.179685 | controller | 2026-03-09 15:51:29.217096 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-03-09 15:51:29.217162 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:00.058) 0:07:10.203 ********** 2026-03-09 15:51:29.217184 | controller | skipping: [instance] 2026-03-09 15:51:29.217397 | controller | 2026-03-09 15:51:29.217409 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-03-09 15:51:29.217417 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:00.037) 0:07:10.241 ********** 2026-03-09 15:51:29.275677 | controller | skipping: [instance] 2026-03-09 15:51:29.275757 | controller | 2026-03-09 15:51:29.275766 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-03-09 15:51:29.275774 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:00.058) 0:07:10.299 ********** 2026-03-09 15:51:29.356231 | controller | 2026-03-09 15:51:29.356387 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-03-09 15:51:29.409357 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:00.081) 0:07:10.380 ********** 2026-03-09 15:51:29.409387 | controller | skipping: [instance] 2026-03-09 15:51:29.409585 | controller | 2026-03-09 15:51:29.409597 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-03-09 15:51:29.468901 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:00.053) 0:07:10.433 ********** 2026-03-09 15:51:29.468933 | controller | skipping: [instance] 2026-03-09 15:51:29.521802 | controller | 2026-03-09 15:51:29.521824 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-03-09 15:51:29.521831 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:00.058) 0:07:10.492 ********** 2026-03-09 15:51:29.521840 | controller | skipping: [instance] 2026-03-09 15:51:29.521886 | controller | 2026-03-09 15:51:29.521893 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-03-09 15:51:29.521901 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:00.053) 0:07:10.545 ********** 2026-03-09 15:51:29.586387 | controller | skipping: [instance] 2026-03-09 15:51:29.586450 | controller | 2026-03-09 15:51:29.586556 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-03-09 15:51:29.586655 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:00.064) 0:07:10.610 ********** 2026-03-09 15:51:29.702138 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-03-09 15:51:29.702258 | controller | ok: [instance -> controller-0] 2026-03-09 15:51:29.702345 | controller | 2026-03-09 15:51:29.702435 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-03-09 15:51:29.702514 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:00.115) 0:07:10.726 ********** 2026-03-09 15:51:29.773262 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:29.773377 | controller | 2026-03-09 15:51:29.773493 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-03-09 15:51:29.773585 | controller | Monday 09 March 2026 15:51:29 +0000 (0:00:00.071) 0:07:10.797 ********** 2026-03-09 15:51:30.823795 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:30.823861 | controller | 2026-03-09 15:51:30.823987 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-03-09 15:51:30.824060 | controller | Monday 09 March 2026 15:51:30 +0000 (0:00:01.050) 0:07:11.847 ********** 2026-03-09 15:51:30.868798 | controller | skipping: [instance] 2026-03-09 15:51:30.868892 | controller | 2026-03-09 15:51:30.868991 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-03-09 15:51:30.869110 | controller | Monday 09 March 2026 15:51:30 +0000 (0:00:00.045) 0:07:11.893 ********** 2026-03-09 15:51:30.921296 | controller | skipping: [instance] 2026-03-09 15:51:30.921369 | controller | 2026-03-09 15:51:30.921465 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-03-09 15:51:30.921556 | controller | Monday 09 March 2026 15:51:30 +0000 (0:00:00.052) 0:07:11.945 ********** 2026-03-09 15:51:30.963843 | controller | skipping: [instance] 2026-03-09 15:51:30.963959 | controller | 2026-03-09 15:51:30.964094 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-03-09 15:51:30.964177 | controller | Monday 09 March 2026 15:51:30 +0000 (0:00:00.042) 0:07:11.988 ********** 2026-03-09 15:51:31.024981 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:31.025032 | controller | 2026-03-09 15:51:31.025173 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-03-09 15:51:31.025211 | controller | Monday 09 March 2026 15:51:31 +0000 (0:00:00.061) 0:07:12.049 ********** 2026-03-09 15:51:31.071105 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:31.071212 | controller | 2026-03-09 15:51:31.071310 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-03-09 15:51:31.071404 | controller | Monday 09 March 2026 15:51:31 +0000 (0:00:00.045) 0:07:12.095 ********** 2026-03-09 15:51:31.244802 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:31.244891 | controller | 2026-03-09 15:51:31.244994 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-03-09 15:51:31.245096 | controller | Monday 09 March 2026 15:51:31 +0000 (0:00:00.173) 0:07:12.268 ********** 2026-03-09 15:51:31.868252 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:31.868330 | controller | 2026-03-09 15:51:31.868439 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-03-09 15:51:31.868534 | controller | Monday 09 March 2026 15:51:31 +0000 (0:00:00.623) 0:07:12.892 ********** 2026-03-09 15:51:31.919038 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:31.919221 | controller | 2026-03-09 15:51:31.919317 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-03-09 15:51:31.919337 | controller | Monday 09 March 2026 15:51:31 +0000 (0:00:00.051) 0:07:12.943 ********** 2026-03-09 15:51:32.876418 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:32.876488 | controller | 2026-03-09 15:51:32.876597 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-03-09 15:51:32.876736 | controller | Monday 09 March 2026 15:51:32 +0000 (0:00:00.956) 0:07:13.900 ********** 2026-03-09 15:51:32.924941 | controller | skipping: [instance] 2026-03-09 15:51:32.925029 | controller | 2026-03-09 15:51:32.925134 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-03-09 15:51:32.925233 | controller | Monday 09 March 2026 15:51:32 +0000 (0:00:00.049) 0:07:13.949 ********** 2026-03-09 15:51:33.702653 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:33.702704 | controller | 2026-03-09 15:51:33.702933 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-03-09 15:51:33.755889 | controller | Monday 09 March 2026 15:51:33 +0000 (0:00:00.777) 0:07:14.726 ********** 2026-03-09 15:51:33.755914 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:33.755967 | controller | 2026-03-09 15:51:33.756074 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-03-09 15:51:33.756166 | controller | Monday 09 March 2026 15:51:33 +0000 (0:00:00.053) 0:07:14.780 ********** 2026-03-09 15:51:34.697607 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:34.697953 | controller | 2026-03-09 15:51:35.243102 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-03-09 15:51:35.243133 | controller | Monday 09 March 2026 15:51:34 +0000 (0:00:00.941) 0:07:15.721 ********** 2026-03-09 15:51:35.243146 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:35.400194 | controller | 2026-03-09 15:51:35.400227 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-03-09 15:51:35.400235 | controller | Monday 09 March 2026 15:51:35 +0000 (0:00:00.544) 0:07:16.266 ********** 2026-03-09 15:51:35.400245 | controller | 2026-03-09 15:51:36.552106 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-03-09 15:51:36.552162 | controller | Monday 09 March 2026 15:51:35 +0000 (0:00:00.157) 0:07:16.424 ********** 2026-03-09 15:51:36.552177 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:36.552204 | controller | 2026-03-09 15:51:36.552212 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2026-03-09 15:51:36.552314 | controller | Monday 09 March 2026 15:51:36 +0000 (0:00:01.152) 0:07:17.576 ********** 2026-03-09 15:51:37.691224 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:37.691278 | controller | 2026-03-09 15:51:37.691289 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2026-03-09 15:51:37.691403 | controller | Monday 09 March 2026 15:51:37 +0000 (0:00:01.139) 0:07:18.715 ********** 2026-03-09 15:51:37.721003 | controller | skipping: [instance] 2026-03-09 15:51:37.762090 | controller | 2026-03-09 15:51:37.762125 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2026-03-09 15:51:37.762134 | controller | Monday 09 March 2026 15:51:37 +0000 (0:00:00.029) 0:07:18.745 ********** 2026-03-09 15:51:37.762145 | controller | skipping: [instance] 2026-03-09 15:51:37.762188 | controller | 2026-03-09 15:51:37.762197 | controller | TASK [reproducer : Prepare architecture-based deployment] ********************** 2026-03-09 15:51:37.762206 | controller | Monday 09 March 2026 15:51:37 +0000 (0:00:00.041) 0:07:18.786 ********** 2026-03-09 15:51:37.803003 | controller | skipping: [instance] 2026-03-09 15:51:37.803096 | controller | 2026-03-09 15:51:37.803195 | controller | TASK [reproducer : Prepare architecture-based post deployment] ***************** 2026-03-09 15:51:37.803294 | controller | Monday 09 March 2026 15:51:37 +0000 (0:00:00.041) 0:07:18.827 ********** 2026-03-09 15:51:37.844535 | controller | skipping: [instance] 2026-03-09 15:51:37.844651 | controller | 2026-03-09 15:51:37.844762 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** 2026-03-09 15:51:37.844846 | controller | Monday 09 March 2026 15:51:37 +0000 (0:00:00.041) 0:07:18.869 ********** 2026-03-09 15:51:38.777084 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:38.777144 | controller | 2026-03-09 15:51:38.777266 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** 2026-03-09 15:51:38.777347 | controller | Monday 09 March 2026 15:51:38 +0000 (0:00:00.932) 0:07:19.801 ********** 2026-03-09 15:51:39.253240 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:39.253276 | controller | 2026-03-09 15:51:39.253393 | controller | TASK [Ensure we have needed inventory files] *********************************** 2026-03-09 15:51:39.253503 | controller | Monday 09 March 2026 15:51:39 +0000 (0:00:00.476) 0:07:20.277 ********** 2026-03-09 15:51:39.729933 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:39.730003 | controller | 2026-03-09 15:51:39.730077 | controller | TASK [Ensure we have CRC ssh key] ********************************************** 2026-03-09 15:51:39.730204 | controller | Monday 09 March 2026 15:51:39 +0000 (0:00:00.476) 0:07:20.754 ********** 2026-03-09 15:51:40.188042 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:40.188094 | controller | 2026-03-09 15:51:40.188218 | controller | TASK [Ensure we have the MAC mapping file] ************************************* 2026-03-09 15:51:40.188315 | controller | Monday 09 March 2026 15:51:40 +0000 (0:00:00.457) 0:07:21.212 ********** 2026-03-09 15:51:40.682782 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:40.682842 | controller | 2026-03-09 15:51:40.682936 | controller | TASK [Load crc inventory] ****************************************************** 2026-03-09 15:51:40.683104 | controller | Monday 09 March 2026 15:51:40 +0000 (0:00:00.494) 0:07:21.707 ********** 2026-03-09 15:51:41.183578 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:41.183664 | controller | 2026-03-09 15:51:41.183786 | controller | TASK [Load compute inventory] ************************************************** 2026-03-09 15:51:41.183871 | controller | Monday 09 March 2026 15:51:41 +0000 (0:00:00.500) 0:07:22.207 ********** 2026-03-09 15:51:41.667983 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:41.668042 | controller | 2026-03-09 15:51:41.668126 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** 2026-03-09 15:51:41.668228 | controller | Monday 09 March 2026 15:51:41 +0000 (0:00:00.484) 0:07:22.692 ********** 2026-03-09 15:51:42.152419 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:42.152470 | controller | 2026-03-09 15:51:42.152555 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* 2026-03-09 15:51:42.152666 | controller | Monday 09 March 2026 15:51:42 +0000 (0:00:00.484) 0:07:23.176 ********** 2026-03-09 15:51:42.622430 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:42.622487 | controller | 2026-03-09 15:51:42.622553 | controller | TASK [Check default location secret file] ************************************** 2026-03-09 15:51:42.622638 | controller | Monday 09 March 2026 15:51:42 +0000 (0:00:00.469) 0:07:23.646 ********** 2026-03-09 15:51:43.103457 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:43.103521 | controller | 2026-03-09 15:51:43.103620 | controller | TASK [Check non-default location secret] *************************************** 2026-03-09 15:51:43.103738 | controller | Monday 09 March 2026 15:51:43 +0000 (0:00:00.481) 0:07:24.127 ********** 2026-03-09 15:51:43.591567 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-03-09 15:51:43.591610 | controller | 2026-03-09 15:51:43.591759 | controller | TASK [Assert all of the tests] ************************************************* 2026-03-09 15:51:43.591855 | controller | Monday 09 March 2026 15:51:43 +0000 (0:00:00.488) 0:07:24.615 ********** 2026-03-09 15:51:43.634317 | controller | ok: [instance] 2026-03-09 15:51:43.634389 | controller | 2026-03-09 15:51:43.634483 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-03-09 15:51:43.634591 | controller | Monday 09 March 2026 15:51:43 +0000 (0:00:00.042) 0:07:24.658 ********** 2026-03-09 15:51:43.845678 | controller | changed: [instance] 2026-03-09 15:51:43.845757 | controller | 2026-03-09 15:51:43.845857 | controller | TASK [Get journalctl in a file] ************************************************ 2026-03-09 15:51:43.845955 | controller | Monday 09 March 2026 15:51:43 +0000 (0:00:00.211) 0:07:24.870 ********** 2026-03-09 15:51:44.078786 | controller | changed: [instance] 2026-03-09 15:51:44.078870 | controller | 2026-03-09 15:51:44.078967 | controller | TASK [Dump journalctl output] ************************************************** 2026-03-09 15:51:44.079079 | controller | Monday 09 March 2026 15:51:44 +0000 (0:00:00.233) 0:07:25.103 ********** 2026-03-09 15:51:44.488958 | controller | changed: [instance] 2026-03-09 15:51:44.489189 | controller | 2026-03-09 15:51:44.489232 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-03-09 15:51:44.489243 | controller | Monday 09 March 2026 15:51:44 +0000 (0:00:00.410) 0:07:25.513 ********** 2026-03-09 15:51:44.999758 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-03-09 15:51:44.999829 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-03-09 15:51:44.999910 | controller | 2026-03-09 15:51:45.000002 | controller | TASK [Create log directory] **************************************************** 2026-03-09 15:51:45.000110 | controller | Monday 09 March 2026 15:51:44 +0000 (0:00:00.510) 0:07:26.024 ********** 2026-03-09 15:51:45.216990 | controller | changed: [instance] 2026-03-09 15:51:45.217049 | controller | 2026-03-09 15:51:45.217158 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-03-09 15:51:45.217373 | controller | Monday 09 March 2026 15:51:45 +0000 (0:00:00.217) 0:07:26.241 ********** 2026-03-09 15:51:46.127718 | controller | changed: [instance] 2026-03-09 15:51:46.127777 | controller | 2026-03-09 15:51:46.127885 | controller | PLAY RECAP ********************************************************************* 2026-03-09 15:51:46.128244 | controller | instance : ok=555 changed=212 unreachable=0 failed=0 skipped=254 rescued=0 ignored=0 2026-03-09 15:51:46.128270 | controller | 2026-03-09 15:51:46.128277 | controller | Monday 09 March 2026 15:51:46 +0000 (0:00:00.909) 0:07:27.150 ********** 2026-03-09 15:51:46.128285 | controller | =============================================================================== 2026-03-09 15:51:46.128410 | controller | reproducer : Check package install status ------------------------------ 50.57s 2026-03-09 15:51:46.128439 | controller | ci_setup : Install needed packages ------------------------------------- 34.28s 2026-03-09 15:51:46.128533 | controller | libvirt_manager : Download base image ---------------------------------- 32.00s 2026-03-09 15:51:46.128611 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 22.97s 2026-03-09 15:51:46.128731 | controller | reproducer : Install collections on controller-0 ----------------------- 22.41s 2026-03-09 15:51:46.128806 | controller | libvirt_manager : Install packages required for using KVM -------------- 10.81s 2026-03-09 15:51:46.128892 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.67s 2026-03-09 15:51:46.128989 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.91s 2026-03-09 15:51:46.129120 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.63s 2026-03-09 15:51:46.129174 | controller | ci_setup : Install openshift client ------------------------------------- 6.19s 2026-03-09 15:51:46.129251 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.06s 2026-03-09 15:51:46.129337 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.90s 2026-03-09 15:51:46.129424 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.63s 2026-03-09 15:51:46.129508 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.50s 2026-03-09 15:51:46.129594 | controller | networking_mapper : Gather the facts ------------------------------------ 3.36s 2026-03-09 15:51:46.129726 | controller | ci_setup : Manage directories ------------------------------------------- 2.76s 2026-03-09 15:51:46.129809 | controller | sushy_emulator : Install required packages ------------------------------ 2.52s 2026-03-09 15:51:46.129896 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.48s 2026-03-09 15:51:46.129982 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.32s 2026-03-09 15:51:46.130070 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2026-03-09 15:51:46.256405 | controller | INFO Running crc_layout > cleanup 2026-03-09 15:51:46.256799 | controller | WARNING Skipping, cleanup playbook not configured. 2026-03-09 15:51:46.264203 | controller | INFO Running job_uri > prepare 2026-03-09 15:51:46.264577 | controller | WARNING Skipping, prepare playbook not configured. 2026-03-09 15:51:46.271892 | controller | INFO Running job_uri > converge 2026-03-09 15:51:46.716065 | controller | 2026-03-09 15:51:46.716133 | controller | PLAY [Prepare] ***************************************************************** 2026-03-09 15:51:46.716250 | controller | 2026-03-09 15:51:46.716348 | controller | TASK [Call task file in loop] ************************************************** 2026-03-09 15:51:46.716447 | controller | Monday 09 March 2026 15:51:46 +0000 (0:00:00.034) 0:00:00.034 ********** 2026-03-09 15:51:46.784269 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) 2026-03-09 15:51:46.784330 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2026-03-09 15:51:46.784444 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2026-03-09 15:51:46.784543 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) 2026-03-09 15:51:46.784664 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2026-03-09 15:51:46.784784 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2026-03-09 15:51:46.784877 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) 2026-03-09 15:51:46.784966 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) 2026-03-09 15:51:46.785070 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) 2026-03-09 15:51:46.785191 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) 2026-03-09 15:51:46.785274 | controller | 2026-03-09 15:51:46.785372 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** 2026-03-09 15:51:46.785462 | controller | Monday 09 March 2026 15:51:46 +0000 (0:00:00.068) 0:00:00.103 ********** 2026-03-09 15:51:46.822873 | controller | 2026-03-09 15:51:46.822944 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-09 15:51:46.823049 | controller | Monday 09 March 2026 15:51:46 +0000 (0:00:00.038) 0:00:00.142 ********** 2026-03-09 15:51:46.859731 | controller | ok: [instance] 2026-03-09 15:51:46.859782 | controller | 2026-03-09 15:51:46.859877 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-09 15:51:46.859971 | controller | Monday 09 March 2026 15:51:46 +0000 (0:00:00.036) 0:00:00.178 ********** 2026-03-09 15:51:46.896749 | controller | ok: [instance] 2026-03-09 15:51:46.896805 | controller | 2026-03-09 15:51:46.896916 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-09 15:51:46.897019 | controller | Monday 09 March 2026 15:51:46 +0000 (0:00:00.037) 0:00:00.216 ********** 2026-03-09 15:51:46.943219 | controller | ok: [instance] 2026-03-09 15:51:46.943357 | controller | 2026-03-09 15:51:46.943528 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-09 15:51:46.968794 | controller | Monday 09 March 2026 15:51:46 +0000 (0:00:00.046) 0:00:00.262 ********** 2026-03-09 15:51:46.968818 | controller | skipping: [instance] 2026-03-09 15:51:46.968897 | controller | 2026-03-09 15:51:46.969007 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-09 15:51:46.969142 | controller | Monday 09 March 2026 15:51:46 +0000 (0:00:00.025) 0:00:00.288 ********** 2026-03-09 15:51:47.026470 | controller | ok: [instance] => changed=false 2026-03-09 15:51:47.026577 | controller | msg: All assertions passed 2026-03-09 15:51:47.026682 | controller | 2026-03-09 15:51:47.026787 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2026-03-09 15:51:47.026880 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.057) 0:00:00.345 ********** 2026-03-09 15:51:47.062371 | controller | 2026-03-09 15:51:47.062469 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-09 15:51:47.062571 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.036) 0:00:00.381 ********** 2026-03-09 15:51:47.098312 | controller | ok: [instance] 2026-03-09 15:51:47.098402 | controller | 2026-03-09 15:51:47.098511 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-09 15:51:47.098610 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.035) 0:00:00.417 ********** 2026-03-09 15:51:47.136441 | controller | ok: [instance] 2026-03-09 15:51:47.136527 | controller | 2026-03-09 15:51:47.136646 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-09 15:51:47.136768 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.038) 0:00:00.455 ********** 2026-03-09 15:51:47.169518 | controller | ok: [instance] 2026-03-09 15:51:47.169646 | controller | 2026-03-09 15:51:47.169772 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-09 15:51:47.169870 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.033) 0:00:00.488 ********** 2026-03-09 15:51:47.194761 | controller | skipping: [instance] 2026-03-09 15:51:47.194843 | controller | 2026-03-09 15:51:47.194941 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-09 15:51:47.195052 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.025) 0:00:00.514 ********** 2026-03-09 15:51:47.230879 | controller | ok: [instance] => changed=false 2026-03-09 15:51:47.230961 | controller | msg: All assertions passed 2026-03-09 15:51:47.231087 | controller | 2026-03-09 15:51:47.231222 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2026-03-09 15:51:47.231311 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.036) 0:00:00.550 ********** 2026-03-09 15:51:47.268280 | controller | 2026-03-09 15:51:47.268373 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-09 15:51:47.268472 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.037) 0:00:00.587 ********** 2026-03-09 15:51:47.305867 | controller | ok: [instance] 2026-03-09 15:51:47.305956 | controller | 2026-03-09 15:51:47.306054 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-09 15:51:47.306152 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.036) 0:00:00.624 ********** 2026-03-09 15:51:47.347507 | controller | ok: [instance] 2026-03-09 15:51:47.347600 | controller | 2026-03-09 15:51:47.347735 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-09 15:51:47.347832 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.042) 0:00:00.666 ********** 2026-03-09 15:51:47.384249 | controller | ok: [instance] 2026-03-09 15:51:47.384327 | controller | 2026-03-09 15:51:47.384432 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-09 15:51:47.384527 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.036) 0:00:00.703 ********** 2026-03-09 15:51:47.410006 | controller | skipping: [instance] 2026-03-09 15:51:47.410081 | controller | 2026-03-09 15:51:47.410183 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-09 15:51:47.410278 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.025) 0:00:00.729 ********** 2026-03-09 15:51:47.447879 | controller | ok: [instance] => changed=false 2026-03-09 15:51:47.447957 | controller | msg: All assertions passed 2026-03-09 15:51:47.448049 | controller | 2026-03-09 15:51:47.448153 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** 2026-03-09 15:51:47.448256 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.037) 0:00:00.767 ********** 2026-03-09 15:51:47.489432 | controller | 2026-03-09 15:51:47.489514 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-09 15:51:47.489613 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.041) 0:00:00.808 ********** 2026-03-09 15:51:47.524867 | controller | ok: [instance] 2026-03-09 15:51:47.524951 | controller | 2026-03-09 15:51:47.525070 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-09 15:51:47.525187 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.035) 0:00:00.844 ********** 2026-03-09 15:51:47.565246 | controller | ok: [instance] 2026-03-09 15:51:47.565316 | controller | 2026-03-09 15:51:47.565412 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-09 15:51:47.565507 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.040) 0:00:00.884 ********** 2026-03-09 15:51:47.601333 | controller | ok: [instance] 2026-03-09 15:51:47.601410 | controller | 2026-03-09 15:51:47.601514 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-09 15:51:47.601607 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.036) 0:00:00.920 ********** 2026-03-09 15:51:47.630846 | controller | skipping: [instance] 2026-03-09 15:51:47.630925 | controller | 2026-03-09 15:51:47.631051 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-09 15:51:47.631142 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.029) 0:00:00.950 ********** 2026-03-09 15:51:47.665467 | controller | ok: [instance] => changed=false 2026-03-09 15:51:47.665556 | controller | msg: All assertions passed 2026-03-09 15:51:47.665660 | controller | 2026-03-09 15:51:47.665774 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2026-03-09 15:51:47.665861 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.034) 0:00:00.984 ********** 2026-03-09 15:51:47.725710 | controller | 2026-03-09 15:51:47.725821 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-09 15:51:47.725918 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.060) 0:00:01.045 ********** 2026-03-09 15:51:47.761184 | controller | ok: [instance] 2026-03-09 15:51:47.761277 | controller | 2026-03-09 15:51:47.761382 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-09 15:51:47.761481 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.035) 0:00:01.080 ********** 2026-03-09 15:51:47.789935 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:47.790035 | controller | assertion: _matched_url | default('') | length > 0 2026-03-09 15:51:47.790140 | controller | evaluated_to: false 2026-03-09 15:51:47.790267 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2026-03-09 15:51:47.819133 | controller | 2026-03-09 15:51:47.819261 | controller | TASK [Clear errors to manually handle them] ************************************ 2026-03-09 15:51:47.819745 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.039) 0:00:01.120 ********** 2026-03-09 15:51:47.819862 | controller | 2026-03-09 15:51:47.819970 | controller | TASK [Really fail if string passed but should have failed] ********************* 2026-03-09 15:51:47.820062 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.017) 0:00:01.138 ********** 2026-03-09 15:51:47.856985 | controller | skipping: [instance] 2026-03-09 15:51:47.857153 | controller | 2026-03-09 15:51:47.857270 | controller | TASK [Really fail if string failed but should have passed] ********************* 2026-03-09 15:51:47.857282 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.038) 0:00:01.176 ********** 2026-03-09 15:51:47.889337 | controller | skipping: [instance] 2026-03-09 15:51:47.889415 | controller | 2026-03-09 15:51:47.889522 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2026-03-09 15:51:47.889618 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.032) 0:00:01.208 ********** 2026-03-09 15:51:47.925760 | controller | 2026-03-09 15:51:47.925863 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-09 15:51:47.925963 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.036) 0:00:01.245 ********** 2026-03-09 15:51:47.959043 | controller | ok: [instance] 2026-03-09 15:51:47.959194 | controller | 2026-03-09 15:51:47.959239 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-09 15:51:47.959340 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.033) 0:00:01.278 ********** 2026-03-09 15:51:47.986734 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:47.986833 | controller | assertion: _matched_url | default('') | length > 0 2026-03-09 15:51:47.986932 | controller | evaluated_to: false 2026-03-09 15:51:47.987366 | controller | msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2026-03-09 15:51:48.018073 | controller | 2026-03-09 15:51:48.018178 | controller | TASK [Clear errors to manually handle them] ************************************ 2026-03-09 15:51:48.018294 | controller | Monday 09 March 2026 15:51:47 +0000 (0:00:00.040) 0:00:01.319 ********** 2026-03-09 15:51:48.018379 | controller | 2026-03-09 15:51:48.018475 | controller | TASK [Really fail if string passed but should have failed] ********************* 2026-03-09 15:51:48.018573 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.018) 0:00:01.337 ********** 2026-03-09 15:51:48.052874 | controller | skipping: [instance] 2026-03-09 15:51:48.052960 | controller | 2026-03-09 15:51:48.053062 | controller | TASK [Really fail if string failed but should have passed] ********************* 2026-03-09 15:51:48.053167 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.034) 0:00:01.372 ********** 2026-03-09 15:51:48.088242 | controller | skipping: [instance] 2026-03-09 15:51:48.088323 | controller | 2026-03-09 15:51:48.088433 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** 2026-03-09 15:51:48.088530 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.035) 0:00:01.407 ********** 2026-03-09 15:51:48.130305 | controller | 2026-03-09 15:51:48.130407 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-09 15:51:48.130514 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.042) 0:00:01.449 ********** 2026-03-09 15:51:48.165430 | controller | ok: [instance] 2026-03-09 15:51:48.165547 | controller | 2026-03-09 15:51:48.165670 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-09 15:51:48.165764 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.034) 0:00:01.484 ********** 2026-03-09 15:51:48.208980 | controller | ok: [instance] 2026-03-09 15:51:48.209085 | controller | 2026-03-09 15:51:48.209190 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-09 15:51:48.209286 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.043) 0:00:01.528 ********** 2026-03-09 15:51:48.246057 | controller | ok: [instance] 2026-03-09 15:51:48.246142 | controller | 2026-03-09 15:51:48.246258 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-09 15:51:48.246347 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.037) 0:00:01.565 ********** 2026-03-09 15:51:48.273906 | controller | skipping: [instance] 2026-03-09 15:51:48.274439 | controller | 2026-03-09 15:51:48.274790 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-09 15:51:48.274928 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.027) 0:00:01.592 ********** 2026-03-09 15:51:48.311299 | controller | ok: [instance] => changed=false 2026-03-09 15:51:48.311411 | controller | msg: All assertions passed 2026-03-09 15:51:48.311520 | controller | 2026-03-09 15:51:48.311668 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** 2026-03-09 15:51:48.311797 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.038) 0:00:01.630 ********** 2026-03-09 15:51:48.354138 | controller | 2026-03-09 15:51:48.354291 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-09 15:51:48.354502 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.042) 0:00:01.673 ********** 2026-03-09 15:51:48.416305 | controller | ok: [instance] 2026-03-09 15:51:48.416389 | controller | 2026-03-09 15:51:48.416494 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-09 15:51:48.416646 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.062) 0:00:01.735 ********** 2026-03-09 15:51:48.454051 | controller | ok: [instance] 2026-03-09 15:51:48.454151 | controller | 2026-03-09 15:51:48.454293 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2026-03-09 15:51:48.454411 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.037) 0:00:01.773 ********** 2026-03-09 15:51:48.493207 | controller | ok: [instance] 2026-03-09 15:51:48.493305 | controller | 2026-03-09 15:51:48.493420 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2026-03-09 15:51:48.493545 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.039) 0:00:01.812 ********** 2026-03-09 15:51:48.521774 | controller | skipping: [instance] 2026-03-09 15:51:48.521858 | controller | 2026-03-09 15:51:48.521961 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2026-03-09 15:51:48.522083 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.028) 0:00:01.841 ********** 2026-03-09 15:51:48.557474 | controller | ok: [instance] => changed=false 2026-03-09 15:51:48.557589 | controller | msg: All assertions passed 2026-03-09 15:51:48.557735 | controller | 2026-03-09 15:51:48.557862 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** 2026-03-09 15:51:48.599887 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.035) 0:00:01.876 ********** 2026-03-09 15:51:48.599912 | controller | 2026-03-09 15:51:48.600013 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-09 15:51:48.600138 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.042) 0:00:01.919 ********** 2026-03-09 15:51:48.634254 | controller | ok: [instance] 2026-03-09 15:51:48.634343 | controller | 2026-03-09 15:51:48.634489 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-09 15:51:48.634535 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.034) 0:00:01.953 ********** 2026-03-09 15:51:48.664376 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:48.664486 | controller | assertion: _matched_url | default('') | length > 0 2026-03-09 15:51:48.664596 | controller | evaluated_to: false 2026-03-09 15:51:48.664714 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2026-03-09 15:51:48.693761 | controller | 2026-03-09 15:51:48.693851 | controller | TASK [Clear errors to manually handle them] ************************************ 2026-03-09 15:51:48.693947 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.042) 0:00:01.995 ********** 2026-03-09 15:51:48.694056 | controller | 2026-03-09 15:51:48.694136 | controller | TASK [Really fail if string passed but should have failed] ********************* 2026-03-09 15:51:48.694223 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.017) 0:00:02.012 ********** 2026-03-09 15:51:48.728851 | controller | skipping: [instance] 2026-03-09 15:51:48.728921 | controller | 2026-03-09 15:51:48.728939 | controller | TASK [Really fail if string failed but should have passed] ********************* 2026-03-09 15:51:48.728951 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.035) 0:00:02.048 ********** 2026-03-09 15:51:48.767741 | controller | skipping: [instance] 2026-03-09 15:51:48.767821 | controller | 2026-03-09 15:51:48.767927 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** 2026-03-09 15:51:48.768027 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.038) 0:00:02.086 ********** 2026-03-09 15:51:48.807059 | controller | 2026-03-09 15:51:48.807167 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2026-03-09 15:51:48.807273 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.039) 0:00:02.126 ********** 2026-03-09 15:51:48.846343 | controller | ok: [instance] 2026-03-09 15:51:48.846424 | controller | 2026-03-09 15:51:48.846522 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2026-03-09 15:51:48.846719 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.039) 0:00:02.165 ********** 2026-03-09 15:51:48.874338 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:48.874430 | controller | assertion: _matched_url | default('') | length > 0 2026-03-09 15:51:48.874523 | controller | evaluated_to: false 2026-03-09 15:51:48.874639 | controller | msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2026-03-09 15:51:48.904077 | controller | 2026-03-09 15:51:48.904442 | controller | TASK [Clear errors to manually handle them] ************************************ 2026-03-09 15:51:48.904578 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.038) 0:00:02.204 ********** 2026-03-09 15:51:48.904596 | controller | 2026-03-09 15:51:48.904607 | controller | TASK [Really fail if string passed but should have failed] ********************* 2026-03-09 15:51:48.904739 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.018) 0:00:02.223 ********** 2026-03-09 15:51:48.938986 | controller | skipping: [instance] 2026-03-09 15:51:48.939076 | controller | 2026-03-09 15:51:48.939189 | controller | TASK [Really fail if string failed but should have passed] ********************* 2026-03-09 15:51:48.939285 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.035) 0:00:02.258 ********** 2026-03-09 15:51:48.971467 | controller | skipping: [instance] 2026-03-09 15:51:48.971491 | controller | 2026-03-09 15:51:48.971642 | controller | TASK [Print success message] *************************************************** 2026-03-09 15:51:48.971728 | controller | Monday 09 March 2026 15:51:48 +0000 (0:00:00.032) 0:00:02.290 ********** 2026-03-09 15:51:49.026772 | controller | ok: [instance] => 2026-03-09 15:51:49.026890 | controller | msg: All strings passed! 2026-03-09 15:51:49.027010 | controller | 2026-03-09 15:51:49.027123 | controller | PLAY RECAP ********************************************************************* 2026-03-09 15:51:49.027243 | controller | instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 2026-03-09 15:51:49.027321 | controller | 2026-03-09 15:51:49.027408 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.055) 0:00:02.346 ********** 2026-03-09 15:51:49.027493 | controller | =============================================================================== 2026-03-09 15:51:49.027583 | controller | Call task file in loop -------------------------------------------------- 0.07s 2026-03-09 15:51:49.027692 | controller | reproducer : Apply regex match filter ----------------------------------- 0.06s 2026-03-09 15:51:49.027778 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.06s 2026-03-09 15:51:49.027868 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.06s 2026-03-09 15:51:49.027954 | controller | Print success message --------------------------------------------------- 0.06s 2026-03-09 15:51:49.028055 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2026-03-09 15:51:49.028138 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-09 15:51:49.028235 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.04s 2026-03-09 15:51:49.028325 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-09 15:51:49.028414 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 --- 0.04s 2026-03-09 15:51:49.028499 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-09 15:51:49.028587 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log --- 0.04s 2026-03-09 15:51:49.028699 | controller | Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35 --- 0.04s 2026-03-09 15:51:49.028795 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-09 15:51:49.028882 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-09 15:51:49.028970 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2026-03-09 15:51:49.029063 | controller | Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a --- 0.04s 2026-03-09 15:51:49.029151 | controller | reproducer : Apply regex match filter ----------------------------------- 0.04s 2026-03-09 15:51:49.029256 | controller | reproducer : Extract job id for later reference ------------------------- 0.04s 2026-03-09 15:51:49.029346 | controller | Really fail if string failed but should have passed --------------------- 0.04s 2026-03-09 15:51:49.116034 | controller | INFO Running job_uri > cleanup 2026-03-09 15:51:49.116399 | controller | WARNING Skipping, cleanup playbook not configured. 2026-03-09 15:51:49.123660 | controller | INFO Running network_validations > prepare 2026-03-09 15:51:49.124068 | controller | WARNING Skipping, prepare playbook not configured. 2026-03-09 15:51:49.131170 | controller | INFO Running network_validations > converge 2026-03-09 15:51:49.558513 | controller | 2026-03-09 15:51:49.558589 | controller | PLAY [Prepare] ***************************************************************** 2026-03-09 15:51:49.558708 | controller | 2026-03-09 15:51:49.558787 | controller | TASK [Set failed fact] ********************************************************* 2026-03-09 15:51:49.558876 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.033) 0:00:00.033 ********** 2026-03-09 15:51:49.581978 | controller | ok: [instance] 2026-03-09 15:51:49.582073 | controller | 2026-03-09 15:51:49.582212 | controller | TASK [Load scenarios] ********************************************************** 2026-03-09 15:51:49.582321 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.023) 0:00:00.057 ********** 2026-03-09 15:51:49.605606 | controller | ok: [instance] 2026-03-09 15:51:49.605732 | controller | 2026-03-09 15:51:49.605850 | controller | TASK [Test network validations] ************************************************ 2026-03-09 15:51:49.605962 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.023) 0:00:00.081 ********** 2026-03-09 15:51:49.669898 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) 2026-03-09 15:51:49.670015 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) 2026-03-09 15:51:49.670147 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) 2026-03-09 15:51:49.670283 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) 2026-03-09 15:51:49.670381 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) 2026-03-09 15:51:49.670486 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) 2026-03-09 15:51:49.670574 | controller | 2026-03-09 15:51:49.670700 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:49.670788 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.064) 0:00:00.145 ********** 2026-03-09 15:51:49.695791 | controller | ok: [instance] 2026-03-09 15:51:49.695872 | controller | 2026-03-09 15:51:49.695965 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:49.696062 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.025) 0:00:00.171 ********** 2026-03-09 15:51:49.724575 | controller | ok: [instance] 2026-03-09 15:51:49.724670 | controller | 2026-03-09 15:51:49.724777 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:49.724872 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.028) 0:00:00.200 ********** 2026-03-09 15:51:49.749659 | controller | ok: [instance] => 2026-03-09 15:51:49.749757 | controller | msg: 'Running: Default nets only' 2026-03-09 15:51:49.749849 | controller | 2026-03-09 15:51:49.749944 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:49.750045 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.025) 0:00:00.225 ********** 2026-03-09 15:51:49.791801 | controller | 2026-03-09 15:51:49.791922 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-09 15:51:49.792024 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.042) 0:00:00.267 ********** 2026-03-09 15:51:49.818706 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-09 15:51:49.818826 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-09 15:51:49.818922 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-09 15:51:49.819066 | controller | collisions and unexpected behavior. 2026-03-09 15:51:49.876453 | controller | ok: [instance] => (item=controller) 2026-03-09 15:51:49.876525 | controller | 2026-03-09 15:51:49.876651 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-09 15:51:49.876743 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.084) 0:00:00.352 ********** 2026-03-09 15:51:49.929405 | controller | ok: [instance] 2026-03-09 15:51:49.929514 | controller | 2026-03-09 15:51:49.929609 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-03-09 15:51:49.929732 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.052) 0:00:00.405 ********** 2026-03-09 15:51:49.992532 | controller | ok: [instance] => changed=false 2026-03-09 15:51:49.992617 | controller | msg: All assertions passed 2026-03-09 15:51:49.992728 | controller | 2026-03-09 15:51:49.992825 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:49.992923 | controller | Monday 09 March 2026 15:51:49 +0000 (0:00:00.063) 0:00:00.468 ********** 2026-03-09 15:51:50.029863 | controller | skipping: [instance] 2026-03-09 15:51:50.029943 | controller | 2026-03-09 15:51:50.030073 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:50.030199 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.037) 0:00:00.505 ********** 2026-03-09 15:51:50.064779 | controller | skipping: [instance] 2026-03-09 15:51:50.064860 | controller | 2026-03-09 15:51:50.064958 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:50.065087 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.034) 0:00:00.540 ********** 2026-03-09 15:51:50.097513 | controller | skipping: [instance] 2026-03-09 15:51:50.097596 | controller | 2026-03-09 15:51:50.097711 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:50.097817 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.032) 0:00:00.573 ********** 2026-03-09 15:51:50.119357 | controller | ok: [instance] 2026-03-09 15:51:50.119440 | controller | 2026-03-09 15:51:50.119542 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:50.119658 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.021) 0:00:00.595 ********** 2026-03-09 15:51:50.144736 | controller | ok: [instance] 2026-03-09 15:51:50.144817 | controller | 2026-03-09 15:51:50.144917 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:50.145022 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.025) 0:00:00.620 ********** 2026-03-09 15:51:50.173855 | controller | ok: [instance] => 2026-03-09 15:51:50.173949 | controller | msg: 'Running: Default nets and spine/leaf' 2026-03-09 15:51:50.174057 | controller | 2026-03-09 15:51:50.174162 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:50.174253 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.029) 0:00:00.649 ********** 2026-03-09 15:51:50.214281 | controller | 2026-03-09 15:51:50.214387 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-09 15:51:50.214493 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.040) 0:00:00.690 ********** 2026-03-09 15:51:50.239724 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-09 15:51:50.257790 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-09 15:51:50.257814 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-09 15:51:50.257821 | controller | collisions and unexpected behavior. 2026-03-09 15:51:50.257832 | controller | ok: [instance] => (item=controller) 2026-03-09 15:51:50.257856 | controller | 2026-03-09 15:51:50.257965 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-09 15:51:50.258064 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.043) 0:00:00.733 ********** 2026-03-09 15:51:50.315235 | controller | ok: [instance] 2026-03-09 15:51:50.315324 | controller | 2026-03-09 15:51:50.315883 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-03-09 15:51:50.316009 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.057) 0:00:00.790 ********** 2026-03-09 15:51:50.378152 | controller | ok: [instance] => changed=false 2026-03-09 15:51:50.378318 | controller | msg: All assertions passed 2026-03-09 15:51:50.378418 | controller | 2026-03-09 15:51:50.378546 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:50.378724 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.062) 0:00:00.853 ********** 2026-03-09 15:51:50.413447 | controller | skipping: [instance] 2026-03-09 15:51:50.413561 | controller | 2026-03-09 15:51:50.413662 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:50.413784 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.035) 0:00:00.889 ********** 2026-03-09 15:51:50.446104 | controller | skipping: [instance] 2026-03-09 15:51:50.446205 | controller | 2026-03-09 15:51:50.446293 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:50.446390 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.032) 0:00:00.921 ********** 2026-03-09 15:51:50.480736 | controller | skipping: [instance] 2026-03-09 15:51:50.480828 | controller | 2026-03-09 15:51:50.480930 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:50.481017 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.034) 0:00:00.956 ********** 2026-03-09 15:51:50.503111 | controller | ok: [instance] 2026-03-09 15:51:50.503208 | controller | 2026-03-09 15:51:50.503308 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:50.503398 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.022) 0:00:00.978 ********** 2026-03-09 15:51:50.528689 | controller | ok: [instance] 2026-03-09 15:51:50.528797 | controller | 2026-03-09 15:51:50.528920 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:50.529051 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.025) 0:00:01.004 ********** 2026-03-09 15:51:50.553040 | controller | ok: [instance] => 2026-03-09 15:51:50.553144 | controller | msg: 'Running: Default nets with extra defined net' 2026-03-09 15:51:50.553249 | controller | 2026-03-09 15:51:50.553329 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:50.553432 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.024) 0:00:01.028 ********** 2026-03-09 15:51:50.600846 | controller | 2026-03-09 15:51:50.600948 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-09 15:51:50.601044 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.047) 0:00:01.076 ********** 2026-03-09 15:51:50.627294 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-09 15:51:50.627388 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-09 15:51:50.627503 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-09 15:51:50.627594 | controller | collisions and unexpected behavior. 2026-03-09 15:51:50.675178 | controller | ok: [instance] => (item=controller) 2026-03-09 15:51:50.675238 | controller | 2026-03-09 15:51:50.675471 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-09 15:51:50.729867 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.073) 0:00:01.150 ********** 2026-03-09 15:51:50.729889 | controller | ok: [instance] 2026-03-09 15:51:50.729951 | controller | 2026-03-09 15:51:50.730068 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-03-09 15:51:50.730180 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.055) 0:00:01.205 ********** 2026-03-09 15:51:50.775927 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:50.776068 | controller | assertion: _defined | difference(_all_nets) | length == 0 2026-03-09 15:51:50.776200 | controller | evaluated_to: false 2026-03-09 15:51:50.776248 | controller | msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' 2026-03-09 15:51:50.787662 | controller | 2026-03-09 15:51:50.787767 | controller | TASK [reproducer : Dump initial layout] **************************************** 2026-03-09 15:51:50.787964 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.057) 0:00:01.263 ********** 2026-03-09 15:51:50.819465 | controller | ok: [instance] => 2026-03-09 15:51:50.819564 | controller | cifmw_libvirt_manager_configuration: 2026-03-09 15:51:50.819677 | controller | networks: 2026-03-09 15:51:50.819793 | controller | public: defined 2026-03-09 15:51:50.819876 | controller | vms: 2026-03-09 15:51:50.819952 | controller | controller: 2026-03-09 15:51:50.820068 | controller | nets: 2026-03-09 15:51:50.820164 | controller | - public 2026-03-09 15:51:50.820252 | controller | 2026-03-09 15:51:50.820344 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2026-03-09 15:51:50.820436 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.031) 0:00:01.295 ********** 2026-03-09 15:51:50.849143 | controller | skipping: [instance] 2026-03-09 15:51:50.849221 | controller | 2026-03-09 15:51:50.849320 | controller | TASK [reproducer : Dump layout patches] **************************************** 2026-03-09 15:51:50.849413 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.029) 0:00:01.324 ********** 2026-03-09 15:51:50.925115 | controller | skipping: [instance] 2026-03-09 15:51:50.925207 | controller | 2026-03-09 15:51:50.925306 | controller | TASK [reproducer : Dump built layout] ****************************************** 2026-03-09 15:51:50.925399 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.075) 0:00:01.400 ********** 2026-03-09 15:51:50.964057 | controller | ok: [instance] => 2026-03-09 15:51:50.964175 | controller | _cifmw_libvirt_manager_layout: 2026-03-09 15:51:50.964290 | controller | networks: 2026-03-09 15:51:50.964403 | controller | extra_net_1: defined 2026-03-09 15:51:50.964508 | controller | public: defined 2026-03-09 15:51:50.964616 | controller | vms: 2026-03-09 15:51:50.964851 | controller | controller: 2026-03-09 15:51:50.964934 | controller | nets: 2026-03-09 15:51:50.964943 | controller | - public 2026-03-09 15:51:50.965015 | controller | 2026-03-09 15:51:50.965103 | controller | TASK [reproducer : Fail for good] ********************************************** 2026-03-09 15:51:50.965205 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.038) 0:00:01.439 ********** 2026-03-09 15:51:50.977330 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:50.977423 | controller | msg: Error detected, please check assertions and debugging output above. 2026-03-09 15:51:51.014453 | controller | 2026-03-09 15:51:51.014544 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:51:51.014769 | controller | Monday 09 March 2026 15:51:50 +0000 (0:00:00.029) 0:00:01.468 ********** 2026-03-09 15:51:51.014840 | controller | 2026-03-09 15:51:51.014849 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:51.014930 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.020) 0:00:01.489 ********** 2026-03-09 15:51:51.038124 | controller | ok: [instance] 2026-03-09 15:51:51.038256 | controller | 2026-03-09 15:51:51.038270 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:51.074656 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.023) 0:00:01.513 ********** 2026-03-09 15:51:51.074677 | controller | skipping: [instance] 2026-03-09 15:51:51.074764 | controller | 2026-03-09 15:51:51.074775 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:51.074874 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.036) 0:00:01.550 ********** 2026-03-09 15:51:51.108251 | controller | skipping: [instance] 2026-03-09 15:51:51.108343 | controller | 2026-03-09 15:51:51.108427 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:51.108524 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.033) 0:00:01.583 ********** 2026-03-09 15:51:51.142813 | controller | skipping: [instance] 2026-03-09 15:51:51.142899 | controller | 2026-03-09 15:51:51.143006 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:51.143107 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.034) 0:00:01.618 ********** 2026-03-09 15:51:51.166449 | controller | ok: [instance] 2026-03-09 15:51:51.166550 | controller | 2026-03-09 15:51:51.166680 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:51.166776 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.023) 0:00:01.642 ********** 2026-03-09 15:51:51.194464 | controller | ok: [instance] 2026-03-09 15:51:51.194546 | controller | 2026-03-09 15:51:51.194669 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:51.194766 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.027) 0:00:01.670 ********** 2026-03-09 15:51:51.221164 | controller | ok: [instance] => 2026-03-09 15:51:51.221253 | controller | msg: 'Running: Missing default net definition' 2026-03-09 15:51:51.221354 | controller | 2026-03-09 15:51:51.221449 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:51.221542 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.026) 0:00:01.696 ********** 2026-03-09 15:51:51.260905 | controller | 2026-03-09 15:51:51.260994 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-09 15:51:51.261089 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.039) 0:00:01.736 ********** 2026-03-09 15:51:51.286281 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-09 15:51:51.286385 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-09 15:51:51.286471 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-09 15:51:51.286733 | controller | collisions and unexpected behavior. 2026-03-09 15:51:51.306359 | controller | ok: [instance] => (item=controller) 2026-03-09 15:51:51.306428 | controller | 2026-03-09 15:51:51.306534 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-09 15:51:51.306649 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.045) 0:00:01.781 ********** 2026-03-09 15:51:51.352313 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:51.352404 | controller | assertion: _all_nets | difference(_defined) | length == 0 2026-03-09 15:51:51.352497 | controller | evaluated_to: false 2026-03-09 15:51:51.352594 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' 2026-03-09 15:51:51.363847 | controller | 2026-03-09 15:51:51.363976 | controller | TASK [reproducer : Dump initial layout] **************************************** 2026-03-09 15:51:51.364056 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.057) 0:00:01.839 ********** 2026-03-09 15:51:51.397529 | controller | ok: [instance] => 2026-03-09 15:51:51.397617 | controller | cifmw_libvirt_manager_configuration: 2026-03-09 15:51:51.397757 | controller | networks: 2026-03-09 15:51:51.397847 | controller | public: defined 2026-03-09 15:51:51.397934 | controller | vms: 2026-03-09 15:51:51.398046 | controller | controller: 2026-03-09 15:51:51.398114 | controller | nets: 2026-03-09 15:51:51.398204 | controller | - public 2026-03-09 15:51:51.398285 | controller | 2026-03-09 15:51:51.398373 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2026-03-09 15:51:51.398461 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.033) 0:00:01.873 ********** 2026-03-09 15:51:51.427377 | controller | skipping: [instance] 2026-03-09 15:51:51.427452 | controller | 2026-03-09 15:51:51.427564 | controller | TASK [reproducer : Dump layout patches] **************************************** 2026-03-09 15:51:51.427654 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.029) 0:00:01.903 ********** 2026-03-09 15:51:51.528674 | controller | skipping: [instance] 2026-03-09 15:51:51.528763 | controller | 2026-03-09 15:51:51.528869 | controller | TASK [reproducer : Dump built layout] ****************************************** 2026-03-09 15:51:51.528978 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.100) 0:00:02.004 ********** 2026-03-09 15:51:51.589665 | controller | ok: [instance] => 2026-03-09 15:51:51.589811 | controller | _cifmw_libvirt_manager_layout: 2026-03-09 15:51:51.589920 | controller | networks: 2026-03-09 15:51:51.590032 | controller | public: defined 2026-03-09 15:51:51.590128 | controller | vms: 2026-03-09 15:51:51.590228 | controller | controller: 2026-03-09 15:51:51.590316 | controller | nets: 2026-03-09 15:51:51.590404 | controller | - public 2026-03-09 15:51:51.590492 | controller | - foo 2026-03-09 15:51:51.590576 | controller | 2026-03-09 15:51:51.590687 | controller | TASK [reproducer : Fail for good] ********************************************** 2026-03-09 15:51:51.590796 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.061) 0:00:02.065 ********** 2026-03-09 15:51:51.602391 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:51.602489 | controller | msg: Error detected, please check assertions and debugging output above. 2026-03-09 15:51:51.629019 | controller | 2026-03-09 15:51:51.629136 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:51:51.629271 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.022) 0:00:02.088 ********** 2026-03-09 15:51:51.629377 | controller | 2026-03-09 15:51:51.629494 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:51.629600 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.016) 0:00:02.104 ********** 2026-03-09 15:51:51.650890 | controller | ok: [instance] 2026-03-09 15:51:51.651012 | controller | 2026-03-09 15:51:51.651126 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:51.651276 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.022) 0:00:02.126 ********** 2026-03-09 15:51:51.685545 | controller | skipping: [instance] 2026-03-09 15:51:51.685642 | controller | 2026-03-09 15:51:51.685774 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:51.685865 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.034) 0:00:02.161 ********** 2026-03-09 15:51:51.718713 | controller | skipping: [instance] 2026-03-09 15:51:51.718761 | controller | 2026-03-09 15:51:51.718868 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:51.718973 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.032) 0:00:02.194 ********** 2026-03-09 15:51:51.753094 | controller | skipping: [instance] 2026-03-09 15:51:51.753175 | controller | 2026-03-09 15:51:51.753284 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:51.753378 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.034) 0:00:02.228 ********** 2026-03-09 15:51:51.776510 | controller | ok: [instance] 2026-03-09 15:51:51.776566 | controller | 2026-03-09 15:51:51.776679 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:51.776782 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.023) 0:00:02.252 ********** 2026-03-09 15:51:51.804399 | controller | ok: [instance] 2026-03-09 15:51:51.804560 | controller | 2026-03-09 15:51:51.804612 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:51.804753 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.027) 0:00:02.280 ********** 2026-03-09 15:51:51.832557 | controller | ok: [instance] => 2026-03-09 15:51:51.832669 | controller | msg: 'Running: Missing spine/leaf net definition' 2026-03-09 15:51:51.832878 | controller | 2026-03-09 15:51:51.832942 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:51.832952 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.028) 0:00:02.308 ********** 2026-03-09 15:51:51.876975 | controller | 2026-03-09 15:51:51.877101 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-09 15:51:51.877227 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.044) 0:00:02.352 ********** 2026-03-09 15:51:51.901605 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-09 15:51:51.901722 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-09 15:51:51.901823 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-09 15:51:51.901925 | controller | collisions and unexpected behavior. 2026-03-09 15:51:51.921028 | controller | ok: [instance] => (item=controller) 2026-03-09 15:51:51.921115 | controller | 2026-03-09 15:51:51.921233 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-03-09 15:51:51.921340 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.043) 0:00:02.396 ********** 2026-03-09 15:51:51.968572 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:51.968662 | controller | assertion: _all_nets | difference(_defined) | length == 0 2026-03-09 15:51:51.968757 | controller | evaluated_to: false 2026-03-09 15:51:51.968864 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' 2026-03-09 15:51:51.981097 | controller | 2026-03-09 15:51:51.981194 | controller | TASK [reproducer : Dump initial layout] **************************************** 2026-03-09 15:51:51.981290 | controller | Monday 09 March 2026 15:51:51 +0000 (0:00:00.059) 0:00:02.456 ********** 2026-03-09 15:51:52.014848 | controller | ok: [instance] => 2026-03-09 15:51:52.014925 | controller | cifmw_libvirt_manager_configuration: 2026-03-09 15:51:52.015061 | controller | networks: 2026-03-09 15:51:52.015109 | controller | l00-s0: defined 2026-03-09 15:51:52.015212 | controller | public: defined 2026-03-09 15:51:52.015289 | controller | vms: 2026-03-09 15:51:52.015372 | controller | controller: 2026-03-09 15:51:52.015458 | controller | nets: 2026-03-09 15:51:52.015551 | controller | - public 2026-03-09 15:51:52.015667 | controller | spineleafnets: 2026-03-09 15:51:52.015751 | controller | - l00-s0 2026-03-09 15:51:52.015833 | controller | 2026-03-09 15:51:52.015924 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2026-03-09 15:51:52.016012 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.033) 0:00:02.490 ********** 2026-03-09 15:51:52.044798 | controller | skipping: [instance] 2026-03-09 15:51:52.044883 | controller | 2026-03-09 15:51:52.045045 | controller | TASK [reproducer : Dump layout patches] **************************************** 2026-03-09 15:51:52.045081 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.029) 0:00:02.520 ********** 2026-03-09 15:51:52.126212 | controller | skipping: [instance] 2026-03-09 15:51:52.126267 | controller | 2026-03-09 15:51:52.126376 | controller | TASK [reproducer : Dump built layout] ****************************************** 2026-03-09 15:51:52.126469 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.081) 0:00:02.601 ********** 2026-03-09 15:51:52.165012 | controller | ok: [instance] => 2026-03-09 15:51:52.165084 | controller | _cifmw_libvirt_manager_layout: 2026-03-09 15:51:52.165182 | controller | networks: 2026-03-09 15:51:52.165283 | controller | l00-s0: defined 2026-03-09 15:51:52.165379 | controller | public: defined 2026-03-09 15:51:52.165463 | controller | vms: 2026-03-09 15:51:52.165551 | controller | controller: 2026-03-09 15:51:52.165676 | controller | nets: 2026-03-09 15:51:52.165775 | controller | - public 2026-03-09 15:51:52.165859 | controller | spineleafnets: 2026-03-09 15:51:52.165945 | controller | - l00-s0 2026-03-09 15:51:52.166047 | controller | - l00-s1 2026-03-09 15:51:52.166129 | controller | 2026-03-09 15:51:52.166231 | controller | TASK [reproducer : Fail for good] ********************************************** 2026-03-09 15:51:52.166320 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.038) 0:00:02.640 ********** 2026-03-09 15:51:52.178511 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:52.178595 | controller | msg: Error detected, please check assertions and debugging output above. 2026-03-09 15:51:52.207040 | controller | 2026-03-09 15:51:52.207114 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:51:52.207220 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.024) 0:00:02.665 ********** 2026-03-09 15:51:52.207311 | controller | 2026-03-09 15:51:52.207448 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:52.207486 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.017) 0:00:02.682 ********** 2026-03-09 15:51:52.233069 | controller | ok: [instance] 2026-03-09 15:51:52.233160 | controller | 2026-03-09 15:51:52.233269 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:52.233364 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.026) 0:00:02.708 ********** 2026-03-09 15:51:52.270245 | controller | skipping: [instance] 2026-03-09 15:51:52.270324 | controller | 2026-03-09 15:51:52.270418 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:52.270511 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.037) 0:00:02.745 ********** 2026-03-09 15:51:52.304230 | controller | skipping: [instance] 2026-03-09 15:51:52.304314 | controller | 2026-03-09 15:51:52.304415 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:52.304512 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.033) 0:00:02.779 ********** 2026-03-09 15:51:52.366843 | controller | skipping: [instance] 2026-03-09 15:51:52.366932 | controller | 2026-03-09 15:51:52.366987 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:52.367345 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.062) 0:00:02.842 ********** 2026-03-09 15:51:52.389444 | controller | ok: [instance] 2026-03-09 15:51:52.389536 | controller | 2026-03-09 15:51:52.389647 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:52.389752 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.022) 0:00:02.865 ********** 2026-03-09 15:51:52.417731 | controller | ok: [instance] 2026-03-09 15:51:52.442698 | controller | 2026-03-09 15:51:52.442725 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:52.442734 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.026) 0:00:02.891 ********** 2026-03-09 15:51:52.442745 | controller | ok: [instance] => 2026-03-09 15:51:52.442789 | controller | msg: 'Running: No network for a VM' 2026-03-09 15:51:52.442891 | controller | 2026-03-09 15:51:52.442982 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:52.443064 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.026) 0:00:02.918 ********** 2026-03-09 15:51:52.484231 | controller | 2026-03-09 15:51:52.484328 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-03-09 15:51:52.484425 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.041) 0:00:02.959 ********** 2026-03-09 15:51:52.508943 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2026-03-09 15:51:52.509097 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2026-03-09 15:51:52.509117 | controller | in the `loop_control` option for the task to something else to avoid variable 2026-03-09 15:51:52.509247 | controller | collisions and unexpected behavior. 2026-03-09 15:51:52.522571 | controller | failed: [instance] (item=foo) => changed=false 2026-03-09 15:51:52.522643 | controller | ansible_loop_var: item 2026-03-09 15:51:52.522660 | controller | assertion: item.value.nets is defined 2026-03-09 15:51:52.522758 | controller | evaluated_to: false 2026-03-09 15:51:52.522838 | controller | item: 2026-03-09 15:51:52.522927 | controller | key: foo 2026-03-09 15:51:52.523015 | controller | value: 2026-03-09 15:51:52.523105 | controller | disksize: 10 2026-03-09 15:51:52.523208 | controller | msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' 2026-03-09 15:51:52.534931 | controller | ok: [instance] => (item=controller) 2026-03-09 15:51:52.535179 | controller | 2026-03-09 15:51:52.535299 | controller | TASK [reproducer : Dump initial layout] **************************************** 2026-03-09 15:51:52.535329 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.050) 0:00:03.010 ********** 2026-03-09 15:51:52.567178 | controller | ok: [instance] => 2026-03-09 15:51:52.567244 | controller | cifmw_libvirt_manager_configuration: 2026-03-09 15:51:52.567351 | controller | networks: 2026-03-09 15:51:52.567442 | controller | public: defined 2026-03-09 15:51:52.567535 | controller | vms: 2026-03-09 15:51:52.567613 | controller | controller: 2026-03-09 15:51:52.567724 | controller | nets: 2026-03-09 15:51:52.567823 | controller | - public 2026-03-09 15:51:52.567895 | controller | 2026-03-09 15:51:52.567986 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2026-03-09 15:51:52.568075 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.032) 0:00:03.042 ********** 2026-03-09 15:51:52.597049 | controller | skipping: [instance] 2026-03-09 15:51:52.597302 | controller | 2026-03-09 15:51:52.597505 | controller | TASK [reproducer : Dump layout patches] **************************************** 2026-03-09 15:51:52.597647 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.029) 0:00:03.072 ********** 2026-03-09 15:51:52.676686 | controller | skipping: [instance] 2026-03-09 15:51:52.676788 | controller | 2026-03-09 15:51:52.676891 | controller | TASK [reproducer : Dump built layout] ****************************************** 2026-03-09 15:51:52.677014 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.079) 0:00:03.152 ********** 2026-03-09 15:51:52.716929 | controller | ok: [instance] => 2026-03-09 15:51:52.717074 | controller | _cifmw_libvirt_manager_layout: 2026-03-09 15:51:52.717112 | controller | networks: 2026-03-09 15:51:52.717217 | controller | public: defined 2026-03-09 15:51:52.717302 | controller | vms: 2026-03-09 15:51:52.717378 | controller | controller: 2026-03-09 15:51:52.717456 | controller | nets: 2026-03-09 15:51:52.717701 | controller | - public 2026-03-09 15:51:52.717747 | controller | foo: 2026-03-09 15:51:52.717757 | controller | disksize: 10 2026-03-09 15:51:52.717830 | controller | 2026-03-09 15:51:52.717947 | controller | TASK [reproducer : Fail for good] ********************************************** 2026-03-09 15:51:52.718026 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.040) 0:00:03.192 ********** 2026-03-09 15:51:52.730034 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:52.760130 | controller | msg: Error detected, please check assertions and debugging output above. 2026-03-09 15:51:52.760164 | controller | 2026-03-09 15:51:52.760230 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:51:52.760311 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.025) 0:00:03.218 ********** 2026-03-09 15:51:52.760394 | controller | 2026-03-09 15:51:52.760485 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:52.760559 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.017) 0:00:03.235 ********** 2026-03-09 15:51:52.784689 | controller | ok: [instance] 2026-03-09 15:51:52.784781 | controller | 2026-03-09 15:51:52.784894 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:52.785029 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.024) 0:00:03.260 ********** 2026-03-09 15:51:52.829686 | controller | skipping: [instance] 2026-03-09 15:51:52.829775 | controller | 2026-03-09 15:51:52.829888 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:52.830007 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.044) 0:00:03.305 ********** 2026-03-09 15:51:52.864882 | controller | skipping: [instance] 2026-03-09 15:51:52.864934 | controller | 2026-03-09 15:51:52.865022 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:52.865114 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.035) 0:00:03.340 ********** 2026-03-09 15:51:52.897595 | controller | skipping: [instance] 2026-03-09 15:51:52.897673 | controller | 2026-03-09 15:51:52.897707 | controller | TASK [Fail if needed] ********************************************************** 2026-03-09 15:51:52.897813 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.032) 0:00:03.373 ********** 2026-03-09 15:51:52.956908 | controller | skipping: [instance] 2026-03-09 15:51:52.956969 | controller | 2026-03-09 15:51:52.957121 | controller | PLAY RECAP ********************************************************************* 2026-03-09 15:51:52.957233 | controller | instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 2026-03-09 15:51:52.957245 | controller | 2026-03-09 15:51:52.957323 | controller | Monday 09 March 2026 15:51:52 +0000 (0:00:00.058) 0:00:03.431 ********** 2026-03-09 15:51:52.957399 | controller | =============================================================================== 2026-03-09 15:51:52.957517 | controller | reproducer : Dump layout patches ---------------------------------------- 0.10s 2026-03-09 15:51:52.957576 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.08s 2026-03-09 15:51:52.957682 | controller | reproducer : Dump layout patches ---------------------------------------- 0.08s 2026-03-09 15:51:52.957768 | controller | reproducer : Dump layout patches ---------------------------------------- 0.08s 2026-03-09 15:51:52.957864 | controller | reproducer : Dump layout patches ---------------------------------------- 0.08s 2026-03-09 15:51:52.957976 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.07s 2026-03-09 15:51:52.958096 | controller | Test network validations ------------------------------------------------ 0.06s 2026-03-09 15:51:52.958138 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2026-03-09 15:51:52.958232 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2026-03-09 15:51:52.958316 | controller | Append failed scenario to list ------------------------------------------ 0.06s 2026-03-09 15:51:52.958401 | controller | reproducer : Dump built layout ------------------------------------------ 0.06s 2026-03-09 15:51:52.958489 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2026-03-09 15:51:52.958573 | controller | Fail if needed ---------------------------------------------------------- 0.06s 2026-03-09 15:51:52.958685 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2026-03-09 15:51:52.958771 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2026-03-09 15:51:52.958961 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2026-03-09 15:51:52.959024 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2026-03-09 15:51:52.959032 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.05s 2026-03-09 15:51:52.959126 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s 2026-03-09 15:51:52.959229 | controller | Validate data ----------------------------------------------------------- 0.05s 2026-03-09 15:51:53.037768 | controller | INFO Running network_validations > cleanup 2026-03-09 15:51:53.038112 | controller | WARNING Skipping, cleanup playbook not configured. 2026-03-09 15:51:53.045510 | controller | INFO Running ocp_validations > prepare 2026-03-09 15:51:53.045903 | controller | WARNING Skipping, prepare playbook not configured. 2026-03-09 15:51:53.053419 | controller | INFO Running ocp_validations > converge 2026-03-09 15:51:53.489307 | controller | 2026-03-09 15:51:53.489371 | controller | PLAY [Prepare] ***************************************************************** 2026-03-09 15:51:53.489477 | controller | 2026-03-09 15:51:53.489578 | controller | TASK [Set failed fact] ********************************************************* 2026-03-09 15:51:53.489704 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.039) 0:00:00.039 ********** 2026-03-09 15:51:53.513706 | controller | ok: [instance] 2026-03-09 15:51:53.513790 | controller | 2026-03-09 15:51:53.513889 | controller | TASK [Load scenarios] ********************************************************** 2026-03-09 15:51:53.513999 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.024) 0:00:00.064 ********** 2026-03-09 15:51:53.540199 | controller | ok: [instance] 2026-03-09 15:51:53.540287 | controller | 2026-03-09 15:51:53.540394 | controller | TASK [Test no volumes] ********************************************************* 2026-03-09 15:51:53.540488 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.026) 0:00:00.091 ********** 2026-03-09 15:51:53.646648 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) 2026-03-09 15:51:53.646742 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) 2026-03-09 15:51:53.646848 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) 2026-03-09 15:51:53.646948 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) 2026-03-09 15:51:53.647044 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) 2026-03-09 15:51:53.647128 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) 2026-03-09 15:51:53.647252 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) 2026-03-09 15:51:53.647333 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) 2026-03-09 15:51:53.647430 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) 2026-03-09 15:51:53.647515 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) 2026-03-09 15:51:53.647605 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) 2026-03-09 15:51:53.647722 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) 2026-03-09 15:51:53.647810 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) 2026-03-09 15:51:53.647908 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) 2026-03-09 15:51:53.647992 | controller | 2026-03-09 15:51:53.648082 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:53.648174 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.106) 0:00:00.197 ********** 2026-03-09 15:51:53.668600 | controller | ok: [instance] 2026-03-09 15:51:53.668704 | controller | 2026-03-09 15:51:53.668808 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:53.668900 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.022) 0:00:00.219 ********** 2026-03-09 15:51:53.698072 | controller | ok: [instance] 2026-03-09 15:51:53.698170 | controller | 2026-03-09 15:51:53.698270 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:53.698361 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.029) 0:00:00.248 ********** 2026-03-09 15:51:53.728789 | controller | ok: [instance] => 2026-03-09 15:51:53.728873 | controller | msg: 'Running: No volume, no worker' 2026-03-09 15:51:53.728968 | controller | 2026-03-09 15:51:53.729079 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:53.729182 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.030) 0:00:00.279 ********** 2026-03-09 15:51:53.795938 | controller | 2026-03-09 15:51:53.796029 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:51:53.796188 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.066) 0:00:00.346 ********** 2026-03-09 15:51:53.854802 | controller | ok: [instance] 2026-03-09 15:51:53.854876 | controller | 2026-03-09 15:51:53.854993 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:51:53.855196 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.058) 0:00:00.405 ********** 2026-03-09 15:51:53.897137 | controller | ok: [instance] 2026-03-09 15:51:53.897199 | controller | 2026-03-09 15:51:53.897280 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:51:53.897371 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.042) 0:00:00.448 ********** 2026-03-09 15:51:53.966732 | controller | ok: [instance] 2026-03-09 15:51:53.966866 | controller | 2026-03-09 15:51:53.966900 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:51:53.967053 | controller | Monday 09 March 2026 15:51:53 +0000 (0:00:00.069) 0:00:00.517 ********** 2026-03-09 15:51:54.007355 | controller | skipping: [instance] 2026-03-09 15:51:54.007431 | controller | 2026-03-09 15:51:54.007531 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:51:54.007621 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.040) 0:00:00.558 ********** 2026-03-09 15:51:54.059105 | controller | ok: [instance] 2026-03-09 15:51:54.059198 | controller | 2026-03-09 15:51:54.059299 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-09 15:51:54.059383 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.051) 0:00:00.609 ********** 2026-03-09 15:51:54.099794 | controller | skipping: [instance] 2026-03-09 15:51:54.099897 | controller | 2026-03-09 15:51:54.100028 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-09 15:51:54.100136 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.040) 0:00:00.650 ********** 2026-03-09 15:51:54.138896 | controller | skipping: [instance] 2026-03-09 15:51:54.138963 | controller | 2026-03-09 15:51:54.139105 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-09 15:51:54.139182 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.039) 0:00:00.689 ********** 2026-03-09 15:51:54.184516 | controller | skipping: [instance] 2026-03-09 15:51:54.184596 | controller | 2026-03-09 15:51:54.184721 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-09 15:51:54.184822 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.045) 0:00:00.735 ********** 2026-03-09 15:51:54.228337 | controller | skipping: [instance] 2026-03-09 15:51:54.228408 | controller | 2026-03-09 15:51:54.228509 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-09 15:51:54.228598 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.043) 0:00:00.779 ********** 2026-03-09 15:51:54.271317 | controller | skipping: [instance] 2026-03-09 15:51:54.271386 | controller | 2026-03-09 15:51:54.271481 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-09 15:51:54.271575 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.042) 0:00:00.822 ********** 2026-03-09 15:51:54.322603 | controller | skipping: [instance] 2026-03-09 15:51:54.322710 | controller | 2026-03-09 15:51:54.322821 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:54.322918 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.050) 0:00:00.873 ********** 2026-03-09 15:51:54.360547 | controller | skipping: [instance] 2026-03-09 15:51:54.360661 | controller | 2026-03-09 15:51:54.360799 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:54.360912 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.038) 0:00:00.911 ********** 2026-03-09 15:51:54.392056 | controller | skipping: [instance] 2026-03-09 15:51:54.392192 | controller | 2026-03-09 15:51:54.392305 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:54.392331 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.031) 0:00:00.942 ********** 2026-03-09 15:51:54.425633 | controller | skipping: [instance] 2026-03-09 15:51:54.425727 | controller | 2026-03-09 15:51:54.425831 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:54.425927 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.033) 0:00:00.976 ********** 2026-03-09 15:51:54.447679 | controller | ok: [instance] 2026-03-09 15:51:54.447771 | controller | 2026-03-09 15:51:54.447870 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:54.448022 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.022) 0:00:00.998 ********** 2026-03-09 15:51:54.475539 | controller | ok: [instance] 2026-03-09 15:51:54.475881 | controller | 2026-03-09 15:51:54.476224 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:54.476246 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.027) 0:00:01.026 ********** 2026-03-09 15:51:54.503321 | controller | ok: [instance] => 2026-03-09 15:51:54.503348 | controller | msg: 'Running: No volume, with worker' 2026-03-09 15:51:54.503360 | controller | 2026-03-09 15:51:54.503530 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:54.503553 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.027) 0:00:01.053 ********** 2026-03-09 15:51:54.548812 | controller | 2026-03-09 15:51:54.548901 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:51:54.549004 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.045) 0:00:01.099 ********** 2026-03-09 15:51:54.606968 | controller | ok: [instance] 2026-03-09 15:51:54.607275 | controller | 2026-03-09 15:51:54.607382 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:51:54.607733 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.058) 0:00:01.157 ********** 2026-03-09 15:51:54.647000 | controller | ok: [instance] 2026-03-09 15:51:54.647074 | controller | 2026-03-09 15:51:54.647185 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:51:54.647280 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.039) 0:00:01.197 ********** 2026-03-09 15:51:54.748440 | controller | ok: [instance] 2026-03-09 15:51:54.748484 | controller | 2026-03-09 15:51:54.748614 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:51:54.748715 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.101) 0:00:01.299 ********** 2026-03-09 15:51:54.819305 | controller | ok: [instance] 2026-03-09 15:51:54.819386 | controller | 2026-03-09 15:51:54.819483 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:51:54.819610 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.070) 0:00:01.370 ********** 2026-03-09 15:51:54.874361 | controller | ok: [instance] 2026-03-09 15:51:54.874432 | controller | 2026-03-09 15:51:54.874527 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-09 15:51:54.874636 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.054) 0:00:01.425 ********** 2026-03-09 15:51:54.915424 | controller | skipping: [instance] 2026-03-09 15:51:54.915512 | controller | 2026-03-09 15:51:54.915601 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-09 15:51:54.915713 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.041) 0:00:01.466 ********** 2026-03-09 15:51:54.956787 | controller | skipping: [instance] 2026-03-09 15:51:54.956863 | controller | 2026-03-09 15:51:54.956977 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-09 15:51:54.957136 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.041) 0:00:01.507 ********** 2026-03-09 15:51:55.000682 | controller | skipping: [instance] 2026-03-09 15:51:55.000791 | controller | 2026-03-09 15:51:55.000888 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-09 15:51:55.000996 | controller | Monday 09 March 2026 15:51:54 +0000 (0:00:00.042) 0:00:01.550 ********** 2026-03-09 15:51:55.048822 | controller | skipping: [instance] 2026-03-09 15:51:55.048908 | controller | 2026-03-09 15:51:55.049022 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-09 15:51:55.049124 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.049) 0:00:01.599 ********** 2026-03-09 15:51:55.094020 | controller | skipping: [instance] 2026-03-09 15:51:55.094098 | controller | 2026-03-09 15:51:55.094195 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-09 15:51:55.094279 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.045) 0:00:01.644 ********** 2026-03-09 15:51:55.148290 | controller | skipping: [instance] 2026-03-09 15:51:55.148351 | controller | 2026-03-09 15:51:55.148441 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:55.148545 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.054) 0:00:01.699 ********** 2026-03-09 15:51:55.186651 | controller | skipping: [instance] 2026-03-09 15:51:55.186824 | controller | 2026-03-09 15:51:55.187001 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:55.187172 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.038) 0:00:01.737 ********** 2026-03-09 15:51:55.226202 | controller | skipping: [instance] 2026-03-09 15:51:55.226281 | controller | 2026-03-09 15:51:55.226370 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:55.226456 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.039) 0:00:01.777 ********** 2026-03-09 15:51:55.261598 | controller | skipping: [instance] 2026-03-09 15:51:55.262167 | controller | 2026-03-09 15:51:55.262268 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:55.262370 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.035) 0:00:01.812 ********** 2026-03-09 15:51:55.288373 | controller | ok: [instance] 2026-03-09 15:51:55.288460 | controller | 2026-03-09 15:51:55.288469 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:55.288478 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.026) 0:00:01.839 ********** 2026-03-09 15:51:55.316474 | controller | ok: [instance] 2026-03-09 15:51:55.344169 | controller | 2026-03-09 15:51:55.344189 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:55.344197 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.027) 0:00:01.866 ********** 2026-03-09 15:51:55.344205 | controller | ok: [instance] => 2026-03-09 15:51:55.344261 | controller | msg: 'Running: Volume, no worker' 2026-03-09 15:51:55.344351 | controller | 2026-03-09 15:51:55.344463 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:55.344551 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.028) 0:00:01.894 ********** 2026-03-09 15:51:55.392746 | controller | 2026-03-09 15:51:55.392876 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:51:55.392988 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.048) 0:00:01.943 ********** 2026-03-09 15:51:55.457898 | controller | ok: [instance] 2026-03-09 15:51:55.457961 | controller | 2026-03-09 15:51:55.458072 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:51:55.458157 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.065) 0:00:02.008 ********** 2026-03-09 15:51:55.503500 | controller | ok: [instance] 2026-03-09 15:51:55.503577 | controller | 2026-03-09 15:51:55.503708 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:51:55.503797 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.045) 0:00:02.054 ********** 2026-03-09 15:51:55.578135 | controller | ok: [instance] 2026-03-09 15:51:55.578196 | controller | 2026-03-09 15:51:55.578299 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:51:55.578388 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.074) 0:00:02.128 ********** 2026-03-09 15:51:55.622024 | controller | skipping: [instance] 2026-03-09 15:51:55.622108 | controller | 2026-03-09 15:51:55.622219 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:51:55.622296 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.043) 0:00:02.172 ********** 2026-03-09 15:51:55.667039 | controller | skipping: [instance] 2026-03-09 15:51:55.667161 | controller | 2026-03-09 15:51:55.667688 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-09 15:51:55.667827 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.044) 0:00:02.217 ********** 2026-03-09 15:51:55.716707 | controller | ok: [instance] 2026-03-09 15:51:55.716729 | controller | 2026-03-09 15:51:55.716737 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-09 15:51:55.716746 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.049) 0:00:02.267 ********** 2026-03-09 15:51:55.807696 | controller | skipping: [instance] 2026-03-09 15:51:55.807746 | controller | 2026-03-09 15:51:55.807846 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-09 15:51:55.807937 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.091) 0:00:02.358 ********** 2026-03-09 15:51:55.876871 | controller | ok: [instance] 2026-03-09 15:51:55.876975 | controller | 2026-03-09 15:51:55.876992 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-09 15:51:55.877089 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.069) 0:00:02.427 ********** 2026-03-09 15:51:55.948152 | controller | ok: [instance] 2026-03-09 15:51:55.948220 | controller | 2026-03-09 15:51:55.948320 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-09 15:51:55.948410 | controller | Monday 09 March 2026 15:51:55 +0000 (0:00:00.071) 0:00:02.498 ********** 2026-03-09 15:51:56.021123 | controller | ok: [instance] => changed=false 2026-03-09 15:51:56.021233 | controller | msg: All assertions passed 2026-03-09 15:51:56.021322 | controller | 2026-03-09 15:51:56.021417 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-09 15:51:56.021524 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.073) 0:00:02.571 ********** 2026-03-09 15:51:56.101428 | controller | ok: [instance] => changed=false 2026-03-09 15:51:56.101531 | controller | msg: All assertions passed 2026-03-09 15:51:56.101644 | controller | 2026-03-09 15:51:56.101765 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:56.101858 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.080) 0:00:02.652 ********** 2026-03-09 15:51:56.141816 | controller | skipping: [instance] 2026-03-09 15:51:56.141896 | controller | 2026-03-09 15:51:56.142003 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:56.142102 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.040) 0:00:02.692 ********** 2026-03-09 15:51:56.174308 | controller | skipping: [instance] 2026-03-09 15:51:56.174481 | controller | 2026-03-09 15:51:56.174501 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:56.174606 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.032) 0:00:02.725 ********** 2026-03-09 15:51:56.211276 | controller | skipping: [instance] 2026-03-09 15:51:56.211340 | controller | 2026-03-09 15:51:56.211441 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:56.211536 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.036) 0:00:02.761 ********** 2026-03-09 15:51:56.237413 | controller | ok: [instance] 2026-03-09 15:51:56.237494 | controller | 2026-03-09 15:51:56.237594 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:56.237704 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.026) 0:00:02.788 ********** 2026-03-09 15:51:56.267495 | controller | ok: [instance] 2026-03-09 15:51:56.267569 | controller | 2026-03-09 15:51:56.267824 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:56.295259 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.030) 0:00:02.818 ********** 2026-03-09 15:51:56.295286 | controller | ok: [instance] => 2026-03-09 15:51:56.295364 | controller | msg: 'Running: Volume, with worker' 2026-03-09 15:51:56.295444 | controller | 2026-03-09 15:51:56.295543 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:56.295642 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.027) 0:00:02.846 ********** 2026-03-09 15:51:56.352123 | controller | 2026-03-09 15:51:56.352229 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:51:56.352344 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.056) 0:00:02.902 ********** 2026-03-09 15:51:56.412191 | controller | ok: [instance] 2026-03-09 15:51:56.412280 | controller | 2026-03-09 15:51:56.412382 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:51:56.412476 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.060) 0:00:02.963 ********** 2026-03-09 15:51:56.455598 | controller | ok: [instance] 2026-03-09 15:51:56.455692 | controller | 2026-03-09 15:51:56.455809 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:51:56.455934 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.043) 0:00:03.006 ********** 2026-03-09 15:51:56.528854 | controller | ok: [instance] 2026-03-09 15:51:56.528912 | controller | 2026-03-09 15:51:56.529045 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:51:56.529129 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.073) 0:00:03.079 ********** 2026-03-09 15:51:56.601252 | controller | ok: [instance] 2026-03-09 15:51:56.601325 | controller | 2026-03-09 15:51:56.601420 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:51:56.601512 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.072) 0:00:03.151 ********** 2026-03-09 15:51:56.647463 | controller | skipping: [instance] 2026-03-09 15:51:56.647518 | controller | 2026-03-09 15:51:56.647642 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-09 15:51:56.647748 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.046) 0:00:03.198 ********** 2026-03-09 15:51:56.694586 | controller | ok: [instance] 2026-03-09 15:51:56.694649 | controller | 2026-03-09 15:51:56.694767 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-09 15:51:56.694854 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.047) 0:00:03.245 ********** 2026-03-09 15:51:56.750374 | controller | ok: [instance] 2026-03-09 15:51:56.750447 | controller | 2026-03-09 15:51:56.750585 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-09 15:51:56.750725 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.055) 0:00:03.300 ********** 2026-03-09 15:51:56.820370 | controller | ok: [instance] 2026-03-09 15:51:56.820431 | controller | 2026-03-09 15:51:56.820546 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-09 15:51:56.820651 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.070) 0:00:03.370 ********** 2026-03-09 15:51:56.945479 | controller | ok: [instance] 2026-03-09 15:51:56.945555 | controller | 2026-03-09 15:51:56.945698 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-09 15:51:56.945817 | controller | Monday 09 March 2026 15:51:56 +0000 (0:00:00.125) 0:00:03.496 ********** 2026-03-09 15:51:57.017487 | controller | ok: [instance] => changed=false 2026-03-09 15:51:57.017552 | controller | msg: All assertions passed 2026-03-09 15:51:57.017666 | controller | 2026-03-09 15:51:57.017763 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-09 15:51:57.017860 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.072) 0:00:03.568 ********** 2026-03-09 15:51:57.103758 | controller | ok: [instance] => changed=false 2026-03-09 15:51:57.103837 | controller | msg: All assertions passed 2026-03-09 15:51:57.103925 | controller | 2026-03-09 15:51:57.104039 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:57.104132 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.086) 0:00:03.654 ********** 2026-03-09 15:51:57.148121 | controller | skipping: [instance] 2026-03-09 15:51:57.148191 | controller | 2026-03-09 15:51:57.148263 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:57.148359 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.044) 0:00:03.699 ********** 2026-03-09 15:51:57.184250 | controller | skipping: [instance] 2026-03-09 15:51:57.184332 | controller | 2026-03-09 15:51:57.184428 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:57.184532 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.036) 0:00:03.735 ********** 2026-03-09 15:51:57.220865 | controller | skipping: [instance] 2026-03-09 15:51:57.221108 | controller | 2026-03-09 15:51:57.242090 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:57.242116 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.036) 0:00:03.771 ********** 2026-03-09 15:51:57.242127 | controller | ok: [instance] 2026-03-09 15:51:57.242165 | controller | 2026-03-09 15:51:57.242280 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:57.242373 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.021) 0:00:03.793 ********** 2026-03-09 15:51:57.270974 | controller | ok: [instance] 2026-03-09 15:51:57.271048 | controller | 2026-03-09 15:51:57.271170 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:57.271261 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.028) 0:00:03.821 ********** 2026-03-09 15:51:57.296742 | controller | ok: [instance] => 2026-03-09 15:51:57.296817 | controller | msg: 'Running: Too many allocated volumes' 2026-03-09 15:51:57.296913 | controller | 2026-03-09 15:51:57.297032 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:57.297115 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.025) 0:00:03.847 ********** 2026-03-09 15:51:57.337554 | controller | 2026-03-09 15:51:57.337598 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:51:57.337736 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.041) 0:00:03.888 ********** 2026-03-09 15:51:57.399494 | controller | ok: [instance] 2026-03-09 15:51:57.399589 | controller | 2026-03-09 15:51:57.399694 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:51:57.399794 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.061) 0:00:03.950 ********** 2026-03-09 15:51:57.451474 | controller | ok: [instance] 2026-03-09 15:51:57.451555 | controller | 2026-03-09 15:51:57.451674 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:51:57.451770 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.052) 0:00:04.002 ********** 2026-03-09 15:51:57.528117 | controller | ok: [instance] 2026-03-09 15:51:57.528222 | controller | 2026-03-09 15:51:57.528318 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:51:57.528419 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.076) 0:00:04.078 ********** 2026-03-09 15:51:57.572566 | controller | skipping: [instance] 2026-03-09 15:51:57.572664 | controller | 2026-03-09 15:51:57.572760 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:51:57.572858 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.044) 0:00:04.123 ********** 2026-03-09 15:51:57.617214 | controller | skipping: [instance] 2026-03-09 15:51:57.617272 | controller | 2026-03-09 15:51:57.617367 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-09 15:51:57.617461 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.044) 0:00:04.168 ********** 2026-03-09 15:51:57.672457 | controller | ok: [instance] 2026-03-09 15:51:57.717149 | controller | 2026-03-09 15:51:57.717185 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-09 15:51:57.717194 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.053) 0:00:04.221 ********** 2026-03-09 15:51:57.717204 | controller | skipping: [instance] 2026-03-09 15:51:57.717222 | controller | 2026-03-09 15:51:57.717320 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-09 15:51:57.717419 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.046) 0:00:04.268 ********** 2026-03-09 15:51:57.775063 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:57.775168 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2026-03-09 15:51:57.775265 | controller | evaluated_to: false 2026-03-09 15:51:57.775357 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' 2026-03-09 15:51:57.803180 | controller | 2026-03-09 15:51:57.803259 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:51:57.803358 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.069) 0:00:04.337 ********** 2026-03-09 15:51:57.803431 | controller | 2026-03-09 15:51:57.803514 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:57.803596 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.016) 0:00:04.354 ********** 2026-03-09 15:51:57.827834 | controller | ok: [instance] 2026-03-09 15:51:57.827913 | controller | 2026-03-09 15:51:57.828008 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:57.828098 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.024) 0:00:04.378 ********** 2026-03-09 15:51:57.910348 | controller | skipping: [instance] 2026-03-09 15:51:57.910422 | controller | 2026-03-09 15:51:57.910457 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:57.910570 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.082) 0:00:04.461 ********** 2026-03-09 15:51:57.952847 | controller | skipping: [instance] 2026-03-09 15:51:57.952914 | controller | 2026-03-09 15:51:57.953087 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:57.953133 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.042) 0:00:04.503 ********** 2026-03-09 15:51:57.988091 | controller | skipping: [instance] 2026-03-09 15:51:57.988182 | controller | 2026-03-09 15:51:57.988284 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:57.988376 | controller | Monday 09 March 2026 15:51:57 +0000 (0:00:00.035) 0:00:04.539 ********** 2026-03-09 15:51:58.017186 | controller | ok: [instance] 2026-03-09 15:51:58.017271 | controller | 2026-03-09 15:51:58.017367 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:58.017468 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.028) 0:00:04.567 ********** 2026-03-09 15:51:58.055326 | controller | ok: [instance] 2026-03-09 15:51:58.055441 | controller | 2026-03-09 15:51:58.055565 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:58.055712 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.038) 0:00:04.606 ********** 2026-03-09 15:51:58.091094 | controller | ok: [instance] => 2026-03-09 15:51:58.091175 | controller | msg: 'Running: Different volume amount' 2026-03-09 15:51:58.091265 | controller | 2026-03-09 15:51:58.091355 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:58.091437 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.035) 0:00:04.641 ********** 2026-03-09 15:51:58.139500 | controller | 2026-03-09 15:51:58.139623 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:51:58.139657 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.048) 0:00:04.690 ********** 2026-03-09 15:51:58.205178 | controller | ok: [instance] 2026-03-09 15:51:58.205247 | controller | 2026-03-09 15:51:58.205346 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:51:58.205458 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.065) 0:00:04.755 ********** 2026-03-09 15:51:58.256288 | controller | ok: [instance] 2026-03-09 15:51:58.256361 | controller | 2026-03-09 15:51:58.256453 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:51:58.256545 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.051) 0:00:04.807 ********** 2026-03-09 15:51:58.336677 | controller | ok: [instance] 2026-03-09 15:51:58.336761 | controller | 2026-03-09 15:51:58.336887 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:51:58.336975 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.080) 0:00:04.887 ********** 2026-03-09 15:51:58.415906 | controller | ok: [instance] 2026-03-09 15:51:58.416017 | controller | 2026-03-09 15:51:58.416118 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:51:58.416213 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.079) 0:00:04.966 ********** 2026-03-09 15:51:58.463960 | controller | skipping: [instance] 2026-03-09 15:51:58.464052 | controller | 2026-03-09 15:51:58.464161 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-09 15:51:58.464242 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.048) 0:00:05.014 ********** 2026-03-09 15:51:58.517411 | controller | ok: [instance] 2026-03-09 15:51:58.517486 | controller | 2026-03-09 15:51:58.517582 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-09 15:51:58.517700 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.053) 0:00:05.068 ********** 2026-03-09 15:51:58.565819 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:58.565958 | controller | assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 2026-03-09 15:51:58.566046 | controller | evaluated_to: false 2026-03-09 15:51:58.566159 | controller | msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' 2026-03-09 15:51:58.596544 | controller | 2026-03-09 15:51:58.596648 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:51:58.596762 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.061) 0:00:05.129 ********** 2026-03-09 15:51:58.596853 | controller | 2026-03-09 15:51:58.596964 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:58.597055 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.017) 0:00:05.146 ********** 2026-03-09 15:51:58.626828 | controller | ok: [instance] 2026-03-09 15:51:58.626917 | controller | 2026-03-09 15:51:58.627017 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:58.627123 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.030) 0:00:05.177 ********** 2026-03-09 15:51:58.672370 | controller | skipping: [instance] 2026-03-09 15:51:58.672482 | controller | 2026-03-09 15:51:58.672574 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:58.672711 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.045) 0:00:05.222 ********** 2026-03-09 15:51:58.715239 | controller | skipping: [instance] 2026-03-09 15:51:58.715317 | controller | 2026-03-09 15:51:58.715425 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:58.715513 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.043) 0:00:05.265 ********** 2026-03-09 15:51:58.761355 | controller | skipping: [instance] 2026-03-09 15:51:58.761438 | controller | 2026-03-09 15:51:58.761535 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:58.761650 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.046) 0:00:05.312 ********** 2026-03-09 15:51:58.790119 | controller | ok: [instance] 2026-03-09 15:51:58.790216 | controller | 2026-03-09 15:51:58.790314 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:58.790419 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.028) 0:00:05.341 ********** 2026-03-09 15:51:58.824091 | controller | ok: [instance] 2026-03-09 15:51:58.824182 | controller | 2026-03-09 15:51:58.824264 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:58.824373 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.033) 0:00:05.374 ********** 2026-03-09 15:51:58.857877 | controller | ok: [instance] => 2026-03-09 15:51:58.857993 | controller | msg: 'Running: Create LVM without volume' 2026-03-09 15:51:58.858078 | controller | 2026-03-09 15:51:58.858197 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:58.858297 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.033) 0:00:05.408 ********** 2026-03-09 15:51:58.959053 | controller | 2026-03-09 15:51:58.959116 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:51:58.959198 | controller | Monday 09 March 2026 15:51:58 +0000 (0:00:00.100) 0:00:05.509 ********** 2026-03-09 15:51:59.030183 | controller | ok: [instance] 2026-03-09 15:51:59.030244 | controller | 2026-03-09 15:51:59.030343 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:51:59.030444 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.071) 0:00:05.581 ********** 2026-03-09 15:51:59.086163 | controller | ok: [instance] 2026-03-09 15:51:59.086245 | controller | 2026-03-09 15:51:59.086333 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:51:59.086447 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.055) 0:00:05.636 ********** 2026-03-09 15:51:59.168316 | controller | ok: [instance] 2026-03-09 15:51:59.168397 | controller | 2026-03-09 15:51:59.168503 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:51:59.168602 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.082) 0:00:05.719 ********** 2026-03-09 15:51:59.211555 | controller | skipping: [instance] 2026-03-09 15:51:59.211642 | controller | 2026-03-09 15:51:59.211754 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:51:59.211844 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.043) 0:00:05.762 ********** 2026-03-09 15:51:59.255039 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:59.255160 | controller | assertion: not cifmw_devscripts_create_logical_volume | bool 2026-03-09 15:51:59.255258 | controller | evaluated_to: false 2026-03-09 15:51:59.255360 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2026-03-09 15:51:59.287939 | controller | 2026-03-09 15:51:59.288041 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:51:59.288153 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.058) 0:00:05.820 ********** 2026-03-09 15:51:59.288232 | controller | 2026-03-09 15:51:59.288335 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:59.288423 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.017) 0:00:05.838 ********** 2026-03-09 15:51:59.330099 | controller | ok: [instance] 2026-03-09 15:51:59.330154 | controller | 2026-03-09 15:51:59.330287 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:59.330381 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.042) 0:00:05.880 ********** 2026-03-09 15:51:59.377643 | controller | skipping: [instance] 2026-03-09 15:51:59.377868 | controller | 2026-03-09 15:51:59.377980 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:51:59.378079 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.047) 0:00:05.928 ********** 2026-03-09 15:51:59.417384 | controller | skipping: [instance] 2026-03-09 15:51:59.417449 | controller | 2026-03-09 15:51:59.417566 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:51:59.417652 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.039) 0:00:05.968 ********** 2026-03-09 15:51:59.461352 | controller | skipping: [instance] 2026-03-09 15:51:59.461420 | controller | 2026-03-09 15:51:59.461446 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:59.461546 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.043) 0:00:06.011 ********** 2026-03-09 15:51:59.496710 | controller | ok: [instance] 2026-03-09 15:51:59.496816 | controller | 2026-03-09 15:51:59.496916 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:51:59.497026 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.034) 0:00:06.046 ********** 2026-03-09 15:51:59.533151 | controller | ok: [instance] 2026-03-09 15:51:59.533239 | controller | 2026-03-09 15:51:59.533334 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:51:59.533452 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.037) 0:00:06.083 ********** 2026-03-09 15:51:59.565459 | controller | ok: [instance] => 2026-03-09 15:51:59.565546 | controller | msg: 'Running: Create LVMS without volume' 2026-03-09 15:51:59.565650 | controller | 2026-03-09 15:51:59.565770 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:51:59.565862 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.032) 0:00:06.116 ********** 2026-03-09 15:51:59.613899 | controller | 2026-03-09 15:51:59.614000 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:51:59.614105 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.048) 0:00:06.164 ********** 2026-03-09 15:51:59.682482 | controller | ok: [instance] 2026-03-09 15:51:59.682541 | controller | 2026-03-09 15:51:59.682575 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:51:59.682704 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.068) 0:00:06.233 ********** 2026-03-09 15:51:59.735640 | controller | ok: [instance] 2026-03-09 15:51:59.735688 | controller | 2026-03-09 15:51:59.735791 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:51:59.735912 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.052) 0:00:06.285 ********** 2026-03-09 15:51:59.811896 | controller | ok: [instance] 2026-03-09 15:51:59.811956 | controller | 2026-03-09 15:51:59.812061 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:51:59.812154 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.077) 0:00:06.362 ********** 2026-03-09 15:51:59.856906 | controller | skipping: [instance] 2026-03-09 15:51:59.856972 | controller | 2026-03-09 15:51:59.857041 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:51:59.857149 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.044) 0:00:06.407 ********** 2026-03-09 15:51:59.903235 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:51:59.903351 | controller | assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 2026-03-09 15:51:59.903449 | controller | evaluated_to: false 2026-03-09 15:51:59.903540 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2026-03-09 15:51:59.966507 | controller | 2026-03-09 15:51:59.966610 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:51:59.966745 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.056) 0:00:06.464 ********** 2026-03-09 15:51:59.966826 | controller | 2026-03-09 15:51:59.966921 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:51:59.967014 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.052) 0:00:06.516 ********** 2026-03-09 15:51:59.997115 | controller | ok: [instance] 2026-03-09 15:51:59.997211 | controller | 2026-03-09 15:51:59.997304 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:51:59.997398 | controller | Monday 09 March 2026 15:51:59 +0000 (0:00:00.030) 0:00:06.547 ********** 2026-03-09 15:52:00.047346 | controller | skipping: [instance] 2026-03-09 15:52:00.047427 | controller | 2026-03-09 15:52:00.047527 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:52:00.047661 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.050) 0:00:06.598 ********** 2026-03-09 15:52:00.083825 | controller | skipping: [instance] 2026-03-09 15:52:00.083910 | controller | 2026-03-09 15:52:00.084020 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:52:00.084128 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.036) 0:00:06.634 ********** 2026-03-09 15:52:00.119989 | controller | skipping: [instance] 2026-03-09 15:52:00.120083 | controller | 2026-03-09 15:52:00.120192 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:52:00.120296 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.036) 0:00:06.670 ********** 2026-03-09 15:52:00.144033 | controller | ok: [instance] 2026-03-09 15:52:00.144116 | controller | 2026-03-09 15:52:00.144223 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:52:00.144319 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.024) 0:00:06.694 ********** 2026-03-09 15:52:00.173313 | controller | ok: [instance] 2026-03-09 15:52:00.173394 | controller | 2026-03-09 15:52:00.173506 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:52:00.173683 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.029) 0:00:06.724 ********** 2026-03-09 15:52:00.200347 | controller | ok: [instance] => 2026-03-09 15:52:00.200440 | controller | msg: 'Running: Allocate same volume twice' 2026-03-09 15:52:00.200526 | controller | 2026-03-09 15:52:00.200618 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:52:00.200733 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.027) 0:00:06.751 ********** 2026-03-09 15:52:00.243612 | controller | 2026-03-09 15:52:00.243960 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:52:00.303131 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.043) 0:00:06.794 ********** 2026-03-09 15:52:00.303167 | controller | ok: [instance] 2026-03-09 15:52:00.303219 | controller | 2026-03-09 15:52:00.303325 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:52:00.303419 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.059) 0:00:06.854 ********** 2026-03-09 15:52:00.345807 | controller | ok: [instance] 2026-03-09 15:52:00.345864 | controller | 2026-03-09 15:52:00.345979 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:52:00.346069 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.042) 0:00:06.896 ********** 2026-03-09 15:52:00.415803 | controller | ok: [instance] 2026-03-09 15:52:00.415911 | controller | 2026-03-09 15:52:00.416040 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:52:00.416194 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.069) 0:00:06.966 ********** 2026-03-09 15:52:00.458003 | controller | skipping: [instance] 2026-03-09 15:52:00.458078 | controller | 2026-03-09 15:52:00.458187 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:52:00.458287 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.042) 0:00:07.008 ********** 2026-03-09 15:52:00.502673 | controller | skipping: [instance] 2026-03-09 15:52:00.502720 | controller | 2026-03-09 15:52:00.502837 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-09 15:52:00.502949 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.044) 0:00:07.053 ********** 2026-03-09 15:52:00.555938 | controller | ok: [instance] 2026-03-09 15:52:00.556034 | controller | 2026-03-09 15:52:00.556133 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-09 15:52:00.556232 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.053) 0:00:07.106 ********** 2026-03-09 15:52:00.600677 | controller | skipping: [instance] 2026-03-09 15:52:00.600756 | controller | 2026-03-09 15:52:00.600847 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-09 15:52:00.600931 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.044) 0:00:07.151 ********** 2026-03-09 15:52:00.658832 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:52:00.658950 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2026-03-09 15:52:00.659064 | controller | evaluated_to: false 2026-03-09 15:52:00.659185 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' 2026-03-09 15:52:00.686090 | controller | 2026-03-09 15:52:00.686192 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:52:00.686293 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.068) 0:00:07.220 ********** 2026-03-09 15:52:00.686378 | controller | 2026-03-09 15:52:00.686468 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:52:00.686556 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.016) 0:00:07.237 ********** 2026-03-09 15:52:00.710182 | controller | ok: [instance] 2026-03-09 15:52:00.710258 | controller | 2026-03-09 15:52:00.710349 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:52:00.710438 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.024) 0:00:07.261 ********** 2026-03-09 15:52:00.746785 | controller | skipping: [instance] 2026-03-09 15:52:00.746859 | controller | 2026-03-09 15:52:00.746958 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:52:00.747050 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.036) 0:00:07.297 ********** 2026-03-09 15:52:00.780160 | controller | skipping: [instance] 2026-03-09 15:52:00.780240 | controller | 2026-03-09 15:52:00.780333 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:52:00.780419 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.033) 0:00:07.331 ********** 2026-03-09 15:52:00.816761 | controller | skipping: [instance] 2026-03-09 15:52:00.816836 | controller | 2026-03-09 15:52:00.816927 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:52:00.817028 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.036) 0:00:07.367 ********** 2026-03-09 15:52:00.870915 | controller | ok: [instance] 2026-03-09 15:52:00.871021 | controller | 2026-03-09 15:52:00.871032 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:52:00.871067 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.053) 0:00:07.421 ********** 2026-03-09 15:52:00.912815 | controller | ok: [instance] 2026-03-09 15:52:00.912894 | controller | 2026-03-09 15:52:00.913052 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:52:00.913093 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.041) 0:00:07.463 ********** 2026-03-09 15:52:00.944715 | controller | ok: [instance] => 2026-03-09 15:52:00.945004 | controller | msg: 'Running: Allocate same volume twice - no LVMS' 2026-03-09 15:52:00.945034 | controller | 2026-03-09 15:52:00.945042 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:52:00.945050 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.031) 0:00:07.495 ********** 2026-03-09 15:52:00.988585 | controller | 2026-03-09 15:52:00.988708 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:52:00.988800 | controller | Monday 09 March 2026 15:52:00 +0000 (0:00:00.044) 0:00:07.539 ********** 2026-03-09 15:52:01.050692 | controller | ok: [instance] 2026-03-09 15:52:01.050793 | controller | 2026-03-09 15:52:01.050899 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:52:01.051009 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.061) 0:00:07.601 ********** 2026-03-09 15:52:01.102059 | controller | ok: [instance] 2026-03-09 15:52:01.102149 | controller | 2026-03-09 15:52:01.102267 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:52:01.102361 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.051) 0:00:07.652 ********** 2026-03-09 15:52:01.177149 | controller | ok: [instance] 2026-03-09 15:52:01.177215 | controller | 2026-03-09 15:52:01.177325 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:52:01.177418 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.075) 0:00:07.727 ********** 2026-03-09 15:52:01.232964 | controller | skipping: [instance] 2026-03-09 15:52:01.233039 | controller | 2026-03-09 15:52:01.233115 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:52:01.233230 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.055) 0:00:07.783 ********** 2026-03-09 15:52:01.282773 | controller | skipping: [instance] 2026-03-09 15:52:01.282852 | controller | 2026-03-09 15:52:01.282971 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-09 15:52:01.283057 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.049) 0:00:07.833 ********** 2026-03-09 15:52:01.338641 | controller | ok: [instance] 2026-03-09 15:52:01.338737 | controller | 2026-03-09 15:52:01.338839 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-09 15:52:01.338953 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.055) 0:00:07.889 ********** 2026-03-09 15:52:01.393278 | controller | skipping: [instance] 2026-03-09 15:52:01.393341 | controller | 2026-03-09 15:52:01.393454 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-09 15:52:01.393544 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.054) 0:00:07.944 ********** 2026-03-09 15:52:01.468281 | controller | ok: [instance] 2026-03-09 15:52:01.468467 | controller | 2026-03-09 15:52:01.468532 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-09 15:52:01.468547 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.075) 0:00:08.019 ********** 2026-03-09 15:52:01.529015 | controller | skipping: [instance] 2026-03-09 15:52:01.529106 | controller | 2026-03-09 15:52:01.529243 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-09 15:52:01.529425 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.059) 0:00:08.079 ********** 2026-03-09 15:52:01.607227 | controller | ok: [instance] => changed=false 2026-03-09 15:52:01.607321 | controller | msg: All assertions passed 2026-03-09 15:52:01.607411 | controller | 2026-03-09 15:52:01.607508 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-09 15:52:01.607602 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.078) 0:00:08.157 ********** 2026-03-09 15:52:01.702342 | controller | ok: [instance] => changed=false 2026-03-09 15:52:01.702392 | controller | msg: All assertions passed 2026-03-09 15:52:01.702490 | controller | 2026-03-09 15:52:01.702588 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:52:01.702728 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.094) 0:00:08.251 ********** 2026-03-09 15:52:01.749716 | controller | skipping: [instance] 2026-03-09 15:52:01.749822 | controller | 2026-03-09 15:52:01.749916 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:52:01.750042 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.047) 0:00:08.299 ********** 2026-03-09 15:52:01.789812 | controller | skipping: [instance] 2026-03-09 15:52:01.789900 | controller | 2026-03-09 15:52:01.790017 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:52:01.790107 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.040) 0:00:08.340 ********** 2026-03-09 15:52:01.826347 | controller | skipping: [instance] 2026-03-09 15:52:01.826414 | controller | 2026-03-09 15:52:01.826517 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:52:01.826611 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.035) 0:00:08.375 ********** 2026-03-09 15:52:01.853142 | controller | ok: [instance] 2026-03-09 15:52:01.853237 | controller | 2026-03-09 15:52:01.853336 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:52:01.853426 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.027) 0:00:08.402 ********** 2026-03-09 15:52:01.883361 | controller | ok: [instance] 2026-03-09 15:52:01.883452 | controller | 2026-03-09 15:52:01.883555 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:52:01.883675 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.031) 0:00:08.434 ********** 2026-03-09 15:52:01.923380 | controller | ok: [instance] => 2026-03-09 15:52:01.923571 | controller | msg: 'Running: Allocate same volume twice - no cinder_lvm' 2026-03-09 15:52:01.923684 | controller | 2026-03-09 15:52:01.923786 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:52:01.923891 | controller | Monday 09 March 2026 15:52:01 +0000 (0:00:00.039) 0:00:08.474 ********** 2026-03-09 15:52:02.006927 | controller | 2026-03-09 15:52:02.007045 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:52:02.007163 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.082) 0:00:08.557 ********** 2026-03-09 15:52:02.076956 | controller | ok: [instance] 2026-03-09 15:52:02.077051 | controller | 2026-03-09 15:52:02.077171 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:52:02.077268 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.070) 0:00:08.627 ********** 2026-03-09 15:52:02.130665 | controller | ok: [instance] 2026-03-09 15:52:02.130769 | controller | 2026-03-09 15:52:02.130866 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:52:02.130994 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.053) 0:00:08.681 ********** 2026-03-09 15:52:02.213470 | controller | ok: [instance] 2026-03-09 15:52:02.213568 | controller | 2026-03-09 15:52:02.213684 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:52:02.213803 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.082) 0:00:08.763 ********** 2026-03-09 15:52:02.260326 | controller | skipping: [instance] 2026-03-09 15:52:02.260490 | controller | 2026-03-09 15:52:02.260580 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:52:02.260592 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.047) 0:00:08.811 ********** 2026-03-09 15:52:02.313708 | controller | skipping: [instance] 2026-03-09 15:52:02.313780 | controller | 2026-03-09 15:52:02.313889 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-09 15:52:02.313984 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.053) 0:00:08.864 ********** 2026-03-09 15:52:02.383500 | controller | ok: [instance] 2026-03-09 15:52:02.383580 | controller | 2026-03-09 15:52:02.383716 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-09 15:52:02.383838 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.069) 0:00:08.934 ********** 2026-03-09 15:52:02.440078 | controller | skipping: [instance] 2026-03-09 15:52:02.440160 | controller | 2026-03-09 15:52:02.440257 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-09 15:52:02.440354 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.056) 0:00:08.990 ********** 2026-03-09 15:52:02.525552 | controller | ok: [instance] 2026-03-09 15:52:02.525646 | controller | 2026-03-09 15:52:02.525768 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-09 15:52:02.525853 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.077) 0:00:09.068 ********** 2026-03-09 15:52:02.594618 | controller | skipping: [instance] 2026-03-09 15:52:02.594728 | controller | 2026-03-09 15:52:02.594842 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-09 15:52:02.594945 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.073) 0:00:09.142 ********** 2026-03-09 15:52:02.686410 | controller | ok: [instance] => changed=false 2026-03-09 15:52:02.686484 | controller | msg: All assertions passed 2026-03-09 15:52:02.686572 | controller | 2026-03-09 15:52:02.686661 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-09 15:52:02.686787 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.094) 0:00:09.236 ********** 2026-03-09 15:52:02.765454 | controller | skipping: [instance] 2026-03-09 15:52:02.765534 | controller | 2026-03-09 15:52:02.765651 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:52:02.765757 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.078) 0:00:09.315 ********** 2026-03-09 15:52:02.822193 | controller | skipping: [instance] 2026-03-09 15:52:02.822286 | controller | 2026-03-09 15:52:02.822395 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:52:02.822496 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.054) 0:00:09.370 ********** 2026-03-09 15:52:02.872119 | controller | skipping: [instance] 2026-03-09 15:52:02.872213 | controller | 2026-03-09 15:52:02.872303 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:52:02.872392 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.052) 0:00:09.422 ********** 2026-03-09 15:52:02.914393 | controller | skipping: [instance] 2026-03-09 15:52:02.914478 | controller | 2026-03-09 15:52:02.914572 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:52:02.914698 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.041) 0:00:09.464 ********** 2026-03-09 15:52:02.943504 | controller | ok: [instance] 2026-03-09 15:52:02.943613 | controller | 2026-03-09 15:52:02.943716 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:52:02.943833 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.030) 0:00:09.494 ********** 2026-03-09 15:52:02.989739 | controller | ok: [instance] 2026-03-09 15:52:02.989828 | controller | 2026-03-09 15:52:02.989938 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:52:02.990050 | controller | Monday 09 March 2026 15:52:02 +0000 (0:00:00.046) 0:00:09.540 ********** 2026-03-09 15:52:03.025362 | controller | ok: [instance] => 2026-03-09 15:52:03.025468 | controller | msg: 'Running: Config overrides via devscripts' 2026-03-09 15:52:03.025545 | controller | 2026-03-09 15:52:03.025651 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:52:03.025771 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.035) 0:00:09.576 ********** 2026-03-09 15:52:03.074521 | controller | 2026-03-09 15:52:03.074648 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:52:03.074756 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.049) 0:00:09.625 ********** 2026-03-09 15:52:03.124401 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:52:03.124520 | controller | assertion: cifmw_devscripts_config.master_memory is undefined 2026-03-09 15:52:03.124623 | controller | evaluated_to: false 2026-03-09 15:52:03.124756 | controller | msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' 2026-03-09 15:52:03.202520 | controller | 2026-03-09 15:52:03.202616 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:52:03.202742 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.111) 0:00:09.736 ********** 2026-03-09 15:52:03.202830 | controller | 2026-03-09 15:52:03.202940 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:52:03.203029 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.016) 0:00:09.753 ********** 2026-03-09 15:52:03.232817 | controller | ok: [instance] 2026-03-09 15:52:03.232924 | controller | 2026-03-09 15:52:03.233018 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:52:03.233115 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.027) 0:00:09.780 ********** 2026-03-09 15:52:03.275038 | controller | skipping: [instance] 2026-03-09 15:52:03.275117 | controller | 2026-03-09 15:52:03.275220 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:52:03.275325 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.045) 0:00:09.825 ********** 2026-03-09 15:52:03.322512 | controller | skipping: [instance] 2026-03-09 15:52:03.322598 | controller | 2026-03-09 15:52:03.322707 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:52:03.322797 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.047) 0:00:09.873 ********** 2026-03-09 15:52:03.363891 | controller | skipping: [instance] 2026-03-09 15:52:03.363972 | controller | 2026-03-09 15:52:03.364084 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:52:03.364193 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.041) 0:00:09.914 ********** 2026-03-09 15:52:03.394151 | controller | ok: [instance] 2026-03-09 15:52:03.394239 | controller | 2026-03-09 15:52:03.394328 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:52:03.394426 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.030) 0:00:09.944 ********** 2026-03-09 15:52:03.437530 | controller | ok: [instance] 2026-03-09 15:52:03.437910 | controller | 2026-03-09 15:52:03.438046 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:52:03.438151 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.042) 0:00:09.987 ********** 2026-03-09 15:52:03.476528 | controller | ok: [instance] => 2026-03-09 15:52:03.476622 | controller | msg: 'Running: Inject 10 dev-scripts extra_worker' 2026-03-09 15:52:03.476723 | controller | 2026-03-09 15:52:03.476812 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:52:03.476923 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.039) 0:00:10.027 ********** 2026-03-09 15:52:03.533238 | controller | 2026-03-09 15:52:03.533282 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:52:03.533426 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.056) 0:00:10.083 ********** 2026-03-09 15:52:03.611115 | controller | ok: [instance] 2026-03-09 15:52:03.611183 | controller | 2026-03-09 15:52:03.611303 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:52:03.611403 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.077) 0:00:10.161 ********** 2026-03-09 15:52:03.648554 | controller | fatal: [instance]: FAILED! => changed=false 2026-03-09 15:52:03.648651 | controller | assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 2026-03-09 15:52:03.648771 | controller | evaluated_to: false 2026-03-09 15:52:03.648872 | controller | msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' 2026-03-09 15:52:03.677716 | controller | 2026-03-09 15:52:03.677816 | controller | TASK [Clear host errors] ******************************************************* 2026-03-09 15:52:03.677937 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.050) 0:00:10.211 ********** 2026-03-09 15:52:03.678032 | controller | 2026-03-09 15:52:03.678144 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:52:03.678247 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.016) 0:00:10.228 ********** 2026-03-09 15:52:03.702473 | controller | ok: [instance] 2026-03-09 15:52:03.702558 | controller | 2026-03-09 15:52:03.702669 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:52:03.702773 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.024) 0:00:10.253 ********** 2026-03-09 15:52:03.744318 | controller | skipping: [instance] 2026-03-09 15:52:03.744436 | controller | 2026-03-09 15:52:03.744548 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:52:03.744642 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.041) 0:00:10.295 ********** 2026-03-09 15:52:03.792343 | controller | skipping: [instance] 2026-03-09 15:52:03.792427 | controller | 2026-03-09 15:52:03.792526 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:52:03.792640 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.048) 0:00:10.343 ********** 2026-03-09 15:52:03.828252 | controller | skipping: [instance] 2026-03-09 15:52:03.828347 | controller | 2026-03-09 15:52:03.828439 | controller | TASK [Mark run as failed] ****************************************************** 2026-03-09 15:52:03.828532 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.035) 0:00:10.379 ********** 2026-03-09 15:52:03.854015 | controller | ok: [instance] 2026-03-09 15:52:03.854126 | controller | 2026-03-09 15:52:03.854236 | controller | TASK [Load environment file] *************************************************** 2026-03-09 15:52:03.854328 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.025) 0:00:10.404 ********** 2026-03-09 15:52:03.886040 | controller | ok: [instance] 2026-03-09 15:52:03.886143 | controller | 2026-03-09 15:52:03.886247 | controller | TASK [Output scenario name] **************************************************** 2026-03-09 15:52:03.886331 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.031) 0:00:10.436 ********** 2026-03-09 15:52:03.912201 | controller | ok: [instance] => 2026-03-09 15:52:03.912305 | controller | msg: 'Running: Inject 0 dev-scripts extra_worker' 2026-03-09 15:52:03.912418 | controller | 2026-03-09 15:52:03.912499 | controller | TASK [Validate data] *********************************************************** 2026-03-09 15:52:03.912593 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.026) 0:00:10.463 ********** 2026-03-09 15:52:03.960611 | controller | 2026-03-09 15:52:03.960721 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2026-03-09 15:52:03.960826 | controller | Monday 09 March 2026 15:52:03 +0000 (0:00:00.048) 0:00:10.511 ********** 2026-03-09 15:52:04.064006 | controller | ok: [instance] 2026-03-09 15:52:04.064100 | controller | 2026-03-09 15:52:04.064229 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2026-03-09 15:52:04.064328 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.103) 0:00:10.614 ********** 2026-03-09 15:52:04.109580 | controller | ok: [instance] 2026-03-09 15:52:04.109689 | controller | 2026-03-09 15:52:04.109806 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2026-03-09 15:52:04.109901 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.045) 0:00:10.660 ********** 2026-03-09 15:52:04.185932 | controller | ok: [instance] 2026-03-09 15:52:04.185990 | controller | 2026-03-09 15:52:04.186121 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2026-03-09 15:52:04.186226 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.076) 0:00:10.736 ********** 2026-03-09 15:52:04.235415 | controller | skipping: [instance] 2026-03-09 15:52:04.235519 | controller | 2026-03-09 15:52:04.235603 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2026-03-09 15:52:04.235716 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.049) 0:00:10.786 ********** 2026-03-09 15:52:04.295939 | controller | ok: [instance] 2026-03-09 15:52:04.296042 | controller | 2026-03-09 15:52:04.296164 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2026-03-09 15:52:04.296263 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.059) 0:00:10.846 ********** 2026-03-09 15:52:04.337863 | controller | skipping: [instance] 2026-03-09 15:52:04.337975 | controller | 2026-03-09 15:52:04.338084 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2026-03-09 15:52:04.338202 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.042) 0:00:10.888 ********** 2026-03-09 15:52:04.389642 | controller | skipping: [instance] 2026-03-09 15:52:04.389782 | controller | 2026-03-09 15:52:04.389864 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2026-03-09 15:52:04.389983 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.051) 0:00:10.940 ********** 2026-03-09 15:52:04.438058 | controller | skipping: [instance] 2026-03-09 15:52:04.438182 | controller | 2026-03-09 15:52:04.438256 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2026-03-09 15:52:04.438337 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.048) 0:00:10.988 ********** 2026-03-09 15:52:04.497379 | controller | skipping: [instance] 2026-03-09 15:52:04.497473 | controller | 2026-03-09 15:52:04.497573 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2026-03-09 15:52:04.497681 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.059) 0:00:11.048 ********** 2026-03-09 15:52:04.548720 | controller | skipping: [instance] 2026-03-09 15:52:04.548828 | controller | 2026-03-09 15:52:04.548937 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2026-03-09 15:52:04.549035 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.048) 0:00:11.097 ********** 2026-03-09 15:52:04.603737 | controller | skipping: [instance] 2026-03-09 15:52:04.603827 | controller | 2026-03-09 15:52:04.603938 | controller | TASK [Mark failure] ************************************************************ 2026-03-09 15:52:04.604044 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.057) 0:00:11.154 ********** 2026-03-09 15:52:04.647389 | controller | skipping: [instance] 2026-03-09 15:52:04.647487 | controller | 2026-03-09 15:52:04.647581 | controller | TASK [Display error message] *************************************************** 2026-03-09 15:52:04.647710 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.040) 0:00:11.195 ********** 2026-03-09 15:52:04.689066 | controller | skipping: [instance] 2026-03-09 15:52:04.689176 | controller | 2026-03-09 15:52:04.689283 | controller | TASK [Append failed scenario to list] ****************************************** 2026-03-09 15:52:04.689379 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.044) 0:00:11.239 ********** 2026-03-09 15:52:04.730173 | controller | skipping: [instance] 2026-03-09 15:52:04.730264 | controller | 2026-03-09 15:52:04.730361 | controller | TASK [Fail if needed] ********************************************************** 2026-03-09 15:52:04.730457 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.041) 0:00:11.281 ********** 2026-03-09 15:52:04.795326 | controller | skipping: [instance] 2026-03-09 15:52:04.795412 | controller | 2026-03-09 15:52:04.795513 | controller | PLAY RECAP ********************************************************************* 2026-03-09 15:52:04.795602 | controller | instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 2026-03-09 15:52:04.795727 | controller | 2026-03-09 15:52:04.795814 | controller | Monday 09 March 2026 15:52:04 +0000 (0:00:00.064) 0:00:11.345 ********** 2026-03-09 15:52:04.795922 | controller | =============================================================================== 2026-03-09 15:52:04.795985 | controller | reproducer : Ensure no allocation overlap ------------------------------- 0.13s 2026-03-09 15:52:04.796083 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.11s 2026-03-09 15:52:04.796171 | controller | Test no volumes --------------------------------------------------------- 0.11s 2026-03-09 15:52:04.796269 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.10s 2026-03-09 15:52:04.796357 | controller | reproducer : Ensure we get required data in the layout description ------ 0.10s 2026-03-09 15:52:04.796441 | controller | Validate data ----------------------------------------------------------- 0.10s 2026-03-09 15:52:04.796546 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.09s 2026-03-09 15:52:04.796665 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.09s 2026-03-09 15:52:04.796767 | controller | reproducer : Ensure same amount of disks are created -------------------- 0.09s 2026-03-09 15:52:04.796862 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.09s 2026-03-09 15:52:04.796960 | controller | Validate data ----------------------------------------------------------- 0.08s 2026-03-09 15:52:04.797036 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2026-03-09 15:52:04.797118 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2026-03-09 15:52:04.797219 | controller | Mark failure ------------------------------------------------------------ 0.08s 2026-03-09 15:52:04.797307 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2026-03-09 15:52:04.797391 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2026-03-09 15:52:04.797479 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.08s 2026-03-09 15:52:04.797565 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.08s 2026-03-09 15:52:04.797683 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2026-03-09 15:52:04.797773 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.08s 2026-03-09 15:52:04.868328 | controller | INFO Running ocp_validations > cleanup 2026-03-09 15:52:04.868780 | controller | WARNING Skipping, cleanup playbook not configured. 2026-03-09 15:52:04.869449 | controller | INFO Writing /tmp/report.html report. 2026-03-09 15:52:05.075418 | [controller] Waiting on logger 2026-03-09 15:52:10.229912 | [controller] Waiting on logger 2026-03-09 15:52:20.661939 | [controller] Waiting on logger 2026-03-09 15:52:31.093769 | [controller] Waiting on logger 2026-03-09 15:52:35.024957 | [Zuul] Log Stream did not terminate 2026-03-09 15:52:35.025165 | controller | changed 2026-03-09 15:52:35.069248 | 2026-03-09 15:52:35.069335 | PLAY RECAP 2026-03-09 15:52:35.069376 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-09 15:52:35.069398 | 2026-03-09 15:52:35.130579 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-03-09 15:52:35.131332 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-03-09 15:52:35.628747 | 2026-03-09 15:52:35.628845 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-03-09 15:52:35.647895 | 2026-03-09 15:52:35.647959 | TASK [Filter out host if needed] 2026-03-09 15:52:35.655679 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-03-09 15:52:35.659670 | 2026-03-09 15:52:35.659730 | TASK [Ensure file is present] 2026-03-09 15:52:36.399782 | controller | ok 2026-03-09 15:52:36.404987 | 2026-03-09 15:52:36.405052 | TASK [Manage molecule report file] 2026-03-09 15:52:36.427345 | [controller] Waiting on logger 2026-03-09 15:52:45.813847 | [controller] Waiting on logger 2026-03-09 15:52:55.194181 | [controller] Waiting on logger 2026-03-09 15:53:05.589689 | [controller] Waiting on logger 2026-03-09 15:53:06.970367 | [Zuul] Log Stream did not terminate 2026-03-09 15:53:06.970587 | controller | changed 2026-03-09 15:53:06.975802 | 2026-03-09 15:53:06.975863 | TASK [Check if we get ci-framework-data basedir] 2026-03-09 15:53:07.389352 | controller | ok 2026-03-09 15:53:07.394503 | 2026-03-09 15:53:07.394569 | TASK [Create ci-framework-data log directory for zuul] 2026-03-09 15:53:07.899322 | controller | changed 2026-03-09 15:53:07.904170 | 2026-03-09 15:53:07.904233 | TASK [Copy ci-framework interesting files] 2026-03-09 15:53:08.981800 | [controller] Waiting on logger 2026-03-09 15:53:15.304399 | controller | changed 2026-03-09 15:53:15.309432 | 2026-03-09 15:53:15.309498 | TASK [Get SELinux listing] 2026-03-09 15:53:15.330836 | [controller] Waiting on logger 2026-03-09 15:53:25.750030 | [controller] Waiting on logger 2026-03-09 15:53:35.130452 | [controller] Waiting on logger 2026-03-09 15:53:45.525923 | [controller] Waiting on logger 2026-03-09 15:53:45.681774 | [Zuul] Log Stream did not terminate 2026-03-09 15:53:45.681973 | controller | changed 2026-03-09 15:53:45.687666 | 2026-03-09 15:53:45.687732 | TASK [Generate log index] 2026-03-09 15:53:47.220572 | controller | changed 2026-03-09 15:53:47.225801 | 2026-03-09 15:53:47.225881 | TASK [Get some env related data] 2026-03-09 15:53:47.245691 | [controller] Waiting on logger 2026-03-09 15:53:57.685909 | [controller] Waiting on logger 2026-03-09 15:54:08.117965 | [controller] Waiting on logger 2026-03-09 15:54:17.461691 | [controller] Waiting on logger 2026-03-09 15:54:19.247983 | [Zuul] Log Stream did not terminate 2026-03-09 15:54:19.248165 | controller | changed 2026-03-09 15:54:19.253084 | 2026-03-09 15:54:19.253143 | TASK [Generate list of logs to collect in home directory] 2026-03-09 15:54:19.678752 | controller | ok: All paths examined 2026-03-09 15:54:19.683982 | 2026-03-09 15:54:19.684043 | LOOP [Copy logs from home directory] 2026-03-09 15:54:20.491655 | controller | changed: 2026-03-09 15:54:20.491854 | controller | { 2026-03-09 15:54:20.491882 | controller | "atime": 1772005405.932821, 2026-03-09 15:54:20.491901 | controller | "ctime": 1772006396.9238591, 2026-03-09 15:54:20.491929 | controller | "dev": 64513, 2026-03-09 15:54:20.491950 | controller | "gid": 1000, 2026-03-09 15:54:20.491968 | controller | "gr_name": "zuul", 2026-03-09 15:54:20.491988 | controller | "inode": 2773, 2026-03-09 15:54:20.492004 | controller | "isblk": false, 2026-03-09 15:54:20.492019 | controller | "ischr": false, 2026-03-09 15:54:20.492034 | controller | "isdir": false, 2026-03-09 15:54:20.492048 | controller | "isfifo": false, 2026-03-09 15:54:20.492063 | controller | "isgid": false, 2026-03-09 15:54:20.492076 | controller | "islnk": false, 2026-03-09 15:54:20.492090 | controller | "isreg": true, 2026-03-09 15:54:20.492107 | controller | "issock": false, 2026-03-09 15:54:20.492121 | controller | "isuid": false, 2026-03-09 15:54:20.492135 | controller | "mode": "0644", 2026-03-09 15:54:20.492148 | controller | "mtime": 1772006396.9238591, 2026-03-09 15:54:20.492162 | controller | "nlink": 1, 2026-03-09 15:54:20.492176 | controller | "path": "/home/zuul/crc-setup.log", 2026-03-09 15:54:20.492190 | controller | "pw_name": "zuul", 2026-03-09 15:54:20.492203 | controller | "rgrp": true, 2026-03-09 15:54:20.492217 | controller | "roth": true, 2026-03-09 15:54:20.492231 | controller | "rusr": true, 2026-03-09 15:54:20.492245 | controller | "size": 4108, 2026-03-09 15:54:20.492258 | controller | "uid": 1000, 2026-03-09 15:54:20.492294 | controller | "wgrp": false, 2026-03-09 15:54:20.492313 | controller | "woth": false, 2026-03-09 15:54:20.492328 | controller | "wusr": true, 2026-03-09 15:54:20.492342 | controller | "xgrp": false, 2026-03-09 15:54:20.492358 | controller | "xoth": false, 2026-03-09 15:54:20.492372 | controller | "xusr": false 2026-03-09 15:54:20.492386 | controller | } 2026-03-09 15:54:21.202558 | controller | changed: 2026-03-09 15:54:21.202623 | controller | { 2026-03-09 15:54:21.202648 | controller | "atime": 1772006398.6759083, 2026-03-09 15:54:21.202667 | controller | "ctime": 1772007098.5537844, 2026-03-09 15:54:21.202685 | controller | "dev": 64513, 2026-03-09 15:54:21.202701 | controller | "gid": 1000, 2026-03-09 15:54:21.202721 | controller | "gr_name": "zuul", 2026-03-09 15:54:21.202737 | controller | "inode": 359205, 2026-03-09 15:54:21.202754 | controller | "isblk": false, 2026-03-09 15:54:21.202770 | controller | "ischr": false, 2026-03-09 15:54:21.202785 | controller | "isdir": false, 2026-03-09 15:54:21.202899 | controller | "isfifo": false, 2026-03-09 15:54:21.202942 | controller | "isgid": false, 2026-03-09 15:54:21.202962 | controller | "islnk": false, 2026-03-09 15:54:21.202979 | controller | "isreg": true, 2026-03-09 15:54:21.202995 | controller | "issock": false, 2026-03-09 15:54:21.203010 | controller | "isuid": false, 2026-03-09 15:54:21.203023 | controller | "mode": "0644", 2026-03-09 15:54:21.203038 | controller | "mtime": 1772007098.5537844, 2026-03-09 15:54:21.203053 | controller | "nlink": 1, 2026-03-09 15:54:21.203068 | controller | "path": "/home/zuul/crc-start.log", 2026-03-09 15:54:21.203083 | controller | "pw_name": "zuul", 2026-03-09 15:54:21.203096 | controller | "rgrp": true, 2026-03-09 15:54:21.203110 | controller | "roth": true, 2026-03-09 15:54:21.203131 | controller | "rusr": true, 2026-03-09 15:54:21.203146 | controller | "size": 4654, 2026-03-09 15:54:21.203159 | controller | "uid": 1000, 2026-03-09 15:54:21.203173 | controller | "wgrp": false, 2026-03-09 15:54:21.203186 | controller | "woth": false, 2026-03-09 15:54:21.203199 | controller | "wusr": true, 2026-03-09 15:54:21.203212 | controller | "xgrp": false, 2026-03-09 15:54:21.203225 | controller | "xoth": false, 2026-03-09 15:54:21.203239 | controller | "xusr": false 2026-03-09 15:54:21.203252 | controller | } 2026-03-09 15:54:21.912929 | controller | changed: 2026-03-09 15:54:21.913118 | controller | { 2026-03-09 15:54:21.913155 | controller | "atime": 1773070932.8207388, 2026-03-09 15:54:21.913176 | controller | "ctime": 1773070952.45744, 2026-03-09 15:54:21.913194 | controller | "dev": 64513, 2026-03-09 15:54:21.913212 | controller | "gid": 1000, 2026-03-09 15:54:21.913228 | controller | "gr_name": "zuul", 2026-03-09 15:54:21.913245 | controller | "inode": 2763, 2026-03-09 15:54:21.913262 | controller | "isblk": false, 2026-03-09 15:54:21.913300 | controller | "ischr": false, 2026-03-09 15:54:21.913320 | controller | "isdir": false, 2026-03-09 15:54:21.913337 | controller | "isfifo": false, 2026-03-09 15:54:21.913352 | controller | "isgid": false, 2026-03-09 15:54:21.913367 | controller | "islnk": false, 2026-03-09 15:54:21.913381 | controller | "isreg": true, 2026-03-09 15:54:21.913394 | controller | "issock": false, 2026-03-09 15:54:21.913409 | controller | "isuid": false, 2026-03-09 15:54:21.913423 | controller | "mode": "0644", 2026-03-09 15:54:21.913437 | controller | "mtime": 1773070952.45744, 2026-03-09 15:54:21.913452 | controller | "nlink": 1, 2026-03-09 15:54:21.913467 | controller | "path": "/home/zuul/ansible.log", 2026-03-09 15:54:21.913484 | controller | "pw_name": "zuul", 2026-03-09 15:54:21.913500 | controller | "rgrp": true, 2026-03-09 15:54:21.913515 | controller | "roth": true, 2026-03-09 15:54:21.913530 | controller | "rusr": true, 2026-03-09 15:54:21.913544 | controller | "size": 6749, 2026-03-09 15:54:21.913558 | controller | "uid": 1000, 2026-03-09 15:54:21.913571 | controller | "wgrp": false, 2026-03-09 15:54:21.913585 | controller | "woth": false, 2026-03-09 15:54:21.913598 | controller | "wusr": true, 2026-03-09 15:54:21.913612 | controller | "xgrp": false, 2026-03-09 15:54:21.913626 | controller | "xoth": false, 2026-03-09 15:54:21.913640 | controller | "xusr": false 2026-03-09 15:54:21.913654 | controller | } 2026-03-09 15:54:21.930231 | 2026-03-09 15:54:21.930361 | TASK [Copy crio stats log file] 2026-03-09 15:54:21.943930 | controller | skipping: Conditional result was False 2026-03-09 15:54:21.949102 | 2026-03-09 15:54:21.949171 | TASK [Get SELinux related data] 2026-03-09 15:54:21.969731 | [controller] Waiting on logger 2026-03-09 15:54:34.075092 | [controller] Waiting on logger 2026-03-09 15:54:36.969064 | controller | ERROR 2026-03-09 15:54:36.969241 | controller | { 2026-03-09 15:54:36.969304 | controller | "delta": "0:00:00.014036", 2026-03-09 15:54:36.969334 | controller | "end": "2026-03-09 15:54:22.279475", 2026-03-09 15:54:36.969359 | controller | "msg": "non-zero return code", 2026-03-09 15:54:36.969380 | controller | "rc": 1, 2026-03-09 15:54:36.969400 | controller | "start": "2026-03-09 15:54:22.265439" 2026-03-09 15:54:36.969419 | controller | } 2026-03-09 15:54:36.969447 | controller | ERROR: Ignoring Errors 2026-03-09 15:54:36.974406 | 2026-03-09 15:54:36.974470 | TASK [Create system configuration directory] 2026-03-09 15:54:38.211318 | controller | changed 2026-03-09 15:54:38.216574 | 2026-03-09 15:54:38.216653 | TASK [Get some of the system configurations] 2026-03-09 15:54:38.238789 | [controller] Waiting on logger 2026-03-09 15:54:48.629925 | [controller] Waiting on logger 2026-03-09 15:54:59.062093 | [controller] Waiting on logger 2026-03-09 15:55:08.405839 | [controller] Waiting on logger 2026-03-09 15:55:09.920821 | [Zuul] Log Stream did not terminate 2026-03-09 15:55:09.921122 | controller | changed 2026-03-09 15:55:09.926368 | 2026-03-09 15:55:09.926427 | TASK [Copy generated documentation if available] 2026-03-09 15:55:09.939648 | controller | skipping: Conditional result was False 2026-03-09 15:55:09.944566 | 2026-03-09 15:55:09.944623 | TASK [Copy generated AsciiDoc documentation if available] 2026-03-09 15:55:09.957729 | controller | skipping: Conditional result was False 2026-03-09 15:55:09.963112 | 2026-03-09 15:55:09.963170 | TASK [Compress logs bigger than 2MB] 2026-03-09 15:55:13.077710 | [controller] Waiting on logger 2026-03-09 15:55:24.021882 | [controller] Waiting on logger 2026-03-09 15:55:26.888412 | controller | changed 2026-03-09 15:55:26.893473 | 2026-03-09 15:55:26.893536 | TASK [Copy files from workspace on node] 2026-03-09 15:55:26.911017 | controller | ok 2026-03-09 15:55:26.930851 | 2026-03-09 15:55:26.930924 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-09 15:55:26.944659 | controller | skipping: Conditional result was False 2026-03-09 15:55:26.949874 | 2026-03-09 15:55:26.949943 | TASK [fetch-output : Set log path for single node] 2026-03-09 15:55:26.977558 | controller | ok 2026-03-09 15:55:26.981957 | 2026-03-09 15:55:26.982017 | LOOP [fetch-output : Ensure local output dirs] 2026-03-09 15:55:27.160157 | controller -> localhost | ok: "/var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/logs" 2026-03-09 15:55:27.160416 | controller -> localhost | changed: All items complete 2026-03-09 15:55:27.160447 | 2026-03-09 15:55:27.325987 | controller -> localhost | changed: "/var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/artifacts" 2026-03-09 15:55:27.507027 | controller -> localhost | changed: "/var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/docs" 2026-03-09 15:55:27.520363 | 2026-03-09 15:55:27.520482 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-09 15:55:28.174318 | controller | changed: 2026-03-09 15:55:28.174517 | controller | .d..t...... ./ 2026-03-09 15:55:28.174545 | controller | >f+++++++++ README.html 2026-03-09 15:55:28.174565 | controller | >f+++++++++ ansible-execution.log 2026-03-09 15:55:28.174584 | controller | >f+++++++++ ansible.log 2026-03-09 15:55:28.174601 | controller | >f+++++++++ crc-setup.log 2026-03-09 15:55:28.174618 | controller | >f+++++++++ crc-start.log 2026-03-09 15:55:28.174634 | controller | >f+++++++++ dmesg.log 2026-03-09 15:55:28.174650 | controller | >f+++++++++ installed-pkgs.log 2026-03-09 15:55:28.174666 | controller | >f+++++++++ python.log 2026-03-09 15:55:28.174682 | controller | >f+++++++++ registries.conf 2026-03-09 15:55:28.174698 | controller | >f+++++++++ report.html 2026-03-09 15:55:28.174713 | controller | >f+++++++++ selinux-denials.log 2026-03-09 15:55:28.174728 | controller | >f+++++++++ selinux-listing.log 2026-03-09 15:55:28.174744 | controller | cd+++++++++ ci-framework-data/ 2026-03-09 15:55:28.174769 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-03-09 15:55:28.174787 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-03-09 15:55:28.174804 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-03-09 15:55:28.174820 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-03-09 15:55:28.174836 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-03-09 15:55:28.174852 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-03-09 15:55:28.174868 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-03-09 15:55:28.174883 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-03-09 15:55:28.174908 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-03-09 15:55:28.174924 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-03-09 15:55:28.174938 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-03-09 15:55:28.174954 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-03-09 15:55:28.174969 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-03-09 15:55:28.174984 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-03-09 15:55:28.174999 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:a0:9e:91 2026-03-09 15:55:28.175014 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:ac:6a:84 2026-03-09 15:55:28.175029 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:b0:04:56 2026-03-09 15:55:28.175043 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:6d:91:ec 2026-03-09 15:55:28.175058 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:8c:ac:23 2026-03-09 15:55:28.175072 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:39:3f:eb 2026-03-09 15:55:28.175087 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-03-09 15:55:28.175102 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-03-09 15:55:28.175116 | controller | cd+++++++++ ci-framework-data/logs/ 2026-03-09 15:55:28.175130 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-03-09 15:55:28.175146 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-03-09 15:55:28.175161 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-03-09 15:55:28.175176 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-03-09 15:55:28.175191 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-03-09 15:55:28.175206 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-03-09 15:55:28.175221 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-03-09 15:55:28.175245 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-03-09 15:55:28.175280 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-03-09 15:55:28.175399 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-03-09 15:55:28.175431 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-03-09 15:55:28.175450 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-03-09 15:55:28.175468 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-03-09 15:55:28.175489 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-03-09 15:55:28.175507 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-03-09 15:55:28.175524 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-03-09 15:55:28.175542 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-03-09 15:55:28.175560 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-03-09 15:55:28.175576 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-03-09 15:55:28.175592 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-03-09 15:55:28.175611 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-03-09 15:55:28.175628 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-03-09 15:55:28.175645 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-03-09 15:55:28.175662 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-03-09 15:55:28.175678 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-03-09 15:55:28.175695 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-03-09 15:55:28.175711 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-03-09 15:55:28.175727 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-03-09 15:55:28.175743 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-03-09 15:55:28.175759 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-03-09 15:55:28.175776 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-03-09 15:55:28.175792 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-03-09 15:55:28.175809 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-03-09 15:55:28.175826 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-03-09 15:55:28.175842 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-03-09 15:55:28.175859 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-03-09 15:55:28.175875 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-03-09 15:55:28.175906 | controller | cd+++++++++ registries.conf.d/ 2026-03-09 15:55:28.175925 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-03-09 15:55:28.175942 | controller | cd+++++++++ system-config/ 2026-03-09 15:55:28.175958 | controller | cd+++++++++ system-config/libvirt/ 2026-03-09 15:55:28.175975 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-03-09 15:55:28.175991 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-03-09 15:55:28.176006 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-03-09 15:55:28.176023 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-03-09 15:55:28.176042 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-03-09 15:55:28.176059 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-03-09 15:55:28.176075 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-03-09 15:55:28.176091 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-03-09 15:55:28.176107 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-03-09 15:55:28.176123 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-03-09 15:55:28.176139 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-03-09 15:55:28.176155 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-03-09 15:55:28.176171 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-03-09 15:55:28.176186 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-03-09 15:55:28.176201 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-03-09 15:55:28.176217 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-03-09 15:55:28.592183 | controller | changed: .d..t...... ./ 2026-03-09 15:55:29.014495 | controller | changed: .d..t...... ./ 2026-03-09 15:55:29.026452 | 2026-03-09 15:55:29.026557 | TASK [Return artifact to Zuul] 2026-03-09 15:55:29.054669 | controller | ok 2026-03-09 15:55:29.073314 | 2026-03-09 15:55:29.073379 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-03-09 15:55:29.073471 | 2026-03-09 15:55:29.073498 | PLAY RECAP 2026-03-09 15:55:29.073533 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-03-09 15:55:29.073556 | 2026-03-09 15:55:29.145908 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-03-09 15:55:29.146616 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-03-09 15:55:29.647037 | 2026-03-09 15:55:29.647124 | PLAY [all] 2026-03-09 15:55:29.663677 | 2026-03-09 15:55:29.663747 | TASK [include_role : fetch-output] 2026-03-09 15:55:29.691657 | controller | ok 2026-03-09 15:55:29.706817 | 2026-03-09 15:55:29.706905 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-09 15:55:29.740069 | controller | skipping: Conditional result was False 2026-03-09 15:55:29.745146 | 2026-03-09 15:55:29.745218 | TASK [fetch-output : Set log path for single node] 2026-03-09 15:55:29.771980 | controller | ok 2026-03-09 15:55:29.776448 | 2026-03-09 15:55:29.776513 | LOOP [fetch-output : Ensure local output dirs] 2026-03-09 15:55:30.061923 | controller -> localhost | ok: "/var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/logs" 2026-03-09 15:55:30.230305 | controller -> localhost | ok: "/var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/artifacts" 2026-03-09 15:55:30.395646 | controller -> localhost | ok: "/var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/docs" 2026-03-09 15:55:30.402668 | 2026-03-09 15:55:30.402736 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-09 15:55:30.960640 | controller | ok 2026-03-09 15:55:30.960813 | controller | ok: All items complete 2026-03-09 15:55:30.960842 | 2026-03-09 15:55:31.391779 | controller | ok 2026-03-09 15:55:31.820721 | controller | ok 2026-03-09 15:55:31.833546 | 2026-03-09 15:55:31.833642 | TASK [include_role : fetch-output-openshift] 2026-03-09 15:55:31.846732 | controller | skipping: Conditional result was False 2026-03-09 15:55:31.852040 | 2026-03-09 15:55:31.852104 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-09 15:55:32.164139 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006249 2026-03-09 15:55:32.336110 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.005670 2026-03-09 15:55:32.361971 | 2026-03-09 15:55:32.362033 | PLAY [all] 2026-03-09 15:55:32.374645 | 2026-03-09 15:55:32.374710 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-09 15:55:32.879186 | controller | changed 2026-03-09 15:55:32.900152 | 2026-03-09 15:55:32.900208 | PLAY RECAP 2026-03-09 15:55:32.900249 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-03-09 15:55:32.900290 | 2026-03-09 15:55:32.965134 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-03-09 15:55:32.965786 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-03-09 15:55:33.455177 | 2026-03-09 15:55:33.455324 | PLAY [localhost] 2026-03-09 15:55:33.470879 | 2026-03-09 15:55:33.470958 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-09 15:55:33.750581 | localhost | changed 2026-03-09 15:55:33.754734 | 2026-03-09 15:55:33.754809 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-09 15:55:33.771574 | localhost | ok 2026-03-09 15:55:33.778598 | 2026-03-09 15:55:33.778662 | TASK [add-fileserver : Create SSH private key tempfile] 2026-03-09 15:55:34.037296 | localhost | changed 2026-03-09 15:55:34.042280 | 2026-03-09 15:55:34.042344 | TASK [add-fileserver : Create SSH private key from secret] 2026-03-09 15:55:34.534592 | localhost | changed 2026-03-09 15:55:34.539008 | 2026-03-09 15:55:34.539071 | TASK [add-fileserver : Add fileserver ssh key] 2026-03-09 15:55:34.838790 | localhost | Identity added: /var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/tmp/ansible.l23dhenz (/var/lib/zuul/builds/eba07298365f4debb40bc2133a0c74c1/work/tmp/ansible.l23dhenz) 2026-03-09 15:55:34.838958 | localhost | ok: Runtime: 0:00:00.005085 2026-03-09 15:55:34.842751 | 2026-03-09 15:55:34.842813 | TASK [add-fileserver : Remove SSH private key from disk] 2026-03-09 15:55:35.041331 | localhost | ok: Runtime: 0:00:00.003999 2026-03-09 15:55:35.045421 | 2026-03-09 15:55:35.045482 | TASK [add-fileserver : Add fileserver to inventory] 2026-03-09 15:55:35.092245 | localhost | changed 2026-03-09 15:55:35.096633 | 2026-03-09 15:55:35.096693 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-03-09 15:55:35.376440 | localhost | changed 2026-03-09 15:55:35.394800 | 2026-03-09 15:55:35.394852 | PLAY [localhost] 2026-03-09 15:55:35.404953 | 2026-03-09 15:55:35.405010 | TASK [Generate bulk log download script] 2026-03-09 15:55:35.422597 | localhost | ok 2026-03-09 15:55:35.433174 | 2026-03-09 15:55:35.433239 | TASK [local-log-download : Check API endpoint is defined] 2026-03-09 15:55:35.459729 | localhost | ok: All assertions passed 2026-03-09 15:55:35.463997 | 2026-03-09 15:55:35.464062 | TASK [local-log-download : Create download script] 2026-03-09 15:55:35.780366 | localhost -> localhost | changed 2026-03-09 15:55:35.787843 | 2026-03-09 15:55:35.787915 | TASK [Register quick-download link] 2026-03-09 15:55:35.803726 | localhost | ok 2026-03-09 15:55:35.834405 | 2026-03-09 15:55:35.834475 | PLAY [logserver.rdoproject.org] 2026-03-09 15:55:35.842939 | 2026-03-09 15:55:35.842997 | TASK [Set zuul-log-path fact] 2026-03-09 15:55:35.858287 | logserver.rdoproject.org | ok 2026-03-09 15:55:35.866306 | 2026-03-09 15:55:35.866368 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-09 15:55:35.881332 | logserver.rdoproject.org | ok 2026-03-09 15:55:35.886435 | 2026-03-09 15:55:35.886499 | TASK [upload-logs : Create log directories] 2026-03-09 15:55:37.706691 | logserver.rdoproject.org | changed 2026-03-09 15:55:37.709578 | 2026-03-09 15:55:37.709651 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-09 15:55:37.914662 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004825 2026-03-09 15:55:37.918986 | 2026-03-09 15:55:37.919048 | TASK [upload-logs : Upload logs to log server] 2026-03-09 15:55:39.408406 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-03-09 15:55:39.410946 | 2026-03-09 15:55:39.411007 | LOOP [upload-logs : Compress console log and json output] 2026-03-09 15:55:39.445173 | logserver.rdoproject.org | skipping: Conditional result was False 2026-03-09 15:55:39.453129 | logserver.rdoproject.org | skipping: Conditional result was False 2026-03-09 15:55:39.457324 | 2026-03-09 15:55:39.457412 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-09 15:55:39.488466 | logserver.rdoproject.org | skipping: Conditional result was False 2026-03-09 15:55:39.488677 | 2026-03-09 15:55:39.491343 | logserver.rdoproject.org | skipping: Conditional result was False 2026-03-09 15:55:39.503326 | 2026-03-09 15:55:39.503407 | LOOP [upload-logs : Upload console log and json output]